[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:16:08.064201 27446 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.205.190:44963
I20260709 12:16:08.066582 27446 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:16:08.067934 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:08.083024 27452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:08.083016 27453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:08.085443 27446 server_base.cc:1061] running on GCE node
W20260709 12:16:08.086874 27455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:09.287272 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:09.287550 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:09.287775 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599369287750 us; error 0 us; skew 500 ppm
I20260709 12:16:09.288698 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:09.293949 27446 webserver.cc:533] Webserver started at http://127.26.205.190:32943/ using document root <none> and password file <none>
I20260709 12:16:09.294801 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:09.295048 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:09.295523 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:09.301528 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/master-0-root/instance:
uuid: "942380d7ac4444088a00840f14cb1e9b"
format_stamp: "Formatted at 2026-07-09 12:16:09 on dist-test-slave-673s"
I20260709 12:16:09.309410 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:16:09.314787 27461 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:09.316025 27446 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:09.316385 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/master-0-root
uuid: "942380d7ac4444088a00840f14cb1e9b"
format_stamp: "Formatted at 2026-07-09 12:16:09 on dist-test-slave-673s"
I20260709 12:16:09.316826 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:09.366510 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:09.368089 27446 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:16:09.368618 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:09.441730 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.190:44963
I20260709 12:16:09.441819 27512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.190:44963 every 8 connection(s)
I20260709 12:16:09.449677 27513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:09.471935 27513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b: Bootstrap starting.
I20260709 12:16:09.477991 27513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:09.479915 27513 log.cc:826] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b: Log is configured to *not* fsync() on all Append() calls
I20260709 12:16:09.484576 27513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b: No bootstrap required, opened a new log
I20260709 12:16:09.505426 27513 raft_consensus.cc:359] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942380d7ac4444088a00840f14cb1e9b" member_type: VOTER }
I20260709 12:16:09.505980 27513 raft_consensus.cc:385] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:09.506289 27513 raft_consensus.cc:740] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 942380d7ac4444088a00840f14cb1e9b, State: Initialized, Role: FOLLOWER
I20260709 12:16:09.507212 27513 consensus_queue.cc:260] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942380d7ac4444088a00840f14cb1e9b" member_type: VOTER }
I20260709 12:16:09.507717 27513 raft_consensus.cc:399] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:09.508038 27513 raft_consensus.cc:493] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:09.508387 27513 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:09.512566 27513 raft_consensus.cc:515] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942380d7ac4444088a00840f14cb1e9b" member_type: VOTER }
I20260709 12:16:09.513309 27513 leader_election.cc:304] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 942380d7ac4444088a00840f14cb1e9b; no voters: 
I20260709 12:16:09.515028 27513 leader_election.cc:290] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:09.515380 27516 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:09.517644 27516 raft_consensus.cc:697] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 1 LEADER]: Becoming Leader. State: Replica: 942380d7ac4444088a00840f14cb1e9b, State: Running, Role: LEADER
I20260709 12:16:09.518592 27516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942380d7ac4444088a00840f14cb1e9b" member_type: VOTER }
I20260709 12:16:09.519622 27513 sys_catalog.cc:565] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:09.530196 27517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "942380d7ac4444088a00840f14cb1e9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942380d7ac4444088a00840f14cb1e9b" member_type: VOTER } }
I20260709 12:16:09.530238 27518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 942380d7ac4444088a00840f14cb1e9b. Latest consensus state: current_term: 1 leader_uuid: "942380d7ac4444088a00840f14cb1e9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942380d7ac4444088a00840f14cb1e9b" member_type: VOTER } }
I20260709 12:16:09.531188 27517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:09.531198 27518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:09.537869 27525 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:09.549880 27525 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:09.552408 27446 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:09.567508 27525 catalog_manager.cc:1383] Generated new cluster ID: bc0b149974574ff3bf9ef3c94daf0c2d
I20260709 12:16:09.567829 27525 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:09.592381 27525 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:09.593982 27525 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:09.607394 27525 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b: Generated new TSK 0
I20260709 12:16:09.608368 27525 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:09.620399 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:09.630016 27535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:09.632779 27536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:09.635645 27538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:09.635761 27446 server_base.cc:1061] running on GCE node
I20260709 12:16:09.636713 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:09.636984 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:09.637184 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599369637166 us; error 0 us; skew 500 ppm
I20260709 12:16:09.637773 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:09.642318 27446 webserver.cc:533] Webserver started at http://127.26.205.129:46561/ using document root <none> and password file <none>
I20260709 12:16:09.642874 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:09.643101 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:09.643425 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:09.644767 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-0-root/instance:
uuid: "4a19474f5cad4b36a40382910514effe"
format_stamp: "Formatted at 2026-07-09 12:16:09 on dist-test-slave-673s"
I20260709 12:16:09.651000 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:09.656109 27543 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:09.657130 27446 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:16:09.657498 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "4a19474f5cad4b36a40382910514effe"
format_stamp: "Formatted at 2026-07-09 12:16:09 on dist-test-slave-673s"
I20260709 12:16:09.657930 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:09.678874 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:09.680711 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:09.683748 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:09.689411 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:09.689742 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:09.690096 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:09.690333 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:09.783663 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:42457
I20260709 12:16:09.783701 27605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:42457 every 8 connection(s)
I20260709 12:16:09.791605 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:09.805142 27610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:09.809882 27611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:09.819969 27613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:09.822160 27446 server_base.cc:1061] running on GCE node
I20260709 12:16:09.822482 27606 heartbeater.cc:344] Connected to a master server at 127.26.205.190:44963
I20260709 12:16:09.822993 27606 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:09.823086 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:09.823419 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:09.823612 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599369823594 us; error 0 us; skew 500 ppm
I20260709 12:16:09.824247 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:09.824182 27606 heartbeater.cc:507] Master 127.26.205.190:44963 requested a full tablet report, sending...
I20260709 12:16:09.827489 27446 webserver.cc:533] Webserver started at http://127.26.205.130:35953/ using document root <none> and password file <none>
I20260709 12:16:09.827737 27478 ts_manager.cc:194] Registered new tserver with Master: 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457)
I20260709 12:16:09.828089 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:09.828331 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:09.828650 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:09.829754 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-1-root/instance:
uuid: "f4533687d71a404cbec92cf2ea02b474"
format_stamp: "Formatted at 2026-07-09 12:16:09 on dist-test-slave-673s"
I20260709 12:16:09.830629 27478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37210
I20260709 12:16:09.836388 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:16:09.841136 27618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:09.842051 27446 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:16:09.842336 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-1-root
uuid: "f4533687d71a404cbec92cf2ea02b474"
format_stamp: "Formatted at 2026-07-09 12:16:09 on dist-test-slave-673s"
I20260709 12:16:09.842608 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:09.879338 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:09.880709 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:09.883313 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:09.886827 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:09.887017 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:09.887313 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:09.887460 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:09.994554 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.130:40017
I20260709 12:16:09.994676 27680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.130:40017 every 8 connection(s)
I20260709 12:16:10.008397 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:10.016377 27684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:10.017719 27685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:10.025790 27681 heartbeater.cc:344] Connected to a master server at 127.26.205.190:44963
I20260709 12:16:10.026351 27681 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:10.027663 27681 heartbeater.cc:507] Master 127.26.205.190:44963 requested a full tablet report, sending...
I20260709 12:16:10.030915 27478 ts_manager.cc:194] Registered new tserver with Master: f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:10.033257 27478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37218
I20260709 12:16:10.040022 27446 server_base.cc:1061] running on GCE node
W20260709 12:16:10.040189 27687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:10.041419 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:10.041626 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:10.041873 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599370041851 us; error 0 us; skew 500 ppm
I20260709 12:16:10.042493 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:10.045454 27446 webserver.cc:533] Webserver started at http://127.26.205.131:33067/ using document root <none> and password file <none>
I20260709 12:16:10.045980 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:10.046190 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:10.046499 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:10.047709 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-2-root/instance:
uuid: "45922e75a78548c5bcbf53773c10ae3f"
format_stamp: "Formatted at 2026-07-09 12:16:10 on dist-test-slave-673s"
I20260709 12:16:10.053056 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:16:10.056964 27692 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:10.057809 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:16:10.058135 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-2-root
uuid: "45922e75a78548c5bcbf53773c10ae3f"
format_stamp: "Formatted at 2026-07-09 12:16:10 on dist-test-slave-673s"
I20260709 12:16:10.058521 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599367894863-27446-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:10.092367 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:10.094043 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:10.096046 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:10.099725 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:10.099990 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:10.100271 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:10.100504 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:16:10.187300 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.131:43603
I20260709 12:16:10.187350 27754 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.131:43603 every 8 connection(s)
I20260709 12:16:10.204718 27755 heartbeater.cc:344] Connected to a master server at 127.26.205.190:44963
I20260709 12:16:10.205140 27755 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:10.206092 27755 heartbeater.cc:507] Master 127.26.205.190:44963 requested a full tablet report, sending...
I20260709 12:16:10.208187 27478 ts_manager.cc:194] Registered new tserver with Master: 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:10.209021 27446 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015985479s
I20260709 12:16:10.209535 27478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37222
I20260709 12:16:10.261212 27478 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37224:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:10.264963 27478 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:10.369304 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb4de7e16d64c0aae4be87b902c0605 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:10.369908 27570 tablet_service.cc:1511] Processing CreateTablet for tablet fb7d372a6eaf4663831702f4a770835d (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:10.371024 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb4de7e16d64c0aae4be87b902c0605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.372512 27568 tablet_service.cc:1511] Processing CreateTablet for tablet f9b69e7f37f549328636d3d1cb3e61ee (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:10.373912 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b69e7f37f549328636d3d1cb3e61ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.373725 27569 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea27904946c43759c0171bf38dd59a8 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:10.375028 27569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea27904946c43759c0171bf38dd59a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.376119 27567 tablet_service.cc:1511] Processing CreateTablet for tablet bfa67047e29f44c2ab62251ad75fd4ad (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:10.377473 27567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa67047e29f44c2ab62251ad75fd4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.381747 27566 tablet_service.cc:1511] Processing CreateTablet for tablet 342929b3a6f2432d868eb277e347bc9c (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:10.383100 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342929b3a6f2432d868eb277e347bc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.386448 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7d372a6eaf4663831702f4a770835d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.387696 27564 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9d878d627e453e988d2cb7f9e079d1 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:10.386448 27565 tablet_service.cc:1511] Processing CreateTablet for tablet d8fb8d5ee99a403bb2eca86ddd2835a3 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:10.389814 27565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8fb8d5ee99a403bb2eca86ddd2835a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.393824 27563 tablet_service.cc:1511] Processing CreateTablet for tablet 4263ef0eadc1423cbf619a9ace114fae (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:10.395131 27563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4263ef0eadc1423cbf619a9ace114fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.397078 27564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9d878d627e453e988d2cb7f9e079d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.448220 27773 tablet_bootstrap.cc:492] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:10.464475 27719 tablet_service.cc:1511] Processing CreateTablet for tablet fb7d372a6eaf4663831702f4a770835d (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:10.472856 27720 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb4de7e16d64c0aae4be87b902c0605 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:10.471486 27713 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9d878d627e453e988d2cb7f9e079d1 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:10.478369 27719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7d372a6eaf4663831702f4a770835d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.472087 27718 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea27904946c43759c0171bf38dd59a8 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:10.473336 27645 tablet_service.cc:1511] Processing CreateTablet for tablet fb7d372a6eaf4663831702f4a770835d (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:10.488461 27716 tablet_service.cc:1511] Processing CreateTablet for tablet bfa67047e29f44c2ab62251ad75fd4ad (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:10.475792 27644 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea27904946c43759c0171bf38dd59a8 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:10.479785 27646 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb4de7e16d64c0aae4be87b902c0605 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:10.477481 27717 tablet_service.cc:1511] Processing CreateTablet for tablet f9b69e7f37f549328636d3d1cb3e61ee (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:10.492280 27638 tablet_service.cc:1511] Processing CreateTablet for tablet 4263ef0eadc1423cbf619a9ace114fae (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:10.487605 27714 tablet_service.cc:1511] Processing CreateTablet for tablet d8fb8d5ee99a403bb2eca86ddd2835a3 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:10.494910 27715 tablet_service.cc:1511] Processing CreateTablet for tablet 342929b3a6f2432d868eb277e347bc9c (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:10.495434 27642 tablet_service.cc:1511] Processing CreateTablet for tablet bfa67047e29f44c2ab62251ad75fd4ad (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:10.496587 27640 tablet_service.cc:1511] Processing CreateTablet for tablet d8fb8d5ee99a403bb2eca86ddd2835a3 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:10.497125 27643 tablet_service.cc:1511] Processing CreateTablet for tablet f9b69e7f37f549328636d3d1cb3e61ee (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:10.499688 27639 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9d878d627e453e988d2cb7f9e079d1 (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:10.498478 27720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb4de7e16d64c0aae4be87b902c0605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.499868 27641 tablet_service.cc:1511] Processing CreateTablet for tablet 342929b3a6f2432d868eb277e347bc9c (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:10.501662 27645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7d372a6eaf4663831702f4a770835d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.487668 27712 tablet_service.cc:1511] Processing CreateTablet for tablet 4263ef0eadc1423cbf619a9ace114fae (DEFAULT_TABLE table=test-workload [id=10e3fa30b3614b38b1f6e4d088c6871c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:10.503100 27644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea27904946c43759c0171bf38dd59a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.504455 27715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342929b3a6f2432d868eb277e347bc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.507915 27643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b69e7f37f549328636d3d1cb3e61ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.510248 27646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb4de7e16d64c0aae4be87b902c0605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.511291 27638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4263ef0eadc1423cbf619a9ace114fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.512497 27640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8fb8d5ee99a403bb2eca86ddd2835a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.509908 27714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8fb8d5ee99a403bb2eca86ddd2835a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.514185 27717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b69e7f37f549328636d3d1cb3e61ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.513813 27639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9d878d627e453e988d2cb7f9e079d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.515569 27641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342929b3a6f2432d868eb277e347bc9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.518400 27712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4263ef0eadc1423cbf619a9ace114fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.523945 27642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa67047e29f44c2ab62251ad75fd4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.529080 27718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea27904946c43759c0171bf38dd59a8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:10.545549 27526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:10.563683 27713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9d878d627e453e988d2cb7f9e079d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.575027 27716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa67047e29f44c2ab62251ad75fd4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:10.591854 27773 tablet_bootstrap.cc:654] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.642360 27773 tablet_bootstrap.cc:492] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:10.642848 27773 ts_tablet_manager.cc:1403] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.195s	user 0.015s	sys 0.026s
I20260709 12:16:10.670301 27775 tablet_bootstrap.cc:492] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:10.686722 27776 tablet_bootstrap.cc:492] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
I20260709 12:16:10.691044 27773 raft_consensus.cc:359] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:10.698252 27773 raft_consensus.cc:385] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.698599 27773 raft_consensus.cc:740] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.699349 27773 consensus_queue.cc:260] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:10.705004 27775 tablet_bootstrap.cc:654] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.706668 27776 tablet_bootstrap.cc:654] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.718135 27606 heartbeater.cc:499] Master 127.26.205.190:44963 was elected leader, sending a full tablet report...
I20260709 12:16:10.721251 27773 ts_tablet_manager.cc:1434] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.078s	user 0.014s	sys 0.006s
I20260709 12:16:10.723284 27773 tablet_bootstrap.cc:492] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:10.724027 27776 tablet_bootstrap.cc:492] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:10.724031 27775 tablet_bootstrap.cc:492] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:10.724675 27776 ts_tablet_manager.cc:1403] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.014s
I20260709 12:16:10.728171 27776 raft_consensus.cc:359] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.728967 27776 raft_consensus.cc:385] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.729269 27776 raft_consensus.cc:740] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.730057 27776 consensus_queue.cc:260] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.729748 27773 tablet_bootstrap.cc:654] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.724675 27775 ts_tablet_manager.cc:1403] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.020s
I20260709 12:16:10.744678 27775 raft_consensus.cc:359] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.748600 27775 raft_consensus.cc:385] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.749155 27775 raft_consensus.cc:740] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.750385 27775 consensus_queue.cc:260] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.758953 27681 heartbeater.cc:499] Master 127.26.205.190:44963 was elected leader, sending a full tablet report...
I20260709 12:16:10.759394 27773 tablet_bootstrap.cc:492] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:10.759460 27776 ts_tablet_manager.cc:1434] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.023s
I20260709 12:16:10.759929 27773 ts_tablet_manager.cc:1403] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.010s
I20260709 12:16:10.760793 27776 tablet_bootstrap.cc:492] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
I20260709 12:16:10.763844 27773 raft_consensus.cc:359] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.764573 27773 raft_consensus.cc:385] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.764868 27773 raft_consensus.cc:740] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.765611 27773 consensus_queue.cc:260] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.766521 27775 ts_tablet_manager.cc:1434] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 12:16:10.767287 27755 heartbeater.cc:499] Master 127.26.205.190:44963 was elected leader, sending a full tablet report...
I20260709 12:16:10.767678 27775 tablet_bootstrap.cc:492] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:10.771024 27773 ts_tablet_manager.cc:1434] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:16:10.772313 27773 tablet_bootstrap.cc:492] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:10.776474 27775 tablet_bootstrap.cc:654] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.782734 27773 tablet_bootstrap.cc:654] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.783094 27776 tablet_bootstrap.cc:654] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:10.796769 27607 tablet.cc:2406] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:10.807822 27776 tablet_bootstrap.cc:492] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:10.808337 27776 ts_tablet_manager.cc:1403] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.004s
I20260709 12:16:10.810324 27782 raft_consensus.cc:493] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.810834 27782 raft_consensus.cc:515] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.811260 27776 raft_consensus.cc:359] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.811928 27776 raft_consensus.cc:385] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.812239 27776 raft_consensus.cc:740] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.818562 27782 leader_election.cc:290] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:10.820051 27776 consensus_queue.cc:260] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.828392 27773 tablet_bootstrap.cc:492] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:10.829295 27773 ts_tablet_manager.cc:1403] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.027s
I20260709 12:16:10.828686 27776 ts_tablet_manager.cc:1434] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 12:16:10.832835 27775 tablet_bootstrap.cc:492] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:10.833285 27775 ts_tablet_manager.cc:1403] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.015s
I20260709 12:16:10.833441 27776 tablet_bootstrap.cc:492] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
I20260709 12:16:10.833310 27773 raft_consensus.cc:359] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.834158 27773 raft_consensus.cc:385] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.834607 27773 raft_consensus.cc:740] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.835340 27773 consensus_queue.cc:260] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.837468 27773 ts_tablet_manager.cc:1434] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:16:10.838806 27773 tablet_bootstrap.cc:492] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:10.845196 27775 raft_consensus.cc:359] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.845927 27775 raft_consensus.cc:385] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.848038 27776 tablet_bootstrap.cc:654] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.849622 27773 tablet_bootstrap.cc:654] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.852232 27775 raft_consensus.cc:740] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.853188 27775 consensus_queue.cc:260] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.855290 27775 ts_tablet_manager.cc:1434] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 12:16:10.856247 27775 tablet_bootstrap.cc:492] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:10.863811 27775 tablet_bootstrap.cc:654] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.866353 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:10.866770 27773 tablet_bootstrap.cc:492] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:10.867262 27773 ts_tablet_manager.cc:1403] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.004s
W20260709 12:16:10.868816 27693 leader_election.cc:343] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:10.870191 27773 raft_consensus.cc:359] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.870936 27773 raft_consensus.cc:385] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.871236 27773 raft_consensus.cc:740] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.871948 27773 consensus_queue.cc:260] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.874128 27773 ts_tablet_manager.cc:1434] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:10.875056 27773 tablet_bootstrap.cc:492] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:10.876616 27776 tablet_bootstrap.cc:492] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:10.877070 27776 ts_tablet_manager.cc:1403] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.008s
I20260709 12:16:10.880017 27776 raft_consensus.cc:359] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:10.880892 27776 raft_consensus.cc:385] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.881260 27776 raft_consensus.cc:740] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.882042 27776 consensus_queue.cc:260] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:10.885931 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:10.886875 27656 raft_consensus.cc:2468] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 0.
I20260709 12:16:10.888371 27773 tablet_bootstrap.cc:654] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.888777 27696 leader_election.cc:304] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 4a19474f5cad4b36a40382910514effe
I20260709 12:16:10.889890 27782 raft_consensus.cc:2804] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:10.890277 27782 raft_consensus.cc:493] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:10.890671 27782 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:10.893169 27776 ts_tablet_manager.cc:1434] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:16:10.894250 27776 tablet_bootstrap.cc:492] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
I20260709 12:16:10.898130 27775 tablet_bootstrap.cc:492] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:10.899075 27775 ts_tablet_manager.cc:1403] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.016s
I20260709 12:16:10.901405 27776 tablet_bootstrap.cc:654] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.901922 27773 tablet_bootstrap.cc:492] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:10.902412 27773 ts_tablet_manager.cc:1403] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 12:16:10.902029 27775 raft_consensus.cc:359] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.902766 27775 raft_consensus.cc:385] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.903092 27775 raft_consensus.cc:740] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.903867 27775 consensus_queue.cc:260] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.906248 27782 raft_consensus.cc:515] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.911470 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:10.913273 27775 ts_tablet_manager.cc:1434] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.006s
I20260709 12:16:10.914284 27775 tablet_bootstrap.cc:492] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:10.914628 27776 tablet_bootstrap.cc:492] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:10.915227 27776 ts_tablet_manager.cc:1403] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
W20260709 12:16:10.915515 27693 leader_election.cc:343] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:10.906697 27773 raft_consensus.cc:359] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.916121 27773 raft_consensus.cc:385] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.916456 27773 raft_consensus.cc:740] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.917315 27773 consensus_queue.cc:260] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.918506 27776 raft_consensus.cc:359] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.919302 27776 raft_consensus.cc:385] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.919643 27776 raft_consensus.cc:740] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.921044 27775 tablet_bootstrap.cc:654] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.922158 27782 leader_election.cc:290] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:10.923385 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:10.924018 27656 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:10.924265 27773 ts_tablet_manager.cc:1434] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:16:10.920516 27776 consensus_queue.cc:260] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.926241 27776 ts_tablet_manager.cc:1434] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:16:10.927186 27776 tablet_bootstrap.cc:492] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
I20260709 12:16:10.932168 27773 tablet_bootstrap.cc:492] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:10.937896 27656 raft_consensus.cc:2468] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 1.
I20260709 12:16:10.941679 27696 leader_election.cc:304] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 4a19474f5cad4b36a40382910514effe
I20260709 12:16:10.943552 27782 raft_consensus.cc:2804] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:10.944036 27782 raft_consensus.cc:697] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:10.944782 27776 tablet_bootstrap.cc:654] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.944923 27782 consensus_queue.cc:237] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.954242 27775 tablet_bootstrap.cc:492] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:10.954492 27773 tablet_bootstrap.cc:654] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.954774 27775 ts_tablet_manager.cc:1403] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.001s
I20260709 12:16:10.959292 27775 raft_consensus.cc:359] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.960210 27775 raft_consensus.cc:385] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.960572 27775 raft_consensus.cc:740] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.961401 27775 consensus_queue.cc:260] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.962342 27782 raft_consensus.cc:493] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:10.962759 27782 raft_consensus.cc:515] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.963706 27775 ts_tablet_manager.cc:1434] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:10.964656 27775 tablet_bootstrap.cc:492] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:10.968019 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:10.968012 27478 catalog_manager.cc:5697] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 1 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:10.969677 27693 leader_election.cc:343] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:10.971180 27775 tablet_bootstrap.cc:654] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:10.972793 27782 leader_election.cc:290] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:10.973939 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:10.974972 27773 tablet_bootstrap.cc:492] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:10.975566 27773 ts_tablet_manager.cc:1403] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
W20260709 12:16:10.975546 27696 leader_election.cc:343] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:10.976238 27696 leader_election.cc:304] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f; no voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:10.980530 27776 tablet_bootstrap.cc:492] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:10.980631 27782 raft_consensus.cc:2749] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:10.981206 27776 ts_tablet_manager.cc:1403] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.013s
I20260709 12:16:10.979929 27773 raft_consensus.cc:359] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.981931 27773 raft_consensus.cc:385] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.982337 27773 raft_consensus.cc:740] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.983510 27773 consensus_queue.cc:260] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.989456 27776 raft_consensus.cc:359] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.992034 27776 raft_consensus.cc:385] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.993062 27776 raft_consensus.cc:740] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.993222 27775 tablet_bootstrap.cc:492] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:10.993800 27775 ts_tablet_manager.cc:1403] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.010s
I20260709 12:16:10.994125 27776 consensus_queue.cc:260] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.996783 27776 ts_tablet_manager.cc:1434] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.007s
I20260709 12:16:10.996886 27775 raft_consensus.cc:359] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.997684 27775 raft_consensus.cc:385] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:10.997967 27775 raft_consensus.cc:740] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:10.998664 27775 consensus_queue.cc:260] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:10.999495 27776 tablet_bootstrap.cc:492] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
I20260709 12:16:11.001235 27775 ts_tablet_manager.cc:1434] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:16:11.002180 27775 tablet_bootstrap.cc:492] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:10.995004 27773 ts_tablet_manager.cc:1434] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.006s
I20260709 12:16:11.005564 27773 tablet_bootstrap.cc:492] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:11.008584 27775 tablet_bootstrap.cc:654] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.018843 27773 tablet_bootstrap.cc:654] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.026762 27776 tablet_bootstrap.cc:654] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.040993 27776 tablet_bootstrap.cc:492] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:11.041431 27775 tablet_bootstrap.cc:492] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:11.041612 27776 ts_tablet_manager.cc:1403] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.042s	user 0.002s	sys 0.016s
I20260709 12:16:11.041913 27775 ts_tablet_manager.cc:1403] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.019s
I20260709 12:16:11.045149 27775 raft_consensus.cc:359] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:11.045943 27775 raft_consensus.cc:385] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.046293 27775 raft_consensus.cc:740] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.047099 27775 consensus_queue.cc:260] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:11.050380 27775 ts_tablet_manager.cc:1434] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:16:11.051333 27775 tablet_bootstrap.cc:492] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:11.052315 27782 raft_consensus.cc:493] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.052911 27782 raft_consensus.cc:515] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.054944 27782 leader_election.cc:290] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:11.056533 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
W20260709 12:16:11.057977 27693 leader_election.cc:343] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:11.057689 27776 raft_consensus.cc:359] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.059192 27776 raft_consensus.cc:385] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.059628 27776 raft_consensus.cc:740] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.060976 27776 consensus_queue.cc:260] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.062700 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.063285 27775 tablet_bootstrap.cc:654] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.063381 27773 tablet_bootstrap.cc:492] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:11.063328 27656 raft_consensus.cc:2468] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 0.
I20260709 12:16:11.063993 27773 ts_tablet_manager.cc:1403] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.007s
I20260709 12:16:11.065725 27696 leader_election.cc:304] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 4a19474f5cad4b36a40382910514effe
I20260709 12:16:11.066870 27782 raft_consensus.cc:2804] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.067279 27782 raft_consensus.cc:493] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.067687 27782 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.068006 27773 raft_consensus.cc:359] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.068758 27773 raft_consensus.cc:385] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.069056 27773 raft_consensus.cc:740] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.069787 27773 consensus_queue.cc:260] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.072062 27773 ts_tablet_manager.cc:1434] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.002s
I20260709 12:16:11.073427 27780 raft_consensus.cc:493] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.073897 27780 raft_consensus.cc:515] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.077600 27776 ts_tablet_manager.cc:1434] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 12:16:11.078797 27793 raft_consensus.cc:493] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.079275 27793 raft_consensus.cc:515] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.081459 27793 leader_election.cc:290] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:11.085000 27773 tablet_bootstrap.cc:492] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:11.085389 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:11.086850 27581 raft_consensus.cc:2468] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 0.
I20260709 12:16:11.089594 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.091943 27693 leader_election.cc:304] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: 
I20260709 12:16:11.092856 27793 raft_consensus.cc:2804] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.093199 27793 raft_consensus.cc:493] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.093502 27793 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.095230 27776 tablet_bootstrap.cc:492] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
W20260709 12:16:11.099324 27696 leader_election.cc:343] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:11.099059 27780 leader_election.cc:290] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.117897 27777 raft_consensus.cc:493] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.118408 27777 raft_consensus.cc:515] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:11.124267 27777 leader_election.cc:290] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.125417 27780 raft_consensus.cc:493] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.134469 27776 tablet_bootstrap.cc:654] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.129132 27780 raft_consensus.cc:515] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.141803 27773 tablet_bootstrap.cc:654] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.143754 27782 raft_consensus.cc:515] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.147130 27780 leader_election.cc:290] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.147491 27782 leader_election.cc:290] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:11.148222 27782 raft_consensus.cc:493] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.148674 27782 raft_consensus.cc:515] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.148877 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:11.149475 27656 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.150923 27782 leader_election.cc:290] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:11.154747 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa67047e29f44c2ab62251ad75fd4ad" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.155510 27655 raft_consensus.cc:2468] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 0.
I20260709 12:16:11.156903 27696 leader_election.cc:304] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.159934 27777 raft_consensus.cc:493] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.160598 27777 raft_consensus.cc:515] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.166008 27775 tablet_bootstrap.cc:492] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:11.166081 27777 leader_election.cc:290] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.166661 27775 ts_tablet_manager.cc:1403] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.116s	user 0.029s	sys 0.057s
I20260709 12:16:11.162137 27782 raft_consensus.cc:2804] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.169392 27782 raft_consensus.cc:493] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.170113 27782 raft_consensus.cc:3060] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.173185 27775 raft_consensus.cc:359] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.174124 27775 raft_consensus.cc:385] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.174413 27775 raft_consensus.cc:740] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.175241 27775 consensus_queue.cc:260] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.184252 27775 ts_tablet_manager.cc:1434] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:16:11.184468 27793 raft_consensus.cc:515] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.185416 27775 tablet_bootstrap.cc:492] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:11.187235 27793 leader_election.cc:290] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:11.188925 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:11.194618 27775 tablet_bootstrap.cc:654] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.199098 27782 raft_consensus.cc:515] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
W20260709 12:16:11.203506 27696 leader_election.cc:343] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:11.206492 27656 raft_consensus.cc:2468] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 1.
I20260709 12:16:11.216331 27782 leader_election.cc:290] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:11.210366 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:11.228313 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:11.229295 27579 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.233729 27773 tablet_bootstrap.cc:492] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:11.234172 27773 ts_tablet_manager.cc:1403] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.149s	user 0.026s	sys 0.005s
I20260709 12:16:11.222723 27696 leader_election.cc:304] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.238276 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa67047e29f44c2ab62251ad75fd4ad" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:11.225468 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa67047e29f44c2ab62251ad75fd4ad" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:11.238662 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa67047e29f44c2ab62251ad75fd4ad" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe"
W20260709 12:16:11.239174 27693 leader_election.cc:343] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:11.238751 27782 raft_consensus.cc:2804] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:11.242676 27776 tablet_bootstrap.cc:492] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:11.244294 27773 raft_consensus.cc:359] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.242305 27656 raft_consensus.cc:3060] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.245175 27773 raft_consensus.cc:385] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.247058 27776 ts_tablet_manager.cc:1403] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.007s
I20260709 12:16:11.246836 27773 raft_consensus.cc:740] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.245609 27780 raft_consensus.cc:493] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.244952 27578 raft_consensus.cc:3060] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.245460 27782 raft_consensus.cc:697] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:11.251258 27775 tablet_bootstrap.cc:492] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:11.251814 27775 ts_tablet_manager.cc:1403] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.067s	user 0.029s	sys 0.018s
I20260709 12:16:11.252741 27773 consensus_queue.cc:260] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.249687 27780 raft_consensus.cc:515] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:11.255299 27782 consensus_queue.cc:237] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.259258 27773 ts_tablet_manager.cc:1434] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:16:11.260617 27773 tablet_bootstrap.cc:492] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe: Bootstrap starting.
I20260709 12:16:11.281631 27776 raft_consensus.cc:359] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.282501 27656 raft_consensus.cc:2468] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 1.
I20260709 12:16:11.284763 27775 raft_consensus.cc:359] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.285274 27775 raft_consensus.cc:385] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.285511 27775 raft_consensus.cc:740] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.284873 27776 raft_consensus.cc:385] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.284611 27696 leader_election.cc:304] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.287186 27775 consensus_queue.cc:260] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.286983 27776 raft_consensus.cc:740] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.288407 27780 leader_election.cc:290] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603), 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457)
I20260709 12:16:11.287322 27579 raft_consensus.cc:2468] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 1.
I20260709 12:16:11.288998 27793 raft_consensus.cc:2804] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:11.290972 27793 raft_consensus.cc:697] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:11.291623 27775 ts_tablet_manager.cc:1434] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:16:11.289143 27776 consensus_queue.cc:260] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.292763 27775 tablet_bootstrap.cc:492] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f: Bootstrap starting.
I20260709 12:16:11.292783 27793 consensus_queue.cc:237] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.297516 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.298885 27693 leader_election.cc:304] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:11.299610 27777 raft_consensus.cc:493] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.300067 27777 raft_consensus.cc:515] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.301811 27782 raft_consensus.cc:2804] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:11.300969 27729 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 0.
I20260709 12:16:11.301999 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.294059 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.312574 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.305605 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.314157 27728 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 0.
I20260709 12:16:11.314105 27622 leader_election.cc:304] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.312139 27782 raft_consensus.cc:697] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:11.319115 27780 raft_consensus.cc:2804] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.314155 27730 raft_consensus.cc:2468] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 0.
I20260709 12:16:11.341110 27780 raft_consensus.cc:493] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.345355 27817 raft_consensus.cc:493] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.323405 27776 ts_tablet_manager.cc:1434] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.075s	user 0.014s	sys 0.006s
I20260709 12:16:11.342615 27622 leader_election.cc:304] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.348143 27777 leader_election.cc:290] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.346704 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.342782 27780 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.348309 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:11.350270 27729 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 0.
I20260709 12:16:11.350553 27581 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 0.
I20260709 12:16:11.332516 27727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.352771 27727 raft_consensus.cc:2468] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 0.
I20260709 12:16:11.353236 27773 tablet_bootstrap.cc:654] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.346096 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:11.350302 27777 raft_consensus.cc:493] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.315415 27655 raft_consensus.cc:2468] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 0.
I20260709 12:16:11.317008 27656 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 0.
I20260709 12:16:11.353977 27777 raft_consensus.cc:515] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.342782 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:11.345841 27817 raft_consensus.cc:515] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.358124 27580 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 0.
I20260709 12:16:11.359921 27777 leader_election.cc:290] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.367126 27817 leader_election.cc:290] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.365324 27782 consensus_queue.cc:237] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.369508 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.368048 27776 tablet_bootstrap.cc:492] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
I20260709 12:16:11.365384 27579 raft_consensus.cc:2468] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 0.
I20260709 12:16:11.370009 27476 catalog_manager.cc:5697] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 1 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:11.379827 27578 raft_consensus.cc:2468] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 1.
W20260709 12:16:11.381553 27622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:43603, user_credentials={real_user=slave}} blocked reactor thread for 47239us
W20260709 12:16:11.384402 27816 log.cc:927] Time spent T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:16:11.380332 27780 raft_consensus.cc:515] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.385197 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.385910 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.388154 27727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.388371 27655 raft_consensus.cc:2393] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a19474f5cad4b36a40382910514effe in current term 1: Already voted for candidate 45922e75a78548c5bcbf53773c10ae3f in this term.
I20260709 12:16:11.390110 27622 leader_election.cc:304] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.382470 27820 raft_consensus.cc:2804] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.393385 27780 leader_election.cc:290] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.396811 27775 tablet_bootstrap.cc:654] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.391927 27820 raft_consensus.cc:493] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.398952 27780 raft_consensus.cc:2804] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.400609 27780 raft_consensus.cc:493] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.400956 27780 raft_consensus.cc:3060] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.399108 27820 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.405567 27773 tablet_bootstrap.cc:492] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe: No bootstrap required, opened a new log
I20260709 12:16:11.406000 27773 ts_tablet_manager.cc:1403] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.018s
I20260709 12:16:11.404819 27476 catalog_manager.cc:5697] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 1 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:11.411944 27727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:11.413671 27776 tablet_bootstrap.cc:654] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:11.413601 27578 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.416759 27727 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.421320 27775 tablet_bootstrap.cc:492] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f: No bootstrap required, opened a new log
I20260709 12:16:11.399039 27547 leader_election.cc:304] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.421779 27775 ts_tablet_manager.cc:1403] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.008s
I20260709 12:16:11.422236 27819 raft_consensus.cc:2804] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.422607 27819 raft_consensus.cc:493] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.421756 27476 catalog_manager.cc:5697] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 1 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:11.422941 27819 raft_consensus.cc:3060] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.428395 27727 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 1.
I20260709 12:16:11.428974 27547 leader_election.cc:304] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.429782 27776 tablet_bootstrap.cc:492] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:11.429746 27622 leader_election.cc:304] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.430481 27823 raft_consensus.cc:493] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:11.432286 27547 leader_election.cc:343] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:11.432171 27823 raft_consensus.cc:515] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
W20260709 12:16:11.434162 27547 leader_election.cc:343] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:11.436622 27547 leader_election.cc:304] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a19474f5cad4b36a40382910514effe; no voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:11.431663 27817 raft_consensus.cc:2804] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.440281 27817 raft_consensus.cc:493] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.440676 27817 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.441098 27782 consensus_queue.cc:1048] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:11.447539 27817 raft_consensus.cc:515] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:11.434309 27823 leader_election.cc:290] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.448825 27823 raft_consensus.cc:2804] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:11.449260 27823 raft_consensus.cc:697] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:11.450065 27823 consensus_queue.cc:237] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.451221 27777 raft_consensus.cc:2749] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:11.424420 27775 raft_consensus.cc:359] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.452222 27775 raft_consensus.cc:385] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.428757 27820 raft_consensus.cc:515] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:11.454558 27820 leader_election.cc:290] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 election: Requested vote from peers 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603), 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457)
I20260709 12:16:11.430616 27819 raft_consensus.cc:515] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.431593 27776 ts_tablet_manager.cc:1403] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.003s
I20260709 12:16:11.457633 27819 leader_election.cc:290] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.458238 27775 raft_consensus.cc:740] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.458575 27776 raft_consensus.cc:359] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.461020 27776 raft_consensus.cc:385] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.461396 27776 raft_consensus.cc:740] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.436031 27780 raft_consensus.cc:515] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.462291 27776 consensus_queue.cc:260] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.463387 27775 consensus_queue.cc:260] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.459645 27547 leader_election.cc:304] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a19474f5cad4b36a40382910514effe; no voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:11.450486 27817 leader_election.cc:290] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.469295 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.465057 27776 ts_tablet_manager.cc:1434] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:16:11.471477 27776 tablet_bootstrap.cc:492] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474: Bootstrap starting.
I20260709 12:16:11.475253 27775 ts_tablet_manager.cc:1434] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 12:16:11.478343 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:11.466288 27780 leader_election.cc:290] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.478698 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:11.479115 27655 raft_consensus.cc:2393] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a19474f5cad4b36a40382910514effe in current term 1: Already voted for candidate f4533687d71a404cbec92cf2ea02b474 in this term.
I20260709 12:16:11.479332 27730 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.476720 27727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.480131 27727 raft_consensus.cc:2393] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a19474f5cad4b36a40382910514effe in current term 1: Already voted for candidate f4533687d71a404cbec92cf2ea02b474 in this term.
I20260709 12:16:11.415784 27773 raft_consensus.cc:359] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.481611 27727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:11.482013 27773 raft_consensus.cc:385] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.482333 27773 raft_consensus.cc:740] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.482299 27727 raft_consensus.cc:3060] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.483109 27773 consensus_queue.cc:260] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.481647 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:11.485306 27655 raft_consensus.cc:2393] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a19474f5cad4b36a40382910514effe in current term 1: Already voted for candidate f4533687d71a404cbec92cf2ea02b474 in this term.
I20260709 12:16:11.486894 27773 ts_tablet_manager.cc:1434] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.002s
I20260709 12:16:11.487756 27776 tablet_bootstrap.cc:654] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:11.490188 27622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:43603, user_credentials={real_user=slave}} blocked reactor thread for 60511.5us
I20260709 12:16:11.490427 27727 raft_consensus.cc:2468] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 1.
I20260709 12:16:11.491278 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:11.491652 27729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.493680 27730 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 1.
I20260709 12:16:11.493727 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:11.494639 27581 raft_consensus.cc:2393] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4533687d71a404cbec92cf2ea02b474 in current term 1: Already voted for candidate 4a19474f5cad4b36a40382910514effe in this term.
I20260709 12:16:11.493291 27547 leader_election.cc:304] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a19474f5cad4b36a40382910514effe; no voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:11.494015 27579 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.495680 27577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:11.496533 27577 raft_consensus.cc:2393] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4533687d71a404cbec92cf2ea02b474 in current term 1: Already voted for candidate 4a19474f5cad4b36a40382910514effe in this term.
I20260709 12:16:11.492369 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:11.498867 27728 raft_consensus.cc:2393] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4533687d71a404cbec92cf2ea02b474 in current term 1: Already voted for candidate 4a19474f5cad4b36a40382910514effe in this term.
I20260709 12:16:11.493079 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:11.500494 27580 raft_consensus.cc:2393] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4533687d71a404cbec92cf2ea02b474 in current term 1: Already voted for candidate 45922e75a78548c5bcbf53773c10ae3f in this term.
I20260709 12:16:11.502038 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:11.502796 27728 raft_consensus.cc:2393] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4533687d71a404cbec92cf2ea02b474 in current term 1: Already voted for candidate 4a19474f5cad4b36a40382910514effe in this term.
I20260709 12:16:11.506398 27579 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 1.
I20260709 12:16:11.508109 27817 raft_consensus.cc:2749] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:11.510113 27619 leader_election.cc:304] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4533687d71a404cbec92cf2ea02b474; no voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe
I20260709 12:16:11.510524 27476 catalog_manager.cc:5697] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.511502 27826 raft_consensus.cc:2749] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:11.512892 27619 leader_election.cc:304] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4533687d71a404cbec92cf2ea02b474; no voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe
I20260709 12:16:11.513952 27826 raft_consensus.cc:2749] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:11.515156 27619 leader_election.cc:304] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4533687d71a404cbec92cf2ea02b474; no voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe
I20260709 12:16:11.516294 27826 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.521173 27547 leader_election.cc:304] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:11.522082 27817 raft_consensus.cc:2804] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:11.522543 27817 raft_consensus.cc:697] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:11.523413 27817 consensus_queue.cc:237] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:11.524796 27819 raft_consensus.cc:2749] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:11.529541 27776 tablet_bootstrap.cc:492] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474: No bootstrap required, opened a new log
I20260709 12:16:11.529973 27776 ts_tablet_manager.cc:1403] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.010s
I20260709 12:16:11.530496 27547 leader_election.cc:304] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:11.537324 27777 raft_consensus.cc:2804] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:11.532467 27776 raft_consensus.cc:359] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.532982 27819 raft_consensus.cc:493] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.538162 27819 raft_consensus.cc:515] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.540076 27819 leader_election.cc:290] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.540817 27776 raft_consensus.cc:385] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:11.541111 27776 raft_consensus.cc:740] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Initialized, Role: FOLLOWER
I20260709 12:16:11.542136 27776 consensus_queue.cc:260] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.547108 27776 ts_tablet_manager.cc:1434] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260709 12:16:11.548023 27526 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:11.535633 27826 raft_consensus.cc:2749] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:11.553004 27777 raft_consensus.cc:697] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:11.556779 27777 consensus_queue.cc:237] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.562674 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474" is_pre_election: true
I20260709 12:16:11.563335 27655 raft_consensus.cc:2468] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 0.
I20260709 12:16:11.567556 27782 consensus_queue.cc:1048] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:11.572530 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.573392 27728 raft_consensus.cc:2468] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 0.
I20260709 12:16:11.577033 27547 leader_election.cc:304] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.579614 27833 raft_consensus.cc:2804] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.580169 27833 raft_consensus.cc:493] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.580744 27833 raft_consensus.cc:3060] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.589119 27833 raft_consensus.cc:515] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.590515 27476 catalog_manager.cc:5697] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 1 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:11.591372 27833 leader_election.cc:290] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.592850 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:11.593734 27655 raft_consensus.cc:3060] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.594358 27476 catalog_manager.cc:5697] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 1 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.592998 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:11.596714 27728 raft_consensus.cc:3060] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.604234 27655 raft_consensus.cc:2468] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 1.
I20260709 12:16:11.603475 27728 raft_consensus.cc:2468] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 1.
I20260709 12:16:11.605406 27547 leader_election.cc:304] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.606283 27826 raft_consensus.cc:493] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:11.607000 27833 raft_consensus.cc:2804] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:11.606736 27826 raft_consensus.cc:515] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.609041 27833 raft_consensus.cc:697] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:11.609184 27826 leader_election.cc:290] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.610112 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:11.610028 27833 consensus_queue.cc:237] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.610773 27728 raft_consensus.cc:2468] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 0.
I20260709 12:16:11.610954 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:11.611617 27578 raft_consensus.cc:2468] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 0.
I20260709 12:16:11.611861 27622 leader_election.cc:304] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.613474 27826 raft_consensus.cc:2804] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:11.613826 27826 raft_consensus.cc:493] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:11.614171 27826 raft_consensus.cc:3060] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.624707 27826 raft_consensus.cc:515] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.627823 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:11.626246 27475 catalog_manager.cc:5697] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 1 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.628425 27728 raft_consensus.cc:3060] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.628280 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:11.628971 27578 raft_consensus.cc:3060] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.635468 27578 raft_consensus.cc:2468] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 1.
I20260709 12:16:11.636173 27826 leader_election.cc:290] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:11.636650 27619 leader_election.cc:304] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:11.640678 27826 raft_consensus.cc:2804] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:11.641155 27826 raft_consensus.cc:697] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:11.641965 27826 consensus_queue.cc:237] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:11.643635 27728 raft_consensus.cc:2468] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 1.
I20260709 12:16:11.650012 27475 catalog_manager.cc:5697] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.700035 27578 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:11.706094 27810 consensus_queue.cc:1048] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:11.719085 27793 consensus_queue.cc:1048] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:11.831244 27782 consensus_queue.cc:1048] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:11.845916 27793 consensus_queue.cc:1048] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:11.847576 27826 consensus_queue.cc:1048] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:11.869874 27780 consensus_queue.cc:1048] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:11.883191 27793 consensus_queue.cc:1048] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:11.899873 27782 consensus_queue.cc:1048] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:11.927212 27728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
mode: GRACEFUL
new_leader_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:55656
I20260709 12:16:11.927845 27728 raft_consensus.cc:606] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Received request to transfer leadership to TS 4a19474f5cad4b36a40382910514effe
I20260709 12:16:11.933454 27728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
mode: GRACEFUL
new_leader_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:55656
I20260709 12:16:11.933952 27728 raft_consensus.cc:606] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Received request to transfer leadership to TS 4a19474f5cad4b36a40382910514effe
I20260709 12:16:11.939050 27728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
mode: GRACEFUL
new_leader_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:55656
I20260709 12:16:11.939539 27728 raft_consensus.cc:606] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Received request to transfer leadership to TS 4a19474f5cad4b36a40382910514effe
I20260709 12:16:11.944654 27728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfa67047e29f44c2ab62251ad75fd4ad"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
mode: GRACEFUL
new_leader_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:55656
I20260709 12:16:11.945138 27728 raft_consensus.cc:606] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Received request to transfer leadership to TS f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:11.959028 27578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
mode: GRACEFUL
new_leader_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:32910
I20260709 12:16:11.959530 27578 raft_consensus.cc:606] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Received request to transfer leadership to TS f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:11.970960 27578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
mode: GRACEFUL
new_leader_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:32910
I20260709 12:16:11.971503 27578 raft_consensus.cc:606] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Received request to transfer leadership to TS 45922e75a78548c5bcbf53773c10ae3f
I20260709 12:16:12.006264 27833 consensus_queue.cc:1048] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:12.007509 27777 consensus_queue.cc:1048] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:12.025895 27833 consensus_queue.cc:1048] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:12.031351 27777 consensus_queue.cc:1048] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:12.051785 27833 raft_consensus.cc:993] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe: : Instructing follower 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:12.052249 27833 raft_consensus.cc:1081] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Signalling peer 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:12.054719 27728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:55644
I20260709 12:16:12.055393 27728 raft_consensus.cc:493] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:12.055845 27728 raft_consensus.cc:3060] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.063474 27728 raft_consensus.cc:515] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.064653 27730 raft_consensus.cc:1240] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Rejecting Update request from peer 4a19474f5cad4b36a40382910514effe for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:12.066637 27728 leader_election.cc:290] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 2 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:12.066869 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:12.067606 27656 raft_consensus.cc:3060] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.067946 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4263ef0eadc1423cbf619a9ace114fae" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:12.068521 27578 raft_consensus.cc:3055] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:12.068614 27777 consensus_queue.cc:1059] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:12.068898 27578 raft_consensus.cc:740] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:12.069736 27578 consensus_queue.cc:260] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.070758 27578 raft_consensus.cc:3060] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.074812 27656 raft_consensus.cc:2468] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 2.
I20260709 12:16:12.076061 27696 leader_election.cc:304] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:12.076229 27578 raft_consensus.cc:2468] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 2.
W20260709 12:16:12.076788 27777 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:16:12.076923 27810 raft_consensus.cc:2804] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:12.077405 27810 raft_consensus.cc:697] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:12.078312 27810 consensus_queue.cc:237] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.085402 27777 consensus_queue.cc:1048] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:12.087070 27476 catalog_manager.cc:5697] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 1 to 2, leader changed from 4a19474f5cad4b36a40382910514effe (127.26.205.129) to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 2 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:12.093705 27833 raft_consensus.cc:993] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe: : Instructing follower f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:12.094128 27834 raft_consensus.cc:1081] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Signalling peer f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:12.095779 27655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:33672
I20260709 12:16:12.096987 27655 raft_consensus.cc:493] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:12.097407 27655 raft_consensus.cc:3060] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.104512 27833 consensus_queue.cc:1048] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:12.104759 27655 raft_consensus.cc:515] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.107396 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:12.107942 27578 raft_consensus.cc:3055] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:12.108255 27578 raft_consensus.cc:740] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:12.109318 27578 consensus_queue.cc:260] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.110663 27578 raft_consensus.cc:3060] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.115826 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342929b3a6f2432d868eb277e347bc9c" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:12.116497 27728 raft_consensus.cc:3060] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.115137 27655 leader_election.cc:290] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 2 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:12.123137 27728 raft_consensus.cc:2468] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 2.
I20260709 12:16:12.126691 27622 leader_election.cc:304] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:12.127636 27780 raft_consensus.cc:2804] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:12.128103 27780 raft_consensus.cc:697] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 2 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:12.128940 27780 consensus_queue.cc:237] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.129634 27810 raft_consensus.cc:993] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f: : Instructing follower 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:12.130348 27810 raft_consensus.cc:1081] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Signalling peer 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:12.131114 27810 raft_consensus.cc:993] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f: : Instructing follower 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:12.131465 27810 raft_consensus.cc:1081] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Signalling peer 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:12.132186 27823 consensus_queue.cc:1048] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:12.133725 27579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:32892
I20260709 12:16:12.134266 27579 raft_consensus.cc:493] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:12.134619 27579 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.133725 27580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:32892
I20260709 12:16:12.141052 27580 raft_consensus.cc:493] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:12.141443 27580 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.140820 27478 catalog_manager.cc:5697] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 1 to 2, leader changed from 4a19474f5cad4b36a40382910514effe (127.26.205.129) to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:12.141464 27578 raft_consensus.cc:2468] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 2.
I20260709 12:16:12.148847 27580 raft_consensus.cc:515] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.152181 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:12.152777 27655 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.152045 27579 raft_consensus.cc:515] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.155959 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:12.156522 27656 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.163031 27656 raft_consensus.cc:2468] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 2.
I20260709 12:16:12.166481 27547 leader_election.cc:304] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:12.166721 27655 raft_consensus.cc:2468] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 2.
I20260709 12:16:12.167387 27833 raft_consensus.cc:2804] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:12.167884 27833 raft_consensus.cc:697] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:12.167961 27580 leader_election.cc:290] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 2 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:12.167932 27547 leader_election.cc:304] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:12.168846 27833 consensus_queue.cc:237] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.170861 27826 consensus_queue.cc:1048] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:12.171936 27833 raft_consensus.cc:2804] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:12.173342 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:12.175447 27579 leader_election.cc:290] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 2 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:12.172384 27833 raft_consensus.cc:697] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:12.177811 27833 consensus_queue.cc:237] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.177716 27478 catalog_manager.cc:5697] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 1 to 2, leader changed from 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131) to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 2 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:12.176870 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:12.181742 27656 raft_consensus.cc:1240] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Rejecting Update request from peer 45922e75a78548c5bcbf53773c10ae3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:12.173941 27730 raft_consensus.cc:3055] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:12.182363 27730 raft_consensus.cc:740] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:12.183384 27793 consensus_queue.cc:1059] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.184206 27728 raft_consensus.cc:3055] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:12.184587 27728 raft_consensus.cc:740] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:12.185098 27730 consensus_queue.cc:260] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.185392 27728 consensus_queue.cc:260] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.186313 27730 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.186600 27728 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.187475 27655 raft_consensus.cc:1240] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Rejecting Update request from peer 45922e75a78548c5bcbf53773c10ae3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:12.194186 27728 raft_consensus.cc:2468] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 2.
W20260709 12:16:12.194705 27782 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:16:12.197633 27730 raft_consensus.cc:2468] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 2.
I20260709 12:16:12.207615 27475 catalog_manager.cc:5697] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 1 to 2, leader changed from 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131) to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 2 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:12.300626 27810 raft_consensus.cc:993] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f: : Instructing follower f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:12.301097 27810 raft_consensus.cc:1081] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Signalling peer f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:12.301774 27793 raft_consensus.cc:993] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f: : Instructing follower 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:12.302163 27793 raft_consensus.cc:1081] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Signalling peer 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:12.302878 27655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfa67047e29f44c2ab62251ad75fd4ad"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:33664
I20260709 12:16:12.303412 27655 raft_consensus.cc:493] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:12.303786 27655 raft_consensus.cc:3060] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.303905 27578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:32892
I20260709 12:16:12.304592 27578 raft_consensus.cc:493] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:12.304996 27578 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.310348 27655 raft_consensus.cc:515] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.311425 27578 raft_consensus.cc:515] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.312791 27655 leader_election.cc:290] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 2 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:12.313576 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa67047e29f44c2ab62251ad75fd4ad" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:12.313715 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa67047e29f44c2ab62251ad75fd4ad" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:12.314167 27579 raft_consensus.cc:3060] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.314283 27730 raft_consensus.cc:3055] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:12.314692 27730 raft_consensus.cc:740] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:12.315483 27730 consensus_queue.cc:260] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.316642 27730 raft_consensus.cc:3060] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.317236 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:12.318336 27655 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.318889 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:12.317878 27578 leader_election.cc:290] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 2 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:12.319442 27728 raft_consensus.cc:3055] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:12.319768 27728 raft_consensus.cc:740] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:12.320822 27579 raft_consensus.cc:2468] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 2.
I20260709 12:16:12.321250 27728 consensus_queue.cc:260] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.322232 27619 leader_election.cc:304] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:12.322417 27728 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:12.323122 27826 raft_consensus.cc:2804] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:12.323627 27826 raft_consensus.cc:697] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 2 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:12.324461 27826 consensus_queue.cc:237] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.328754 27728 raft_consensus.cc:2468] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 2.
I20260709 12:16:12.329975 27547 leader_election.cc:304] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: 
I20260709 12:16:12.330834 27833 raft_consensus.cc:2804] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:12.331261 27833 raft_consensus.cc:697] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:12.332106 27655 raft_consensus.cc:2468] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 2.
I20260709 12:16:12.332049 27833 consensus_queue.cc:237] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:12.333447 27730 raft_consensus.cc:2468] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 2.
I20260709 12:16:12.335084 27475 catalog_manager.cc:5697] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 1 to 2, leader changed from 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131) to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:12.340133 27478 catalog_manager.cc:5697] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 1 to 2, leader changed from 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131) to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 2 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:12.549690 27728 raft_consensus.cc:1275] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.551240 27833 consensus_queue.cc:1048] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.573089 27655 raft_consensus.cc:1275] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.573307 27728 raft_consensus.cc:1275] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.576254 27579 raft_consensus.cc:1275] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.577791 27833 consensus_queue.cc:1048] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:12.579026 27860 consensus_queue.cc:1048] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.579161 27826 consensus_queue.cc:1048] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.594161 27728 raft_consensus.cc:1275] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.595405 27655 raft_consensus.cc:1275] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.597994 27777 consensus_queue.cc:1048] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.600152 27823 consensus_queue.cc:1048] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.637238 27655 raft_consensus.cc:1275] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.638458 27793 consensus_queue.cc:1048] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.645875 27579 raft_consensus.cc:1275] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.647254 27793 consensus_queue.cc:1048] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.831790 27728 raft_consensus.cc:1275] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.833169 27860 consensus_queue.cc:1048] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.840822 27655 raft_consensus.cc:1275] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.842326 27833 consensus_queue.cc:1048] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.851514 27579 raft_consensus.cc:1275] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.852684 27780 consensus_queue.cc:1048] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:12.860741 27728 raft_consensus.cc:1275] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:12.862522 27826 consensus_queue.cc:1048] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:14.999239 27446 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:16:14.999944 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:15.017622 27579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
mode: GRACEFUL
new_leader_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:58268
I20260709 12:16:15.018138 27579 raft_consensus.cc:606] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Received request to transfer leadership to TS 45922e75a78548c5bcbf53773c10ae3f
I20260709 12:16:15.031054 27655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
mode: GRACEFUL
new_leader_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:40934
I20260709 12:16:15.031602 27655 raft_consensus.cc:606] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Received request to transfer leadership to TS 45922e75a78548c5bcbf53773c10ae3f
I20260709 12:16:15.032784 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:15.033185 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:15.079787 27867 raft_consensus.cc:993] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe: : Instructing follower 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:15.080214 27872 raft_consensus.cc:1081] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Signalling peer 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:15.082093 27728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:55644
I20260709 12:16:15.082527 27728 raft_consensus.cc:493] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:15.082785 27728 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:15.087137 27728 raft_consensus.cc:515] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:15.088724 27728 leader_election.cc:290] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 2 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457)
I20260709 12:16:15.089584 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:15.089882 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:15.090200 27655 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:15.090574 27579 raft_consensus.cc:3055] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:15.090886 27579 raft_consensus.cc:740] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:15.091713 27579 consensus_queue.cc:260] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:15.093034 27579 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:15.096395 27655 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 2.
I20260709 12:16:15.097676 27696 leader_election.cc:304] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:15.098358 27865 raft_consensus.cc:2804] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:15.098596 27579 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 2.
I20260709 12:16:15.099942 27865 raft_consensus.cc:697] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:15.100761 27865 consensus_queue.cc:237] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:15.108027 27478 catalog_manager.cc:5697] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 1 to 2, leader changed from 4a19474f5cad4b36a40382910514effe (127.26.205.129) to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 2 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:15.242934 27879 raft_consensus.cc:993] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474: : Instructing follower 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:15.243436 27866 raft_consensus.cc:1081] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Signalling peer 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:15.244958 27730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:55642
I20260709 12:16:15.245546 27730 raft_consensus.cc:493] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:15.245961 27730 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:15.251377 27730 raft_consensus.cc:515] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:15.253252 27730 leader_election.cc:290] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 2 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:15.253943 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:15.254283 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:15.254545 27579 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:15.254840 27655 raft_consensus.cc:3055] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:15.255105 27655 raft_consensus.cc:740] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:15.255807 27655 consensus_queue.cc:260] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:15.256723 27655 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:15.259202 27579 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 2.
I20260709 12:16:15.260277 27693 leader_election.cc:304] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: 
I20260709 12:16:15.261052 27865 raft_consensus.cc:2804] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:15.261401 27655 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 2.
I20260709 12:16:15.261475 27865 raft_consensus.cc:697] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:15.262327 27865 consensus_queue.cc:237] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:15.271373 27478 catalog_manager.cc:5697] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 1 to 2, leader changed from f4533687d71a404cbec92cf2ea02b474 (127.26.205.130) to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 2 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:15.575522 27579 raft_consensus.cc:1275] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:15.576709 27865 consensus_queue.cc:1048] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:15.585860 27655 raft_consensus.cc:1275] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:15.587262 27865 consensus_queue.cc:1048] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:15.748016 27579 raft_consensus.cc:1275] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:15.749338 27865 consensus_queue.cc:1048] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:15.757380 27655 raft_consensus.cc:1275] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:15.760016 27883 consensus_queue.cc:1048] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:16.034204 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:16.039544 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:16.039959 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:17.040844 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:17.045718 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:17.046133 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:18.047101 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:18.052321 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:18.052865 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:19.053977 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:19.058972 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:19.059377 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:20.060694 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:20.066074 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:20.066515 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:21.067417 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:21.072284 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:21.072691 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:22.073599 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:22.078289 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:22.078677 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:23.079504 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:23.084231 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:23.084686 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:24.085741 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:24.090580 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:24.091043 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:25.118059 27446 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:16:25.122730 27730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
mode: GRACEFUL
new_leader_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:55656
I20260709 12:16:25.123378 27730 raft_consensus.cc:606] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Received request to transfer leadership to TS f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:25.128253 27579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
mode: GRACEFUL
new_leader_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:32910
I20260709 12:16:25.128840 27579 raft_consensus.cc:606] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Received request to transfer leadership to TS f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:25.133782 27579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
mode: GRACEFUL
new_leader_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:32910
I20260709 12:16:25.134217 27579 raft_consensus.cc:606] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Received request to transfer leadership to TS f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:25.138352 27579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
mode: GRACEFUL
new_leader_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:32910
I20260709 12:16:25.138763 27579 raft_consensus.cc:606] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Received request to transfer leadership to TS f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:25.147717 27730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
mode: GRACEFUL
new_leader_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:55656
I20260709 12:16:25.148198 27730 raft_consensus.cc:606] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Received request to transfer leadership to TS f4533687d71a404cbec92cf2ea02b474
I20260709 12:16:25.185689 27898 raft_consensus.cc:993] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe: : Instructing follower f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.186199 27900 raft_consensus.cc:1081] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Signalling peer f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.187583 27655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:33672
I20260709 12:16:25.188067 27655 raft_consensus.cc:493] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.188408 27655 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.192963 27655 raft_consensus.cc:515] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.194453 27655 leader_election.cc:290] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:25.195420 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:25.195528 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:25.196058 27579 raft_consensus.cc:3055] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.196075 27730 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.196393 27579 raft_consensus.cc:740] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:25.197166 27579 consensus_queue.cc:260] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.198050 27579 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.200352 27730 raft_consensus.cc:2468] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.201479 27622 leader_election.cc:304] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:25.202270 27899 raft_consensus.cc:2804] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:25.202565 27579 raft_consensus.cc:2468] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.203357 27899 raft_consensus.cc:697] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:25.204293 27899 consensus_queue.cc:237] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.211040 27478 catalog_manager.cc:5697] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 2 to 3, leader changed from 4a19474f5cad4b36a40382910514effe (127.26.205.129) to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 3 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.259315 27893 raft_consensus.cc:993] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f: : Instructing follower f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.259735 27893 raft_consensus.cc:1081] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Signalling peer f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.261410 27655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:33664
I20260709 12:16:25.261932 27655 raft_consensus.cc:493] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.262221 27655 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.263609 27898 raft_consensus.cc:993] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe: : Instructing follower f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.264062 27900 raft_consensus.cc:1081] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Signalling peer f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.265657 27656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:33672
I20260709 12:16:25.266199 27656 raft_consensus.cc:493] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.266543 27656 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.268050 27655 raft_consensus.cc:515] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:25.270426 27655 leader_election.cc:290] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Requested vote from peers 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603), 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457)
I20260709 12:16:25.270741 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:25.270913 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:25.271278 27730 raft_consensus.cc:3055] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.271335 27579 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.271626 27730 raft_consensus.cc:740] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:25.272346 27730 consensus_queue.cc:260] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:25.272910 27656 raft_consensus.cc:515] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.273502 27730 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.275100 27656 leader_election.cc:290] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:25.275918 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:25.276481 27578 raft_consensus.cc:3055] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.276798 27578 raft_consensus.cc:740] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:25.276863 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ea27904946c43759c0171bf38dd59a8" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:25.277315 27728 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.277325 27579 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.277649 27578 consensus_queue.cc:260] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.278546 27619 leader_election.cc:304] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:25.278937 27578 raft_consensus.cc:3060] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.279400 27899 raft_consensus.cc:2804] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:25.279868 27899 raft_consensus.cc:697] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:25.280828 27899 consensus_queue.cc:237] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:25.282058 27728 raft_consensus.cc:2468] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.283175 27622 leader_election.cc:304] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:25.284165 27901 raft_consensus.cc:2804] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:25.285935 27578 raft_consensus.cc:2468] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.288475 27730 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.290714 27901 raft_consensus.cc:697] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:25.291442 27893 raft_consensus.cc:993] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f: : Instructing follower f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.291949 27893 raft_consensus.cc:1081] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Signalling peer f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.292258 27901 consensus_queue.cc:237] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.292965 27478 catalog_manager.cc:5697] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 2 to 3, leader changed from 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131) to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 3 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.293709 27656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:33664
I20260709 12:16:25.294257 27656 raft_consensus.cc:493] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.296279 27656 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.302392 27656 raft_consensus.cc:515] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.304054 27656 leader_election.cc:290] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:25.304754 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:25.305315 27578 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.306092 27478 catalog_manager.cc:5697] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 2 to 3, leader changed from 4a19474f5cad4b36a40382910514effe (127.26.205.129) to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 3 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.307971 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:25.308406 27730 raft_consensus.cc:3055] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.308751 27730 raft_consensus.cc:740] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:25.309432 27730 consensus_queue.cc:260] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.310556 27730 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.311183 27578 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.312474 27619 leader_election.cc:304] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a19474f5cad4b36a40382910514effe, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:25.313252 27901 raft_consensus.cc:2804] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:25.313758 27901 raft_consensus.cc:697] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:25.315644 27730 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.315548 27901 consensus_queue.cc:237] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.321798 27478 catalog_manager.cc:5697] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 2 to 3, leader changed from 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131) to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 3 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.591131 27898 raft_consensus.cc:993] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe: : Instructing follower f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.591630 27900 raft_consensus.cc:1081] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Signalling peer f4533687d71a404cbec92cf2ea02b474 to start an election
I20260709 12:16:25.592965 27656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
 from {username='slave'} at 127.0.0.1:33672
I20260709 12:16:25.593400 27656 raft_consensus.cc:493] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.593670 27656 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.597561 27656 raft_consensus.cc:515] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.598963 27656 leader_election.cc:290] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:25.599840 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:25.600001 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:25.600334 27578 raft_consensus.cc:3055] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:25.600543 27730 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.600699 27578 raft_consensus.cc:740] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:25.601486 27578 consensus_queue.cc:260] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.602404 27578 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:25.605020 27730 raft_consensus.cc:2468] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.606096 27622 leader_election.cc:304] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, f4533687d71a404cbec92cf2ea02b474; no voters: 
I20260709 12:16:25.606943 27901 raft_consensus.cc:2804] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:25.607345 27901 raft_consensus.cc:697] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Leader. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:25.607599 27578 raft_consensus.cc:2468] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4533687d71a404cbec92cf2ea02b474 in term 3.
I20260709 12:16:25.608124 27901 consensus_queue.cc:237] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:25.614384 27478 catalog_manager.cc:5697] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 reported cstate change: term changed from 2 to 3, leader changed from 4a19474f5cad4b36a40382910514effe (127.26.205.129) to f4533687d71a404cbec92cf2ea02b474 (127.26.205.130). New cstate: current_term: 3 leader_uuid: "f4533687d71a404cbec92cf2ea02b474" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.670992 27730 raft_consensus.cc:1275] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.672298 27901 consensus_queue.cc:1048] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.681835 27578 raft_consensus.cc:1275] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.683432 27901 consensus_queue.cc:1048] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.703451 27578 raft_consensus.cc:1275] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.704779 27909 consensus_queue.cc:1048] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.713390 27730 raft_consensus.cc:1275] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.715426 27909 consensus_queue.cc:1048] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.736846 27730 raft_consensus.cc:1275] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.737972 27909 consensus_queue.cc:1048] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.746140 27578 raft_consensus.cc:1275] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.747625 27901 consensus_queue.cc:1048] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.898620 27578 raft_consensus.cc:1275] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.899863 27901 consensus_queue.cc:1048] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:25.904241 27728 raft_consensus.cc:1275] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:25.905473 27901 consensus_queue.cc:1048] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:26.062165 27578 raft_consensus.cc:1275] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:26.063442 27901 consensus_queue.cc:1048] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:26.071902 27728 raft_consensus.cc:1275] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Refusing update from remote peer f4533687d71a404cbec92cf2ea02b474: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:26.073923 27909 consensus_queue.cc:1048] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:28.186141 27446 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:16:28.186930 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:28.196514 27656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
mode: GRACEFUL
new_leader_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:40934
I20260709 12:16:28.197196 27656 raft_consensus.cc:606] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Received request to transfer leadership to TS 4a19474f5cad4b36a40382910514effe
I20260709 12:16:28.199859 27656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
mode: GRACEFUL
new_leader_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:40934
I20260709 12:16:28.200340 27656 raft_consensus.cc:606] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Received request to transfer leadership to TS 4a19474f5cad4b36a40382910514effe
I20260709 12:16:28.202555 27656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
mode: GRACEFUL
new_leader_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:40934
I20260709 12:16:28.202986 27656 raft_consensus.cc:606] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Received request to transfer leadership to TS 45922e75a78548c5bcbf53773c10ae3f
I20260709 12:16:28.205227 27656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
mode: GRACEFUL
new_leader_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:40934
I20260709 12:16:28.205646 27656 raft_consensus.cc:606] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Received request to transfer leadership to TS 4a19474f5cad4b36a40382910514effe
I20260709 12:16:28.207669 27656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d"
dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
mode: GRACEFUL
new_leader_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:40934
I20260709 12:16:28.208087 27656 raft_consensus.cc:606] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Received request to transfer leadership to TS 45922e75a78548c5bcbf53773c10ae3f
I20260709 12:16:28.209091 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:28.209519 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:28.220899 27928 raft_consensus.cc:993] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474: : Instructing follower 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:28.221421 27909 raft_consensus.cc:1081] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Signalling peer 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:28.222820 27579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:32894
I20260709 12:16:28.223266 27579 raft_consensus.cc:493] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:28.223599 27579 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.228612 27579 raft_consensus.cc:515] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:28.230640 27579 leader_election.cc:290] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 4 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:28.231761 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:28.232205 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:28.232527 27656 raft_consensus.cc:3055] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:28.232788 27728 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.232862 27656 raft_consensus.cc:740] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:28.233737 27656 consensus_queue.cc:260] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:28.235131 27656 raft_consensus.cc:3060] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.239722 27728 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 4.
I20260709 12:16:28.241124 27547 leader_election.cc:304] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: 
I20260709 12:16:28.241575 27656 raft_consensus.cc:2468] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 4.
I20260709 12:16:28.242758 27929 raft_consensus.cc:2804] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:28.243814 27929 raft_consensus.cc:697] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 4 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:28.244879 27929 consensus_queue.cc:237] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:28.247262 27928 raft_consensus.cc:993] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474: : Instructing follower 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:28.247690 27928 raft_consensus.cc:1081] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Signalling peer 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:28.249691 27728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:55642
I20260709 12:16:28.250226 27728 raft_consensus.cc:493] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:28.250558 27728 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.253911 27909 raft_consensus.cc:993] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474: : Instructing follower 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:28.254355 27928 raft_consensus.cc:1081] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Signalling peer 45922e75a78548c5bcbf53773c10ae3f to start an election
I20260709 12:16:28.253726 27476 catalog_manager.cc:5697] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 3 to 4, leader changed from f4533687d71a404cbec92cf2ea02b474 (127.26.205.130) to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 4 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.256110 27730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d"
dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
 from {username='slave'} at 127.0.0.1:55642
I20260709 12:16:28.256701 27730 raft_consensus.cc:493] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:28.256618 27728 raft_consensus.cc:515] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.257170 27730 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.259188 27728 leader_election.cc:290] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 4 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:28.261059 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:28.261366 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8fb8d5ee99a403bb2eca86ddd2835a3" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:28.261785 27579 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.261912 27656 raft_consensus.cc:3055] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:28.262408 27656 raft_consensus.cc:740] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:28.263118 27656 consensus_queue.cc:260] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.264361 27656 raft_consensus.cc:3060] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.264308 27730 raft_consensus.cc:515] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.267506 27655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:28.268007 27655 raft_consensus.cc:3055] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:28.268266 27655 raft_consensus.cc:740] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:28.268936 27655 consensus_queue.cc:260] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.270071 27730 leader_election.cc:290] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 4 election: Requested vote from peers 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457), f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017)
I20260709 12:16:28.269973 27578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7d372a6eaf4663831702f4a770835d" candidate_uuid: "45922e75a78548c5bcbf53773c10ae3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4a19474f5cad4b36a40382910514effe"
I20260709 12:16:28.270613 27578 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.271199 27579 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 4.
I20260709 12:16:28.269992 27655 raft_consensus.cc:3060] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.272842 27693 leader_election.cc:304] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: 
I20260709 12:16:28.274052 27907 raft_consensus.cc:2804] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:28.278411 27578 raft_consensus.cc:2468] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 4.
I20260709 12:16:28.279791 27693 leader_election.cc:304] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: 
I20260709 12:16:28.280812 27655 raft_consensus.cc:2468] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 4.
I20260709 12:16:28.281076 27907 raft_consensus.cc:697] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 4 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:28.282410 27907 consensus_queue.cc:237] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.283088 27935 raft_consensus.cc:2804] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:28.283587 27656 raft_consensus.cc:2468] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45922e75a78548c5bcbf53773c10ae3f in term 4.
I20260709 12:16:28.284157 27935 raft_consensus.cc:697] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 4 LEADER]: Becoming Leader. State: Replica: 45922e75a78548c5bcbf53773c10ae3f, State: Running, Role: LEADER
I20260709 12:16:28.285881 27935 consensus_queue.cc:237] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.293361 27476 catalog_manager.cc:5697] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 3 to 4, leader changed from f4533687d71a404cbec92cf2ea02b474 (127.26.205.130) to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 4 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.303514 27476 catalog_manager.cc:5697] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f reported cstate change: term changed from 3 to 4, leader changed from f4533687d71a404cbec92cf2ea02b474 (127.26.205.130) to 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131). New cstate: current_term: 4 leader_uuid: "45922e75a78548c5bcbf53773c10ae3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.408068 27909 raft_consensus.cc:993] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474: : Instructing follower 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:28.408669 27928 raft_consensus.cc:1081] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Signalling peer 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:28.410164 27578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:32894
I20260709 12:16:28.410698 27578 raft_consensus.cc:493] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:28.411031 27578 raft_consensus.cc:3060] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:28.415314 27578 raft_consensus.cc:515] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.416787 27578 leader_election.cc:290] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 2 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:28.417531 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:28.417881 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9d878d627e453e988d2cb7f9e079d1" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:28.418009 27656 raft_consensus.cc:3055] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:28.418298 27656 raft_consensus.cc:740] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:28.418349 27728 raft_consensus.cc:3060] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:28.419055 27656 consensus_queue.cc:260] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.419894 27656 raft_consensus.cc:3060] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:28.422492 27728 raft_consensus.cc:2468] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 2.
I20260709 12:16:28.423362 27547 leader_election.cc:304] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: 
I20260709 12:16:28.424018 27929 raft_consensus.cc:2804] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:28.424400 27929 raft_consensus.cc:697] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:28.424412 27656 raft_consensus.cc:2468] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 2.
I20260709 12:16:28.425344 27929 consensus_queue.cc:237] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.432147 27476 catalog_manager.cc:5697] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 1 to 2, leader changed from f4533687d71a404cbec92cf2ea02b474 (127.26.205.130) to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 2 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.434191 27909 raft_consensus.cc:993] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474: : Instructing follower 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:28.434626 27928 raft_consensus.cc:1081] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Signalling peer 4a19474f5cad4b36a40382910514effe to start an election
I20260709 12:16:28.436033 27578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee"
dest_uuid: "4a19474f5cad4b36a40382910514effe"
 from {username='slave'} at 127.0.0.1:32894
I20260709 12:16:28.436544 27578 raft_consensus.cc:493] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:28.436913 27578 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.442139 27578 raft_consensus.cc:515] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.443502 27578 leader_election.cc:290] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 4 election: Requested vote from peers f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017), 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603)
I20260709 12:16:28.444352 27656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f4533687d71a404cbec92cf2ea02b474"
I20260709 12:16:28.444543 27728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b69e7f37f549328636d3d1cb3e61ee" candidate_uuid: "4a19474f5cad4b36a40382910514effe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "45922e75a78548c5bcbf53773c10ae3f"
I20260709 12:16:28.444895 27656 raft_consensus.cc:3055] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:28.444986 27728 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.445240 27656 raft_consensus.cc:740] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4533687d71a404cbec92cf2ea02b474, State: Running, Role: LEADER
I20260709 12:16:28.446034 27656 consensus_queue.cc:260] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.447118 27656 raft_consensus.cc:3060] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:28.450927 27728 raft_consensus.cc:2468] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 4.
I20260709 12:16:28.451908 27547 leader_election.cc:304] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe; no voters: 
I20260709 12:16:28.452661 27929 raft_consensus.cc:2804] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:28.452826 27656 raft_consensus.cc:2468] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a19474f5cad4b36a40382910514effe in term 4.
I20260709 12:16:28.453171 27929 raft_consensus.cc:697] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 4 LEADER]: Becoming Leader. State: Replica: 4a19474f5cad4b36a40382910514effe, State: Running, Role: LEADER
I20260709 12:16:28.453960 27929 consensus_queue.cc:237] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } }
I20260709 12:16:28.461051 27476 catalog_manager.cc:5697] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe reported cstate change: term changed from 3 to 4, leader changed from f4533687d71a404cbec92cf2ea02b474 (127.26.205.130) to 4a19474f5cad4b36a40382910514effe (127.26.205.129). New cstate: current_term: 4 leader_uuid: "4a19474f5cad4b36a40382910514effe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.653709 27656 raft_consensus.cc:1275] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:28.655019 27929 consensus_queue.cc:1048] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:28.665560 27728 raft_consensus.cc:1275] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:28.667356 27929 consensus_queue.cc:1048] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:28.707134 27656 raft_consensus.cc:1275] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:28.708340 27935 consensus_queue.cc:1048] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:28.716938 27578 raft_consensus.cc:1275] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:28.718539 27936 consensus_queue.cc:1048] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:28.822541 27656 raft_consensus.cc:1275] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:28.823709 27936 consensus_queue.cc:1048] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:28.832549 27578 raft_consensus.cc:1275] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Refusing update from remote peer 45922e75a78548c5bcbf53773c10ae3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:28.834442 27907 consensus_queue.cc:1048] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:28.922940 27728 raft_consensus.cc:1275] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:28.924183 27929 consensus_queue.cc:1048] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:28.933101 27656 raft_consensus.cc:1275] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:28.935067 27953 consensus_queue.cc:1048] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:29.028688 27656 raft_consensus.cc:1275] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:29.029784 27953 consensus_queue.cc:1048] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:29.038623 27728 raft_consensus.cc:1275] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Refusing update from remote peer 4a19474f5cad4b36a40382910514effe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:29.040488 27930 consensus_queue.cc:1048] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [LEADER]: Connected to new peer: Peer: permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:29.210768 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:29.217320 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:29.217796 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:30.218856 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:30.224181 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:30.224663 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:31.431917 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:31.460888 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:31.461575 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:31.838124 27964 raft_consensus.cc:493] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4a19474f5cad4b36a40382910514effe)
I20260709 12:16:31.838997 27964 raft_consensus.cc:515] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4533687d71a404cbec92cf2ea02b474" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 40017 } } peers { permanent_uuid: "45922e75a78548c5bcbf53773c10ae3f" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 43603 } } peers { permanent_uuid: "4a19474f5cad4b36a40382910514effe" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 42457 } }
I20260709 12:16:31.842538 27730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45922e75a78548c5bcbf53773c10ae3f" is_pre_election: true
I20260709 12:16:31.849017 27964 leader_election.cc:290] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45922e75a78548c5bcbf53773c10ae3f (127.26.205.131:43603), 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457)
I20260709 12:16:31.852325 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb4de7e16d64c0aae4be87b902c0605" candidate_uuid: "f4533687d71a404cbec92cf2ea02b474" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4a19474f5cad4b36a40382910514effe" is_pre_election: true
I20260709 12:16:31.854205 27619 leader_election.cc:304] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4533687d71a404cbec92cf2ea02b474; no voters: 45922e75a78548c5bcbf53773c10ae3f, 4a19474f5cad4b36a40382910514effe
I20260709 12:16:31.854763 27964 raft_consensus.cc:2749] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:16:31.877043 27602 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4060 after lost signal to thread 27449
W20260709 12:16:31.877837 27602 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4740 after lost signal to thread 27512
W20260709 12:16:31.878623 27602 debug-util.cc:398] Leaking SignalData structure 0x7b08001db9a0 after lost signal to thread 27605
W20260709 12:16:31.879277 27602 debug-util.cc:398] Leaking SignalData structure 0x7b080017c4e0 after lost signal to thread 27680
W20260709 12:16:31.879895 27602 debug-util.cc:398] Leaking SignalData structure 0x7b08001806e0 after lost signal to thread 27754
I20260709 12:16:32.462798 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:32.467819 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:32.468243 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:33.469406 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:33.474414 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:33.474876 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:34.475987 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:34.480908 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:34.481341 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:35.482357 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:35.487526 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:35.487951 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:36.488983 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:36.493741 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:36.494174 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:37.597308 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:37.606146 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:37.607607 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:38.517019 27509 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 27449
W20260709 12:16:38.517896 27509 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 27512
W20260709 12:16:38.518868 27509 debug-util.cc:398] Leaking SignalData structure 0x7b08001f59e0 after lost signal to thread 27605
W20260709 12:16:38.519888 27509 debug-util.cc:398] Leaking SignalData structure 0x7b0800137560 after lost signal to thread 27680
W20260709 12:16:38.520709 27509 debug-util.cc:398] Leaking SignalData structure 0x7b080017dbc0 after lost signal to thread 27754
I20260709 12:16:38.642212 27446 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:16:38.642951 27446 tablet_server.cc:179] TabletServer@127.26.205.129:0 shutting down...
I20260709 12:16:38.685963 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:38.686921 27446 tablet_replica.cc:333] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.688127 27446 raft_consensus.cc:2243] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:38.689543 27446 raft_consensus.cc:2272] T f9b69e7f37f549328636d3d1cb3e61ee P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.693002 27446 tablet_replica.cc:333] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.693845 27446 raft_consensus.cc:2243] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.694520 27446 raft_consensus.cc:2272] T 342929b3a6f2432d868eb277e347bc9c P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.697178 27446 tablet_replica.cc:333] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.697983 27446 raft_consensus.cc:2243] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.698567 27446 raft_consensus.cc:2272] T bfa67047e29f44c2ab62251ad75fd4ad P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.701074 27446 tablet_replica.cc:333] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.701606 27446 raft_consensus.cc:2243] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.702077 27446 raft_consensus.cc:2272] T fb7d372a6eaf4663831702f4a770835d P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.703895 27446 tablet_replica.cc:333] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.704491 27446 raft_consensus.cc:2243] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:38.705399 27446 raft_consensus.cc:2272] T 5a9d878d627e453e988d2cb7f9e079d1 P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.707258 27446 tablet_replica.cc:333] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.707746 27446 raft_consensus.cc:2243] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:38.708642 27446 raft_consensus.cc:2272] T 7cb4de7e16d64c0aae4be87b902c0605 P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.710484 27446 tablet_replica.cc:333] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.710969 27446 raft_consensus.cc:2243] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.711467 27446 raft_consensus.cc:2272] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 4a19474f5cad4b36a40382910514effe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.713260 27446 tablet_replica.cc:333] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.713696 27446 raft_consensus.cc:2243] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.714203 27446 raft_consensus.cc:2272] T 4263ef0eadc1423cbf619a9ace114fae P 4a19474f5cad4b36a40382910514effe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.715903 27446 tablet_replica.cc:333] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe: stopping tablet replica
I20260709 12:16:38.716351 27446 raft_consensus.cc:2243] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.716866 27446 raft_consensus.cc:2272] T 1ea27904946c43759c0171bf38dd59a8 P 4a19474f5cad4b36a40382910514effe [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:38.851953 27619 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.205.129:42457: connect: Connection refused (error 111)
W20260709 12:16:38.857023 27619 consensus_peers.cc:597] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 -> Peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Couldn't send request to peer 4a19474f5cad4b36a40382910514effe. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:42457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:38.876499 27693 consensus_peers.cc:597] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f -> Peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Couldn't send request to peer 4a19474f5cad4b36a40382910514effe. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:42457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:38.880173 27446 tablet_server.cc:196] TabletServer@127.26.205.129:0 shutdown complete.
I20260709 12:16:38.901800 27446 tablet_server.cc:179] TabletServer@127.26.205.130:0 shutting down...
W20260709 12:16:38.913429 27619 consensus_peers.cc:597] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 -> Peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Couldn't send request to peer 4a19474f5cad4b36a40382910514effe. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:42457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:38.941623 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:38.942520 27446 tablet_replica.cc:333] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.943486 27446 raft_consensus.cc:2243] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:38.944654 27446 raft_consensus.cc:2272] T 342929b3a6f2432d868eb277e347bc9c P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.947093 27446 tablet_replica.cc:333] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.947695 27446 raft_consensus.cc:2243] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:38.948711 27446 raft_consensus.cc:2272] T 1ea27904946c43759c0171bf38dd59a8 P f4533687d71a404cbec92cf2ea02b474 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:38.950443 27693 consensus_peers.cc:597] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f -> Peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Couldn't send request to peer 4a19474f5cad4b36a40382910514effe. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:42457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:38.950968 27446 tablet_replica.cc:333] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.951521 27446 raft_consensus.cc:2243] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.951967 27446 raft_consensus.cc:2272] T f9b69e7f37f549328636d3d1cb3e61ee P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.953722 27446 tablet_replica.cc:333] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.954303 27446 raft_consensus.cc:2243] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.954762 27446 raft_consensus.cc:2272] T 7cb4de7e16d64c0aae4be87b902c0605 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.956526 27446 tablet_replica.cc:333] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.957015 27446 raft_consensus.cc:2243] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.957473 27446 raft_consensus.cc:2272] T d8fb8d5ee99a403bb2eca86ddd2835a3 P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.959165 27446 tablet_replica.cc:333] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.959621 27446 raft_consensus.cc:2243] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:38.960347 27446 raft_consensus.cc:2272] T bfa67047e29f44c2ab62251ad75fd4ad P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.962028 27446 tablet_replica.cc:333] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.962529 27446 raft_consensus.cc:2243] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.962954 27446 raft_consensus.cc:2272] T 5a9d878d627e453e988d2cb7f9e079d1 P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.964675 27446 tablet_replica.cc:333] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.965126 27446 raft_consensus.cc:2243] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.965540 27446 raft_consensus.cc:2272] T fb7d372a6eaf4663831702f4a770835d P f4533687d71a404cbec92cf2ea02b474 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:38.967294 27446 tablet_replica.cc:333] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474: stopping tablet replica
I20260709 12:16:38.967733 27446 raft_consensus.cc:2243] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:38.968165 27446 raft_consensus.cc:2272] T 4263ef0eadc1423cbf619a9ace114fae P f4533687d71a404cbec92cf2ea02b474 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:38.978204 27696 consensus_peers.cc:597] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f -> Peer f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017): Couldn't send request to peer f4533687d71a404cbec92cf2ea02b474. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:39.000330 27446 tablet_server.cc:196] TabletServer@127.26.205.130:0 shutdown complete.
W20260709 12:16:39.010923 27693 consensus_peers.cc:597] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f -> Peer 4a19474f5cad4b36a40382910514effe (127.26.205.129:42457): Couldn't send request to peer 4a19474f5cad4b36a40382910514effe. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:42457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:39.023106 27446 tablet_server.cc:179] TabletServer@127.26.205.131:0 shutting down...
W20260709 12:16:39.057638 27696 consensus_peers.cc:597] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f -> Peer f4533687d71a404cbec92cf2ea02b474 (127.26.205.130:40017): Couldn't send request to peer f4533687d71a404cbec92cf2ea02b474. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:40017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:39.063879 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:39.064716 27446 tablet_replica.cc:333] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.065738 27446 raft_consensus.cc:2243] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:39.066718 27446 raft_consensus.cc:2272] T 4263ef0eadc1423cbf619a9ace114fae P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.069181 27446 tablet_replica.cc:333] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.069729 27446 raft_consensus.cc:2243] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:39.070606 27446 raft_consensus.cc:2272] T d8fb8d5ee99a403bb2eca86ddd2835a3 P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.072551 27446 tablet_replica.cc:333] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.073076 27446 raft_consensus.cc:2243] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.073518 27446 raft_consensus.cc:2272] T 7cb4de7e16d64c0aae4be87b902c0605 P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.075387 27446 tablet_replica.cc:333] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.075878 27446 raft_consensus.cc:2243] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.076313 27446 raft_consensus.cc:2272] T 1ea27904946c43759c0171bf38dd59a8 P 45922e75a78548c5bcbf53773c10ae3f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.078133 27446 tablet_replica.cc:333] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.078639 27446 raft_consensus.cc:2243] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.079107 27446 raft_consensus.cc:2272] T bfa67047e29f44c2ab62251ad75fd4ad P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.080969 27446 tablet_replica.cc:333] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.081447 27446 raft_consensus.cc:2243] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.081923 27446 raft_consensus.cc:2272] T f9b69e7f37f549328636d3d1cb3e61ee P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.083783 27446 tablet_replica.cc:333] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.084285 27446 raft_consensus.cc:2243] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.084725 27446 raft_consensus.cc:2272] T 342929b3a6f2432d868eb277e347bc9c P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.086436 27446 tablet_replica.cc:333] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.086918 27446 raft_consensus.cc:2243] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.087370 27446 raft_consensus.cc:2272] T 5a9d878d627e453e988d2cb7f9e079d1 P 45922e75a78548c5bcbf53773c10ae3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.089035 27446 tablet_replica.cc:333] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f: stopping tablet replica
I20260709 12:16:39.089479 27446 raft_consensus.cc:2243] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:39.090291 27446 raft_consensus.cc:2272] T fb7d372a6eaf4663831702f4a770835d P 45922e75a78548c5bcbf53773c10ae3f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.118970 27446 tablet_server.cc:196] TabletServer@127.26.205.131:0 shutdown complete.
I20260709 12:16:39.148083 27446 master.cc:562] Master@127.26.205.190:44963 shutting down...
I20260709 12:16:39.362862 27446 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:39.363749 27446 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.364204 27446 tablet_replica.cc:333] T 00000000000000000000000000000000 P 942380d7ac4444088a00840f14cb1e9b: stopping tablet replica
W20260709 12:16:40.382480 27446 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27509)
I20260709 12:16:40.775179 27446 master.cc:584] Master@127.26.205.190:44963 shutdown complete.
45922e75a78548c5bcbf53773c10ae3f  1
4a19474f5cad4b36a40382910514effe  4
f4533687d71a404cbec92cf2ea02b474  4
45922e75a78548c5bcbf53773c10ae3f  3
4a19474f5cad4b36a40382910514effe  3
f4533687d71a404cbec92cf2ea02b474  3
45922e75a78548c5bcbf53773c10ae3f  1
4a19474f5cad4b36a40382910514effe  0
f4533687d71a404cbec92cf2ea02b474  8
45922e75a78548c5bcbf53773c10ae3f  3
4a19474f5cad4b36a40382910514effe  3
f4533687d71a404cbec92cf2ea02b474  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32755 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:16:40.816493 27446 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.205.190:37159
I20260709 12:16:40.817618 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:40.822865 27977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:40.823549 27978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:40.824889 27446 server_base.cc:1061] running on GCE node
W20260709 12:16:40.825232 27980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:40.826157 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:40.826337 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:40.826537 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599400826501 us; error 0 us; skew 500 ppm
I20260709 12:16:40.827064 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:40.829471 27446 webserver.cc:533] Webserver started at http://127.26.205.190:41771/ using document root <none> and password file <none>
I20260709 12:16:40.829974 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:40.830170 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:40.830458 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:40.831600 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/master-0-root/instance:
uuid: "e8b9777a4fc645e183e793ba360e5a60"
format_stamp: "Formatted at 2026-07-09 12:16:40 on dist-test-slave-673s"
I20260709 12:16:40.836290 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:40.839519 27985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:40.840427 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:40.840776 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/master-0-root
uuid: "e8b9777a4fc645e183e793ba360e5a60"
format_stamp: "Formatted at 2026-07-09 12:16:40 on dist-test-slave-673s"
I20260709 12:16:40.841048 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:40.862854 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:40.864127 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:40.903273 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.190:37159
I20260709 12:16:40.903357 28036 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.190:37159 every 8 connection(s)
I20260709 12:16:40.907495 28037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:40.916836 28037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60: Bootstrap starting.
I20260709 12:16:40.921491 28037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:40.925602 28037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60: No bootstrap required, opened a new log
I20260709 12:16:40.927718 28037 raft_consensus.cc:359] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b9777a4fc645e183e793ba360e5a60" member_type: VOTER }
I20260709 12:16:40.928143 28037 raft_consensus.cc:385] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:40.928320 28037 raft_consensus.cc:740] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b9777a4fc645e183e793ba360e5a60, State: Initialized, Role: FOLLOWER
I20260709 12:16:40.928807 28037 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b9777a4fc645e183e793ba360e5a60" member_type: VOTER }
I20260709 12:16:40.929230 28037 raft_consensus.cc:399] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:40.929414 28037 raft_consensus.cc:493] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:40.929617 28037 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:40.933475 28037 raft_consensus.cc:515] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b9777a4fc645e183e793ba360e5a60" member_type: VOTER }
I20260709 12:16:40.934036 28037 leader_election.cc:304] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8b9777a4fc645e183e793ba360e5a60; no voters: 
I20260709 12:16:40.935199 28037 leader_election.cc:290] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:40.935598 28040 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:40.936942 28040 raft_consensus.cc:697] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 1 LEADER]: Becoming Leader. State: Replica: e8b9777a4fc645e183e793ba360e5a60, State: Running, Role: LEADER
I20260709 12:16:40.937701 28040 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b9777a4fc645e183e793ba360e5a60" member_type: VOTER }
I20260709 12:16:40.938108 28037 sys_catalog.cc:565] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:40.943804 28042 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8b9777a4fc645e183e793ba360e5a60. Latest consensus state: current_term: 1 leader_uuid: "e8b9777a4fc645e183e793ba360e5a60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b9777a4fc645e183e793ba360e5a60" member_type: VOTER } }
I20260709 12:16:40.944619 28042 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:40.944836 28041 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8b9777a4fc645e183e793ba360e5a60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b9777a4fc645e183e793ba360e5a60" member_type: VOTER } }
I20260709 12:16:40.945467 28041 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:40.946982 28050 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:40.954841 28050 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:40.955853 27446 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:40.963615 28050 catalog_manager.cc:1383] Generated new cluster ID: 112b9f4ac11f4e2cab1088cb90f86b85
I20260709 12:16:40.963929 28050 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:40.984737 28050 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:40.986060 28050 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:41.001935 28050 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60: Generated new TSK 0
I20260709 12:16:41.002578 28050 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:41.022159 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:41.027926 28058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:41.029186 28059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:41.030747 28061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:41.030961 27446 server_base.cc:1061] running on GCE node
I20260709 12:16:41.031909 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:41.032083 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:41.032202 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599401032191 us; error 0 us; skew 500 ppm
I20260709 12:16:41.032738 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:41.034907 27446 webserver.cc:533] Webserver started at http://127.26.205.129:34311/ using document root <none> and password file <none>
I20260709 12:16:41.035341 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:41.035490 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:41.035696 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:41.036777 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-0-root/instance:
uuid: "7a058a1d383a4fee948a23754ace4763"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-673s"
I20260709 12:16:41.041391 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:41.045060 28066 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.045843 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:16:41.046104 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "7a058a1d383a4fee948a23754ace4763"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-673s"
I20260709 12:16:41.046340 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:41.061822 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:41.063028 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:41.064551 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:41.066815 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:41.066990 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.067173 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:41.067308 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.107435 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:32981
I20260709 12:16:41.107543 28128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:32981 every 8 connection(s)
I20260709 12:16:41.112661 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:41.119864 28133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:41.122282 28134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:41.124539 28136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:41.125231 28129 heartbeater.cc:344] Connected to a master server at 127.26.205.190:37159
I20260709 12:16:41.125617 28129 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:41.125679 27446 server_base.cc:1061] running on GCE node
I20260709 12:16:41.126771 28129 heartbeater.cc:507] Master 127.26.205.190:37159 requested a full tablet report, sending...
I20260709 12:16:41.127708 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:41.128034 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:41.128250 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599401128227 us; error 0 us; skew 500 ppm
I20260709 12:16:41.128988 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:41.129442 28002 ts_manager.cc:194] Registered new tserver with Master: 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981)
I20260709 12:16:41.131613 28002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44522
I20260709 12:16:41.131739 27446 webserver.cc:533] Webserver started at http://127.26.205.130:32943/ using document root <none> and password file <none>
I20260709 12:16:41.132380 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:41.132665 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:41.133038 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:41.134262 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-1-root/instance:
uuid: "fbe91368743940ec90e27e75812f3467"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-673s"
I20260709 12:16:41.139467 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:16:41.143119 28141 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.143960 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:41.144296 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-1-root
uuid: "fbe91368743940ec90e27e75812f3467"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-673s"
I20260709 12:16:41.144651 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:41.166539 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:41.167810 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:41.169411 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:41.171607 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:41.171857 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.172108 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:41.172283 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.213100 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.130:34725
I20260709 12:16:41.213246 28203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.130:34725 every 8 connection(s)
I20260709 12:16:41.217864 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:41.224938 28207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:41.228184 28208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:41.228946 28210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:41.230141 27446 server_base.cc:1061] running on GCE node
I20260709 12:16:41.231014 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:16:41.231186 28204 heartbeater.cc:344] Connected to a master server at 127.26.205.190:37159
W20260709 12:16:41.231281 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:41.231707 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599401231689 us; error 0 us; skew 500 ppm
I20260709 12:16:41.231726 28204 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:41.232336 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:41.232689 28204 heartbeater.cc:507] Master 127.26.205.190:37159 requested a full tablet report, sending...
I20260709 12:16:41.234941 28002 ts_manager.cc:194] Registered new tserver with Master: fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:41.235155 27446 webserver.cc:533] Webserver started at http://127.26.205.131:40475/ using document root <none> and password file <none>
I20260709 12:16:41.235745 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:41.235973 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:41.236248 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:41.236552 28002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44534
I20260709 12:16:41.237548 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-2-root/instance:
uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-673s"
I20260709 12:16:41.242180 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:41.245432 28215 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.246179 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:41.246543 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-2-root
uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
format_stamp: "Formatted at 2026-07-09 12:16:41 on dist-test-slave-673s"
I20260709 12:16:41.246850 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599367894863-27446-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:41.258806 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:41.259959 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:41.261413 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:41.263556 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:41.263787 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.264058 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:41.264222 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:41.303066 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.131:34137
I20260709 12:16:41.303160 28277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.131:34137 every 8 connection(s)
I20260709 12:16:41.316802 28278 heartbeater.cc:344] Connected to a master server at 127.26.205.190:37159
I20260709 12:16:41.317231 28278 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:41.317965 28278 heartbeater.cc:507] Master 127.26.205.190:37159 requested a full tablet report, sending...
I20260709 12:16:41.319733 28002 ts_manager.cc:194] Registered new tserver with Master: 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:41.320411 27446 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014179284s
I20260709 12:16:41.321103 28002 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44538
I20260709 12:16:41.345153 28002 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44548:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:41.348177 28002 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:41.419598 28169 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc4f967fa9d405394ac987c5d90dc0b (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:41.424998 28169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc4f967fa9d405394ac987c5d90dc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.426334 28166 tablet_service.cc:1511] Processing CreateTablet for tablet cba48d5e24d44a289e12e84b2097f5ed (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:41.428102 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba48d5e24d44a289e12e84b2097f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.429581 28168 tablet_service.cc:1511] Processing CreateTablet for tablet aa71ebca0d68412ab918dbb516df24f7 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:41.431856 28168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa71ebca0d68412ab918dbb516df24f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.431630 28165 tablet_service.cc:1511] Processing CreateTablet for tablet fd233c6983c24f9e8f0b52176ec5ebd7 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:41.433346 28165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd233c6983c24f9e8f0b52176ec5ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.437378 28164 tablet_service.cc:1511] Processing CreateTablet for tablet 1d50c911a9214da989dd5b292db345dd (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:41.438651 28164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d50c911a9214da989dd5b292db345dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.443528 28163 tablet_service.cc:1511] Processing CreateTablet for tablet 979f76764bb84402bd1402e024f6f984 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:41.429381 28167 tablet_service.cc:1511] Processing CreateTablet for tablet 21198db841d041a1bce8c1ca7149f59d (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:41.448987 28162 tablet_service.cc:1511] Processing CreateTablet for tablet a8decf9a9fc745a4be553c258e10de13 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:41.447446 28163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979f76764bb84402bd1402e024f6f984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.450438 28162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8decf9a9fc745a4be553c258e10de13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.453141 28167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21198db841d041a1bce8c1ca7149f59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.473562 28243 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc4f967fa9d405394ac987c5d90dc0b (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:41.474926 28243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc4f967fa9d405394ac987c5d90dc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.478053 28241 tablet_service.cc:1511] Processing CreateTablet for tablet 21198db841d041a1bce8c1ca7149f59d (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:41.479435 28241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21198db841d041a1bce8c1ca7149f59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.479102 28242 tablet_service.cc:1511] Processing CreateTablet for tablet aa71ebca0d68412ab918dbb516df24f7 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:41.480379 28242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa71ebca0d68412ab918dbb516df24f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.481572 28237 tablet_service.cc:1511] Processing CreateTablet for tablet 979f76764bb84402bd1402e024f6f984 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:41.482841 28237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979f76764bb84402bd1402e024f6f984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.482559 28236 tablet_service.cc:1511] Processing CreateTablet for tablet a8decf9a9fc745a4be553c258e10de13 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:41.484315 28236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8decf9a9fc745a4be553c258e10de13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.485530 28238 tablet_service.cc:1511] Processing CreateTablet for tablet 1d50c911a9214da989dd5b292db345dd (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:41.486792 28238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d50c911a9214da989dd5b292db345dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.490482 28240 tablet_service.cc:1511] Processing CreateTablet for tablet cba48d5e24d44a289e12e84b2097f5ed (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:41.491775 28240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba48d5e24d44a289e12e84b2097f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.491688 28235 tablet_service.cc:1511] Processing CreateTablet for tablet e39d8a9e9a604d1faeb92749c0633d4a (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:41.493527 28235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d8a9e9a604d1faeb92749c0633d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.493559 28239 tablet_service.cc:1511] Processing CreateTablet for tablet fd233c6983c24f9e8f0b52176ec5ebd7 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:41.495334 28239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd233c6983c24f9e8f0b52176ec5ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.500279 28161 tablet_service.cc:1511] Processing CreateTablet for tablet 63643c6598614810a9d146b6094f66ca (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:41.501636 28161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63643c6598614810a9d146b6094f66ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.502568 28234 tablet_service.cc:1511] Processing CreateTablet for tablet 63643c6598614810a9d146b6094f66ca (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:41.504273 28234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63643c6598614810a9d146b6094f66ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.523280 28292 tablet_bootstrap.cc:492] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:41.525640 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc4f967fa9d405394ac987c5d90dc0b (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:41.527070 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc4f967fa9d405394ac987c5d90dc0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.528879 28085 tablet_service.cc:1511] Processing CreateTablet for tablet 63643c6598614810a9d146b6094f66ca (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:41.530174 28085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63643c6598614810a9d146b6094f66ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.533354 28166 tablet_service.cc:1511] Processing CreateTablet for tablet e39d8a9e9a604d1faeb92749c0633d4a (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:41.533548 28093 tablet_service.cc:1511] Processing CreateTablet for tablet aa71ebca0d68412ab918dbb516df24f7 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:41.534632 28166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d8a9e9a604d1faeb92749c0633d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.535816 28092 tablet_service.cc:1511] Processing CreateTablet for tablet 21198db841d041a1bce8c1ca7149f59d (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:41.537994 28091 tablet_service.cc:1511] Processing CreateTablet for tablet cba48d5e24d44a289e12e84b2097f5ed (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:41.540225 28090 tablet_service.cc:1511] Processing CreateTablet for tablet fd233c6983c24f9e8f0b52176ec5ebd7 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:41.542366 28089 tablet_service.cc:1511] Processing CreateTablet for tablet 1d50c911a9214da989dd5b292db345dd (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:41.534649 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa71ebca0d68412ab918dbb516df24f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.546007 28086 tablet_service.cc:1511] Processing CreateTablet for tablet e39d8a9e9a604d1faeb92749c0633d4a (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:41.546425 28087 tablet_service.cc:1511] Processing CreateTablet for tablet a8decf9a9fc745a4be553c258e10de13 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:41.549566 28088 tablet_service.cc:1511] Processing CreateTablet for tablet 979f76764bb84402bd1402e024f6f984 (DEFAULT_TABLE table=test-workload [id=ab70f265f13c4e7097b0ef1ceede2163]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:41.550283 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21198db841d041a1bce8c1ca7149f59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.550891 28087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8decf9a9fc745a4be553c258e10de13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.551477 28089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d50c911a9214da989dd5b292db345dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.552224 28086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d8a9e9a604d1faeb92749c0633d4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.556768 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd233c6983c24f9e8f0b52176ec5ebd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.557749 28088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 979f76764bb84402bd1402e024f6f984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.558359 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cba48d5e24d44a289e12e84b2097f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.590260 28292 tablet_bootstrap.cc:654] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.663640 28294 tablet_bootstrap.cc:492] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:41.667346 28293 tablet_bootstrap.cc:492] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:41.675755 28294 tablet_bootstrap.cc:654] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.678009 28292 tablet_bootstrap.cc:492] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:41.680094 28292 ts_tablet_manager.cc:1403] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.157s	user 0.005s	sys 0.012s
I20260709 12:16:41.680181 28294 tablet_bootstrap.cc:492] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:41.679345 28293 tablet_bootstrap.cc:654] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.680687 28294 ts_tablet_manager.cc:1403] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 12:16:41.683149 28292 raft_consensus.cc:359] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.683152 28294 raft_consensus.cc:359] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.683892 28292 raft_consensus.cc:385] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.684149 28294 raft_consensus.cc:385] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.684252 28292 raft_consensus.cc:740] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.684571 28294 raft_consensus.cc:740] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.685231 28292 consensus_queue.cc:260] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.685433 28294 consensus_queue.cc:260] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.687165 28204 heartbeater.cc:499] Master 127.26.205.190:37159 was elected leader, sending a full tablet report...
I20260709 12:16:41.687655 28293 tablet_bootstrap.cc:492] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:41.688298 28293 ts_tablet_manager.cc:1403] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 12:16:41.689754 28292 ts_tablet_manager.cc:1434] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:41.690685 28292 tablet_bootstrap.cc:492] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:41.692276 28293 raft_consensus.cc:359] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.693176 28293 raft_consensus.cc:385] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.693553 28293 raft_consensus.cc:740] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.693727 28129 heartbeater.cc:499] Master 127.26.205.190:37159 was elected leader, sending a full tablet report...
I20260709 12:16:41.694761 28294 ts_tablet_manager.cc:1434] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:16:41.694397 28293 consensus_queue.cc:260] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.695837 28294 tablet_bootstrap.cc:492] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:41.704308 28294 tablet_bootstrap.cc:654] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.707360 28292 tablet_bootstrap.cc:654] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.711233 28294 tablet_bootstrap.cc:492] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:41.711843 28294 ts_tablet_manager.cc:1403] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:16:41.715484 28294 raft_consensus.cc:359] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.716468 28294 raft_consensus.cc:385] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.716856 28294 raft_consensus.cc:740] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
W20260709 12:16:41.717274 28205 tablet.cc:2406] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:41.717732 28294 consensus_queue.cc:260] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.720741 28294 ts_tablet_manager.cc:1434] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 12:16:41.721930 28294 tablet_bootstrap.cc:492] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:41.725500 28278 heartbeater.cc:499] Master 127.26.205.190:37159 was elected leader, sending a full tablet report...
I20260709 12:16:41.725708 28293 ts_tablet_manager.cc:1434] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.037s	user 0.023s	sys 0.011s
I20260709 12:16:41.726887 28293 tablet_bootstrap.cc:492] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:41.728928 28294 tablet_bootstrap.cc:654] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.733850 28293 tablet_bootstrap.cc:654] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.741030 28294 tablet_bootstrap.cc:492] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:41.741632 28294 ts_tablet_manager.cc:1403] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:16:41.741683 28292 tablet_bootstrap.cc:492] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:41.742632 28292 ts_tablet_manager.cc:1403] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.016s
I20260709 12:16:41.745735 28294 raft_consensus.cc:359] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.745800 28292 raft_consensus.cc:359] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.746872 28294 raft_consensus.cc:385] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.747078 28292 raft_consensus.cc:385] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.747519 28292 raft_consensus.cc:740] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.747315 28294 raft_consensus.cc:740] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.748620 28292 consensus_queue.cc:260] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.749085 28294 consensus_queue.cc:260] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.750808 28292 ts_tablet_manager.cc:1434] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:41.751163 28294 ts_tablet_manager.cc:1434] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:16:41.751813 28292 tablet_bootstrap.cc:492] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:41.752112 28294 tablet_bootstrap.cc:492] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:41.758507 28293 tablet_bootstrap.cc:492] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:41.758984 28293 ts_tablet_manager.cc:1403] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.008s
I20260709 12:16:41.761231 28292 tablet_bootstrap.cc:654] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.761838 28293 raft_consensus.cc:359] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.762575 28293 raft_consensus.cc:385] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.762884 28293 raft_consensus.cc:740] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.763598 28293 consensus_queue.cc:260] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.765725 28293 ts_tablet_manager.cc:1434] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:41.766652 28293 tablet_bootstrap.cc:492] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:41.770857 28294 tablet_bootstrap.cc:654] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.774544 28292 tablet_bootstrap.cc:492] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:41.775099 28292 ts_tablet_manager.cc:1403] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 12:16:41.777071 28293 tablet_bootstrap.cc:654] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.778211 28292 raft_consensus.cc:359] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.779045 28292 raft_consensus.cc:385] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.779397 28292 raft_consensus.cc:740] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.780553 28292 consensus_queue.cc:260] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.782987 28292 ts_tablet_manager.cc:1434] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:16:41.783907 28292 tablet_bootstrap.cc:492] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:41.784518 28293 tablet_bootstrap.cc:492] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:41.784958 28293 ts_tablet_manager.cc:1403] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.008s
I20260709 12:16:41.785066 28294 tablet_bootstrap.cc:492] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:41.785558 28294 ts_tablet_manager.cc:1403] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.007s
I20260709 12:16:41.787796 28293 raft_consensus.cc:359] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.788560 28293 raft_consensus.cc:385] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.788293 28294 raft_consensus.cc:359] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.788873 28293 raft_consensus.cc:740] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.790427 28294 raft_consensus.cc:385] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.790335 28292 tablet_bootstrap.cc:654] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.790879 28294 raft_consensus.cc:740] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.791122 28293 consensus_queue.cc:260] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.791739 28294 consensus_queue.cc:260] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.793413 28293 ts_tablet_manager.cc:1434] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:16:41.794390 28293 tablet_bootstrap.cc:492] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:41.800269 28294 ts_tablet_manager.cc:1434] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:16:41.801312 28294 tablet_bootstrap.cc:492] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:41.802011 28293 tablet_bootstrap.cc:654] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.809012 28294 tablet_bootstrap.cc:654] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.815655 28293 tablet_bootstrap.cc:492] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:41.816316 28293 ts_tablet_manager.cc:1403] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:16:41.818192 28292 tablet_bootstrap.cc:492] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:41.818611 28292 ts_tablet_manager.cc:1403] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.014s
I20260709 12:16:41.818846 28294 tablet_bootstrap.cc:492] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:41.819301 28294 ts_tablet_manager.cc:1403] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 12:16:41.819243 28293 raft_consensus.cc:359] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:41.820071 28293 raft_consensus.cc:385] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.820381 28293 raft_consensus.cc:740] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.821045 28292 raft_consensus.cc:359] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.821365 28300 raft_consensus.cc:493] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.821136 28293 consensus_queue.cc:260] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:41.821704 28292 raft_consensus.cc:385] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.822088 28292 raft_consensus.cc:740] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.821839 28300 raft_consensus.cc:515] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.822775 28292 consensus_queue.cc:260] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.835799 28300 leader_election.cc:290] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:41.836987 28292 ts_tablet_manager.cc:1434] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:16:41.839682 28300 raft_consensus.cc:493] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.840303 28300 raft_consensus.cc:515] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.845335 28300 leader_election.cc:290] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:41.847272 28292 tablet_bootstrap.cc:492] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:41.855715 28292 tablet_bootstrap.cc:654] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.855443 28294 raft_consensus.cc:359] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.864490 28298 raft_consensus.cc:493] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.865002 28298 raft_consensus.cc:515] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.867164 28294 raft_consensus.cc:385] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.867508 28294 raft_consensus.cc:740] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.867595 28298 leader_election.cc:290] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:41.868371 28294 consensus_queue.cc:260] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.875221 28294 ts_tablet_manager.cc:1434] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:16:41.897331 28294 tablet_bootstrap.cc:492] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:41.907260 28294 tablet_bootstrap.cc:654] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.914289 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:41.913282 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:41.915010 28103 raft_consensus.cc:2468] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 0.
W20260709 12:16:41.916508 28219 leader_election.cc:343] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:41.917184 28219 leader_election.cc:304] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:41.918992 28311 raft_consensus.cc:2804] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:41.919368 28311 raft_consensus.cc:493] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.919694 28311 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:41.926172 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:41.926816 28103 raft_consensus.cc:2468] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 0.
I20260709 12:16:41.929450 28293 ts_tablet_manager.cc:1434] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.113s	user 0.028s	sys 0.019s
I20260709 12:16:41.930640 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:41.931299 28179 raft_consensus.cc:2468] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 0.
I20260709 12:16:41.932189 28293 tablet_bootstrap.cc:492] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:41.937464 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:41.938786 28293 tablet_bootstrap.cc:654] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.938828 28218 leader_election.cc:304] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:41.940281 28312 raft_consensus.cc:2804] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:41.940713 28312 raft_consensus.cc:493] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.941078 28312 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:41.945007 28218 leader_election.cc:343] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:41.946415 28145 leader_election.cc:304] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:41.947268 28298 raft_consensus.cc:2804] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:41.947610 28298 raft_consensus.cc:493] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:41.947964 28298 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:41.948777 28049 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:41.950738 28312 raft_consensus.cc:515] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.952661 28294 tablet_bootstrap.cc:492] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:41.953142 28294 ts_tablet_manager.cc:1403] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.021s
I20260709 12:16:41.953652 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763"
W20260709 12:16:41.955693 28219 leader_election.cc:343] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:41.956111 28294 raft_consensus.cc:359] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.956849 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" is_pre_election: true
I20260709 12:16:41.957041 28298 raft_consensus.cc:515] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.957401 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:41.956806 28312 leader_election.cc:290] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:41.957909 28179 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:41.956864 28294 raft_consensus.cc:385] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.958714 28294 raft_consensus.cc:740] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.959100 28298 leader_election.cc:290] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 1 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:41.927389 28311 raft_consensus.cc:515] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.959451 28294 consensus_queue.cc:260] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.962044 28294 ts_tablet_manager.cc:1434] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:16:41.963002 28294 tablet_bootstrap.cc:492] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:41.964174 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:41.965124 28103 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:41.965497 28145 leader_election.cc:343] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:41.968259 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:41.968724 28311 leader_election.cc:290] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:41.969449 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:41.969592 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:41.970089 28104 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:41.970739 28218 leader_election.cc:343] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:41.971377 28294 tablet_bootstrap.cc:654] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:41.972229 28103 raft_consensus.cc:2468] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 1.
I20260709 12:16:41.975036 28179 raft_consensus.cc:2468] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 1.
I20260709 12:16:41.976622 28104 raft_consensus.cc:2468] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 1.
I20260709 12:16:41.978037 28219 leader_election.cc:304] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: fbe91368743940ec90e27e75812f3467
I20260709 12:16:41.978865 28293 tablet_bootstrap.cc:492] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:41.979349 28293 ts_tablet_manager.cc:1403] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 12:16:41.981268 28218 leader_election.cc:304] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:41.982357 28312 raft_consensus.cc:2804] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:41.982259 28293 raft_consensus.cc:359] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.982846 28292 tablet_bootstrap.cc:492] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:41.983000 28300 raft_consensus.cc:2804] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:41.983527 28292 ts_tablet_manager.cc:1403] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.137s	user 0.045s	sys 0.042s
I20260709 12:16:41.982841 28312 raft_consensus.cc:697] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:41.984830 28312 consensus_queue.cc:237] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.985644 28294 tablet_bootstrap.cc:492] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:41.983031 28293 raft_consensus.cc:385] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.986122 28294 ts_tablet_manager.cc:1403] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.009s
I20260709 12:16:41.986409 28292 raft_consensus.cc:359] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:41.986172 28293 raft_consensus.cc:740] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.987138 28292 raft_consensus.cc:385] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.987473 28292 raft_consensus.cc:740] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.988210 28292 consensus_queue.cc:260] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:41.988158 28293 consensus_queue.cc:260] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.990543 28300 raft_consensus.cc:697] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:41.990834 28294 raft_consensus.cc:359] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.991542 28294 raft_consensus.cc:385] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:41.991865 28294 raft_consensus.cc:740] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:41.991724 28300 consensus_queue.cc:237] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.992704 28294 consensus_queue.cc:260] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.993234 28292 ts_tablet_manager.cc:1434] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:16:41.994347 28292 tablet_bootstrap.cc:492] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:41.996631 28145 leader_election.cc:304] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:41.997740 28299 raft_consensus.cc:493] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:41.998382 28299 raft_consensus.cc:515] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:41.999226 28298 raft_consensus.cc:2804] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:42.007789 28145 leader_election.cc:343] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.033151 28299 leader_election.cc:290] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.035940 28298 raft_consensus.cc:697] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 1 LEADER]: Becoming Leader. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:42.038746 28298 consensus_queue.cc:237] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.034114 28299 raft_consensus.cc:493] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.044413 28299 raft_consensus.cc:515] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.049953 28299 leader_election.cc:290] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.047611 28292 tablet_bootstrap.cc:654] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.043886 28294 ts_tablet_manager.cc:1434] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.057s	user 0.016s	sys 0.007s
I20260709 12:16:42.050127 28000 catalog_manager.cc:5697] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.056833 28294 tablet_bootstrap.cc:492] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:42.062618 28300 raft_consensus.cc:493] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.063278 28300 raft_consensus.cc:515] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.066416 28294 tablet_bootstrap.cc:654] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.068171 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.069101 28300 leader_election.cc:290] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.070540 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
W20260709 12:16:42.071552 28219 leader_election.cc:343] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:42.072599 28218 leader_election.cc:343] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.073026 28218 leader_election.cc:304] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7; no voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.074038 28300 raft_consensus.cc:2749] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:42.075198 28293 ts_tablet_manager.cc:1434] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.012s
I20260709 12:16:42.076243 28293 tablet_bootstrap.cc:492] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:42.076488 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" is_pre_election: true
I20260709 12:16:42.076557 27999 catalog_manager.cc:5697] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbe91368743940ec90e27e75812f3467 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "fbe91368743940ec90e27e75812f3467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:42.077896 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" is_pre_election: true
W20260709 12:16:42.080802 28070 leader_election.cc:343] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:42.081553 28070 leader_election.cc:343] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.083799 28293 tablet_bootstrap.cc:654] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.086433 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.086891 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.087190 28179 raft_consensus.cc:2468] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 0.
I20260709 12:16:42.087450 28178 raft_consensus.cc:2468] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 0.
I20260709 12:16:42.089833 28069 leader_election.cc:304] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:42.091037 28069 leader_election.cc:304] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:42.091220 28294 tablet_bootstrap.cc:492] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:42.091990 28294 ts_tablet_manager.cc:1403] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 12:16:42.092073 28299 raft_consensus.cc:2804] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:42.092556 28299 raft_consensus.cc:493] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.092881 28299 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.095351 28294 raft_consensus.cc:359] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.096236 28294 raft_consensus.cc:385] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.096601 28294 raft_consensus.cc:740] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.096773 28327 raft_consensus.cc:2804] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:42.097319 28327 raft_consensus.cc:493] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.097754 28327 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.097651 28294 consensus_queue.cc:260] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.105633 28299 raft_consensus.cc:515] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.109200 28299 leader_election.cc:290] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.109748 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:42.109841 28327 raft_consensus.cc:515] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.110388 28178 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.113480 28294 ts_tablet_manager.cc:1434] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:16:42.114429 28294 tablet_bootstrap.cc:492] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:42.114578 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:42.115140 28179 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.116006 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
W20260709 12:16:42.117998 28070 leader_election.cc:343] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.120297 28294 tablet_bootstrap.cc:654] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.121227 28178 raft_consensus.cc:2468] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 1.
I20260709 12:16:42.122735 28069 leader_election.cc:304] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:42.127188 28327 leader_election.cc:290] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.125443 28299 raft_consensus.cc:2804] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:42.127516 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:42.128153 28299 raft_consensus.cc:697] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:42.129005 28299 consensus_queue.cc:237] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
W20260709 12:16:42.129242 28070 leader_election.cc:343] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.122519 28179 raft_consensus.cc:2468] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 1.
I20260709 12:16:42.133176 28069 leader_election.cc:304] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:42.136277 28335 raft_consensus.cc:2804] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:42.136940 28335 raft_consensus.cc:697] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:42.137532 28294 tablet_bootstrap.cc:492] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
I20260709 12:16:42.137527 28293 tablet_bootstrap.cc:492] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:42.138121 28293 ts_tablet_manager.cc:1403] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.013s
I20260709 12:16:42.138115 28294 ts_tablet_manager.cc:1403] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:16:42.138016 28335 consensus_queue.cc:237] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.141788 28293 raft_consensus.cc:359] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.143357 28292 tablet_bootstrap.cc:492] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:42.143234 28293 raft_consensus.cc:385] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.143960 28293 raft_consensus.cc:740] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.144096 28292 ts_tablet_manager.cc:1403] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.150s	user 0.025s	sys 0.034s
I20260709 12:16:42.146448 28293 consensus_queue.cc:260] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.147990 28292 raft_consensus.cc:359] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.148734 28292 raft_consensus.cc:385] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.149048 28292 raft_consensus.cc:740] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.149461 28293 ts_tablet_manager.cc:1434] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:16:42.149796 28292 consensus_queue.cc:260] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.150506 28293 tablet_bootstrap.cc:492] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:42.152056 28292 ts_tablet_manager.cc:1434] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:16:42.158107 28294 raft_consensus.cc:359] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.158978 28294 raft_consensus.cc:385] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.159297 28294 raft_consensus.cc:740] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.160208 28294 consensus_queue.cc:260] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.162496 28294 ts_tablet_manager.cc:1434] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:16:42.163430 28294 tablet_bootstrap.cc:492] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763: Bootstrap starting.
I20260709 12:16:42.163847 28293 tablet_bootstrap.cc:654] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.163560 28292 tablet_bootstrap.cc:492] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:42.166378 28299 raft_consensus.cc:493] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.169003 28299 raft_consensus.cc:515] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.171049 28299 leader_election.cc:290] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.171605 28294 tablet_bootstrap.cc:654] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.174026 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63643c6598614810a9d146b6094f66ca" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" is_pre_election: true
W20260709 12:16:42.176260 28070 leader_election.cc:343] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.177448 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63643c6598614810a9d146b6094f66ca" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.180065 28292 tablet_bootstrap.cc:654] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:42.180104 28069 leader_election.cc:343] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.180857 28069 leader_election.cc:304] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763; no voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.181911 28299 raft_consensus.cc:2749] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:42.175951 28002 catalog_manager.cc:5697] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.189045 28293 tablet_bootstrap.cc:492] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:42.189663 28293 ts_tablet_manager.cc:1403] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.013s
I20260709 12:16:42.193030 28300 raft_consensus.cc:493] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.192874 28293 raft_consensus.cc:359] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.193672 28293 raft_consensus.cc:385] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.193518 28300 raft_consensus.cc:515] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:42.193996 28293 raft_consensus.cc:740] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.194810 28293 consensus_queue.cc:260] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.195626 28300 leader_election.cc:290] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981)
I20260709 12:16:42.196501 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.197079 28293 ts_tablet_manager.cc:1434] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:16:42.197095 28179 raft_consensus.cc:2468] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 0.
I20260709 12:16:42.198191 28293 tablet_bootstrap.cc:492] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:42.198580 28218 leader_election.cc:304] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:42.197139 27999 catalog_manager.cc:5697] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:42.199452 28300 raft_consensus.cc:2804] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:42.199826 28300 raft_consensus.cc:493] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.199955 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.200224 28300 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.200016 27999 catalog_manager.cc:5697] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:42.201987 28219 leader_election.cc:343] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.204104 28299 raft_consensus.cc:493] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.204695 28293 tablet_bootstrap.cc:654] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.204602 28299 raft_consensus.cc:515] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.206697 28299 leader_election.cc:290] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.208541 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" is_pre_election: true
I20260709 12:16:42.211846 28294 tablet_bootstrap.cc:492] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763: No bootstrap required, opened a new log
W20260709 12:16:42.214380 28070 leader_election.cc:343] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.216203 28292 tablet_bootstrap.cc:492] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:42.216746 28292 ts_tablet_manager.cc:1403] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.006s
I20260709 12:16:42.216454 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.216297 28300 raft_consensus.cc:515] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:42.217082 28294 ts_tablet_manager.cc:1403] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.009s
I20260709 12:16:42.217304 28179 raft_consensus.cc:2468] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 0.
I20260709 12:16:42.218461 28069 leader_election.cc:304] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:42.219363 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:42.219920 28178 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.222415 28292 raft_consensus.cc:359] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.223107 28292 raft_consensus.cc:385] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.223392 28292 raft_consensus.cc:740] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.224608 28299 raft_consensus.cc:2804] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:42.224472 28292 consensus_queue.cc:260] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.225006 28299 raft_consensus.cc:493] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.225415 28299 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.226742 28292 ts_tablet_manager.cc:1434] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:42.228044 28292 tablet_bootstrap.cc:492] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:42.224696 28294 raft_consensus.cc:359] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:42.229836 28294 raft_consensus.cc:385] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.230211 28294 raft_consensus.cc:740] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.231343 28294 consensus_queue.cc:260] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:42.237818 28292 tablet_bootstrap.cc:654] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.241657 28293 tablet_bootstrap.cc:492] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:42.241645 28294 ts_tablet_manager.cc:1434] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:16:42.242305 28293 ts_tablet_manager.cc:1403] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.030s
I20260709 12:16:42.243332 28335 raft_consensus.cc:493] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.243820 28335 raft_consensus.cc:515] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.245419 28293 raft_consensus.cc:359] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.246076 28293 raft_consensus.cc:385] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.246415 28293 raft_consensus.cc:740] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.232023 28299 raft_consensus.cc:515] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.247299 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.247203 28293 consensus_queue.cc:260] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.247913 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" is_pre_election: true
I20260709 12:16:42.248178 28179 raft_consensus.cc:2393] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a058a1d383a4fee948a23754ace4763 in current term 1: Already voted for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in this term.
I20260709 12:16:42.249390 28293 ts_tablet_manager.cc:1434] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:42.249851 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:42.250304 28300 leader_election.cc:290] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981)
I20260709 12:16:42.250394 28104 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.249970 28299 leader_election.cc:290] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.250305 28293 tablet_bootstrap.cc:492] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:42.247396 28178 raft_consensus.cc:2468] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 1.
I20260709 12:16:42.253068 28218 leader_election.cc:304] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:42.254272 28292 tablet_bootstrap.cc:492] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:42.254719 28292 ts_tablet_manager.cc:1403] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 12:16:42.256042 28070 leader_election.cc:304] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763; no voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.256842 28293 tablet_bootstrap.cc:654] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.257586 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:42.257411 28292 raft_consensus.cc:359] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.258179 28292 raft_consensus.cc:385] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.258483 28292 raft_consensus.cc:740] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.259262 28292 consensus_queue.cc:260] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.261420 28292 ts_tablet_manager.cc:1434] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:16:42.262287 28292 tablet_bootstrap.cc:492] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:42.263343 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:42.264087 28178 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:42.266062 28070 leader_election.cc:343] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.246006 28335 leader_election.cc:290] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.267649 28335 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.268818 28292 tablet_bootstrap.cc:654] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.273075 28324 raft_consensus.cc:2804] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:42.273619 28324 raft_consensus.cc:697] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:42.274837 28312 raft_consensus.cc:493] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.275275 28312 raft_consensus.cc:515] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.276922 28104 raft_consensus.cc:2468] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 1.
I20260709 12:16:42.277109 28178 raft_consensus.cc:2468] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 1.
I20260709 12:16:42.277429 28312 leader_election.cc:290] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.279155 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d8a9e9a604d1faeb92749c0633d4a" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.279873 28293 tablet_bootstrap.cc:492] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:42.274456 28324 consensus_queue.cc:237] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:42.282521 28103 raft_consensus.cc:2468] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 0.
I20260709 12:16:42.282718 28293 ts_tablet_manager.cc:1403] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.015s
I20260709 12:16:42.283864 28219 leader_election.cc:304] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:42.280426 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d8a9e9a604d1faeb92749c0633d4a" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.281663 28335 raft_consensus.cc:2749] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:42.285614 28293 raft_consensus.cc:359] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.285512 28069 leader_election.cc:304] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 2a4293e6d5e94b29b329dd2aa066faa7
W20260709 12:16:42.285935 28218 leader_election.cc:343] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:42.286341 28292 tablet_bootstrap.cc:492] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:42.286332 28293 raft_consensus.cc:385] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.284798 28312 raft_consensus.cc:2804] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:42.286768 28293 raft_consensus.cc:740] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.286916 28292 ts_tablet_manager.cc:1403] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.005s
I20260709 12:16:42.286873 28312 raft_consensus.cc:493] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.287349 28312 raft_consensus.cc:3060] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.287508 28293 consensus_queue.cc:260] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.290128 28293 ts_tablet_manager.cc:1434] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:42.290403 28335 raft_consensus.cc:2804] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:42.290858 28335 raft_consensus.cc:697] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:42.291066 28293 tablet_bootstrap.cc:492] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7: Bootstrap starting.
I20260709 12:16:42.291682 28335 consensus_queue.cc:237] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.289834 28292 raft_consensus.cc:359] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.292831 28292 raft_consensus.cc:385] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.293102 28292 raft_consensus.cc:740] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.293917 28292 consensus_queue.cc:260] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.297152 28292 ts_tablet_manager.cc:1434] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:16:42.297814 28293 tablet_bootstrap.cc:654] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.297992 28292 tablet_bootstrap.cc:492] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467: Bootstrap starting.
I20260709 12:16:42.303680 28292 tablet_bootstrap.cc:654] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:42.313549 28299 raft_consensus.cc:493] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.314098 28299 raft_consensus.cc:515] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.314884 28292 tablet_bootstrap.cc:492] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467: No bootstrap required, opened a new log
I20260709 12:16:42.315339 28292 ts_tablet_manager.cc:1403] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.010s
I20260709 12:16:42.316280 28299 leader_election.cc:290] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.315310 28002 catalog_manager.cc:5697] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:42.318015 28293 tablet_bootstrap.cc:492] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7: No bootstrap required, opened a new log
I20260709 12:16:42.318293 28292 raft_consensus.cc:359] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.318980 28292 raft_consensus.cc:385] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.319000 28293 ts_tablet_manager.cc:1403] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.001s
I20260709 12:16:42.319388 28292 raft_consensus.cc:740] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.318084 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.319608 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" is_pre_election: true
I20260709 12:16:42.319504 28312 raft_consensus.cc:515] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.321784 28252 raft_consensus.cc:2468] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 0.
I20260709 12:16:42.321775 28292 consensus_queue.cc:260] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.322207 28293 raft_consensus.cc:359] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.322871 28293 raft_consensus.cc:385] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:42.323137 28293 raft_consensus.cc:740] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Initialized, Role: FOLLOWER
I20260709 12:16:42.323267 28070 leader_election.cc:304] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:42.323853 28293 consensus_queue.cc:260] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.324743 28179 raft_consensus.cc:2468] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 0.
I20260709 12:16:42.326061 28293 ts_tablet_manager.cc:1434] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:42.324194 28299 raft_consensus.cc:2804] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:42.326639 28299 raft_consensus.cc:493] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.326947 28299 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.328698 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d8a9e9a604d1faeb92749c0633d4a" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:42.329283 28104 raft_consensus.cc:3060] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.331229 28292 ts_tablet_manager.cc:1434] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:16:42.332080 28299 raft_consensus.cc:515] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.334766 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:42.334777 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:42.335436 28179 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.335436 28252 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.336319 28104 raft_consensus.cc:2468] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 1.
I20260709 12:16:42.336913 28324 raft_consensus.cc:493] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.337359 28324 raft_consensus.cc:515] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.337714 28219 leader_election.cc:304] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:42.339471 28324 leader_election.cc:290] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.339991 28324 raft_consensus.cc:2804] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:42.340098 28312 leader_election.cc:290] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.342548 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.335259 28299 leader_election.cc:290] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.343672 28252 raft_consensus.cc:2468] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 1.
I20260709 12:16:42.343864 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d8a9e9a604d1faeb92749c0633d4a" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:42.344416 28177 raft_consensus.cc:3060] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.344744 28070 leader_election.cc:304] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:42.345438 28299 raft_consensus.cc:2804] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:42.345867 28299 raft_consensus.cc:697] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:42.347035 28311 raft_consensus.cc:493] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.346659 28299 consensus_queue.cc:237] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.346546 28002 catalog_manager.cc:5697] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:42.347468 28311 raft_consensus.cc:515] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.349515 28311 leader_election.cc:290] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.349550 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.350423 28104 raft_consensus.cc:2393] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4293e6d5e94b29b329dd2aa066faa7 in current term 1: Already voted for candidate fbe91368743940ec90e27e75812f3467 in this term.
I20260709 12:16:42.353175 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63643c6598614810a9d146b6094f66ca" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.353796 28178 raft_consensus.cc:2468] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 0.
I20260709 12:16:42.353698 28219 leader_election.cc:304] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7; no voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.354600 28311 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.355533 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63643c6598614810a9d146b6094f66ca" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.355731 28218 leader_election.cc:304] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:42.356122 28104 raft_consensus.cc:2468] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 0.
I20260709 12:16:42.356578 28312 raft_consensus.cc:2804] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:42.356976 28312 raft_consensus.cc:493] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:42.357301 28312 raft_consensus.cc:3060] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.360054 28311 raft_consensus.cc:2749] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:42.363562 28324 raft_consensus.cc:697] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:42.364032 28177 raft_consensus.cc:2468] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 1.
I20260709 12:16:42.363423 28002 catalog_manager.cc:5697] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:42.364471 28324 consensus_queue.cc:237] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.370229 28179 raft_consensus.cc:2468] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 1.
I20260709 12:16:42.370003 28312 raft_consensus.cc:515] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.374706 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63643c6598614810a9d146b6094f66ca" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:42.375358 28104 raft_consensus.cc:3060] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.375438 28312 leader_election.cc:290] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.376566 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63643c6598614810a9d146b6094f66ca" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:42.377183 28179 raft_consensus.cc:3060] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.378444 28002 catalog_manager.cc:5697] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.382361 28104 raft_consensus.cc:2468] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 1.
I20260709 12:16:42.384013 28219 leader_election.cc:304] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:42.384274 28179 raft_consensus.cc:2468] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 1.
I20260709 12:16:42.384922 28312 raft_consensus.cc:2804] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:42.388146 28312 raft_consensus.cc:697] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:42.389037 28298 raft_consensus.cc:493] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.389021 28312 consensus_queue.cc:237] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.389523 28298 raft_consensus.cc:515] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.391234 28298 leader_election.cc:290] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.393358 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.393652 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" is_pre_election: true
I20260709 12:16:42.394127 28104 raft_consensus.cc:2393] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbe91368743940ec90e27e75812f3467 in current term 1: Already voted for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in this term.
I20260709 12:16:42.395263 28145 leader_election.cc:304] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbe91368743940ec90e27e75812f3467; no voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:42.395970 28298 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.397485 28002 catalog_manager.cc:5697] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.401970 28298 raft_consensus.cc:2749] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:42.468295 28298 consensus_queue.cc:1048] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.482054 28358 consensus_queue.cc:1048] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:42.492653 28312 raft_consensus.cc:493] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.493184 28312 raft_consensus.cc:515] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.494931 28312 leader_election.cc:290] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.495932 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.495879 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.496738 28179 raft_consensus.cc:2393] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4293e6d5e94b29b329dd2aa066faa7 in current term 1: Already voted for candidate 7a058a1d383a4fee948a23754ace4763 in this term.
I20260709 12:16:42.497754 28218 leader_election.cc:304] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7; no voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.498435 28312 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.501253 28324 raft_consensus.cc:493] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.501655 28324 raft_consensus.cc:515] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.503239 28324 leader_election.cc:290] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.503382 28312 raft_consensus.cc:2749] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:42.504185 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.504402 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.505134 28179 raft_consensus.cc:2393] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4293e6d5e94b29b329dd2aa066faa7 in current term 1: Already voted for candidate 7a058a1d383a4fee948a23754ace4763 in this term.
I20260709 12:16:42.506140 28218 leader_election.cc:304] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7; no voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.506765 28312 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.510385 28324 consensus_queue.cc:1048] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.511178 28312 raft_consensus.cc:2749] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:42.520553 28324 consensus_queue.cc:1048] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.551074 28324 consensus_queue.cc:1048] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.561694 28300 consensus_queue.cc:1048] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.569319 28299 consensus_queue.cc:1048] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.580399 28335 consensus_queue.cc:1048] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:42.603317 28300 raft_consensus.cc:493] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:42.603935 28300 raft_consensus.cc:515] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.606518 28300 leader_election.cc:290] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:42.607746 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbe91368743940ec90e27e75812f3467" is_pre_election: true
I20260709 12:16:42.608053 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a058a1d383a4fee948a23754ace4763" is_pre_election: true
I20260709 12:16:42.608625 28179 raft_consensus.cc:2393] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4293e6d5e94b29b329dd2aa066faa7 in current term 1: Already voted for candidate 7a058a1d383a4fee948a23754ace4763 in this term.
I20260709 12:16:42.609961 28219 leader_election.cc:304] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7; no voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.610687 28300 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:42.616221 28300 raft_consensus.cc:2749] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:42.619624 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:40228
I20260709 12:16:42.620246 28252 raft_consensus.cc:606] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:42.633846 28179 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:59244
I20260709 12:16:42.634373 28179 raft_consensus.cc:606] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 1 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:42.642135 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:40228
I20260709 12:16:42.642590 28252 raft_consensus.cc:606] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:42.648015 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:40228
I20260709 12:16:42.648634 28252 raft_consensus.cc:606] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:42.661464 28104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:47400
I20260709 12:16:42.661921 28104 raft_consensus.cc:606] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Received request to transfer leadership to TS fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.666731 28104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "979f76764bb84402bd1402e024f6f984"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:47400
I20260709 12:16:42.667181 28104 raft_consensus.cc:606] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Received request to transfer leadership to TS fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.671614 28104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:47400
I20260709 12:16:42.672026 28104 raft_consensus.cc:606] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Received request to transfer leadership to TS fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.676561 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e39d8a9e9a604d1faeb92749c0633d4a"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
mode: GRACEFUL
new_leader_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:40228
I20260709 12:16:42.676993 28252 raft_consensus.cc:606] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Received request to transfer leadership to TS fbe91368743940ec90e27e75812f3467
I20260709 12:16:42.687355 28335 consensus_queue.cc:1048] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.693691 28327 raft_consensus.cc:993] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763: : Instructing follower fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:42.694146 28299 raft_consensus.cc:1081] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Signalling peer fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:42.695849 28177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:59230
I20260709 12:16:42.696419 28177 raft_consensus.cc:493] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:42.696808 28177 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.699476 28327 consensus_queue.cc:1048] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.703703 28177 raft_consensus.cc:515] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.707105 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:42.707353 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:42.707711 28104 raft_consensus.cc:3055] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:42.708076 28104 raft_consensus.cc:740] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:42.709097 28104 consensus_queue.cc:260] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.709723 28177 leader_election.cc:290] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 2 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.709908 28104 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.708105 28252 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.716082 28104 raft_consensus.cc:2468] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 2.
I20260709 12:16:42.716311 28252 raft_consensus.cc:2468] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 2.
I20260709 12:16:42.717207 28145 leader_election.cc:304] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:42.717967 28358 raft_consensus.cc:2804] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:42.718443 28358 raft_consensus.cc:697] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Becoming Leader. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:42.719211 28358 consensus_queue.cc:237] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.725630 27999 catalog_manager.cc:5697] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 reported cstate change: term changed from 1 to 2, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to fbe91368743940ec90e27e75812f3467 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "fbe91368743940ec90e27e75812f3467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:42.738170 28327 consensus_queue.cc:1048] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.749197 28335 consensus_queue.cc:1048] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.798022 28335 consensus_queue.cc:1048] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.807623 28299 consensus_queue.cc:1048] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.814932 28335 raft_consensus.cc:993] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763: : Instructing follower fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:42.815443 28299 raft_consensus.cc:1081] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Signalling peer fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:42.816998 28179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:59230
I20260709 12:16:42.817564 28179 raft_consensus.cc:493] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:42.817945 28179 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.823170 28179 raft_consensus.cc:515] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.825107 28179 leader_election.cc:290] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 2 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.825860 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:42.826186 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:42.826465 28104 raft_consensus.cc:3055] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:42.826745 28252 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.826953 28104 raft_consensus.cc:740] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:42.827780 28104 consensus_queue.cc:260] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.828763 28104 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.831425 28252 raft_consensus.cc:2468] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 2.
I20260709 12:16:42.832716 28145 leader_election.cc:304] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:42.833496 28358 raft_consensus.cc:2804] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:42.833676 28104 raft_consensus.cc:2468] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 2.
I20260709 12:16:42.834017 28358 raft_consensus.cc:697] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Becoming Leader. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:42.835309 28358 consensus_queue.cc:237] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.837385 28300 consensus_queue.cc:1048] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.842631 28002 catalog_manager.cc:5697] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 reported cstate change: term changed from 1 to 2, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to fbe91368743940ec90e27e75812f3467 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "fbe91368743940ec90e27e75812f3467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:42.843961 28300 consensus_queue.cc:1048] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.851058 28312 consensus_queue.cc:1048] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.861050 28311 consensus_queue.cc:1048] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.868331 28300 raft_consensus.cc:993] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:42.868868 28300 raft_consensus.cc:1081] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:42.870461 28104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47380
I20260709 12:16:42.870986 28104 raft_consensus.cc:493] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:42.871361 28104 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.877096 28104 raft_consensus.cc:515] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:42.878643 28104 leader_election.cc:290] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 2 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.879339 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:42.879827 28179 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.880792 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:42.881273 28252 raft_consensus.cc:3055] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:42.881542 28252 raft_consensus.cc:740] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:42.882200 28252 consensus_queue.cc:260] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:42.883085 28252 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.884773 28179 raft_consensus.cc:2468] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 2.
I20260709 12:16:42.885715 28069 leader_election.cc:304] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:42.886392 28299 raft_consensus.cc:2804] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:42.886808 28299 raft_consensus.cc:697] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:42.887511 28299 consensus_queue.cc:237] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:42.888129 28252 raft_consensus.cc:2468] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 2.
I20260709 12:16:42.893347 27999 catalog_manager.cc:5697] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 1 to 2, leader changed from 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.932330 28311 consensus_queue.cc:1048] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.942229 28311 consensus_queue.cc:1048] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:42.950201 28300 raft_consensus.cc:993] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7: : Instructing follower fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:42.950663 28311 raft_consensus.cc:1081] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Signalling peer fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:42.952183 28179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e39d8a9e9a604d1faeb92749c0633d4a"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:59218
I20260709 12:16:42.952775 28179 raft_consensus.cc:493] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:42.953130 28179 raft_consensus.cc:3060] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.957998 28179 raft_consensus.cc:515] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.959621 28179 leader_election.cc:290] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 2 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:42.960693 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d8a9e9a604d1faeb92749c0633d4a" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:42.961133 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d8a9e9a604d1faeb92749c0633d4a" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:42.961269 28104 raft_consensus.cc:3060] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.961691 28252 raft_consensus.cc:3055] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:42.962286 28252 raft_consensus.cc:740] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:42.963184 28252 consensus_queue.cc:260] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.964395 28252 raft_consensus.cc:3060] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:42.968068 28104 raft_consensus.cc:2468] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 2.
I20260709 12:16:42.969245 28145 leader_election.cc:304] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:42.969941 28358 raft_consensus.cc:2804] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:42.970422 28358 raft_consensus.cc:697] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Becoming Leader. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:42.970888 28252 raft_consensus.cc:2468] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 2.
I20260709 12:16:42.971277 28358 consensus_queue.cc:237] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:42.977375 28002 catalog_manager.cc:5697] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 reported cstate change: term changed from 1 to 2, leader changed from 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131) to fbe91368743940ec90e27e75812f3467 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "fbe91368743940ec90e27e75812f3467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.001230 28298 raft_consensus.cc:993] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:43.001403 28327 raft_consensus.cc:993] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763: : Instructing follower fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:43.001884 28327 raft_consensus.cc:1081] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Signalling peer fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:43.003156 28300 raft_consensus.cc:993] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:43.003103 28358 raft_consensus.cc:1081] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 1 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:43.003505 28179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "979f76764bb84402bd1402e024f6f984"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:59230
I20260709 12:16:43.003691 28300 raft_consensus.cc:1081] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:43.004115 28179 raft_consensus.cc:493] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:43.004536 28179 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.005223 28104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47392
I20260709 12:16:43.005460 28103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47380
I20260709 12:16:43.005790 28104 raft_consensus.cc:493] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:43.006027 28103 raft_consensus.cc:493] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:43.006222 28104 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.006438 28103 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.011166 28104 raft_consensus.cc:515] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.011498 28179 raft_consensus.cc:515] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.013833 28177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:43.014048 28104 leader_election.cc:290] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 2 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:43.014268 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:43.014364 28179 leader_election.cc:290] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 2 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:43.014436 28177 raft_consensus.cc:3055] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:43.014915 28102 raft_consensus.cc:3055] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:43.014974 28177 raft_consensus.cc:740] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:43.015367 28102 raft_consensus.cc:740] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:43.016064 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:43.015914 28177 consensus_queue.cc:260] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.016351 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:43.016208 28102 consensus_queue.cc:260] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.016819 28252 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.016917 28253 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.017235 28177 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.017524 28102 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.012921 28103 raft_consensus.cc:515] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.022012 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:43.022580 28178 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.024533 28252 raft_consensus.cc:2468] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 2.
I20260709 12:16:43.024600 28102 raft_consensus.cc:2468] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 2.
I20260709 12:16:43.025892 28177 raft_consensus.cc:2468] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 2.
I20260709 12:16:43.025965 28070 leader_election.cc:304] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:43.026054 28145 leader_election.cc:304] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:43.027009 28299 raft_consensus.cc:2804] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:43.027009 28358 raft_consensus.cc:2804] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:43.027333 28103 leader_election.cc:290] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 2 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:43.027513 28299 raft_consensus.cc:697] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:43.027747 28358 raft_consensus.cc:697] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Becoming Leader. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:43.028385 28299 consensus_queue.cc:237] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.030284 28178 raft_consensus.cc:2468] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 2.
I20260709 12:16:43.028497 28358 consensus_queue.cc:237] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.031491 28069 leader_election.cc:304] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:43.031839 28253 raft_consensus.cc:2468] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 2.
I20260709 12:16:43.033069 28327 raft_consensus.cc:2804] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:43.033545 28327 raft_consensus.cc:697] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:43.034543 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:43.034317 28327 consensus_queue.cc:237] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.035187 28252 raft_consensus.cc:3055] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:43.035570 28252 raft_consensus.cc:740] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:43.036639 28252 consensus_queue.cc:260] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.036377 28002 catalog_manager.cc:5697] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 1 to 2, leader changed from fbe91368743940ec90e27e75812f3467 (127.26.205.130) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.038690 28252 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.039299 27999 catalog_manager.cc:5697] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 reported cstate change: term changed from 1 to 2, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to fbe91368743940ec90e27e75812f3467 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "fbe91368743940ec90e27e75812f3467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.045341 28252 raft_consensus.cc:2468] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 2.
I20260709 12:16:43.049954 27999 catalog_manager.cc:5697] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 1 to 2, leader changed from 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.121493 28252 raft_consensus.cc:1275] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.122509 28311 raft_consensus.cc:993] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:43.122983 28311 raft_consensus.cc:1081] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:43.122980 28358 consensus_queue.cc:1048] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:43.124797 28103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47380
I20260709 12:16:43.125499 28103 raft_consensus.cc:493] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:43.126168 28103 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.135485 28102 raft_consensus.cc:1275] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.137645 28385 consensus_queue.cc:1048] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.137794 28103 raft_consensus.cc:515] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.140756 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:43.141325 28178 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.141268 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:43.142061 28252 raft_consensus.cc:3055] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:43.142447 28252 raft_consensus.cc:740] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:43.142850 28103 leader_election.cc:290] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 2 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:43.145570 28252 consensus_queue.cc:260] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.146901 28252 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:43.148080 28178 raft_consensus.cc:2468] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 2.
I20260709 12:16:43.149149 28069 leader_election.cc:304] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:43.149845 28299 raft_consensus.cc:2804] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:43.150303 28299 raft_consensus.cc:697] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:43.151093 28299 consensus_queue.cc:237] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:43.154155 28252 raft_consensus.cc:2468] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 2.
I20260709 12:16:43.158169 27999 catalog_manager.cc:5697] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 1 to 2, leader changed from 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:43.335791 28252 raft_consensus.cc:1275] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.337096 28385 consensus_queue.cc:1048] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.344774 28102 raft_consensus.cc:1275] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.347348 28385 consensus_queue.cc:1048] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.438534 28178 raft_consensus.cc:1275] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.439801 28299 consensus_queue.cc:1048] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.447355 28252 raft_consensus.cc:1275] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.449630 28335 consensus_queue.cc:1048] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.470762 28252 raft_consensus.cc:1275] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.471891 28335 consensus_queue.cc:1048] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.477937 28178 raft_consensus.cc:1275] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.479334 28327 consensus_queue.cc:1048] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.490621 28178 raft_consensus.cc:1275] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.492489 28327 consensus_queue.cc:1048] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.496057 28252 raft_consensus.cc:1275] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.498395 28386 consensus_queue.cc:1048] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.504567 28253 raft_consensus.cc:1275] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.505870 28385 consensus_queue.cc:1048] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.513664 28102 raft_consensus.cc:1275] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.516150 28385 consensus_queue.cc:1048] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:43.519150 28253 raft_consensus.cc:1275] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.523901 28385 consensus_queue.cc:1048] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.532285 28102 raft_consensus.cc:1275] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.536468 28298 consensus_queue.cc:1048] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.630374 28178 raft_consensus.cc:1275] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.631667 28386 consensus_queue.cc:1048] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:43.640230 28253 raft_consensus.cc:1275] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:43.643357 28386 consensus_queue.cc:1048] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:45.709609 27446 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:16:45.710371 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.726698 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
 from {username='slave'} at 127.0.0.1:40542
I20260709 12:16:45.727382 28102 raft_consensus.cc:606] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Received request to transfer leadership to TS 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:45.730000 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
 from {username='slave'} at 127.0.0.1:40542
I20260709 12:16:45.730511 28102 raft_consensus.cc:606] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Received request to transfer leadership to TS 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:45.731539 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:45.731976 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:45.864449 28390 raft_consensus.cc:993] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763: : Instructing follower 2a4293e6d5e94b29b329dd2aa066faa7 to start an election
I20260709 12:16:45.864904 28299 raft_consensus.cc:1081] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Signalling peer 2a4293e6d5e94b29b329dd2aa066faa7 to start an election
I20260709 12:16:45.866245 28252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
 from {username='slave'} at 127.0.0.1:40214
I20260709 12:16:45.866647 28252 raft_consensus.cc:493] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.866981 28252 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.871065 28252 raft_consensus.cc:515] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:45.872378 28252 leader_election.cc:290] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 2 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:45.873291 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:45.873406 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:45.873836 28102 raft_consensus.cc:3055] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.873935 28178 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.874191 28102 raft_consensus.cc:740] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:45.874854 28102 consensus_queue.cc:260] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:45.875737 28102 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.878705 28178 raft_consensus.cc:2468] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 2.
I20260709 12:16:45.879803 28218 leader_election.cc:304] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:45.880755 28102 raft_consensus.cc:2468] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 2.
I20260709 12:16:45.881403 28393 raft_consensus.cc:2804] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.882480 28393 raft_consensus.cc:697] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:45.883330 28393 consensus_queue.cc:237] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:45.889587 27999 catalog_manager.cc:5697] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 1 to 2, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 2 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.070165 28390 raft_consensus.cc:993] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763: : Instructing follower 2a4293e6d5e94b29b329dd2aa066faa7 to start an election
I20260709 12:16:46.070631 28299 raft_consensus.cc:1081] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Signalling peer 2a4293e6d5e94b29b329dd2aa066faa7 to start an election
I20260709 12:16:46.072023 28252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
 from {username='slave'} at 127.0.0.1:40214
I20260709 12:16:46.072563 28252 raft_consensus.cc:493] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:46.072877 28252 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.077255 28252 raft_consensus.cc:515] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:46.078572 28252 leader_election.cc:290] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 3 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:46.079476 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:46.079667 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:46.079998 28102 raft_consensus.cc:3055] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:46.080204 28178 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.080336 28102 raft_consensus.cc:740] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:46.081300 28102 consensus_queue.cc:260] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:46.082196 28102 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:46.085609 28178 raft_consensus.cc:2468] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 3.
I20260709 12:16:46.086663 28218 leader_election.cc:304] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:46.087028 28102 raft_consensus.cc:2468] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 3.
I20260709 12:16:46.087466 28393 raft_consensus.cc:2804] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:46.087888 28393 raft_consensus.cc:697] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:46.088676 28393 consensus_queue.cc:237] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:46.095176 27999 catalog_manager.cc:5697] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 2 to 3, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 3 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.473351 28102 raft_consensus.cc:1275] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Refusing update from remote peer 2a4293e6d5e94b29b329dd2aa066faa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.474601 28393 consensus_queue.cc:1048] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.486868 28178 raft_consensus.cc:1275] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Refusing update from remote peer 2a4293e6d5e94b29b329dd2aa066faa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.488648 28394 consensus_queue.cc:1048] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.488857 28102 raft_consensus.cc:1275] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Refusing update from remote peer 2a4293e6d5e94b29b329dd2aa066faa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.490428 28394 consensus_queue.cc:1048] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.503261 28178 raft_consensus.cc:1275] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Refusing update from remote peer 2a4293e6d5e94b29b329dd2aa066faa7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.505893 28393 consensus_queue.cc:1048] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.733031 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.738391 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:46.738839 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.739806 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.745262 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:47.745694 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:48.747079 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.753681 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:48.754033 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.755000 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.760286 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:49.760670 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:50.761502 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.767534 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:50.768101 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:51.769112 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:51.775357 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:51.775782 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:52.776844 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.782218 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:52.782677 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:53.783680 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:53.788800 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:53.789227 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:54.790198 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:54.795385 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:54.795815 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:55.825230 27446 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:16:55.834625 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:40228
I20260709 12:16:55.835310 28252 raft_consensus.cc:606] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:55.842981 28252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:40228
I20260709 12:16:55.843452 28252 raft_consensus.cc:606] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:55.848160 28178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:59244
I20260709 12:16:55.848637 28178 raft_consensus.cc:606] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:55.853328 28178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "979f76764bb84402bd1402e024f6f984"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:59244
I20260709 12:16:55.853883 28178 raft_consensus.cc:606] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:55.859339 28178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
mode: GRACEFUL
new_leader_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:59244
I20260709 12:16:55.859907 28178 raft_consensus.cc:606] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Received request to transfer leadership to TS 7a058a1d383a4fee948a23754ace4763
I20260709 12:16:55.897135 28412 raft_consensus.cc:993] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:55.897676 28416 raft_consensus.cc:1081] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:55.899170 28103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "979f76764bb84402bd1402e024f6f984"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47392
I20260709 12:16:55.899693 28103 raft_consensus.cc:493] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:55.900032 28103 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.905469 28103 raft_consensus.cc:515] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:55.907251 28103 leader_election.cc:290] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 3 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:55.908361 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:55.908169 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:55.908941 28252 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.908998 28178 raft_consensus.cc:3055] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.909356 28178 raft_consensus.cc:740] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:55.910213 28178 consensus_queue.cc:260] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:55.911123 28178 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.913594 28252 raft_consensus.cc:2468] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 3.
I20260709 12:16:55.914772 28070 leader_election.cc:304] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:55.915611 28413 raft_consensus.cc:2804] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:55.916051 28413 raft_consensus.cc:697] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:55.916363 28178 raft_consensus.cc:2468] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 3.
I20260709 12:16:55.917068 28413 consensus_queue.cc:237] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:55.924297 27999 catalog_manager.cc:5697] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 2 to 3, leader changed from fbe91368743940ec90e27e75812f3467 (127.26.205.130) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 3 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.025640 28412 raft_consensus.cc:993] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:56.026086 28416 raft_consensus.cc:1081] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:56.027442 28103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47392
I20260709 12:16:56.027932 28103 raft_consensus.cc:493] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.028196 28103 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.033015 28103 raft_consensus.cc:515] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.034946 28103 leader_election.cc:290] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 3 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:56.035548 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:56.035984 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d50c911a9214da989dd5b292db345dd" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:56.036089 28178 raft_consensus.cc:3055] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.036389 28178 raft_consensus.cc:740] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:56.036482 28252 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.037228 28178 consensus_queue.cc:260] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.038116 28178 raft_consensus.cc:3060] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.040786 28252 raft_consensus.cc:2468] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 3.
I20260709 12:16:56.041661 28070 leader_election.cc:304] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:56.042378 28413 raft_consensus.cc:2804] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.042789 28413 raft_consensus.cc:697] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:56.042834 28178 raft_consensus.cc:2468] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 3.
I20260709 12:16:56.043800 28413 consensus_queue.cc:237] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.051018 27999 catalog_manager.cc:5697] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 2 to 3, leader changed from fbe91368743940ec90e27e75812f3467 (127.26.205.130) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 3 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.140944 28393 raft_consensus.cc:993] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:56.141436 28423 raft_consensus.cc:1081] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:56.142923 28103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47380
I20260709 12:16:56.143570 28103 raft_consensus.cc:493] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.143848 28103 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.149214 28103 raft_consensus.cc:515] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.150882 28103 leader_election.cc:290] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 3 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:56.151623 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:56.151847 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21198db841d041a1bce8c1ca7149f59d" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:56.152300 28178 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.152352 28252 raft_consensus.cc:3055] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.152791 28252 raft_consensus.cc:740] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:56.153426 28252 consensus_queue.cc:260] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.154309 28252 raft_consensus.cc:3060] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.157150 28178 raft_consensus.cc:2468] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 3.
I20260709 12:16:56.158190 28069 leader_election.cc:304] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:56.158571 28252 raft_consensus.cc:2468] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 3.
I20260709 12:16:56.158948 28413 raft_consensus.cc:2804] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.159482 28413 raft_consensus.cc:697] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:56.160496 28413 consensus_queue.cc:237] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.167248 27999 catalog_manager.cc:5697] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 2 to 3, leader changed from 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 3 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.188252 28393 raft_consensus.cc:993] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:56.188548 28412 raft_consensus.cc:993] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467: : Instructing follower 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:56.188758 28423 raft_consensus.cc:1081] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:56.188992 28416 raft_consensus.cc:1081] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Signalling peer 7a058a1d383a4fee948a23754ace4763 to start an election
I20260709 12:16:56.190451 28102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47380
I20260709 12:16:56.190575 28103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
 from {username='slave'} at 127.0.0.1:47392
I20260709 12:16:56.190965 28102 raft_consensus.cc:493] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.191110 28103 raft_consensus.cc:493] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.191295 28102 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.191560 28103 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.195791 28102 raft_consensus.cc:515] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.196111 28103 raft_consensus.cc:515] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.198009 28103 leader_election.cc:290] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 3 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:56.197841 28102 leader_election.cc:290] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 4 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:56.198586 28252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:56.198745 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:56.198992 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd233c6983c24f9e8f0b52176ec5ebd7" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:56.199131 28252 raft_consensus.cc:3055] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:56.199307 28179 raft_consensus.cc:3055] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.199448 28178 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.199461 28252 raft_consensus.cc:740] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:56.199687 28179 raft_consensus.cc:740] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:56.200491 28252 consensus_queue.cc:260] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.200802 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8decf9a9fc745a4be553c258e10de13" candidate_uuid: "7a058a1d383a4fee948a23754ace4763" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:56.201336 28253 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.200711 28179 consensus_queue.cc:260] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.201735 28252 raft_consensus.cc:3060] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.202348 28179 raft_consensus.cc:3060] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.205828 28178 raft_consensus.cc:2468] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 4.
I20260709 12:16:56.206923 28069 leader_election.cc:304] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a058a1d383a4fee948a23754ace4763, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:56.207928 28413 raft_consensus.cc:2804] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:56.208078 28252 raft_consensus.cc:2468] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 4.
I20260709 12:16:56.210291 28413 raft_consensus.cc:697] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 4 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:56.211249 28413 consensus_queue.cc:237] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.211829 28253 raft_consensus.cc:2468] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 3.
I20260709 12:16:56.212121 28179 raft_consensus.cc:2468] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a058a1d383a4fee948a23754ace4763 in term 3.
I20260709 12:16:56.212970 28070 leader_election.cc:304] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:56.213817 28425 raft_consensus.cc:2804] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.214243 28425 raft_consensus.cc:697] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Becoming Leader. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:56.215004 28425 consensus_queue.cc:237] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:56.222630 27999 catalog_manager.cc:5697] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 3 to 4, leader changed from 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 4 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.232826 27999 catalog_manager.cc:5697] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 reported cstate change: term changed from 2 to 3, leader changed from fbe91368743940ec90e27e75812f3467 (127.26.205.130) to 7a058a1d383a4fee948a23754ace4763 (127.26.205.129). New cstate: current_term: 3 leader_uuid: "7a058a1d383a4fee948a23754ace4763" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.308416 28253 raft_consensus.cc:1275] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.309751 28413 consensus_queue.cc:1048] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.319274 28179 raft_consensus.cc:1275] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.320837 28425 consensus_queue.cc:1048] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.497409 28253 raft_consensus.cc:1275] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.498615 28413 consensus_queue.cc:1048] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.506978 28179 raft_consensus.cc:1275] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.508749 28413 consensus_queue.cc:1048] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.585074 28253 raft_consensus.cc:1275] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.586459 28413 consensus_queue.cc:1048] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.598496 28179 raft_consensus.cc:1275] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.599843 28413 consensus_queue.cc:1048] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.647512 28179 raft_consensus.cc:1275] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 4 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:56.648945 28413 consensus_queue.cc:1048] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:56.658509 28253 raft_consensus.cc:1275] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 4 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:56.662045 28425 consensus_queue.cc:1048] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:56.736985 28179 raft_consensus.cc:1275] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.738327 28425 consensus_queue.cc:1048] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.747543 28253 raft_consensus.cc:1275] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Refusing update from remote peer 7a058a1d383a4fee948a23754ace4763: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.749181 28436 consensus_queue.cc:1048] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.901343 27446 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:16:58.902129 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:58.909149 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "979f76764bb84402bd1402e024f6f984"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:40542
I20260709 12:16:58.909770 28102 raft_consensus.cc:606] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Received request to transfer leadership to TS fbe91368743940ec90e27e75812f3467
I20260709 12:16:58.912177 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
 from {username='slave'} at 127.0.0.1:40542
I20260709 12:16:58.912590 28102 raft_consensus.cc:606] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Received request to transfer leadership to TS 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:58.914692 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
 from {username='slave'} at 127.0.0.1:40542
I20260709 12:16:58.915050 28102 raft_consensus.cc:606] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Received request to transfer leadership to TS 2a4293e6d5e94b29b329dd2aa066faa7
I20260709 12:16:58.917131 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed"
dest_uuid: "7a058a1d383a4fee948a23754ace4763"
mode: GRACEFUL
new_leader_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:40542
I20260709 12:16:58.917518 28102 raft_consensus.cc:606] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Received request to transfer leadership to TS fbe91368743940ec90e27e75812f3467
I20260709 12:16:58.918592 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:58.919051 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:59.024621 28415 raft_consensus.cc:993] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763: : Instructing follower 2a4293e6d5e94b29b329dd2aa066faa7 to start an election
I20260709 12:16:59.025188 28444 raft_consensus.cc:1081] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Signalling peer 2a4293e6d5e94b29b329dd2aa066faa7 to start an election
I20260709 12:16:59.026682 28253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
 from {username='slave'} at 127.0.0.1:40214
I20260709 12:16:59.027189 28253 raft_consensus.cc:493] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.027642 28253 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.032966 28253 raft_consensus.cc:515] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.035384 28253 leader_election.cc:290] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 3 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725)
I20260709 12:16:59.036168 28178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:59.036863 28178 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.036000 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa71ebca0d68412ab918dbb516df24f7" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:59.037343 28102 raft_consensus.cc:3055] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:59.037639 28102 raft_consensus.cc:740] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:59.038661 28415 raft_consensus.cc:993] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763: : Instructing follower fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:59.039191 28415 raft_consensus.cc:1081] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Signalling peer fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:59.038614 28102 consensus_queue.cc:260] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.040156 28102 raft_consensus.cc:3060] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.042503 28178 raft_consensus.cc:2468] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 3.
I20260709 12:16:59.042804 28179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:59230
I20260709 12:16:59.043275 28179 raft_consensus.cc:493] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.043597 28179 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.043943 28218 leader_election.cc:304] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:59.044956 28423 raft_consensus.cc:2804] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:59.046018 28423 raft_consensus.cc:697] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:59.046985 28102 raft_consensus.cc:2468] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 3.
I20260709 12:16:59.047080 28423 consensus_queue.cc:237] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.050860 28179 raft_consensus.cc:515] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.053511 28179 leader_election.cc:290] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 3 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:59.054066 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:59.054366 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cba48d5e24d44a289e12e84b2097f5ed" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:59.054595 28102 raft_consensus.cc:3055] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:59.054832 28253 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.054910 28102 raft_consensus.cc:740] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:59.055732 28102 consensus_queue.cc:260] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.056952 28102 raft_consensus.cc:3060] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.056530 27999 catalog_manager.cc:5697] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 2 to 3, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 3 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.061378 28253 raft_consensus.cc:2468] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 3.
I20260709 12:16:59.062857 28145 leader_election.cc:304] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:59.063724 28416 raft_consensus.cc:2804] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:59.065385 28102 raft_consensus.cc:2468] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 3.
I20260709 12:16:59.065281 28416 raft_consensus.cc:697] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 3 LEADER]: Becoming Leader. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:59.066672 28416 consensus_queue.cc:237] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.076289 28002 catalog_manager.cc:5697] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 reported cstate change: term changed from 2 to 3, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to fbe91368743940ec90e27e75812f3467 (127.26.205.130). New cstate: current_term: 3 leader_uuid: "fbe91368743940ec90e27e75812f3467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.115139 28444 raft_consensus.cc:993] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763: : Instructing follower 2a4293e6d5e94b29b329dd2aa066faa7 to start an election
I20260709 12:16:59.115590 28444 raft_consensus.cc:1081] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Signalling peer 2a4293e6d5e94b29b329dd2aa066faa7 to start an election
I20260709 12:16:59.117029 28253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b"
dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
 from {username='slave'} at 127.0.0.1:40214
I20260709 12:16:59.117511 28253 raft_consensus.cc:493] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.117808 28253 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.122138 28253 raft_consensus.cc:515] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:59.123577 28253 leader_election.cc:290] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 3 election: Requested vote from peers fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725), 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981)
I20260709 12:16:59.124545 28179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbe91368743940ec90e27e75812f3467"
I20260709 12:16:59.124692 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc4f967fa9d405394ac987c5d90dc0b" candidate_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:59.125108 28179 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.125233 28102 raft_consensus.cc:3055] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:59.125609 28102 raft_consensus.cc:740] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:59.126312 28102 consensus_queue.cc:260] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:59.127162 28102 raft_consensus.cc:3060] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.131430 28102 raft_consensus.cc:2468] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 3.
I20260709 12:16:59.131412 28179 raft_consensus.cc:2468] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4293e6d5e94b29b329dd2aa066faa7 in term 3.
I20260709 12:16:59.132799 28219 leader_election.cc:304] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, 7a058a1d383a4fee948a23754ace4763; no voters: 
I20260709 12:16:59.133620 28423 raft_consensus.cc:2804] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:59.134028 28423 raft_consensus.cc:697] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Becoming Leader. State: Replica: 2a4293e6d5e94b29b329dd2aa066faa7, State: Running, Role: LEADER
I20260709 12:16:59.134819 28423 consensus_queue.cc:237] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } }
I20260709 12:16:59.141642 28002 catalog_manager.cc:5697] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 reported cstate change: term changed from 2 to 3, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131). New cstate: current_term: 3 leader_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.307032 28415 raft_consensus.cc:993] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763: : Instructing follower fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:59.307463 28444 raft_consensus.cc:1081] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Signalling peer fbe91368743940ec90e27e75812f3467 to start an election
I20260709 12:16:59.308873 28179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "979f76764bb84402bd1402e024f6f984"
dest_uuid: "fbe91368743940ec90e27e75812f3467"
 from {username='slave'} at 127.0.0.1:59230
I20260709 12:16:59.309286 28179 raft_consensus.cc:493] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.309510 28179 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:59.314062 28179 raft_consensus.cc:515] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.315389 28179 leader_election.cc:290] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 4 election: Requested vote from peers 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981), 2a4293e6d5e94b29b329dd2aa066faa7 (127.26.205.131:34137)
I20260709 12:16:59.316031 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7a058a1d383a4fee948a23754ace4763"
I20260709 12:16:59.316303 28253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "979f76764bb84402bd1402e024f6f984" candidate_uuid: "fbe91368743940ec90e27e75812f3467" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2a4293e6d5e94b29b329dd2aa066faa7"
I20260709 12:16:59.316569 28102 raft_consensus.cc:3055] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:59.316812 28253 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:59.316882 28102 raft_consensus.cc:740] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7a058a1d383a4fee948a23754ace4763, State: Running, Role: LEADER
I20260709 12:16:59.317704 28102 consensus_queue.cc:260] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.318540 28102 raft_consensus.cc:3060] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:59.321192 28253 raft_consensus.cc:2468] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 4.
I20260709 12:16:59.322039 28145 leader_election.cc:304] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4293e6d5e94b29b329dd2aa066faa7, fbe91368743940ec90e27e75812f3467; no voters: 
I20260709 12:16:59.322739 28416 raft_consensus.cc:2804] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:59.322861 28102 raft_consensus.cc:2468] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe91368743940ec90e27e75812f3467 in term 4.
I20260709 12:16:59.323211 28416 raft_consensus.cc:697] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 4 LEADER]: Becoming Leader. State: Replica: fbe91368743940ec90e27e75812f3467, State: Running, Role: LEADER
I20260709 12:16:59.324051 28416 consensus_queue.cc:237] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } }
I20260709 12:16:59.330768 28002 catalog_manager.cc:5697] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 reported cstate change: term changed from 3 to 4, leader changed from 7a058a1d383a4fee948a23754ace4763 (127.26.205.129) to fbe91368743940ec90e27e75812f3467 (127.26.205.130). New cstate: current_term: 4 leader_uuid: "fbe91368743940ec90e27e75812f3467" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.440639 28179 raft_consensus.cc:1275] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Refusing update from remote peer 2a4293e6d5e94b29b329dd2aa066faa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:59.441882 28423 consensus_queue.cc:1048] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.454689 28102 raft_consensus.cc:1275] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Refusing update from remote peer 2a4293e6d5e94b29b329dd2aa066faa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:59.456578 28423 consensus_queue.cc:1048] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.491609 28102 raft_consensus.cc:1275] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:59.492708 28416 consensus_queue.cc:1048] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.501128 28253 raft_consensus.cc:1275] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:59.502676 28449 consensus_queue.cc:1048] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.544227 28102 raft_consensus.cc:1275] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Refusing update from remote peer 2a4293e6d5e94b29b329dd2aa066faa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:59.545480 28423 consensus_queue.cc:1048] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.554833 28179 raft_consensus.cc:1275] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Refusing update from remote peer 2a4293e6d5e94b29b329dd2aa066faa7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:59.556957 28423 consensus_queue.cc:1048] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbe91368743940ec90e27e75812f3467" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.756727 28102 raft_consensus.cc:1275] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 4 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:59.757912 28461 consensus_queue.cc:1048] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a058a1d383a4fee948a23754ace4763" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:59.768775 28253 raft_consensus.cc:1275] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 4 FOLLOWER]: Refusing update from remote peer fbe91368743940ec90e27e75812f3467: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:59.770947 28416 consensus_queue.cc:1048] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4293e6d5e94b29b329dd2aa066faa7" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:59.919967 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:59.926136 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:59.926570 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:00.927490 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:00.934103 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:00.934531 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:01.935467 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:01.941011 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:01.941450 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:02.942444 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:02.948830 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:02.949450 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:03.950392 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:03.955664 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:03.956015 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:04.956871 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:04.962227 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:04.962590 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:05.963418 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:05.969136 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:05.969576 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:06.970487 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:06.976985 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:06.977401 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:07.978353 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.983587 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:07.984028 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:09.014685 27446 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:17:09.015309 27446 tablet_server.cc:179] TabletServer@127.26.205.129:0 shutting down...
I20260709 12:17:09.040637 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:09.041347 27446 tablet_replica.cc:333] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.042155 27446 raft_consensus.cc:2243] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.043395 27446 raft_consensus.cc:2272] T 21198db841d041a1bce8c1ca7149f59d P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.045439 27446 tablet_replica.cc:333] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.046000 27446 raft_consensus.cc:2243] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.046612 27446 raft_consensus.cc:2272] T e39d8a9e9a604d1faeb92749c0633d4a P 7a058a1d383a4fee948a23754ace4763 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.048870 27446 tablet_replica.cc:333] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.049412 27446 raft_consensus.cc:2243] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.049846 27446 raft_consensus.cc:2272] T cba48d5e24d44a289e12e84b2097f5ed P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.051544 27446 tablet_replica.cc:333] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.052088 27446 raft_consensus.cc:2243] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.052645 27446 raft_consensus.cc:2272] T 9dc4f967fa9d405394ac987c5d90dc0b P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.054422 27446 tablet_replica.cc:333] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.054924 27446 raft_consensus.cc:2243] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.055363 27446 raft_consensus.cc:2272] T aa71ebca0d68412ab918dbb516df24f7 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.057148 27446 tablet_replica.cc:333] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.057655 27446 raft_consensus.cc:2243] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.058492 27446 raft_consensus.cc:2272] T a8decf9a9fc745a4be553c258e10de13 P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.060137 27446 tablet_replica.cc:333] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.060691 27446 raft_consensus.cc:2243] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.061107 27446 raft_consensus.cc:2272] T 63643c6598614810a9d146b6094f66ca P 7a058a1d383a4fee948a23754ace4763 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.062681 27446 tablet_replica.cc:333] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.063144 27446 raft_consensus.cc:2243] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.063886 27446 raft_consensus.cc:2272] T fd233c6983c24f9e8f0b52176ec5ebd7 P 7a058a1d383a4fee948a23754ace4763 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.065701 27446 tablet_replica.cc:333] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.066200 27446 raft_consensus.cc:2243] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.066680 27446 raft_consensus.cc:2272] T 979f76764bb84402bd1402e024f6f984 P 7a058a1d383a4fee948a23754ace4763 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.068301 27446 tablet_replica.cc:333] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763: stopping tablet replica
I20260709 12:17:09.068749 27446 raft_consensus.cc:2243] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.069509 27446 raft_consensus.cc:2272] T 1d50c911a9214da989dd5b292db345dd P 7a058a1d383a4fee948a23754ace4763 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.101433 27446 tablet_server.cc:196] TabletServer@127.26.205.129:0 shutdown complete.
I20260709 12:17:09.123556 27446 tablet_server.cc:179] TabletServer@127.26.205.130:0 shutting down...
W20260709 12:17:09.131322 28218 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 12:17:09.137151 28218 consensus_peers.cc:597] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 -> Peer fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725): Couldn't send request to peer fbe91368743940ec90e27e75812f3467. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:09.157557 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:09.158375 27446 tablet_replica.cc:333] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.159266 27446 raft_consensus.cc:2243] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.159672 27446 raft_consensus.cc:2272] T 63643c6598614810a9d146b6094f66ca P fbe91368743940ec90e27e75812f3467 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.161644 27446 tablet_replica.cc:333] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.162139 27446 raft_consensus.cc:2243] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.162554 27446 raft_consensus.cc:2272] T fd233c6983c24f9e8f0b52176ec5ebd7 P fbe91368743940ec90e27e75812f3467 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.164284 27446 tablet_replica.cc:333] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.164829 27446 raft_consensus.cc:2243] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.165251 27446 raft_consensus.cc:2272] T a8decf9a9fc745a4be553c258e10de13 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.166816 27446 tablet_replica.cc:333] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.167425 27446 raft_consensus.cc:2243] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.168174 27446 raft_consensus.cc:2272] T e39d8a9e9a604d1faeb92749c0633d4a P fbe91368743940ec90e27e75812f3467 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.169943 27446 tablet_replica.cc:333] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.170395 27446 raft_consensus.cc:2243] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.170787 27446 raft_consensus.cc:2272] T 21198db841d041a1bce8c1ca7149f59d P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.172310 27446 tablet_replica.cc:333] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.172818 27446 raft_consensus.cc:2243] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.173177 27446 raft_consensus.cc:2272] T 1d50c911a9214da989dd5b292db345dd P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.174805 27446 tablet_replica.cc:333] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.175232 27446 raft_consensus.cc:2243] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.175972 27446 raft_consensus.cc:2272] T 979f76764bb84402bd1402e024f6f984 P fbe91368743940ec90e27e75812f3467 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.177644 27446 tablet_replica.cc:333] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.178045 27446 raft_consensus.cc:2243] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.178426 27446 raft_consensus.cc:2272] T aa71ebca0d68412ab918dbb516df24f7 P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.180058 27446 tablet_replica.cc:333] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.180528 27446 raft_consensus.cc:2243] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.180922 27446 raft_consensus.cc:2272] T 9dc4f967fa9d405394ac987c5d90dc0b P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.182471 27446 tablet_replica.cc:333] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467: stopping tablet replica
I20260709 12:17:09.182912 27446 raft_consensus.cc:2243] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.183663 27446 raft_consensus.cc:2272] T cba48d5e24d44a289e12e84b2097f5ed P fbe91368743940ec90e27e75812f3467 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.213366 27446 tablet_server.cc:196] TabletServer@127.26.205.130:0 shutdown complete.
W20260709 12:17:09.216857 28218 consensus_peers.cc:597] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 -> Peer fbe91368743940ec90e27e75812f3467 (127.26.205.130:34725): Couldn't send request to peer fbe91368743940ec90e27e75812f3467. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34725: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:09.224161 28219 consensus_peers.cc:597] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 -> Peer 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981): Couldn't send request to peer 7a058a1d383a4fee948a23754ace4763. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:09.239475 27446 tablet_server.cc:179] TabletServer@127.26.205.131:0 shutting down...
I20260709 12:17:09.267917 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:09.268806 27446 tablet_replica.cc:333] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.269498 27446 raft_consensus.cc:2243] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.270190 27446 raft_consensus.cc:2272] T a8decf9a9fc745a4be553c258e10de13 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:09.272151 28219 consensus_peers.cc:597] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 -> Peer 7a058a1d383a4fee948a23754ace4763 (127.26.205.129:32981): Couldn't send request to peer 7a058a1d383a4fee948a23754ace4763. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:09.272746 27446 tablet_replica.cc:333] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.273298 27446 raft_consensus.cc:2243] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.273783 27446 raft_consensus.cc:2272] T 1d50c911a9214da989dd5b292db345dd P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.275568 27446 tablet_replica.cc:333] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.276096 27446 raft_consensus.cc:2243] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.276640 27446 raft_consensus.cc:2272] T 979f76764bb84402bd1402e024f6f984 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.278456 27446 tablet_replica.cc:333] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.279024 27446 raft_consensus.cc:2243] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.279508 27446 raft_consensus.cc:2272] T 21198db841d041a1bce8c1ca7149f59d P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.281339 27446 tablet_replica.cc:333] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.281833 27446 raft_consensus.cc:2243] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.282254 27446 raft_consensus.cc:2272] T e39d8a9e9a604d1faeb92749c0633d4a P 2a4293e6d5e94b29b329dd2aa066faa7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.283875 27446 tablet_replica.cc:333] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.284401 27446 raft_consensus.cc:2243] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.285250 27446 raft_consensus.cc:2272] T aa71ebca0d68412ab918dbb516df24f7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.286837 27446 tablet_replica.cc:333] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.287313 27446 raft_consensus.cc:2243] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.288065 27446 raft_consensus.cc:2272] T 9dc4f967fa9d405394ac987c5d90dc0b P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.291224 27446 tablet_replica.cc:333] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.291715 27446 raft_consensus.cc:2243] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.292137 27446 raft_consensus.cc:2272] T cba48d5e24d44a289e12e84b2097f5ed P 2a4293e6d5e94b29b329dd2aa066faa7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.293756 27446 tablet_replica.cc:333] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.294203 27446 raft_consensus.cc:2243] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.294916 27446 raft_consensus.cc:2272] T 63643c6598614810a9d146b6094f66ca P 2a4293e6d5e94b29b329dd2aa066faa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.296952 27446 tablet_replica.cc:333] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7: stopping tablet replica
I20260709 12:17:09.297596 27446 raft_consensus.cc:2243] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.298121 27446 raft_consensus.cc:2272] T fd233c6983c24f9e8f0b52176ec5ebd7 P 2a4293e6d5e94b29b329dd2aa066faa7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.326938 27446 tablet_server.cc:196] TabletServer@127.26.205.131:0 shutdown complete.
I20260709 12:17:09.346560 27446 master.cc:562] Master@127.26.205.190:37159 shutting down...
I20260709 12:17:09.367503 27446 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:17:09.368113 27446 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.368533 27446 tablet_replica.cc:333] T 00000000000000000000000000000000 P e8b9777a4fc645e183e793ba360e5a60: stopping tablet replica
I20260709 12:17:09.387862 27446 master.cc:584] Master@127.26.205.190:37159 shutdown complete.
2a4293e6d5e94b29b329dd2aa066faa7  1
7a058a1d383a4fee948a23754ace4763  5
fbe91368743940ec90e27e75812f3467  4
2a4293e6d5e94b29b329dd2aa066faa7  3
7a058a1d383a4fee948a23754ace4763  3
fbe91368743940ec90e27e75812f3467  4
2a4293e6d5e94b29b329dd2aa066faa7  1
7a058a1d383a4fee948a23754ace4763  8
fbe91368743940ec90e27e75812f3467  1
2a4293e6d5e94b29b329dd2aa066faa7  3
7a058a1d383a4fee948a23754ace4763  4
fbe91368743940ec90e27e75812f3467  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28611 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:17:09.428277 27446 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.205.190:43093
I20260709 12:17:09.429493 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:09.435156 28480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:09.435060 28481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:09.435985 28483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:09.436875 27446 server_base.cc:1061] running on GCE node
I20260709 12:17:09.437635 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:09.437813 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:09.437927 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599429437916 us; error 0 us; skew 500 ppm
I20260709 12:17:09.438377 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:09.440639 27446 webserver.cc:533] Webserver started at http://127.26.205.190:34815/ using document root <none> and password file <none>
I20260709 12:17:09.441062 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:09.441211 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:09.441427 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:09.442504 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/master-0-root/instance:
uuid: "8e0de7eff4a840c28e4ee5b7f8b98182"
format_stamp: "Formatted at 2026-07-09 12:17:09 on dist-test-slave-673s"
I20260709 12:17:09.447007 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:09.450377 28488 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.451225 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:17:09.451467 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/master-0-root
uuid: "8e0de7eff4a840c28e4ee5b7f8b98182"
format_stamp: "Formatted at 2026-07-09 12:17:09 on dist-test-slave-673s"
I20260709 12:17:09.451700 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:09.483073 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:09.484292 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:09.522857 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.190:43093
I20260709 12:17:09.522938 28539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.190:43093 every 8 connection(s)
I20260709 12:17:09.526981 28540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:09.536545 28540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Bootstrap starting.
I20260709 12:17:09.541112 28540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:09.545251 28540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: No bootstrap required, opened a new log
I20260709 12:17:09.547290 28540 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0de7eff4a840c28e4ee5b7f8b98182" member_type: VOTER }
I20260709 12:17:09.547724 28540 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:09.547911 28540 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e0de7eff4a840c28e4ee5b7f8b98182, State: Initialized, Role: FOLLOWER
I20260709 12:17:09.548496 28540 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0de7eff4a840c28e4ee5b7f8b98182" member_type: VOTER }
I20260709 12:17:09.548939 28540 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:17:09.549129 28540 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:17:09.549352 28540 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:09.553467 28540 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0de7eff4a840c28e4ee5b7f8b98182" member_type: VOTER }
I20260709 12:17:09.553997 28540 leader_election.cc:304] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e0de7eff4a840c28e4ee5b7f8b98182; no voters: 
I20260709 12:17:09.555135 28540 leader_election.cc:290] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:17:09.555449 28543 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:09.556740 28543 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 1 LEADER]: Becoming Leader. State: Replica: 8e0de7eff4a840c28e4ee5b7f8b98182, State: Running, Role: LEADER
I20260709 12:17:09.557478 28543 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0de7eff4a840c28e4ee5b7f8b98182" member_type: VOTER }
I20260709 12:17:09.558107 28540 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:17:09.560372 28545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e0de7eff4a840c28e4ee5b7f8b98182. Latest consensus state: current_term: 1 leader_uuid: "8e0de7eff4a840c28e4ee5b7f8b98182" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0de7eff4a840c28e4ee5b7f8b98182" member_type: VOTER } }
I20260709 12:17:09.560336 28544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e0de7eff4a840c28e4ee5b7f8b98182" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e0de7eff4a840c28e4ee5b7f8b98182" member_type: VOTER } }
I20260709 12:17:09.561065 28545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:09.561136 28544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [sys.catalog]: This master's current role is: LEADER
I20260709 12:17:09.567751 28548 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:17:09.575383 28548 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:17:09.576284 27446 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:17:09.584261 28548 catalog_manager.cc:1383] Generated new cluster ID: 2d800b65169a4319a39ac3f2fe96ea86
I20260709 12:17:09.584578 28548 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:17:09.610257 28548 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:17:09.611478 28548 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:17:09.626926 28548 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Generated new TSK 0
I20260709 12:17:09.627528 28548 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:17:09.642611 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:09.648350 28561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:09.649703 28562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:09.652346 27446 server_base.cc:1061] running on GCE node
W20260709 12:17:09.652415 28564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:09.653604 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:09.653869 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:09.654048 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599429654014 us; error 0 us; skew 500 ppm
I20260709 12:17:09.654589 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:09.656862 27446 webserver.cc:533] Webserver started at http://127.26.205.129:39287/ using document root <none> and password file <none>
I20260709 12:17:09.657339 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:09.657498 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:09.657816 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:09.658876 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/instance:
uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
format_stamp: "Formatted at 2026-07-09 12:17:09 on dist-test-slave-673s"
I20260709 12:17:09.663213 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:17:09.666354 28569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.667209 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:17:09.667457 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
format_stamp: "Formatted at 2026-07-09 12:17:09 on dist-test-slave-673s"
I20260709 12:17:09.667691 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:09.678822 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:09.680027 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:09.681483 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:09.683763 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:09.683948 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.684253 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:09.684427 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.725039 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:36607
I20260709 12:17:09.725193 28631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:36607 every 8 connection(s)
I20260709 12:17:09.729847 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:09.737663 28636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:09.739377 28637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:09.742250 27446 server_base.cc:1061] running on GCE node
W20260709 12:17:09.743964 28639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:09.744938 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:09.745204 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:09.745162 28632 heartbeater.cc:344] Connected to a master server at 127.26.205.190:43093
I20260709 12:17:09.745548 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599429745526 us; error 0 us; skew 500 ppm
I20260709 12:17:09.745716 28632 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:09.746372 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:09.746670 28632 heartbeater.cc:507] Master 127.26.205.190:43093 requested a full tablet report, sending...
I20260709 12:17:09.749166 27446 webserver.cc:533] Webserver started at http://127.26.205.130:37709/ using document root <none> and password file <none>
I20260709 12:17:09.749166 28505 ts_manager.cc:194] Registered new tserver with Master: e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:09.749943 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:09.750201 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:09.750515 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:09.751677 28505 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54286
I20260709 12:17:09.752031 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/instance:
uuid: "a8342e3fcab94ce89482df67988159ea"
format_stamp: "Formatted at 2026-07-09 12:17:09 on dist-test-slave-673s"
I20260709 12:17:09.756585 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:09.759676 28644 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.760775 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:09.761066 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root
uuid: "a8342e3fcab94ce89482df67988159ea"
format_stamp: "Formatted at 2026-07-09 12:17:09 on dist-test-slave-673s"
I20260709 12:17:09.761336 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:09.800172 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:09.801445 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:09.802889 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:09.805035 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:09.805270 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.805513 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:09.805688 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.843708 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.130:42113
I20260709 12:17:09.843858 28706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.130:42113 every 8 connection(s)
I20260709 12:17:09.848651 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:09.855973 28710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:09.857941 28711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:09.863236 28713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:09.864065 27446 server_base.cc:1061] running on GCE node
I20260709 12:17:09.865203 28707 heartbeater.cc:344] Connected to a master server at 127.26.205.190:43093
I20260709 12:17:09.865419 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:17:09.865617 28707 heartbeater.cc:461] Registering TS with master...
W20260709 12:17:09.865677 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:09.865952 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599429865934 us; error 0 us; skew 500 ppm
I20260709 12:17:09.866505 28707 heartbeater.cc:507] Master 127.26.205.190:43093 requested a full tablet report, sending...
I20260709 12:17:09.866724 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:09.869133 28505 ts_manager.cc:194] Registered new tserver with Master: a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:09.869658 27446 webserver.cc:533] Webserver started at http://127.26.205.131:41161/ using document root <none> and password file <none>
I20260709 12:17:09.870114 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:09.870270 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:09.870554 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:09.870785 28505 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54300
I20260709 12:17:09.871912 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/instance:
uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
format_stamp: "Formatted at 2026-07-09 12:17:09 on dist-test-slave-673s"
I20260709 12:17:09.876386 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:17:09.879731 28718 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.880504 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:17:09.880798 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root
uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
format_stamp: "Formatted at 2026-07-09 12:17:09 on dist-test-slave-673s"
I20260709 12:17:09.881067 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:09.916386 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:09.917613 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:09.919066 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:09.921356 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:09.921588 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.921861 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:09.922067 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:09.961615 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.131:44843
I20260709 12:17:09.961720 28780 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.131:44843 every 8 connection(s)
I20260709 12:17:09.975786 28781 heartbeater.cc:344] Connected to a master server at 127.26.205.190:43093
I20260709 12:17:09.976186 28781 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:09.977046 28781 heartbeater.cc:507] Master 127.26.205.190:43093 requested a full tablet report, sending...
I20260709 12:17:09.978963 28505 ts_manager.cc:194] Registered new tserver with Master: a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:09.979401 27446 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01435783s
I20260709 12:17:09.980366 28505 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54302
I20260709 12:17:10.003921 28505 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54312:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:17:10.010423 28505 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:17:10.210673 28746 tablet_service.cc:1511] Processing CreateTablet for tablet a975dd4c5a744a1d98c05841000796f8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:10.212105 28746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a975dd4c5a744a1d98c05841000796f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.212453 28744 tablet_service.cc:1511] Processing CreateTablet for tablet 14b09750d07a41f39c2913b5d03c6994 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:10.213795 28744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b09750d07a41f39c2913b5d03c6994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.210500 28745 tablet_service.cc:1511] Processing CreateTablet for tablet b5e3c15999a1401a85e85110ac625d58 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:10.217626 28745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e3c15999a1401a85e85110ac625d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.220082 28597 tablet_service.cc:1511] Processing CreateTablet for tablet a975dd4c5a744a1d98c05841000796f8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:10.221426 28597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a975dd4c5a744a1d98c05841000796f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.222958 28742 tablet_service.cc:1511] Processing CreateTablet for tablet e599bf217cb043a7957d025cd753fea4 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:10.225584 28596 tablet_service.cc:1511] Processing CreateTablet for tablet b5e3c15999a1401a85e85110ac625d58 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:10.226873 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e3c15999a1401a85e85110ac625d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.226830 28741 tablet_service.cc:1511] Processing CreateTablet for tablet ac62777e94e1417c867cb2ac80a55824 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:10.210500 28743 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad958cd19754b4b9c2817e4b5cd7ded (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:10.229561 28595 tablet_service.cc:1511] Processing CreateTablet for tablet 14b09750d07a41f39c2913b5d03c6994 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:10.230830 28595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b09750d07a41f39c2913b5d03c6994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.231040 28592 tablet_service.cc:1511] Processing CreateTablet for tablet ac62777e94e1417c867cb2ac80a55824 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:10.233533 28594 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad958cd19754b4b9c2817e4b5cd7ded (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:10.233995 28591 tablet_service.cc:1511] Processing CreateTablet for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:10.235707 28593 tablet_service.cc:1511] Processing CreateTablet for tablet e599bf217cb043a7957d025cd753fea4 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:10.242074 28739 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa8c90dea5b494e9adb22b30b41b45c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:10.246701 28738 tablet_service.cc:1511] Processing CreateTablet for tablet dcb1386731ec4c46bd9cc992c2ffc31b (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:10.248919 28740 tablet_service.cc:1511] Processing CreateTablet for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:10.224287 28742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e599bf217cb043a7957d025cd753fea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.256973 28741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac62777e94e1417c867cb2ac80a55824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.265009 28743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad958cd19754b4b9c2817e4b5cd7ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.270524 28590 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa8c90dea5b494e9adb22b30b41b45c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:10.271380 28589 tablet_service.cc:1511] Processing CreateTablet for tablet dcb1386731ec4c46bd9cc992c2ffc31b (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:10.274823 28588 tablet_service.cc:1511] Processing CreateTablet for tablet ecc67b62cf604852ae673df459d4ce67 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:10.277362 28592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac62777e94e1417c867cb2ac80a55824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.280498 28590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa8c90dea5b494e9adb22b30b41b45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.283402 28589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb1386731ec4c46bd9cc992c2ffc31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.288868 28594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad958cd19754b4b9c2817e4b5cd7ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.290549 28796 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:10.292873 28593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e599bf217cb043a7957d025cd753fea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.296728 28796 tablet_bootstrap.cc:654] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:10.296864 28591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.300851 28738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb1386731ec4c46bd9cc992c2ffc31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.302160 28596 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4b956d8e604e81b411a6c4ce1681ad (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:10.303432 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4b956d8e604e81b411a6c4ce1681ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.304849 28740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.304881 28588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc67b62cf604852ae673df459d4ce67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.307304 28739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa8c90dea5b494e9adb22b30b41b45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.315555 28595 tablet_service.cc:1511] Processing CreateTablet for tablet f6ca073d2ba7428e8ef693a68c16429b (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:10.316983 28595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ca073d2ba7428e8ef693a68c16429b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.317869 28737 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4b956d8e604e81b411a6c4ce1681ad (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:10.319247 28737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4b956d8e604e81b411a6c4ce1681ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.334616 28744 tablet_service.cc:1511] Processing CreateTablet for tablet ecc67b62cf604852ae673df459d4ce67 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:10.342579 28597 tablet_service.cc:1511] Processing CreateTablet for tablet 52e0d44a1cde4f32b60dd0ed014922ec (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:10.343921 28597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e0d44a1cde4f32b60dd0ed014922ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.346537 28797 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:10.350605 28796 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:10.351101 28796 ts_tablet_manager.cc:1403] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 12:17:10.357585 28594 tablet_service.cc:1511] Processing CreateTablet for tablet 30c9fa2ab7fb487da44a0d6de40286ff (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:10.358901 28594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c9fa2ab7fb487da44a0d6de40286ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.358978 28590 tablet_service.cc:1511] Processing CreateTablet for tablet a7f9c29f436b4c6bbfb909b71ca1d309 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:10.360617 28590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f9c29f436b4c6bbfb909b71ca1d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.360422 28796 raft_consensus.cc:359] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.361275 28796 raft_consensus.cc:385] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:10.361614 28796 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:10.361279 28593 tablet_service.cc:1511] Processing CreateTablet for tablet 78db6dee59ca445c95d367900be0ef94 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:10.363780 28593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78db6dee59ca445c95d367900be0ef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.364495 28589 tablet_service.cc:1511] Processing CreateTablet for tablet bb3409e46c8446f79a337919b428c7ac (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:10.363489 28737 tablet_service.cc:1511] Processing CreateTablet for tablet 52e0d44a1cde4f32b60dd0ed014922ec (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:10.365713 28589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3409e46c8446f79a337919b428c7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.367193 28672 tablet_service.cc:1511] Processing CreateTablet for tablet a975dd4c5a744a1d98c05841000796f8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:17:10.367321 28739 tablet_service.cc:1511] Processing CreateTablet for tablet f6ca073d2ba7428e8ef693a68c16429b (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:10.368477 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a975dd4c5a744a1d98c05841000796f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.369539 28669 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad958cd19754b4b9c2817e4b5cd7ded (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:17:10.370832 28669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad958cd19754b4b9c2817e4b5cd7ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.373644 28670 tablet_service.cc:1511] Processing CreateTablet for tablet 14b09750d07a41f39c2913b5d03c6994 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:17:10.375005 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b09750d07a41f39c2913b5d03c6994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.377765 28671 tablet_service.cc:1511] Processing CreateTablet for tablet b5e3c15999a1401a85e85110ac625d58 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:17:10.379155 28671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e3c15999a1401a85e85110ac625d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.362366 28796 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.387184 28667 tablet_service.cc:1511] Processing CreateTablet for tablet ac62777e94e1417c867cb2ac80a55824 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:17:10.387887 28665 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa8c90dea5b494e9adb22b30b41b45c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:17:10.388622 28667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac62777e94e1417c867cb2ac80a55824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.389240 28665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa8c90dea5b494e9adb22b30b41b45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.389633 28666 tablet_service.cc:1511] Processing CreateTablet for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:17:10.390995 28666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.393662 28664 tablet_service.cc:1511] Processing CreateTablet for tablet dcb1386731ec4c46bd9cc992c2ffc31b (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:17:10.395414 28664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb1386731ec4c46bd9cc992c2ffc31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.397991 28663 tablet_service.cc:1511] Processing CreateTablet for tablet ecc67b62cf604852ae673df459d4ce67 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:17:10.399760 28663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc67b62cf604852ae673df459d4ce67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.400864 28799 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:10.401651 28668 tablet_service.cc:1511] Processing CreateTablet for tablet e599bf217cb043a7957d025cd753fea4 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:17:10.384996 28591 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4d3cf35bc44b2b334697ab60648ca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:10.402964 28668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e599bf217cb043a7957d025cd753fea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.403426 28591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4d3cf35bc44b2b334697ab60648ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.407334 28799 tablet_bootstrap.cc:654] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:10.408468 28596 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe68878605a4b8ab3302650b63aae98 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:10.409940 28670 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4b956d8e604e81b411a6c4ce1681ad (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:17:10.411106 28797 tablet_bootstrap.cc:654] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:10.411242 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4b956d8e604e81b411a6c4ce1681ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.413664 28796 ts_tablet_manager.cc:1434] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.005s
I20260709 12:17:10.409854 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe68878605a4b8ab3302650b63aae98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.416946 28595 tablet_service.cc:1511] Processing CreateTablet for tablet 05ef99f51b5a4b959e982c258f2aafcc (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:10.418284 28595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ef99f51b5a4b959e982c258f2aafcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.424810 28781 heartbeater.cc:499] Master 127.26.205.190:43093 was elected leader, sending a full tablet report...
I20260709 12:17:10.428898 28796 tablet_bootstrap.cc:492] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:10.430137 28670 tablet_service.cc:1511] Processing CreateTablet for tablet 52e0d44a1cde4f32b60dd0ed014922ec (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:17:10.431494 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e0d44a1cde4f32b60dd0ed014922ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.440742 28744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecc67b62cf604852ae673df459d4ce67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.448838 28737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e0d44a1cde4f32b60dd0ed014922ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.452821 28739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ca073d2ba7428e8ef693a68c16429b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.456126 28796 tablet_bootstrap.cc:654] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:10.465153 28589 tablet_service.cc:1511] Processing CreateTablet for tablet 1548a806b02a4f79b5010615f560d2bb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:10.466483 28589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1548a806b02a4f79b5010615f560d2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.471055 28593 tablet_service.cc:1511] Processing CreateTablet for tablet b35b6c6fffe3416bb8f69b556040e319 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:10.481540 28741 tablet_service.cc:1511] Processing CreateTablet for tablet a7f9c29f436b4c6bbfb909b71ca1d309 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:10.490149 28741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f9c29f436b4c6bbfb909b71ca1d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.489017 28593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35b6c6fffe3416bb8f69b556040e319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.481735 28665 tablet_service.cc:1511] Processing CreateTablet for tablet f6ca073d2ba7428e8ef693a68c16429b (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:17:10.486367 28740 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe68878605a4b8ab3302650b63aae98 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:10.494122 28665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ca073d2ba7428e8ef693a68c16429b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.494414 28743 tablet_service.cc:1511] Processing CreateTablet for tablet 78db6dee59ca445c95d367900be0ef94 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:10.495661 28740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe68878605a4b8ab3302650b63aae98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.480382 28746 tablet_service.cc:1511] Processing CreateTablet for tablet 30c9fa2ab7fb487da44a0d6de40286ff (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:10.513087 28588 tablet_service.cc:1511] Processing CreateTablet for tablet 243df7b9197c40219914bcac6111faca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:10.514000 28594 tablet_service.cc:1511] Processing CreateTablet for tablet cdf685c3207841c286a253af2d105972 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:10.514456 28745 tablet_service.cc:1511] Processing CreateTablet for tablet 05ef99f51b5a4b959e982c258f2aafcc (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:10.516202 28667 tablet_service.cc:1511] Processing CreateTablet for tablet 30c9fa2ab7fb487da44a0d6de40286ff (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:17:10.523748 28737 tablet_service.cc:1511] Processing CreateTablet for tablet 1548a806b02a4f79b5010615f560d2bb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:10.528101 28588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243df7b9197c40219914bcac6111faca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.528954 28797 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:10.529456 28797 ts_tablet_manager.cc:1403] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.183s	user 0.015s	sys 0.018s
I20260709 12:17:10.532284 28797 raft_consensus.cc:359] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.533051 28797 raft_consensus.cc:385] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:10.533365 28797 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:10.534409 28594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf685c3207841c286a253af2d105972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.540652 28799 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:10.576761 28799 ts_tablet_manager.cc:1403] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.176s	user 0.007s	sys 0.012s
I20260709 12:17:10.579030 28741 tablet_service.cc:1511] Processing CreateTablet for tablet b35b6c6fffe3416bb8f69b556040e319 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:10.546195 28669 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe68878605a4b8ab3302650b63aae98 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:17:10.547372 28664 tablet_service.cc:1511] Processing CreateTablet for tablet a7f9c29f436b4c6bbfb909b71ca1d309 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:17:10.549861 28797 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.552847 28743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78db6dee59ca445c95d367900be0ef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.582250 28737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1548a806b02a4f79b5010615f560d2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.556143 28671 tablet_service.cc:1511] Processing CreateTablet for tablet 78db6dee59ca445c95d367900be0ef94 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:17:10.582868 28745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ef99f51b5a4b959e982c258f2aafcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.583460 28741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35b6c6fffe3416bb8f69b556040e319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.583539 28740 tablet_service.cc:1511] Processing CreateTablet for tablet 243df7b9197c40219914bcac6111faca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:10.584929 28740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243df7b9197c40219914bcac6111faca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.556990 28667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c9fa2ab7fb487da44a0d6de40286ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.557495 28596 tablet_service.cc:1511] Processing CreateTablet for tablet 302623a332a2421e848283481e8010f6 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:10.562011 28588 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9f78bead97491ebb7f049af3cf869c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:10.592797 28664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f9c29f436b4c6bbfb909b71ca1d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.593487 28669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe68878605a4b8ab3302650b63aae98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.594087 28671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78db6dee59ca445c95d367900be0ef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.603427 28740 tablet_service.cc:1511] Processing CreateTablet for tablet cdf685c3207841c286a253af2d105972 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:10.562206 28589 tablet_service.cc:1511] Processing CreateTablet for tablet f23bf973b94c463f8da13a996fc7f221 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:10.559676 28593 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5c0f8a4f2a47d5bfb86a593b95a1cd (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:17:10.604835 28740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf685c3207841c286a253af2d105972. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:10.569803 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:10.579910 28799 raft_consensus.cc:359] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.605603 28799 raft_consensus.cc:385] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:10.605945 28799 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:10.606755 28799 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.616015 28800 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.499012 28738 tablet_service.cc:1511] Processing CreateTablet for tablet bb3409e46c8446f79a337919b428c7ac (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:10.616575 28800 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.617596 28738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3409e46c8446f79a337919b428c7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.629014 28632 heartbeater.cc:499] Master 127.26.205.190:43093 was elected leader, sending a full tablet report...
I20260709 12:17:10.638445 28799 ts_tablet_manager.cc:1434] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.013s
I20260709 12:17:10.639413 28707 heartbeater.cc:499] Master 127.26.205.190:43093 was elected leader, sending a full tablet report...
I20260709 12:17:10.639757 28799 tablet_bootstrap.cc:492] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:10.651010 28797 ts_tablet_manager.cc:1434] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.121s	user 0.011s	sys 0.009s
I20260709 12:17:10.651384 28666 tablet_service.cc:1511] Processing CreateTablet for tablet 05ef99f51b5a4b959e982c258f2aafcc (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:17:10.652122 28797 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:10.652655 28666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ef99f51b5a4b959e982c258f2aafcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.622021 28800 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:10.653641 28744 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5c0f8a4f2a47d5bfb86a593b95a1cd (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 12:17:10.654207 28492 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93219.5us
I20260709 12:17:10.660106 28742 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4d3cf35bc44b2b334697ab60648ca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:10.635917 28746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c9fa2ab7fb487da44a0d6de40286ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.675333 28665 tablet_service.cc:1511] Processing CreateTablet for tablet 1548a806b02a4f79b5010615f560d2bb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:17:10.677271 28744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5c0f8a4f2a47d5bfb86a593b95a1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.678507 28663 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa4d3cf35bc44b2b334697ab60648ca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:17:10.679078 28743 tablet_service.cc:1511] Processing CreateTablet for tablet 302623a332a2421e848283481e8010f6 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:10.671820 28589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23bf973b94c463f8da13a996fc7f221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.679630 28742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4d3cf35bc44b2b334697ab60648ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.647719 28668 tablet_service.cc:1511] Processing CreateTablet for tablet bb3409e46c8446f79a337919b428c7ac (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:17:10.685581 28665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1548a806b02a4f79b5010615f560d2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.705132 28745 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9f78bead97491ebb7f049af3cf869c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:10.708259 28672 tablet_service.cc:1511] Processing CreateTablet for tablet b35b6c6fffe3416bb8f69b556040e319 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:17:10.716423 28663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4d3cf35bc44b2b334697ab60648ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.744529 28668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3409e46c8446f79a337919b428c7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.699425 28743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302623a332a2421e848283481e8010f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.748598 28670 tablet_service.cc:1511] Processing CreateTablet for tablet 243df7b9197c40219914bcac6111faca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:17:10.749984 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243df7b9197c40219914bcac6111faca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.753373 28588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9f78bead97491ebb7f049af3cf869c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.754401 28739 tablet_service.cc:1511] Processing CreateTablet for tablet f23bf973b94c463f8da13a996fc7f221 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:10.755721 28739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23bf973b94c463f8da13a996fc7f221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.756771 28745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9f78bead97491ebb7f049af3cf869c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.756716 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302623a332a2421e848283481e8010f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.761184 28593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5c0f8a4f2a47d5bfb86a593b95a1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.765360 28797 tablet_bootstrap.cc:654] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:10.766996 28799 tablet_bootstrap.cc:654] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:10.773509 28807 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.781504 28667 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5c0f8a4f2a47d5bfb86a593b95a1cd (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 12:17:10.779124 28492 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58605.6us
I20260709 12:17:10.786015 28597 tablet_service.cc:1511] Processing CreateTablet for tablet f7fa5ed3509d4939885ee0d39a32f20a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:10.787322 28597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fa5ed3509d4939885ee0d39a32f20a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.789331 28669 tablet_service.cc:1511] Processing CreateTablet for tablet cdf685c3207841c286a253af2d105972 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:17:10.791085 28591 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae65c3f66064ac694864cddddad892d (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:10.791466 28740 tablet_service.cc:1511] Processing CreateTablet for tablet f7fa5ed3509d4939885ee0d39a32f20a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:10.792533 28591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae65c3f66064ac694864cddddad892d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.792738 28740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fa5ed3509d4939885ee0d39a32f20a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.798476 28595 tablet_service.cc:1511] Processing CreateTablet for tablet aacf3b2dee3345268f9d3c9b6a1e4779 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:10.799782 28595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aacf3b2dee3345268f9d3c9b6a1e4779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.779277 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35b6c6fffe3416bb8f69b556040e319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.800601 28807 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.822309 28668 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9f78bead97491ebb7f049af3cf869c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:17:10.824623 28669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf685c3207841c286a253af2d105972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.826372 28665 tablet_service.cc:1511] Processing CreateTablet for tablet f23bf973b94c463f8da13a996fc7f221 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:17:10.827605 28665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23bf973b94c463f8da13a996fc7f221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.842521 28664 tablet_service.cc:1511] Processing CreateTablet for tablet 302623a332a2421e848283481e8010f6 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:17:10.844368 28664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302623a332a2421e848283481e8010f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.849005 28671 tablet_service.cc:1511] Processing CreateTablet for tablet aacf3b2dee3345268f9d3c9b6a1e4779 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:10.860361 28671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aacf3b2dee3345268f9d3c9b6a1e4779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.849992 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:10.864845 28682 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:10.866677 28720 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:10.867879 28800 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:10.868345 28800 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:10.868564 28490 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 92046.5us
I20260709 12:17:10.868841 28800 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:10.869313 28741 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae65c3f66064ac694864cddddad892d (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:10.870714 28741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae65c3f66064ac694864cddddad892d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.902284 28744 tablet_service.cc:1511] Processing CreateTablet for tablet 71e53cc7795245709057efe9ca977661 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:10.903620 28744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e53cc7795245709057efe9ca977661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.905831 28737 tablet_service.cc:1511] Processing CreateTablet for tablet d2cf259cdc3c4cdfb64950de8d1adb98 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:10.907119 28737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cf259cdc3c4cdfb64950de8d1adb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.909972 28800 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.916827 28807 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:10.926759 28800 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:10.918188 28746 tablet_service.cc:1511] Processing CreateTablet for tablet aacf3b2dee3345268f9d3c9b6a1e4779 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:17:10.943200 28667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5c0f8a4f2a47d5bfb86a593b95a1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.952826 28797 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:10.957172 28668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9f78bead97491ebb7f049af3cf869c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.957639 28797 ts_tablet_manager.cc:1403] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.306s	user 0.045s	sys 0.100s
I20260709 12:17:10.937659 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:10.959280 28682 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:10.956732 28590 tablet_service.cc:1511] Processing CreateTablet for tablet d2cf259cdc3c4cdfb64950de8d1adb98 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:10.955453 28796 tablet_bootstrap.cc:492] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:10.932237 28739 tablet_service.cc:1511] Processing CreateTablet for tablet 1632d712fbcd489da9624b1f43ff7f96 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:10.967458 28803 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.968065 28803 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:10.968202 28592 tablet_service.cc:1511] Processing CreateTablet for tablet 509077a515a748899cf8ea0c5bac854a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:10.969630 28592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509077a515a748899cf8ea0c5bac854a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.969646 28672 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae65c3f66064ac694864cddddad892d (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:17:10.971006 28803 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:10.971027 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae65c3f66064ac694864cddddad892d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.990302 28590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cf259cdc3c4cdfb64950de8d1adb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.977206 28746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aacf3b2dee3345268f9d3c9b6a1e4779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.978446 28796 ts_tablet_manager.cc:1403] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.550s	user 0.046s	sys 0.047s
I20260709 12:17:10.999011 28593 tablet_service.cc:1511] Processing CreateTablet for tablet 1632d712fbcd489da9624b1f43ff7f96 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:11.011427 28745 tablet_service.cc:1511] Processing CreateTablet for tablet c5898a5306cc40cb9c97dff5f6ab3cd8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:11.012001 28797 raft_consensus.cc:359] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.012553 28666 tablet_service.cc:1511] Processing CreateTablet for tablet f7fa5ed3509d4939885ee0d39a32f20a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:17:11.013427 28597 tablet_service.cc:1511] Processing CreateTablet for tablet 71e53cc7795245709057efe9ca977661 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:11.016455 28593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1632d712fbcd489da9624b1f43ff7f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.017023 28739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1632d712fbcd489da9624b1f43ff7f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.024325 28670 tablet_service.cc:1511] Processing CreateTablet for tablet 1632d712fbcd489da9624b1f43ff7f96 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:17:11.024776 28738 tablet_service.cc:1511] Processing CreateTablet for tablet 509077a515a748899cf8ea0c5bac854a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:11.025068 28797 raft_consensus.cc:385] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.018800 28796 raft_consensus.cc:359] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.040022 28742 tablet_service.cc:1511] Processing CreateTablet for tablet a5dc72678108404787b2aa034d4a7243 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:11.044945 28666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fa5ed3509d4939885ee0d39a32f20a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.041392 28799 tablet_bootstrap.cc:492] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:11.045789 28799 ts_tablet_manager.cc:1403] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.406s	user 0.018s	sys 0.013s
I20260709 12:17:11.045835 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1632d712fbcd489da9624b1f43ff7f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.049139 28799 raft_consensus.cc:359] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.033270 28796 raft_consensus.cc:385] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.050096 28796 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.033169 28797 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.051048 28797 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.053791 28797 ts_tablet_manager.cc:1434] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 12:17:11.054896 28797 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:11.054963 28591 tablet_service.cc:1511] Processing CreateTablet for tablet c5898a5306cc40cb9c97dff5f6ab3cd8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:11.041422 28597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e53cc7795245709057efe9ca977661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.060714 28799 raft_consensus.cc:385] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.062053 28799 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.063148 28799 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.064600 28743 tablet_service.cc:1511] Processing CreateTablet for tablet ff1532cf86464920afb02490b110f356 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:11.066044 28743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1532cf86464920afb02490b110f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.069068 28738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509077a515a748899cf8ea0c5bac854a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.069414 28663 tablet_service.cc:1511] Processing CreateTablet for tablet 509077a515a748899cf8ea0c5bac854a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:17:11.074577 28663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509077a515a748899cf8ea0c5bac854a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.096226 28664 tablet_service.cc:1511] Processing CreateTablet for tablet 71e53cc7795245709057efe9ca977661 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:17:11.096760 28596 tablet_service.cc:1511] Processing CreateTablet for tablet 3a420de289b844729c03c9625dd9e63c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:11.073171 28740 tablet_service.cc:1511] Processing CreateTablet for tablet 01095df8e33a4e11bc9089bc7a5cdd37 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:17:11.077077 28742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5dc72678108404787b2aa034d4a7243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.080381 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:11.100737 28594 tablet_service.cc:1511] Processing CreateTablet for tablet 01095df8e33a4e11bc9089bc7a5cdd37 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:17:11.102627 28571 leader_election.cc:343] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.104904 28745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5898a5306cc40cb9c97dff5f6ab3cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.080899 28796 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.108736 28591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5898a5306cc40cb9c97dff5f6ab3cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.110423 28796 ts_tablet_manager.cc:1434] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.106s	user 0.003s	sys 0.004s
I20260709 12:17:11.081768 28682 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:11.112027 28589 tablet_service.cc:1511] Processing CreateTablet for tablet a5dc72678108404787b2aa034d4a7243 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:11.083451 28669 tablet_service.cc:1511] Processing CreateTablet for tablet d2cf259cdc3c4cdfb64950de8d1adb98 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:17:11.086783 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:11.112792 28594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01095df8e33a4e11bc9089bc7a5cdd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.113445 28720 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:11.113940 28740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01095df8e33a4e11bc9089bc7a5cdd37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:11.114181 28573 leader_election.cc:343] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.114493 28800 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:11.114645 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:11.115492 28803 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:11.071455 28799 ts_tablet_manager.cc:1434] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:17:11.095150 28595 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9b05092c214663bd1a274ae3358eb4 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:11.095337 28588 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc886982591478e97f84ddb724a679a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:11.119125 28799 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:11.125084 28796 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:11.126403 28799 tablet_bootstrap.cc:654] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.129222 28669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cf259cdc3c4cdfb64950de8d1adb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.133829 28741 tablet_service.cc:1511] Processing CreateTablet for tablet 3a420de289b844729c03c9625dd9e63c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:11.134433 28671 tablet_service.cc:1511] Processing CreateTablet for tablet a5dc72678108404787b2aa034d4a7243 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:17:11.136052 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:11.168941 28744 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9b05092c214663bd1a274ae3358eb4 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:11.139636 28593 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2bcd2a3b04c82bbf14413a7011c12 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:11.119560 28737 tablet_service.cc:1511] Processing CreateTablet for tablet 663f0169fb984cfe963338bade0eabbb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:11.143605 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:11.147131 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:11.171030 28796 tablet_bootstrap.cc:654] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.147506 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:11.155616 28668 tablet_service.cc:1511] Processing CreateTablet for tablet 01095df8e33a4e11bc9089bc7a5cdd37 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:17:11.113484 28589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5dc72678108404787b2aa034d4a7243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.172307 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a420de289b844729c03c9625dd9e63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.176810 28588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc886982591478e97f84ddb724a679a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.180780 28595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9b05092c214663bd1a274ae3358eb4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:17:11.183034 28722 leader_election.cc:343] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:11.183749 28648 leader_election.cc:343] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:11.184139 28722 leader_election.cc:343] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.161772 28667 tablet_service.cc:1511] Processing CreateTablet for tablet 3a420de289b844729c03c9625dd9e63c (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:17:11.164762 28664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e53cc7795245709057efe9ca977661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.165371 28665 tablet_service.cc:1511] Processing CreateTablet for tablet c5898a5306cc40cb9c97dff5f6ab3cd8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:17:11.170363 28744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9b05092c214663bd1a274ae3358eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.188304 28593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2bcd2a3b04c82bbf14413a7011c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.192745 28665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5898a5306cc40cb9c97dff5f6ab3cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.193141 28590 tablet_service.cc:1511] Processing CreateTablet for tablet cb599a2fb1704106b47a69be90b821d0 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:17:11.194391 28590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb599a2fb1704106b47a69be90b821d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.196729 28667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a420de289b844729c03c9625dd9e63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.197597 28672 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9b05092c214663bd1a274ae3358eb4 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:17:11.198844 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9b05092c214663bd1a274ae3358eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.200742 28668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01095df8e33a4e11bc9089bc7a5cdd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.200835 28592 tablet_service.cc:1511] Processing CreateTablet for tablet ecb84065af5c41b0aaee71485ad69560 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:11.201820 28671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5dc72678108404787b2aa034d4a7243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.202102 28592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb84065af5c41b0aaee71485ad69560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.208901 28737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663f0169fb984cfe963338bade0eabbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.227154 28666 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc886982591478e97f84ddb724a679a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:11.236256 28666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc886982591478e97f84ddb724a679a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.241792 28738 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc886982591478e97f84ddb724a679a (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:17:11.248109 28741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a420de289b844729c03c9625dd9e63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.249464 28796 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:11.249943 28796 ts_tablet_manager.cc:1403] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.125s	user 0.005s	sys 0.008s
I20260709 12:17:11.251408 28591 tablet_service.cc:1511] Processing CreateTablet for tablet 8cace92f719b413eb21f6a0ae2d7d707 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:11.243178 28800 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:11.253473 28739 tablet_service.cc:1511] Processing CreateTablet for tablet f2c936ab911d48fba6cc944d81f99fb1 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:11.254797 28739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c936ab911d48fba6cc944d81f99fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.254560 28800 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.257560 28743 tablet_service.cc:1511] Processing CreateTablet for tablet 8cace92f719b413eb21f6a0ae2d7d707 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:11.258819 28743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cace92f719b413eb21f6a0ae2d7d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.271116 28594 tablet_service.cc:1511] Processing CreateTablet for tablet 663f0169fb984cfe963338bade0eabbb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:11.273823 28746 tablet_service.cc:1511] Processing CreateTablet for tablet c60bef772ef04194a01b6f8f5423dd5f (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:11.276166 28797 tablet_bootstrap.cc:654] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.277078 28738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc886982591478e97f84ddb724a679a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.280053 28746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c60bef772ef04194a01b6f8f5423dd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.280709 28669 tablet_service.cc:1511] Processing CreateTablet for tablet 663f0169fb984cfe963338bade0eabbb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:17:11.283798 28669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663f0169fb984cfe963338bade0eabbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.284258 28664 tablet_service.cc:1511] Processing CreateTablet for tablet ff1532cf86464920afb02490b110f356 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:11.280836 28670 tablet_service.cc:1511] Processing CreateTablet for tablet f2c936ab911d48fba6cc944d81f99fb1 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:11.295706 28796 raft_consensus.cc:359] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.296552 28796 raft_consensus.cc:385] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.296927 28796 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.297839 28796 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.299930 28799 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:11.300518 28799 ts_tablet_manager.cc:1403] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.182s	user 0.006s	sys 0.015s
I20260709 12:17:11.305900 28745 tablet_service.cc:1511] Processing CreateTablet for tablet 09b12c4abe49469ebd1ae7c30355cef2 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:11.307242 28745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b12c4abe49469ebd1ae7c30355cef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.308048 28799 raft_consensus.cc:359] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.308804 28799 raft_consensus.cc:385] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.309103 28799 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.310742 28591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cace92f719b413eb21f6a0ae2d7d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.312860 28664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1532cf86464920afb02490b110f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.316979 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c936ab911d48fba6cc944d81f99fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.321592 28665 tablet_service.cc:1511] Processing CreateTablet for tablet c60bef772ef04194a01b6f8f5423dd5f (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:11.322890 28665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c60bef772ef04194a01b6f8f5423dd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.325374 28595 tablet_service.cc:1511] Processing CreateTablet for tablet f2c936ab911d48fba6cc944d81f99fb1 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:17:11.325891 28594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663f0169fb984cfe963338bade0eabbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.326668 28595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c936ab911d48fba6cc944d81f99fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.326326 28596 tablet_service.cc:1511] Processing CreateTablet for tablet ff1532cf86464920afb02490b110f356 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:17:11.300006 28796 ts_tablet_manager.cc:1434] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:17:11.332679 28740 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2bcd2a3b04c82bbf14413a7011c12 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:11.333426 28799 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.362555 28663 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2bcd2a3b04c82bbf14413a7011c12 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:17:11.365074 28799 ts_tablet_manager.cc:1434] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 12:17:11.366166 28799 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:11.335156 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1532cf86464920afb02490b110f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.335917 28671 tablet_service.cc:1511] Processing CreateTablet for tablet 8cace92f719b413eb21f6a0ae2d7d707 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:17:11.337054 28796 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:11.340795 28648 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:11.370783 28807 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:11.374975 28797 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:11.375542 28797 ts_tablet_manager.cc:1403] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.321s	user 0.013s	sys 0.004s
I20260709 12:17:11.378726 28797 raft_consensus.cc:359] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.379510 28797 raft_consensus.cc:385] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.379835 28797 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.380911 28797 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.381146 28737 tablet_service.cc:1511] Processing CreateTablet for tablet ae666b5b049a49c0bd0b0969e6b2b154 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:11.342590 28742 tablet_service.cc:1511] Processing CreateTablet for tablet ecb84065af5c41b0aaee71485ad69560 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:11.343743 28504 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.353791 28668 tablet_service.cc:1511] Processing CreateTablet for tablet 09b12c4abe49469ebd1ae7c30355cef2 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:11.355214 28672 tablet_service.cc:1511] Processing CreateTablet for tablet ecb84065af5c41b0aaee71485ad69560 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:17:11.359849 28667 tablet_service.cc:1511] Processing CreateTablet for tablet cb599a2fb1704106b47a69be90b821d0 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:17:11.366354 28663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2bcd2a3b04c82bbf14413a7011c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.368783 28803 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.384073 28592 tablet_service.cc:1511] Processing CreateTablet for tablet 09b12c4abe49469ebd1ae7c30355cef2 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:17:11.389765 28803 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.390478 28590 tablet_service.cc:1511] Processing CreateTablet for tablet c60bef772ef04194a01b6f8f5423dd5f (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:17:11.391505 28593 tablet_service.cc:1511] Processing CreateTablet for tablet 6828c27180d54395aa62e49037e09909 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:11.391889 28590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c60bef772ef04194a01b6f8f5423dd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.393369 28588 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea376f5c1af47d79a1871ab80a23cdb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:11.394052 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:11.394685 28588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea376f5c1af47d79a1871ab80a23cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.395241 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:11.396791 28573 leader_election.cc:343] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.397838 28807 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.398351 28807 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.398761 28593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6828c27180d54395aa62e49037e09909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.401708 28666 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea376f5c1af47d79a1871ab80a23cdb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:11.402360 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:11.402849 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:11.406140 28648 leader_election.cc:343] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.391942 28803 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.406301 28597 tablet_service.cc:1511] Processing CreateTablet for tablet e5bdaade8df945828ab371a3267cd752 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:17:11.402290 28571 leader_election.cc:343] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.409435 28668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b12c4abe49469ebd1ae7c30355cef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.409616 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:11.403502 28756 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:11.411392 28803 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:11.411926 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:11.413259 28592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b12c4abe49469ebd1ae7c30355cef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.415995 28737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae666b5b049a49c0bd0b0969e6b2b154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.403647 28807 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.416564 28807 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:11.416712 28742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb84065af5c41b0aaee71485ad69560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.416953 28807 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.416833 28670 tablet_service.cc:1511] Processing CreateTablet for tablet 6828c27180d54395aa62e49037e09909 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:11.417392 28807 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.418023 28744 tablet_service.cc:1511] Processing CreateTablet for tablet 6828c27180d54395aa62e49037e09909 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:17:11.422844 28741 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea376f5c1af47d79a1871ab80a23cdb (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:17:11.428352 28589 tablet_service.cc:1511] Processing CreateTablet for tablet 683aa452755144abbbeaff5aa710e8ca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:17:11.429795 28589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683aa452755144abbbeaff5aa710e8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.430567 28740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2bcd2a3b04c82bbf14413a7011c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.429517 28738 tablet_service.cc:1511] Processing CreateTablet for tablet cb599a2fb1704106b47a69be90b821d0 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:17:11.432787 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb84065af5c41b0aaee71485ad69560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.433063 28803 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.433570 28667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb599a2fb1704106b47a69be90b821d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.433588 28803 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.438809 28796 tablet_bootstrap.cc:654] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.439563 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:11.439723 28803 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.440387 28682 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:17:11.440737 28666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea376f5c1af47d79a1871ab80a23cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.441654 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:11.443598 28571 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:11.444427 28803 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.428583 28664 tablet_service.cc:1511] Processing CreateTablet for tablet e5bdaade8df945828ab371a3267cd752 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:17:11.449260 28664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bdaade8df945828ab371a3267cd752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.450902 28669 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1813ffb1124b0d8e8500ca59a1550f (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:17:11.455283 28671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cace92f719b413eb21f6a0ae2d7d707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.455348 28738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb599a2fb1704106b47a69be90b821d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.458076 28741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea376f5c1af47d79a1871ab80a23cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.468911 28597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bdaade8df945828ab371a3267cd752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.470501 28799 tablet_bootstrap.cc:654] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.481427 28591 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1813ffb1124b0d8e8500ca59a1550f (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:17:11.492674 28807 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.493695 28743 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1813ffb1124b0d8e8500ca59a1550f (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:17:11.495028 28807 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.495640 28807 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.496003 28746 tablet_service.cc:1511] Processing CreateTablet for tablet e5bdaade8df945828ab371a3267cd752 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:17:11.476927 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6828c27180d54395aa62e49037e09909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.501322 28744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6828c27180d54395aa62e49037e09909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.513351 28797 ts_tablet_manager.cc:1434] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.137s	user 0.001s	sys 0.012s
I20260709 12:17:11.514412 28797 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:11.515128 28800 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.515596 28800 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:11.509670 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 97823.1us
I20260709 12:17:11.517987 28800 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:11.519646 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:11.519933 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:11.520502 28756 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.521307 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:11.521947 28606 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:11.522881 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:11.524732 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:11.525554 28800 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:11.524853 28742 tablet_service.cc:1511] Processing CreateTablet for tablet 683aa452755144abbbeaff5aa710e8ca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:17:11.525933 28800 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.527367 28671 tablet_service.cc:1511] Processing CreateTablet for tablet 683aa452755144abbbeaff5aa710e8ca (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 12:17:11.525785 28648 leader_election.cc:343] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.531500 28800 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.528564 28591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1813ffb1124b0d8e8500ca59a1550f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.543700 28803 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:11.554324 28594 tablet_service.cc:1511] Processing CreateTablet for tablet c4d3afd7078b475e884e52f098a3b5cd (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:11.555619 28594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d3afd7078b475e884e52f098a3b5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.503358 28807 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.560791 28590 tablet_service.cc:1511] Processing CreateTablet for tablet 793ab78ecea2432e8fdb088474026ce1 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:17:11.561576 28682 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:11.562057 28590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793ab78ecea2432e8fdb088474026ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.562552 28588 tablet_service.cc:1511] Processing CreateTablet for tablet 316dc144dbef470e8e17c2e02887dfd8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:11.565817 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:11.566461 28807 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.566506 28606 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:11.567848 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:11.570508 28672 tablet_service.cc:1511] Processing CreateTablet for tablet ae666b5b049a49c0bd0b0969e6b2b154 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:11.570696 28648 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:11.573572 28756 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:11.574234 28663 tablet_service.cc:1511] Processing CreateTablet for tablet 793ab78ecea2432e8fdb088474026ce1 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:17:11.574286 28668 tablet_service.cc:1511] Processing CreateTablet for tablet c4d3afd7078b475e884e52f098a3b5cd (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:11.540297 28743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1813ffb1124b0d8e8500ca59a1550f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.576073 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:11.579010 28665 tablet_service.cc:1511] Processing CreateTablet for tablet 316dc144dbef470e8e17c2e02887dfd8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:11.540388 28669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1813ffb1124b0d8e8500ca59a1550f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.579874 28807 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:11.580617 28807 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.581151 28807 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.580760 28825 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:11.582121 28739 tablet_service.cc:1511] Processing CreateTablet for tablet c4d3afd7078b475e884e52f098a3b5cd (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:17:11.583626 28739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d3afd7078b475e884e52f098a3b5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.588208 28745 tablet_service.cc:1511] Processing CreateTablet for tablet 793ab78ecea2432e8fdb088474026ce1 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:17:11.589563 28746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bdaade8df945828ab371a3267cd752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.590034 28596 tablet_service.cc:1511] Processing CreateTablet for tablet ae666b5b049a49c0bd0b0969e6b2b154 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:17:11.591384 28671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683aa452755144abbbeaff5aa710e8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.592780 28742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683aa452755144abbbeaff5aa710e8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.568192 28800 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.603583 28596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae666b5b049a49c0bd0b0969e6b2b154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.603652 28745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793ab78ecea2432e8fdb088474026ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.603438 28672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae666b5b049a49c0bd0b0969e6b2b154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.613615 28755 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:17:11.614413 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:11.615679 28796 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:11.616194 28796 ts_tablet_manager.cc:1403] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.279s	user 0.016s	sys 0.010s
I20260709 12:17:11.612257 28825 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:11.627960 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:11.628595 28606 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.634120 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:11.634819 28800 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:11.621093 28807 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.637485 28682 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:11.633276 28825 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.642194 28796 raft_consensus.cc:359] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:11.646440 28796 raft_consensus.cc:385] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.646762 28796 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.647903 28796 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:11.649827 28807 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.650092 28796 ts_tablet_manager.cc:1434] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.002s
I20260709 12:17:11.650532 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:11.651302 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:11.652076 28755 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:17:11.653215 28648 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:11.655516 28738 tablet_service.cc:1511] Processing CreateTablet for tablet 316dc144dbef470e8e17c2e02887dfd8 (DEFAULT_TABLE table=test-workload [id=8774336601e04021b11d5e9603cef75f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:17:11.656822 28738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 316dc144dbef470e8e17c2e02887dfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.660835 28799 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:11.661300 28799 ts_tablet_manager.cc:1403] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.295s	user 0.017s	sys 0.021s
I20260709 12:17:11.662729 28796 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:11.646714 28606 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:11.665750 28588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 316dc144dbef470e8e17c2e02887dfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.669315 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:11.664638 28800 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.670284 28818 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:11.669992 28800 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:11.671650 28797 tablet_bootstrap.cc:700] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent opening tablet: real 0.103s	user 0.005s	sys 0.000s
I20260709 12:17:11.672356 28797 tablet_bootstrap.cc:654] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.665346 28663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793ab78ecea2432e8fdb088474026ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.665489 28807 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:11.677826 28668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d3afd7078b475e884e52f098a3b5cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.683410 28665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 316dc144dbef470e8e17c2e02887dfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.686877 28799 raft_consensus.cc:359] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.687670 28799 raft_consensus.cc:385] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.688694 28799 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.709322 28800 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:11.710480 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:11.711982 28720 leader_election.cc:343] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.717319 28503 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:11.720533 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51317.8us
I20260709 12:17:11.722203 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:11.728765 28782 tablet.cc:2406] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:17:11.731577 28800 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:11.731526 28818 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:11.732398 28799 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.733462 28818 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.735280 28799 ts_tablet_manager.cc:1434] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.004s
I20260709 12:17:11.736099 28796 tablet_bootstrap.cc:654] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.739007 28797 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:11.739986 28797 ts_tablet_manager.cc:1403] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.226s	user 0.009s	sys 0.010s
W20260709 12:17:11.740355 28722 leader_election.cc:343] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.741055 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:11.742252 28800 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:11.742758 28797 raft_consensus.cc:359] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:11.743486 28797 raft_consensus.cc:385] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.753270 28799 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:11.748761 28797 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.754834 28797 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:11.780814 28799 tablet_bootstrap.cc:654] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.786568 28797 ts_tablet_manager.cc:1434] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:17:11.787974 28797 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:11.793715 28505 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.812597 28796 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:11.813301 28796 ts_tablet_manager.cc:1403] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.151s	user 0.010s	sys 0.017s
I20260709 12:17:11.815228 28797 tablet_bootstrap.cc:654] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.818572 28796 raft_consensus.cc:359] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.819339 28796 raft_consensus.cc:385] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.819648 28796 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.820317 28796 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.821203 28800 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:11.822666 28796 ts_tablet_manager.cc:1434] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:17:11.823662 28796 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:11.827016 28799 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:11.827447 28799 ts_tablet_manager.cc:1403] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.001s
I20260709 12:17:11.830124 28799 raft_consensus.cc:359] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.830834 28799 raft_consensus.cc:385] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.831123 28799 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.831281 28796 tablet_bootstrap.cc:654] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.832253 28799 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.838073 28825 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.838673 28825 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.842451 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:11.844388 28648 leader_election.cc:343] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.845752 28825 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.847971 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:11.848827 28755 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:11.850567 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:11.852080 28825 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:11.852586 28825 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.853029 28825 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.870514 28796 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:11.871008 28796 ts_tablet_manager.cc:1403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.020s
I20260709 12:17:11.874406 28799 ts_tablet_manager.cc:1434] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.003s
I20260709 12:17:11.874351 28796 raft_consensus.cc:359] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.875211 28796 raft_consensus.cc:385] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.875499 28799 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:11.875501 28796 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.876507 28796 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.884536 28799 tablet_bootstrap.cc:654] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.886723 28796 ts_tablet_manager.cc:1434] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:17:11.891953 28796 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:11.897145 28799 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:11.897639 28799 ts_tablet_manager.cc:1403] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 12:17:11.898072 28796 tablet_bootstrap.cc:654] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.900655 28799 raft_consensus.cc:359] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.901513 28799 raft_consensus.cc:385] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.900074 28825 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.901820 28799 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.902585 28799 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.903097 28797 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:11.903326 28796 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:11.903541 28797 ts_tablet_manager.cc:1403] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.116s	user 0.035s	sys 0.038s
I20260709 12:17:11.903779 28796 ts_tablet_manager.cc:1403] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:17:11.904616 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:11.904839 28799 ts_tablet_manager.cc:1434] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:17:11.905886 28799 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:11.906440 28797 raft_consensus.cc:359] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.907133 28797 raft_consensus.cc:385] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.906811 28796 raft_consensus.cc:359] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.907466 28797 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.907573 28796 raft_consensus.cc:385] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.907917 28796 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.908517 28797 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.908757 28796 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:11.909176 28648 leader_election.cc:343] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.910960 28797 ts_tablet_manager.cc:1434] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:11.911438 28796 ts_tablet_manager.cc:1434] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:17:11.912329 28797 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:11.912417 28796 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:11.916658 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:11.917246 28755 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.918569 28796 tablet_bootstrap.cc:654] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.919175 28797 tablet_bootstrap.cc:654] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.923935 28799 tablet_bootstrap.cc:654] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.929698 28796 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:11.930127 28796 ts_tablet_manager.cc:1403] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:17:11.931902 28807 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.932370 28807 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.932760 28796 raft_consensus.cc:359] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.933370 28796 raft_consensus.cc:385] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.933440 28797 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:11.933661 28796 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.934350 28797 ts_tablet_manager.cc:1403] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 12:17:11.934465 28796 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.936484 28800 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.936935 28800 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.938230 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:11.938292 28797 raft_consensus.cc:359] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.938923 28606 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:11.937165 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:11.939203 28797 raft_consensus.cc:385] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.938948 28800 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:11.939703 28797 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.939613 28756 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:11.940726 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:11.934389 28807 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.940853 28797 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.942315 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:11.942616 28803 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.943190 28797 ts_tablet_manager.cc:1434] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:17:11.943089 28803 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:11.943303 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:11.943495 28720 leader_election.cc:343] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.944185 28797 tablet_bootstrap.cc:492] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
W20260709 12:17:11.944681 28722 leader_election.cc:343] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.945106 28722 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:11.945211 28803 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:11.945322 28796 ts_tablet_manager.cc:1434] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:17:11.946411 28796 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:11.946735 28800 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:11.947187 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:11.948742 28571 leader_election.cc:343] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:11.948858 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:11.949514 28756 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:11.950805 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:11.951051 28797 tablet_bootstrap.cc:654] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.947181 28807 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:11.952227 28807 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.952530 28796 tablet_bootstrap.cc:654] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:11.952955 28803 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:11.953361 28803 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.953769 28803 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.958616 28755 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:11.959522 28825 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.959954 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:11.961433 28825 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:11.962767 28825 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:11.963798 28825 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.964740 28796 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:11.965152 28796 ts_tablet_manager.cc:1403] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:17:11.967841 28796 raft_consensus.cc:359] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.968644 28796 raft_consensus.cc:385] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:11.968997 28796 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:11.970083 28796 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.973294 28796 ts_tablet_manager.cc:1434] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:11.952644 28807 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.979485 28503 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:11.980968 28807 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.982568 28799 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:11.983048 28807 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:11.983044 28799 ts_tablet_manager.cc:1403] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.005s
I20260709 12:17:11.984146 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:11.984730 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:11.984737 28755 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.985519 28606 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:11.992087 28606 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:11.992087 28755 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:11.993251 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:11.993944 28807 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:11.994475 28807 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:11.995672 28796 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:11.995328 28807 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:11.980170 28803 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:12.001055 28799 raft_consensus.cc:359] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.001775 28799 raft_consensus.cc:385] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.002504 28799 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.002907 28803 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:12.003237 28799 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.003839 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:12.004637 28755 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.005578 28799 ts_tablet_manager.cc:1434] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:17:12.006588 28799 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.008606 28796 tablet_bootstrap.cc:654] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.014371 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:12.016595 28825 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.017081 28825 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.018111 28797 tablet_bootstrap.cc:492] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.018733 28797 ts_tablet_manager.cc:1403] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.023s
I20260709 12:17:12.019537 28825 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.021895 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:12.022325 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:12.022522 28606 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:12.022918 28756 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:12.022645 28797 raft_consensus.cc:359] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.023684 28797 raft_consensus.cc:385] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.023736 28648 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:12.024207 28797 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
W20260709 12:17:12.024813 28571 leader_election.cc:343] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.025243 28825 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.025821 28825 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.025225 28797 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.026139 28825 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.029844 28799 tablet_bootstrap.cc:654] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.028427 28797 ts_tablet_manager.cc:1434] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 12:17:12.034866 28797 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:12.034646 28825 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.037331 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:12.037889 28606 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.038437 28829 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.038890 28829 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.040938 28829 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.043709 28797 tablet_bootstrap.cc:654] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.046109 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:12.046739 28756 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:12.046969 28607 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.047721 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:12.049634 28648 leader_election.cc:343] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.050381 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:12.051481 28829 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.051901 28829 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.052274 28829 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.061100 28606 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:12.062000 28825 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.063746 28755 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:12.070487 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:12.071677 28829 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.073666 28807 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:12.075266 28503 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.076683 28803 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:12.082820 28797 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.083420 28797 ts_tablet_manager.cc:1403] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.003s
I20260709 12:17:12.087325 28797 raft_consensus.cc:359] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.088210 28797 raft_consensus.cc:385] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.089301 28797 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.089991 28797 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.091132 28799 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.091143 28796 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:12.091498 28829 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.091696 28796 ts_tablet_manager.cc:1403] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.096s	user 0.038s	sys 0.042s
I20260709 12:17:12.091696 28799 ts_tablet_manager.cc:1403] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.019s
I20260709 12:17:12.094419 28799 raft_consensus.cc:359] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.094574 28796 raft_consensus.cc:359] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.095062 28799 raft_consensus.cc:385] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.095173 28796 raft_consensus.cc:385] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.095340 28799 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.095429 28796 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.095829 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:12.096613 28755 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.096199 28796 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.099126 28799 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.105814 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:12.106560 28606 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.106827 28796 ts_tablet_manager.cc:1434] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:17:12.109637 28799 ts_tablet_manager.cc:1434] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.004s
I20260709 12:17:12.113664 28799 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.111536 28796 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:12.121469 28803 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:12.122313 28803 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:12.122680 28755 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:12.131217 28796 tablet_bootstrap.cc:654] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.132790 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:12.133337 28797 ts_tablet_manager.cc:1434] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.050s	user 0.021s	sys 0.025s
I20260709 12:17:12.133459 28756 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.134366 28797 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:12.127761 28799 tablet_bootstrap.cc:654] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.136803 28860 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.137418 28860 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.140580 28797 tablet_bootstrap.cc:654] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.145778 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:12.144369 28800 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:12.144276 28860 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.147042 28754 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:12.148530 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:12.144820 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:12.149390 28860 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.151108 28682 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:12.151374 28860 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.151887 28860 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.156639 28756 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:12.161296 28648 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:12.116503 28606 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:12.167321 28829 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:12.168002 28829 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:12.169200 28829 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.176129 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:12.205281 28829 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:12.206333 28829 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:12.194382 28800 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.204267 28503 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.207665 28829 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.183503 28860 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.215953 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:12.216416 28860 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.216527 28681 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.218698 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:12.219591 28755 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:12.224568 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48513.8us
I20260709 12:17:12.226047 28681 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:12.228473 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:12.231734 28859 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:12.239931 28858 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.240782 28799 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.241416 28799 ts_tablet_manager.cc:1403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.016s
I20260709 12:17:12.244135 28796 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:12.246949 28796 ts_tablet_manager.cc:1403] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.136s	user 0.024s	sys 0.011s
I20260709 12:17:12.250412 28796 raft_consensus.cc:359] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.258152 28799 raft_consensus.cc:359] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.259312 28799 raft_consensus.cc:385] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.258900 28796 raft_consensus.cc:385] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.260079 28796 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.259724 28503 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.259661 28799 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.262387 28796 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.261998 28799 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.266173 28799 ts_tablet_manager.cc:1434] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:17:12.267673 28799 tablet_bootstrap.cc:492] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.266814 28796 ts_tablet_manager.cc:1434] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:17:12.269456 28796 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:12.270890 28829 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.271548 28829 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.275413 28800 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.276051 28800 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.279656 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:12.281203 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:12.282927 28720 leader_election.cc:343] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:12.283735 28722 leader_election.cc:343] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.284219 28722 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:12.285281 28832 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:12.286021 28800 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:12.288214 28799 tablet_bootstrap.cc:654] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.290232 28796 tablet_bootstrap.cc:654] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.294379 28829 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.296679 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:12.299095 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:12.299785 28754 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:12.300540 28859 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:12.301270 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:12.301544 28859 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.306353 28799 tablet_bootstrap.cc:492] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.311112 28799 ts_tablet_manager.cc:1403] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.001s
I20260709 12:17:12.310508 28797 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.313776 28797 ts_tablet_manager.cc:1403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.180s	user 0.029s	sys 0.039s
I20260709 12:17:12.314754 28755 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:12.317134 28796 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:12.317529 28796 ts_tablet_manager.cc:1403] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.002s
I20260709 12:17:12.319386 28796 raft_consensus.cc:359] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.319906 28796 raft_consensus.cc:385] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.320168 28796 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.320627 28829 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.321095 28829 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.320914 28796 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.321048 28797 raft_consensus.cc:359] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.321609 28829 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.321902 28797 raft_consensus.cc:385] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.322320 28797 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.323014 28797 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.321792 28503 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.325387 28797 ts_tablet_manager.cc:1434] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:17:12.326368 28797 tablet_bootstrap.cc:492] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
W20260709 12:17:12.328775 28648 leader_election.cc:343] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.331501 28796 ts_tablet_manager.cc:1434] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:17:12.332105 28797 tablet_bootstrap.cc:654] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.333532 28799 raft_consensus.cc:359] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.331676 28829 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.334272 28799 raft_consensus.cc:385] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.334618 28799 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.335464 28799 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.337975 28799 ts_tablet_manager.cc:1434] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 12:17:12.338920 28799 tablet_bootstrap.cc:492] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.339340 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:12.339898 28755 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.342134 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:12.342823 28607 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.345413 28799 tablet_bootstrap.cc:654] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.347575 28755 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:12.348804 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:12.349570 28858 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:12.349745 28829 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.350103 28858 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:12.351030 28858 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.355049 28607 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:12.358726 28796 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:12.360637 28505 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.400977 28797 tablet_bootstrap.cc:492] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.401574 28797 ts_tablet_manager.cc:1403] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.020s
I20260709 12:17:12.403682 28799 tablet_bootstrap.cc:492] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.404114 28799 ts_tablet_manager.cc:1403] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.012s
I20260709 12:17:12.410328 28796 tablet_bootstrap.cc:654] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.410533 28797 raft_consensus.cc:359] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.411201 28797 raft_consensus.cc:385] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.411715 28797 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.411226 28504 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.412499 28797 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.413035 28799 raft_consensus.cc:359] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.413796 28799 raft_consensus.cc:385] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.414104 28799 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.415285 28797 ts_tablet_manager.cc:1434] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:12.417106 28797 tablet_bootstrap.cc:492] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:12.416895 28799 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.419071 28799 ts_tablet_manager.cc:1434] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 12:17:12.419955 28799 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.420984 28825 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.421492 28825 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.423648 28825 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.425485 28797 tablet_bootstrap.cc:654] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.425715 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:12.427325 28648 leader_election.cc:343] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.427547 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:12.429558 28648 leader_election.cc:343] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.430004 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:12.430830 28825 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:12.431921 28796 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:12.432417 28796 ts_tablet_manager.cc:1403] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.005s
I20260709 12:17:12.432896 28797 tablet_bootstrap.cc:492] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.433437 28797 ts_tablet_manager.cc:1403] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:17:12.436303 28799 tablet_bootstrap.cc:654] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.436614 28797 raft_consensus.cc:359] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.435863 28796 raft_consensus.cc:359] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.437513 28796 raft_consensus.cc:385] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.437883 28796 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.438580 28796 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.440634 28796 ts_tablet_manager.cc:1434] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:12.441896 28796 tablet_bootstrap.cc:492] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:12.437464 28797 raft_consensus.cc:385] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.442834 28797 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.443846 28797 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.446105 28797 ts_tablet_manager.cc:1434] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:17:12.448220 28796 tablet_bootstrap.cc:654] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.449438 28799 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.449772 28797 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:12.449873 28799 ts_tablet_manager.cc:1403] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 12:17:12.452391 28799 raft_consensus.cc:359] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:12.453117 28799 raft_consensus.cc:385] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.453388 28799 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.454228 28799 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:12.455412 28825 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.455878 28825 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } }
I20260709 12:17:12.458581 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:12.459335 28755 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 1: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:17:12.461031 28825 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:12.462551 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:12.463065 28797 tablet_bootstrap.cc:654] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.464309 28648 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:12.465466 28825 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.471411 28799 ts_tablet_manager.cc:1434] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:17:12.472990 28799 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.474596 28825 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:12.474792 28797 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.475234 28797 ts_tablet_manager.cc:1403] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 12:17:12.477907 28797 raft_consensus.cc:359] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.478564 28797 raft_consensus.cc:385] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.478850 28797 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.479477 28797 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.481333 28796 tablet_bootstrap.cc:492] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:12.481824 28796 ts_tablet_manager.cc:1403] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.016s
I20260709 12:17:12.482581 28799 tablet_bootstrap.cc:654] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.484740 28796 raft_consensus.cc:359] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.485476 28796 raft_consensus.cc:385] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.485504 28797 ts_tablet_manager.cc:1434] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:17:12.485881 28796 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.486584 28797 tablet_bootstrap.cc:492] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:12.486748 28796 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.493073 28796 ts_tablet_manager.cc:1434] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:17:12.494035 28796 tablet_bootstrap.cc:492] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:12.497709 28797 tablet_bootstrap.cc:654] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.497881 28799 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.498512 28799 ts_tablet_manager.cc:1403] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 12:17:12.500602 28796 tablet_bootstrap.cc:654] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.501592 28799 raft_consensus.cc:359] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.502450 28799 raft_consensus.cc:385] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.502842 28799 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.503968 28799 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.511929 28796 tablet_bootstrap.cc:492] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:12.512072 28799 ts_tablet_manager.cc:1434] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:12.512512 28796 ts_tablet_manager.cc:1403] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 12:17:12.513298 28799 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.515480 28796 raft_consensus.cc:359] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.516237 28796 raft_consensus.cc:385] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.516543 28796 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.517462 28796 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.519790 28796 ts_tablet_manager.cc:1434] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:12.521703 28796 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:12.525728 28799 tablet_bootstrap.cc:654] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.527043 28859 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.527555 28859 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.530458 28803 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:12.530639 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:12.531075 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:12.532332 28573 leader_election.cc:343] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.532810 28859 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.532550 28825 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:12.533303 28571 leader_election.cc:343] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.533771 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:12.538684 28859 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:12.541812 28797 tablet_bootstrap.cc:492] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.542484 28797 ts_tablet_manager.cc:1403] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.014s
I20260709 12:17:12.544955 28825 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.548609 28796 tablet_bootstrap.cc:654] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.553120 28797 raft_consensus.cc:359] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.554134 28797 raft_consensus.cc:385] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.554522 28797 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.555459 28797 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.558315 28797 ts_tablet_manager.cc:1434] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:17:12.559544 28797 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:12.565084 28799 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.565871 28799 ts_tablet_manager.cc:1403] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.006s
W20260709 12:17:12.567059 28648 consensus_peers.cc:597] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:12.567626 28803 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:12.568532 28797 tablet_bootstrap.cc:654] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.569269 28825 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.578831 28807 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.579341 28807 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.582581 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:12.582113 28807 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:12.585675 28648 leader_election.cc:343] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.583571 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:12.581941 28799 raft_consensus.cc:359] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.587230 28755 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:12.587235 28799 raft_consensus.cc:385] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.589255 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:12.593330 28799 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.594190 28807 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.594602 28807 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.595041 28807 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.594396 28799 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.599908 28799 ts_tablet_manager.cc:1434] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.005s
I20260709 12:17:12.601400 28799 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.616863 28807 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.622148 28829 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:12.627031 28807 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.631397 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:12.632902 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:12.633744 28755 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:12.634075 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:17:12.635581 28648 leader_election.cc:343] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.637274 28797 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.637884 28797 ts_tablet_manager.cc:1403] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.021s
I20260709 12:17:12.638893 28799 tablet_bootstrap.cc:654] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.640197 28796 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:12.640688 28796 ts_tablet_manager.cc:1403] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.013s
I20260709 12:17:12.640763 28797 raft_consensus.cc:359] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.641496 28797 raft_consensus.cc:385] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.641867 28797 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.642695 28797 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.645372 28818 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.645884 28818 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.647600 28796 raft_consensus.cc:359] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.648294 28796 raft_consensus.cc:385] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.648699 28796 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.651538 28797 ts_tablet_manager.cc:1434] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:12.651978 28818 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:12.653764 28796 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.654469 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:12.654892 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:12.655682 28720 leader_election.cc:343] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.654342 28797 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
W20260709 12:17:12.656401 28722 leader_election.cc:343] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.656881 28722 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:12.657990 28818 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:12.656565 28796 ts_tablet_manager.cc:1434] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:17:12.658468 28755 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:12.659854 28796 tablet_bootstrap.cc:492] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:12.662621 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:12.663467 28858 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:12.663998 28858 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:12.664604 28829 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.666601 28858 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.673425 28832 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.674073 28832 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.677448 28832 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:12.679893 28797 tablet_bootstrap.cc:654] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.695993 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:12.695986 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:12.697574 28607 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:12.699162 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:12.700378 28832 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.700927 28832 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.701370 28832 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:12.701964 28720 leader_election.cc:343] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.713199 28796 tablet_bootstrap.cc:654] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.713728 28799 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.714207 28799 ts_tablet_manager.cc:1403] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.024s
I20260709 12:17:12.726415 28799 raft_consensus.cc:359] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.728205 28799 raft_consensus.cc:385] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.728585 28799 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.729291 28799 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.731478 28799 ts_tablet_manager.cc:1434] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:17:12.732424 28799 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.734573 28800 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.735422 28800 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.737224 28832 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.739931 28832 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:12.740185 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:12.741707 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:12.742333 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:12.745726 28799 tablet_bootstrap.cc:654] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:12.746146 28720 leader_election.cc:343] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.746327 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:12.747421 28606 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.741421 28800 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:17:12.753065 28722 leader_election.cc:343] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.753821 28803 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.756695 28870 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.757444 28803 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.759450 28803 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.760571 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:12.762274 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:12.760563 28720 leader_election.cc:343] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:12.763967 28573 leader_election.cc:343] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.764245 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:17:12.766214 28571 leader_election.cc:343] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.766464 28800 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:12.766669 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:12.768569 28606 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:12.770210 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:12.771339 28800 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:12.771807 28800 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:12.768537 28803 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:12.772666 28800 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.782235 28858 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.777974 28504 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:12.781759 28803 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.786538 28870 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.787434 28870 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.788457 28803 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.790534 28803 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.793598 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:12.794100 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:12.794435 28680 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:12.795352 28681 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:12.792204 28870 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.796830 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:12.810946 28797 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.811609 28797 ts_tablet_manager.cc:1403] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.157s	user 0.027s	sys 0.024s
I20260709 12:17:12.797137 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:12.814649 28870 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.814826 28571 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:12.815034 28870 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.815486 28870 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:12.816298 28573 leader_election.cc:343] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.821334 28797 raft_consensus.cc:359] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.821555 28807 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.822126 28797 raft_consensus.cc:385] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.817762 28859 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.822563 28797 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.822768 28859 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.823146 28859 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.802896 28858 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:17:12.823480 28797 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.825800 28797 ts_tablet_manager.cc:1434] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 12:17:12.826823 28797 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:12.796914 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:12.830713 28573 leader_election.cc:343] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.820222 28502 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:12.834095 28797 tablet_bootstrap.cc:654] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:12.833732 28859 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.844887 28796 tablet_bootstrap.cc:492] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:12.845502 28796 ts_tablet_manager.cc:1403] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.186s	user 0.023s	sys 0.020s
I20260709 12:17:12.858572 28803 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:12.873447 28859 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.874150 28799 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:12.874796 28799 ts_tablet_manager.cc:1403] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.008s
I20260709 12:17:12.913209 28796 raft_consensus.cc:359] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.876777 28859 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.915158 28796 raft_consensus.cc:385] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.883610 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:12.885984 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:12.915856 28796 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.919109 28796 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.918547 28682 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.921434 28796 ts_tablet_manager.cc:1434] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.076s	user 0.011s	sys 0.003s
I20260709 12:17:12.922412 28796 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:12.918051 28825 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:17:12.917091 28859 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:12.927337 28573 leader_election.cc:343] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.928236 28800 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.928826 28800 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.928989 28799 raft_consensus.cc:359] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.930152 28799 raft_consensus.cc:385] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.930528 28799 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:12.931406 28799 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.910861 28870 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.932502 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:12.932502 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:12.933949 28722 leader_election.cc:343] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:12.934137 28681 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:12.978874 28859 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.934422 28870 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:12.980219 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:12.981233 28680 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:12.938446 28818 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.982053 28797 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:12.931398 28800 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:12.938771 28720 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:12.982692 28797 ts_tablet_manager.cc:1403] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.156s	user 0.013s	sys 0.025s
I20260709 12:17:12.958433 28799 ts_tablet_manager.cc:1434] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.083s	user 0.011s	sys 0.000s
I20260709 12:17:12.984906 28799 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:12.978761 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:12.962746 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:12.978447 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:12.988497 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49806.2us
I20260709 12:17:12.987315 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:12.991482 28870 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.992492 28870 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.982296 28818 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.987315 28800 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:12.994379 28870 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.991883 28754 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.991808 28681 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:12.998030 28797 raft_consensus.cc:359] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:12.999120 28797 raft_consensus.cc:385] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:12.999404 28797 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.000074 28797 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.003741 28797 ts_tablet_manager.cc:1434] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:17:13.005089 28797 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:12.996754 28800 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.004549 28752 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:13.005659 28800 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.016209 28800 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.014653 28754 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:13.030050 28870 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.049522 28682 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:13.051561 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:13.051882 28800 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.052292 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:13.053143 28571 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:13.053433 28796 tablet_bootstrap.cc:654] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.055748 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.055955 28680 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.062258 28907 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.062708 28797 tablet_bootstrap.cc:654] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.062775 28907 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:13.061334 28859 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.064881 28859 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:13.067149 28859 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.067418 28907 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.074764 28607 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 1: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:17:13.074548 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:17:13.076176 28722 leader_election.cc:343] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.078419 28680 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:13.078722 28818 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.081549 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.084725 28799 tablet_bootstrap.cc:654] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.084951 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:13.085969 28754 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.085992 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:13.087491 28682 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.091341 28680 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 1: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:17:13.092172 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:13.070690 28870 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.099965 28803 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.101838 28803 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:13.103431 28803 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.106936 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:13.114953 28681 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
W20260709 12:17:13.129083 28648 consensus_peers.cc:597] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.136551 28754 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:13.137737 28818 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.142880 28682 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:13.145377 28803 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.148864 28803 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.147590 28720 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:13.150764 28799 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:13.151299 28799 ts_tablet_manager.cc:1403] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.167s	user 0.008s	sys 0.012s
I20260709 12:17:13.151304 28818 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.151892 28818 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:13.153411 28818 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.154286 28799 raft_consensus.cc:359] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.154917 28799 raft_consensus.cc:385] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.155180 28799 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.155857 28799 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.157557 28799 ts_tablet_manager.cc:1434] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 12:17:13.157681 28797 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:13.158138 28797 ts_tablet_manager.cc:1403] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.154s	user 0.020s	sys 0.005s
I20260709 12:17:13.158859 28799 tablet_bootstrap.cc:492] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:13.160912 28803 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.162968 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:13.163304 28797 raft_consensus.cc:359] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.163975 28797 raft_consensus.cc:385] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.164269 28797 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.164949 28799 tablet_bootstrap.cc:654] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:13.164419 28573 leader_election.cc:343] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.164963 28797 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.167974 28858 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:13.170447 28797 ts_tablet_manager.cc:1434] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:13.173435 28797 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:13.174322 28832 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.179971 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.183601 28799 tablet_bootstrap.cc:492] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
W20260709 12:17:13.185930 28571 leader_election.cc:343] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.186467 28571 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:13.186619 28799 ts_tablet_manager.cc:1403] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.008s
I20260709 12:17:13.187662 28803 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.187693 28503 catalog_manager.cc:5697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.190233 28799 raft_consensus.cc:359] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.190379 28858 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.190927 28799 raft_consensus.cc:385] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.191255 28799 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.191522 28796 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:13.191962 28796 ts_tablet_manager.cc:1403] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.270s	user 0.021s	sys 0.038s
I20260709 12:17:13.191259 28858 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.192116 28799 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.193900 28858 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.195431 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.196720 28797 tablet_bootstrap.cc:654] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.196664 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:13.198948 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:13.199770 28858 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.201514 28803 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.201987 28803 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.202971 28681 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.204025 28803 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.193574 28503 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.194478 28796 raft_consensus.cc:359] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.205974 28796 raft_consensus.cc:385] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.206269 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:13.206879 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.206254 28796 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
W20260709 12:17:13.208163 28573 leader_election.cc:343] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.208250 28796 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:13.209268 28571 leader_election.cc:343] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.209794 28799 ts_tablet_manager.cc:1434] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:17:13.209697 28571 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:13.210896 28796 ts_tablet_manager.cc:1434] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:17:13.211786 28796 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:13.214146 28803 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.216616 28818 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.218519 28796 tablet_bootstrap.cc:654] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.226574 28502 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:13.235379 28799 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:13.235627 28796 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:13.236014 28796 ts_tablet_manager.cc:1403] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.007s
I20260709 12:17:13.238765 28796 raft_consensus.cc:359] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.239444 28796 raft_consensus.cc:385] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.239733 28796 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.240356 28796 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.242921 28796 ts_tablet_manager.cc:1434] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:13.244073 28796 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:13.241537 28799 tablet_bootstrap.cc:654] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.251387 28796 tablet_bootstrap.cc:654] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.252992 28797 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:13.253594 28797 ts_tablet_manager.cc:1403] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.015s
I20260709 12:17:13.258447 28503 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:13.260373 28797 raft_consensus.cc:359] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.261092 28797 raft_consensus.cc:385] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.261389 28797 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.262080 28799 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:13.262406 28796 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:13.262066 28797 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.262799 28796 ts_tablet_manager.cc:1403] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:17:13.262645 28799 ts_tablet_manager.cc:1403] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 12:17:13.264587 28797 ts_tablet_manager.cc:1434] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:17:13.265532 28797 tablet_bootstrap.cc:492] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:13.265491 28796 raft_consensus.cc:359] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.265653 28799 raft_consensus.cc:359] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.266288 28796 raft_consensus.cc:385] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.266623 28799 raft_consensus.cc:385] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.266620 28796 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.267120 28799 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.267530 28796 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.267956 28799 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.269680 28796 ts_tablet_manager.cc:1434] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:13.270527 28796 tablet_bootstrap.cc:492] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:13.270812 28799 ts_tablet_manager.cc:1434] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:13.271790 28799 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:13.272466 28797 tablet_bootstrap.cc:654] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.276117 28796 tablet_bootstrap.cc:654] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.277423 28799 tablet_bootstrap.cc:654] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.319634 28799 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:13.320073 28799 ts_tablet_manager.cc:1403] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 12:17:13.322192 28796 tablet_bootstrap.cc:492] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:13.322721 28796 ts_tablet_manager.cc:1403] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.052s	user 0.028s	sys 0.020s
I20260709 12:17:13.322753 28799 raft_consensus.cc:359] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.323534 28799 raft_consensus.cc:385] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.323818 28799 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.324524 28799 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.325749 28796 raft_consensus.cc:359] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.326406 28796 raft_consensus.cc:385] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.326717 28796 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.327512 28796 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.329586 28796 ts_tablet_manager.cc:1434] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:13.332828 28796 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:13.335175 28799 ts_tablet_manager.cc:1434] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:17:13.338795 28796 tablet_bootstrap.cc:654] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.352368 28799 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:13.359112 28796 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:13.359164 28799 tablet_bootstrap.cc:654] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.359826 28796 ts_tablet_manager.cc:1403] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.006s
I20260709 12:17:13.361986 28797 tablet_bootstrap.cc:492] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:13.362610 28797 ts_tablet_manager.cc:1403] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.097s	user 0.033s	sys 0.063s
I20260709 12:17:13.362968 28796 raft_consensus.cc:359] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.363721 28796 raft_consensus.cc:385] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.363996 28796 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.364709 28796 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.365391 28797 raft_consensus.cc:359] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.366030 28797 raft_consensus.cc:385] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.366298 28797 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.366942 28796 ts_tablet_manager.cc:1434] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:17:13.366909 28797 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.367971 28796 tablet_bootstrap.cc:492] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:13.368984 28797 ts_tablet_manager.cc:1434] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:17:13.369791 28797 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:13.376122 28799 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:13.376694 28799 ts_tablet_manager.cc:1403] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.007s
I20260709 12:17:13.379535 28799 raft_consensus.cc:359] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.380231 28799 raft_consensus.cc:385] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.380508 28799 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.381382 28796 tablet_bootstrap.cc:654] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.382238 28797 tablet_bootstrap.cc:654] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.384760 28799 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.386791 28799 ts_tablet_manager.cc:1434] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:17:13.388007 28799 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:13.412352 28796 tablet_bootstrap.cc:492] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:13.412885 28796 ts_tablet_manager.cc:1403] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.001s
I20260709 12:17:13.413200 28799 tablet_bootstrap.cc:654] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.416152 28796 raft_consensus.cc:359] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.416901 28796 raft_consensus.cc:385] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.417199 28796 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.417914 28796 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.420189 28796 ts_tablet_manager.cc:1434] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:13.422340 28797 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:13.422837 28797 ts_tablet_manager.cc:1403] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.011s
I20260709 12:17:13.426263 28797 raft_consensus.cc:359] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.427008 28797 raft_consensus.cc:385] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.427304 28797 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.428143 28797 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.430779 28797 ts_tablet_manager.cc:1434] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:13.432107 28797 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:13.437127 28807 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.437884 28796 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:13.437640 28807 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.439709 28807 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.442133 28807 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.442206 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:13.442673 28807 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.443231 28753 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:13.444849 28796 tablet_bootstrap.cc:654] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.445072 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:13.445142 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.445987 28825 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.446403 28825 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.446746 28825 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.452992 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.453745 28606 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:13.454244 28799 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:13.454706 28799 ts_tablet_manager.cc:1403] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.021s
W20260709 12:17:13.454775 28648 leader_election.cc:343] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.458091 28799 raft_consensus.cc:359] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.458693 28799 raft_consensus.cc:385] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.458930 28799 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.459615 28799 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.461293 28799 ts_tablet_manager.cc:1434] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:13.462069 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:13.462390 28799 tablet_bootstrap.cc:492] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:13.463275 28818 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.463492 28807 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.463763 28818 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.465962 28818 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.466883 28825 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.467272 28858 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.467711 28858 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.468062 28858 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.468838 28799 tablet_bootstrap.cc:654] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.468729 28907 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.470408 28797 tablet_bootstrap.cc:654] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.462607 28796 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:13.473914 28796 ts_tablet_manager.cc:1403] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.001s
I20260709 12:17:13.472954 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.474711 28681 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:13.477471 28796 raft_consensus.cc:359] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.477349 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.478374 28796 raft_consensus.cc:385] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.478775 28796 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
W20260709 12:17:13.479485 28722 leader_election.cc:343] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.480073 28720 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:13.468896 28825 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.479650 28796 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.481213 28921 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.481786 28832 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.481740 28921 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.482391 28832 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.484961 28832 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.485140 28796 ts_tablet_manager.cc:1434] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:17:13.496934 28907 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:13.498982 28796 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:13.501390 28921 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.513041 28921 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.502056 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.504276 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:13.510792 28825 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.515480 28921 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.515960 28753 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:13.515951 28825 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.518399 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.519110 28605 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:13.519438 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.520049 28679 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:13.520330 28722 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:13.515007 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:13.521097 28754 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.522115 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.522254 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:13.522773 28605 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:13.522976 28753 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:13.523984 28818 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.524459 28818 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.518162 28921 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.502848 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.524829 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:17:13.526134 28720 leader_election.cc:343] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.524842 28818 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:13.528254 28722 leader_election.cc:343] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.528903 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:13.528322 28939 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.529714 28921 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.505892 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:13.530282 28939 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.531400 28939 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.532537 28825 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:13.534026 28648 leader_election.cc:343] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.535279 28832 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.536712 28921 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.537178 28921 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.539197 28921 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.539850 28859 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:13.540333 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.540999 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:13.541095 28680 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:13.541712 28607 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:13.541316 28858 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.542547 28720 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:13.543586 28858 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.543658 28800 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:13.544278 28800 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.544713 28800 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.545881 28818 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.547921 28818 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.551566 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:13.552183 28679 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.552136 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:13.552837 28607 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.553194 28832 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.555303 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:13.555980 28678 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.560297 28797 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:13.560954 28797 ts_tablet_manager.cc:1403] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.003s
I20260709 12:17:13.561453 28859 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.561970 28859 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.563308 28679 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:13.564167 28859 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.564416 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:13.569296 28859 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.570122 28754 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:13.569941 28859 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.571398 28797 raft_consensus.cc:359] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.572063 28797 raft_consensus.cc:385] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.572320 28797 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.572997 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:13.573273 28797 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.578377 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:13.578984 28606 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.578914 28800 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.567723 28832 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.579916 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:13.589946 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:13.590543 28756 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.592644 28859 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.594880 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:13.597141 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.597890 28680 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:17:13.599426 28571 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:13.602267 28870 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.602325 28752 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:13.608618 28722 leader_election.cc:343] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:13.628604 28797 ts_tablet_manager.cc:1434] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 12:17:13.623136 28832 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:13.624783 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:13.632087 28797 tablet_bootstrap.cc:492] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:13.633577 28799 tablet_bootstrap.cc:492] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:13.633998 28799 ts_tablet_manager.cc:1403] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.172s	user 0.042s	sys 0.009s
I20260709 12:17:13.641515 28571 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:13.643092 28859 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.638232 28800 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:13.654090 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:13.881743 28796 tablet_bootstrap.cc:654] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.884886 28939 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.890479 28797 tablet_bootstrap.cc:654] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.664579 28604 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.761117 28607 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:13.684964 28756 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:13.745632 28605 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.666347 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:17:13.894951 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 103334us
I20260709 12:17:13.686669 28678 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:13.766556 28606 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:13.700812 28870 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:13.897114 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:13.915553 28799 raft_consensus.cc:359] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.920065 28799 raft_consensus.cc:385] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:13.920467 28799 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:13.921319 28799 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.660573 28832 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.934381 28799 ts_tablet_manager.cc:1434] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.300s	user 0.005s	sys 0.004s
I20260709 12:17:13.935525 28799 tablet_bootstrap.cc:492] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:13.922947 28858 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:13.925076 28870 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.938874 28921 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.925741 28681 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:13.933841 28944 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:13.949693 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:17:13.926187 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 267308us
I20260709 12:17:13.960611 28939 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.965462 28799 tablet_bootstrap.cc:654] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:13.946164 28858 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:17:13.970372 28941 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:17:13.945739 28870 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.948298 28921 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.957666 28944 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.973021 28720 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:17:13.986048 28940 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:17:13.996469 28870 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:13.996981 28858 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:13.997797 28681 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:14.000622 28818 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:14.005693 28818 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:14.006552 28818 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.003065 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:14.003432 28800 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:14.017845 28796 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:14.018544 28796 ts_tablet_manager.cc:1403] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.520s	user 0.013s	sys 0.026s
I20260709 12:17:13.989212 28803 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:17:14.017863 28807 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:14.028618 28797 tablet_bootstrap.cc:492] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:14.029083 28797 ts_tablet_manager.cc:1403] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.397s	user 0.013s	sys 0.012s
I20260709 12:17:14.032557 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:14.030984 28807 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:14.033687 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:14.034926 28682 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:14.034690 28807 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.035756 28944 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:14.034307 28797 raft_consensus.cc:359] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.033159 28607 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:14.037889 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:14.043509 28797 raft_consensus.cc:385] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.044297 28947 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:14.041159 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:14.044756 28947 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.045032 28752 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:14.045117 28947 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:14.041726 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:14.047675 28753 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:14.043898 28797 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.029786 28720 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:14.038645 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:14.057957 28604 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:14.036294 28944 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:17:14.062418 28921 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:14.064189 28951 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:14.064744 28951 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:14.067126 28797 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.066779 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:14.077379 28796 raft_consensus.cc:359] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.077888 28797 ts_tablet_manager.cc:1434] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.007s
I20260709 12:17:14.078125 28796 raft_consensus.cc:385] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.078392 28796 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.079125 28797 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:14.079311 28796 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.085213 28907 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:14.083711 28753 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:14.097148 28799 tablet_bootstrap.cc:492] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:14.097776 28799 ts_tablet_manager.cc:1403] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.162s	user 0.017s	sys 0.011s
I20260709 12:17:14.077661 28951 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.100169 28607 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:14.101717 28796 ts_tablet_manager.cc:1434] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 12:17:14.104272 28796 tablet_bootstrap.cc:492] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:14.141588 28571 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:14.142433 28859 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:14.150986 28958 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:17:14.154295 28947 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.164330 28859 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:14.137769 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:14.166456 28954 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:17:14.282837 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:14.274060 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:14.315189 28750 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:14.312003 28799 raft_consensus.cc:359] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.316884 28799 raft_consensus.cc:385] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:17:14.310570 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 129286us
I20260709 12:17:14.317247 28799 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.322256 28796 tablet_bootstrap.cc:654] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.192391 28947 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:14.319589 28799 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.216926 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:14.335311 28753 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:14.340027 28799 ts_tablet_manager.cc:1434] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.242s	user 0.013s	sys 0.008s
I20260709 12:17:14.327497 28818 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.345227 28818 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:14.344663 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 159426us
I20260709 12:17:14.357080 28799 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:14.358233 28797 tablet_bootstrap.cc:654] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.358130 28946 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.361261 28818 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:14.361810 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:14.366394 28504 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.361306 28946 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.373149 28946 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:14.365332 28682 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:14.377517 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:14.379376 28573 leader_election.cc:343] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.382876 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:14.384259 28796 tablet_bootstrap.cc:492] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:14.384807 28796 ts_tablet_manager.cc:1403] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.282s	user 0.014s	sys 0.005s
I20260709 12:17:14.386188 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:14.388046 28720 leader_election.cc:343] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.374020 28722 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:17:14.420629 28960 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:14.389377 28680 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:14.364895 28951 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:17:14.432456 28950 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:17:14.433645 28963 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.002s
I20260709 12:17:14.414459 28505 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:14.436703 28961 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.123s	user 0.004s	sys 0.000s
W20260709 12:17:14.446036 28962 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:17:14.450029 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:14.452164 28944 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:14.452591 28944 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.452945 28944 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:14.453794 28796 raft_consensus.cc:359] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.454541 28796 raft_consensus.cc:385] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.454854 28796 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.455972 28796 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.444139 28942 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:14.441107 28505 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:14.444303 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70427.3us
I20260709 12:17:14.474622 28950 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:14.495664 28750 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:14.499480 28682 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:14.503324 28796 ts_tablet_manager.cc:1434] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.013s
I20260709 12:17:14.504808 28796 tablet_bootstrap.cc:492] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:14.507887 28797 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:14.508369 28797 ts_tablet_manager.cc:1403] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.430s	user 0.012s	sys 0.065s
I20260709 12:17:14.506809 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:14.513796 28799 tablet_bootstrap.cc:654] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.510914 28818 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.520284 28818 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.523095 28948 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:14.509578 28950 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.526677 28942 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:14.531464 28948 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:14.525658 28818 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:14.537566 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:14.541493 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:14.543668 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:14.532400 28948 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.549304 28944 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:14.556684 28720 leader_election.cc:343] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.552187 28797 raft_consensus.cc:359] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.559944 28797 raft_consensus.cc:385] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.560197 28797 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
W20260709 12:17:14.559485 28722 leader_election.cc:343] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.561286 28722 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:14.562106 28832 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:14.562567 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:14.563170 28722 leader_election.cc:343] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.564134 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:14.563951 28971 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:14.564975 28832 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:14.564771 28797 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.565761 28796 tablet_bootstrap.cc:654] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.570631 28797 ts_tablet_manager.cc:1434] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 12:17:14.571399 28797 tablet_bootstrap.cc:492] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:14.576807 28803 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.577291 28803 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.577975 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:14.579418 28680 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:14.573591 28973 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:17:14.584000 28944 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:14.587288 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:14.600689 28803 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:14.601219 28573 leader_election.cc:343] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.611279 28832 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:14.617671 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:14.620024 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:14.617887 28974 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.053s
I20260709 12:17:14.635349 28799 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:14.636003 28799 ts_tablet_manager.cc:1403] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.279s	user 0.015s	sys 0.013s
I20260709 12:17:14.630918 28573 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:14.642549 28944 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:14.646129 28971 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:14.646523 28799 raft_consensus.cc:359] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.647209 28799 raft_consensus.cc:385] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.647462 28799 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.648128 28799 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.650347 28799 ts_tablet_manager.cc:1434] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:17:14.651232 28799 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:14.652205 28796 tablet_bootstrap.cc:492] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:14.652666 28796 ts_tablet_manager.cc:1403] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.013s
I20260709 12:17:14.658725 28796 raft_consensus.cc:359] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.666273 28796 raft_consensus.cc:385] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.666666 28796 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.691097 28796 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.671124 28971 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:17:14.704595 28976 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:17:14.706303 28796 ts_tablet_manager.cc:1434] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 12:17:14.699635 28680 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:14.707409 28796 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
W20260709 12:17:14.708611 28981 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:17:14.714732 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:14.718114 28944 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:14.718650 28944 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:14.719521 28944 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.719961 28797 tablet_bootstrap.cc:654] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.736609 28799 tablet_bootstrap.cc:654] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.748911 28976 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:17:14.763883 28796 tablet_bootstrap.cc:654] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:14.763760 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45806.8us
I20260709 12:17:14.777995 28800 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.778855 28800 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.781116 28800 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:14.783502 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:14.791288 28503 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.783998 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:14.793776 28678 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 1: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:17:14.794150 28989 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:17:14.798712 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:14.804554 28974 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:14.817312 28799 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:14.817955 28799 ts_tablet_manager.cc:1403] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.167s	user 0.013s	sys 0.009s
I20260709 12:17:14.818209 28505 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.820370 28505 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.822820 28971 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.823472 28971 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.828536 28971 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:14.837361 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:14.846159 28648 leader_election.cc:343] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.852312 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:14.853564 28797 tablet_bootstrap.cc:492] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:14.854203 28797 ts_tablet_manager.cc:1403] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.283s	user 0.013s	sys 0.019s
W20260709 12:17:14.854537 28648 leader_election.cc:343] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.855165 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:14.856163 28858 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:14.862114 28797 raft_consensus.cc:359] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.860236 28974 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:14.865090 28797 raft_consensus.cc:385] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.865410 28797 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.866140 28797 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.866984 28504 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.868506 28797 ts_tablet_manager.cc:1434] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:17:14.868847 28796 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:14.868366 28799 raft_consensus.cc:359] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.869220 28799 raft_consensus.cc:385] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.869390 28796 ts_tablet_manager.cc:1403] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.045s
I20260709 12:17:14.869496 28799 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.869668 28797 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:14.870613 28799 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.872260 28796 raft_consensus.cc:359] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.873008 28799 ts_tablet_manager.cc:1434] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:17:14.874023 28799 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:14.872969 28796 raft_consensus.cc:385] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.874521 28796 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.875229 28796 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.877660 28796 ts_tablet_manager.cc:1434] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:17:14.878934 28796 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:14.885947 28796 tablet_bootstrap.cc:654] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.886795 28797 tablet_bootstrap.cc:654] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.896982 28796 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:14.897537 28796 ts_tablet_manager.cc:1403] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:17:14.898119 28799 tablet_bootstrap.cc:654] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.900239 28796 raft_consensus.cc:359] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.901258 28796 raft_consensus.cc:385] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.901669 28796 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.902604 28796 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.905787 28796 ts_tablet_manager.cc:1434] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:14.907027 28796 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:14.916973 28796 tablet_bootstrap.cc:654] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.918162 28971 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:14.932893 28799 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:14.933362 28799 ts_tablet_manager.cc:1403] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.007s
I20260709 12:17:14.934748 28796 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:14.938779 28796 ts_tablet_manager.cc:1403] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.007s
I20260709 12:17:14.939472 28976 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.939999 28976 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.942022 28796 raft_consensus.cc:359] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.942862 28796 raft_consensus.cc:385] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.943213 28796 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.943879 28796 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.944648 28944 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:14.948233 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:14.949211 28796 ts_tablet_manager.cc:1434] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:17:14.950261 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:14.953029 28722 leader_election.cc:343] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:14.953835 28720 leader_election.cc:343] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:14.954384 28720 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:14.955780 28951 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:14.967621 28976 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:14.968343 28796 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:14.968007 28799 raft_consensus.cc:359] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.972851 28799 raft_consensus.cc:385] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:14.973181 28799 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:14.974366 28799 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:14.976339 28799 ts_tablet_manager.cc:1434] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 12:17:14.977218 28799 tablet_bootstrap.cc:492] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:14.977922 28858 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:14.982764 28799 tablet_bootstrap.cc:654] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:14.996562 28796 tablet_bootstrap.cc:654] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.001502 28947 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.013518 28799 tablet_bootstrap.cc:492] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.014070 28799 ts_tablet_manager.cc:1403] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.006s
W20260709 12:17:15.013592 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:15.020743 28799 raft_consensus.cc:359] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.029908 28797 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.030292 28799 raft_consensus.cc:385] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.030395 28797 ts_tablet_manager.cc:1403] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.161s	user 0.067s	sys 0.065s
I20260709 12:17:15.030632 28799 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.030577 28505 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.031409 28799 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.032928 28797 raft_consensus.cc:359] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.033452 28799 ts_tablet_manager.cc:1434] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:17:15.033595 28797 raft_consensus.cc:385] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.033910 28797 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.034235 28796 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.034386 28799 tablet_bootstrap.cc:492] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.034957 28796 ts_tablet_manager.cc:1403] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.007s
I20260709 12:17:15.034533 28797 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.036931 28797 ts_tablet_manager.cc:1434] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:15.038020 28797 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.037681 28796 raft_consensus.cc:359] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.038455 28796 raft_consensus.cc:385] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.038797 28796 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.039551 28796 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.041844 28796 ts_tablet_manager.cc:1434] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:17:15.043395 28796 tablet_bootstrap.cc:492] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.044880 28799 tablet_bootstrap.cc:654] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.048718 28797 tablet_bootstrap.cc:654] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.050155 28796 tablet_bootstrap.cc:654] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.068300 28604 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.102119 28858 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.102632 28858 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.105809 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:15.107532 28648 leader_election.cc:343] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.108850 28858 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.110451 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:15.111800 28648 leader_election.cc:343] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.112231 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.113296 28858 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.141583 28951 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.142376 28796 tablet_bootstrap.cc:492] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.142120 28951 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.142990 28796 ts_tablet_manager.cc:1403] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.034s
I20260709 12:17:15.143451 28797 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.144505 28951 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.145104 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.145731 28604 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:15.145978 28796 raft_consensus.cc:359] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.146448 28799 tablet_bootstrap.cc:492] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.146528 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.146814 28796 raft_consensus.cc:385] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.147038 28799 ts_tablet_manager.cc:1403] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.113s	user 0.026s	sys 0.060s
I20260709 12:17:15.146896 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:15.147205 28796 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.143913 28797 ts_tablet_manager.cc:1403] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.106s	user 0.025s	sys 0.043s
I20260709 12:17:15.147683 28974 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:17:15.147940 28720 leader_election.cc:343] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.148051 28974 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.148569 28974 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.148200 28796 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.150307 28797 raft_consensus.cc:359] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.150965 28797 raft_consensus.cc:385] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.151031 28796 ts_tablet_manager.cc:1434] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:17:15.151273 28797 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.152156 28796 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.151973 28797 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.154201 28797 ts_tablet_manager.cc:1434] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:17:15.156333 28797 tablet_bootstrap.cc:492] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.156154 28974 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.157145 28799 raft_consensus.cc:359] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.157853 28799 raft_consensus.cc:385] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.158172 28799 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.158850 28799 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.159917 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:15.161262 28799 ts_tablet_manager.cc:1434] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:17:15.161471 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:15.162024 28606 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.162271 28678 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.162956 28799 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.164240 28796 tablet_bootstrap.cc:654] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.168956 28799 tablet_bootstrap.cc:654] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.172785 28606 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:15.177330 28678 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:15.178637 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:15.179687 28951 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:15.180191 28951 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:15.181048 28951 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.185213 28974 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.189453 28947 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.190054 28797 tablet_bootstrap.cc:654] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.194224 28796 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.194774 28796 ts_tablet_manager.cc:1403] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.016s
I20260709 12:17:15.197856 28796 raft_consensus.cc:359] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.198516 28796 raft_consensus.cc:385] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.198784 28796 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.199429 28796 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.200030 28947 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.208501 28951 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.208997 28951 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.210598 28796 ts_tablet_manager.cc:1434] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:17:15.210219 28504 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.210959 28951 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.211464 28796 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.212570 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:15.214010 28722 leader_election.cc:343] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.218305 28799 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.218331 28797 tablet_bootstrap.cc:492] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.218879 28799 ts_tablet_manager.cc:1403] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.056s	user 0.006s	sys 0.008s
I20260709 12:17:15.219035 28797 ts_tablet_manager.cc:1403] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.002s
I20260709 12:17:15.221088 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.221711 28681 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:15.221503 28799 raft_consensus.cc:359] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.222183 28799 raft_consensus.cc:385] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.222458 28799 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.222445 28797 raft_consensus.cc:359] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.223336 28797 raft_consensus.cc:385] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.223309 28799 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.223817 28797 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.225041 28796 tablet_bootstrap.cc:654] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.224812 28797 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.229359 28799 ts_tablet_manager.cc:1434] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:17:15.229512 28797 ts_tablet_manager.cc:1434] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:17:15.230248 28799 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.230578 28797 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.234833 28951 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.235324 28951 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.236238 28799 tablet_bootstrap.cc:654] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.223768 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.237434 28951 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.236848 28797 tablet_bootstrap.cc:654] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.238663 28971 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.240969 28971 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.243088 28971 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.244503 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.244854 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.245152 28606 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:15.239270 28974 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:15.246016 28974 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.246388 28974 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:15.249046 28722 leader_election.cc:343] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.253883 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:15.255555 28796 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.256035 28796 ts_tablet_manager.cc:1403] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 12:17:15.257241 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.254604 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.257925 28753 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:15.258302 28971 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:15.258764 28971 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.258980 28971 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.261484 28796 raft_consensus.cc:359] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.262018 28796 raft_consensus.cc:385] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.262282 28796 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.261770 28974 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.262924 28796 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.264456 28858 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.264937 28858 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.265429 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:15.266083 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:15.266872 28858 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.266783 28681 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:15.266757 28722 leader_election.cc:343] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.272792 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.272715 28971 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.273628 28606 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:15.275071 28796 ts_tablet_manager.cc:1434] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:17:15.275018 28971 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.275544 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:15.276022 28796 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.276561 28971 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:15.276953 28971 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.277567 28971 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.258342 28678 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:15.279914 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:15.280618 28606 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.279332 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.283106 28753 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:15.283198 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:15.283787 28756 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.283236 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.285774 28951 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:15.286168 28951 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.286531 28951 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.287703 28796 tablet_bootstrap.cc:654] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.290930 28756 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:15.292690 28951 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.286144 28947 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.293574 28947 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.292949 28681 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:15.295663 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.295868 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:15.296427 28976 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:15.296509 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:15.296725 28858 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:15.296986 28976 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:15.296496 28974 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.297901 28976 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.298543 28858 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:15.298672 28947 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.301000 28858 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.302667 28797 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.303115 28797 ts_tablet_manager.cc:1403] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.073s	user 0.004s	sys 0.006s
I20260709 12:17:15.299275 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:15.299044 28722 leader_election.cc:343] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.306015 28756 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:15.305922 28797 raft_consensus.cc:359] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.306726 28797 raft_consensus.cc:385] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.307003 28797 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.294122 28971 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.307430 28573 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:15.307637 28797 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.309799 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:15.310449 28604 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.311048 28951 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.311862 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:15.313172 28571 leader_election.cc:343] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.312137 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:15.314373 28971 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.314714 28681 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.315948 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:15.308380 28947 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:15.316543 28753 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.318112 28604 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:15.318722 28947 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.319109 28797 ts_tablet_manager.cc:1434] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:17:15.319470 28947 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.320996 28797 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.324453 28799 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.324954 28799 ts_tablet_manager.cc:1403] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.012s
I20260709 12:17:15.305987 28606 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:15.327178 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:15.335870 28753 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:15.337725 28797 tablet_bootstrap.cc:654] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.338552 28796 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.329556 28971 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:15.347015 28796 ts_tablet_manager.cc:1403] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.004s
I20260709 12:17:15.341544 28799 raft_consensus.cc:359] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.349527 28799 raft_consensus.cc:385] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.349143 28973 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.349908 28799 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.350152 28973 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.350627 28799 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.353554 28971 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:15.354904 28973 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.355350 28971 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.361351 28504 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.369158 28799 ts_tablet_manager.cc:1434] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 12:17:15.369958 28799 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.370982 28796 raft_consensus.cc:359] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.371498 28796 raft_consensus.cc:385] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.371732 28796 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.372289 28796 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.373870 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.374478 28753 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:15.374658 28796 ts_tablet_manager.cc:1434] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.001s
I20260709 12:17:15.369288 28976 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.375608 28796 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.375667 28976 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.379317 28976 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.362277 28947 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.380987 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.373034 28681 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:15.382031 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:15.384322 28722 leader_election.cc:343] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.385375 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:15.386011 28753 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.386648 28797 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.386583 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.386804 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:17:15.388041 28720 leader_election.cc:343] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.388152 28797 ts_tablet_manager.cc:1403] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.009s
I20260709 12:17:15.388594 28976 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:15.388513 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.387764 28505 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.392040 28800 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.397292 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:15.407572 28504 catalog_manager.cc:5697] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.401374 28976 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:15.408797 29024 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:15.409250 29024 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.409611 28976 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.412804 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:15.414577 28681 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.412645 28797 raft_consensus.cc:359] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.398180 28947 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.417013 28797 raft_consensus.cc:385] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.417899 28797 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.420183 28797 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.425006 28797 ts_tablet_manager.cc:1434] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:17:15.426448 28797 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.409621 29024 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:15.428382 28648 leader_election.cc:343] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.430900 28800 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.431388 28800 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.465703 28753 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:15.467538 28573 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:15.471590 28803 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:17:15.472779 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44434us
I20260709 12:17:15.481392 28796 tablet_bootstrap.cc:654] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.476794 28803 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:15.487596 28799 tablet_bootstrap.cc:654] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.488389 28946 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.488883 28946 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.483049 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.492977 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.493782 28682 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:17:15.496943 28803 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:15.501824 28722 leader_election.cc:343] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.505169 28681 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:15.509699 28504 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.484386 28800 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.528857 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.537045 28946 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.540937 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.544111 28797 tablet_bootstrap.cc:654] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.546111 28796 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.546557 28796 ts_tablet_manager.cc:1403] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.020s
I20260709 12:17:15.549139 28504 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.544812 28573 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:15.551640 28800 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.551795 28946 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.552119 28800 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.554143 28800 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.555361 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:15.556818 28722 leader_election.cc:343] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:15.558988 28720 leader_election.cc:343] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.563090 28799 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.563616 28799 ts_tablet_manager.cc:1403] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.194s	user 0.032s	sys 0.022s
I20260709 12:17:15.563401 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.565212 28800 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.566452 28946 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.566859 29024 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.567848 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.568957 29024 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:15.569456 28720 leader_election.cc:343] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.569898 28720 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.570456 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:15.570786 28800 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.571401 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:17:15.571687 28648 leader_election.cc:343] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.571980 28752 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.571733 28799 raft_consensus.cc:359] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.572624 28799 raft_consensus.cc:385] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.572911 28799 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.573743 28799 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.575726 28797 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.576954 28797 ts_tablet_manager.cc:1403] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.001s
I20260709 12:17:15.578729 28752 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:15.579713 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.573212 28796 raft_consensus.cc:359] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.580644 28796 raft_consensus.cc:385] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.580960 28796 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.581029 28825 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:15.581517 28825 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:15.581530 28797 raft_consensus.cc:359] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.581670 28796 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.582581 28797 raft_consensus.cc:385] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.582615 28825 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.585055 28799 ts_tablet_manager.cc:1434] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:17:15.586067 28799 tablet_bootstrap.cc:492] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.583045 28797 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.588691 28796 ts_tablet_manager.cc:1434] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 12:17:15.589579 28796 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.589922 28825 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.590354 28825 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.593122 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.594141 28825 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:15.594446 28648 leader_election.cc:343] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.596088 28505 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.597996 28796 tablet_bootstrap.cc:654] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.589493 28797 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.599400 28799 tablet_bootstrap.cc:654] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.606653 28797 ts_tablet_manager.cc:1434] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:17:15.607921 28797 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.611392 28800 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.630225 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.632612 28946 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.632877 28752 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:15.633309 28946 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.634591 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.635985 28825 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:15.636510 28825 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.636951 28825 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.636996 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.638170 28682 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:17:15.640461 28946 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.642017 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.631984 28797 tablet_bootstrap.cc:654] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.644356 28573 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:15.645709 28946 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.648402 28799 tablet_bootstrap.cc:492] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.648965 28799 ts_tablet_manager.cc:1403] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.063s	user 0.006s	sys 0.007s
I20260709 12:17:15.650254 28825 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.652105 28799 raft_consensus.cc:359] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.652866 28799 raft_consensus.cc:385] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.653203 28799 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.654924 28797 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.655359 28797 ts_tablet_manager.cc:1403] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.003s
I20260709 12:17:15.656426 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:15.656587 28799 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.657922 28797 raft_consensus.cc:359] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.658540 28797 raft_consensus.cc:385] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.658819 28797 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.659662 28797 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.661720 28797 ts_tablet_manager.cc:1434] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:15.662626 28797 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.664636 28946 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:15.666705 28648 leader_election.cc:343] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.668285 28797 tablet_bootstrap.cc:654] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.673581 28976 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:15.677532 28825 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.678512 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:15.678684 28797 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.679016 28752 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.679165 28797 ts_tablet_manager.cc:1403] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 12:17:15.681798 28797 raft_consensus.cc:359] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.684125 28752 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:15.685068 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.686857 28825 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:15.687153 28796 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.682651 28797 raft_consensus.cc:385] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.687309 28825 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:15.687599 28797 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.688185 28825 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.689071 28797 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.689873 28799 ts_tablet_manager.cc:1434] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:17:15.687722 28796 ts_tablet_manager.cc:1403] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.098s	user 0.042s	sys 0.020s
I20260709 12:17:15.692391 28799 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.694224 28796 raft_consensus.cc:359] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.694736 28796 raft_consensus.cc:385] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.694955 28796 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.695524 28796 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.697376 28797 ts_tablet_manager.cc:1434] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:17:15.697219 28946 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.698383 28797 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.698101 28946 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.700953 28796 ts_tablet_manager.cc:1434] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:17:15.704922 29029 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.705145 28946 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.708683 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.711735 28796 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.705473 29029 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.718979 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.717868 29029 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.723058 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.723862 28753 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:15.724995 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.729348 28573 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:15.732052 29029 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.732048 28797 tablet_bootstrap.cc:654] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.736461 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:15.738655 29029 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.743858 28796 tablet_bootstrap.cc:654] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.758689 29029 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.758103 28504 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.764729 28797 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.765326 28797 ts_tablet_manager.cc:1403] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.067s	user 0.002s	sys 0.024s
I20260709 12:17:15.769896 28797 raft_consensus.cc:359] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.770835 28799 tablet_bootstrap.cc:654] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.770663 28797 raft_consensus.cc:385] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.771436 28797 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.772149 28797 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.774865 28796 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.775454 28796 ts_tablet_manager.cc:1403] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.009s
I20260709 12:17:15.777664 28797 ts_tablet_manager.cc:1434] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 12:17:15.778692 28797 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:15.779386 28825 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.780522 28796 raft_consensus.cc:359] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.781271 28796 raft_consensus.cc:385] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.781544 28796 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.782253 28796 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.784834 28797 tablet_bootstrap.cc:654] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.795001 28825 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:15.803395 28951 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.807271 29027 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.808470 28799 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.808921 28799 ts_tablet_manager.cc:1403] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.021s
I20260709 12:17:15.810653 28951 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.811148 28951 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.813787 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:15.815029 28722 leader_election.cc:343] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.816161 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:15.814806 28799 raft_consensus.cc:359] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.818024 28799 raft_consensus.cc:385] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:17:15.818138 28720 leader_election.cc:343] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.816706 28796 ts_tablet_manager.cc:1434] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:17:15.818351 28799 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.818825 28720 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.819490 28796 tablet_bootstrap.cc:492] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.819945 28976 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.820060 28799 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.821166 28951 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.822476 28799 ts_tablet_manager.cc:1434] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:17:15.824095 28799 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.834664 28799 tablet_bootstrap.cc:654] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.835008 28825 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.839326 28974 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.847442 28974 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.848007 28974 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.850080 28974 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:15.850538 28974 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.856899 28796 tablet_bootstrap.cc:654] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.860260 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:15.863775 28720 leader_election.cc:343] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.866034 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.866577 28799 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.867055 28799 ts_tablet_manager.cc:1403] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.008s
I20260709 12:17:15.868131 28796 tablet_bootstrap.cc:492] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.868680 28796 ts_tablet_manager.cc:1403] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.011s
I20260709 12:17:15.869738 28976 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.870394 28799 raft_consensus.cc:359] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.871047 28799 raft_consensus.cc:385] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.871308 28799 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.871299 28796 raft_consensus.cc:359] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.872238 28796 raft_consensus.cc:385] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.872617 28796 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.872185 28799 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.873257 28796 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.874593 28799 ts_tablet_manager.cc:1434] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:15.875208 28796 ts_tablet_manager.cc:1434] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:17:15.875505 28799 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.876061 28796 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.877192 29027 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.877734 29027 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.880232 29027 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.882243 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:15.882880 28752 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:15.883755 28796 tablet_bootstrap.cc:654] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:15.885887 28722 leader_election.cc:343] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.886814 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:15.887506 29024 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:15.887874 29024 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.888193 29024 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.889109 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:15.890275 28974 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:15.898401 29024 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.902892 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:15.905838 28799 tablet_bootstrap.cc:654] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:15.907481 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:15.911520 28750 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.907953 29024 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:15.910274 28796 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:15.915318 28796 ts_tablet_manager.cc:1403] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.003s
I20260709 12:17:15.917940 28796 raft_consensus.cc:359] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.918376 28750 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:15.918671 28796 raft_consensus.cc:385] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.918972 28796 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.919662 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:15.919718 28796 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.920668 28825 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:15.921162 28825 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:15.921903 28796 ts_tablet_manager.cc:1434] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:15.921980 28825 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.922360 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:15.927474 28796 tablet_bootstrap.cc:492] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:15.950500 28797 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:15.951336 28797 ts_tablet_manager.cc:1403] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.173s	user 0.027s	sys 0.002s
W20260709 12:17:15.969938 28648 leader_election.cc:343] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:15.971333 28648 leader_election.cc:343] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:15.979516 28799 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:15.980124 28799 ts_tablet_manager.cc:1403] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.031s
I20260709 12:17:15.981503 29029 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.982815 28799 raft_consensus.cc:359] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.983565 28799 raft_consensus.cc:385] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.983829 28799 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.984409 28799 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.986450 29027 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:15.988692 28606 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:15.989864 28799 ts_tablet_manager.cc:1434] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:17:15.990909 28799 tablet_bootstrap.cc:492] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:15.994009 28797 raft_consensus.cc:359] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:15.994706 28797 raft_consensus.cc:385] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:15.994946 28797 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:15.995512 28797 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.025280 28796 tablet_bootstrap.cc:654] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.027894 28797 ts_tablet_manager.cc:1434] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.076s	user 0.014s	sys 0.001s
I20260709 12:17:16.028829 28797 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:16.025950 28974 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.033475 28974 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.054819 29027 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.059679 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:16.061002 29027 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.062256 28503 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:16.063357 28722 leader_election.cc:343] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.064822 28974 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:16.066298 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.066454 29027 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:16.067791 28720 leader_election.cc:343] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.068240 28720 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.071290 28976 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.071974 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:16.074120 28648 leader_election.cc:343] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.074868 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.075474 28753 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:16.076251 29024 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.078044 29029 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.078519 29029 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.081460 29029 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.082592 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.083261 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.083289 28681 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:16.084010 28753 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:16.084749 28571 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:16.086386 29029 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.086763 29029 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.087553 29029 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.090338 28799 tablet_bootstrap.cc:654] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.097754 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.099941 28971 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.101384 29027 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.131932 28797 tablet_bootstrap.cc:654] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.131821 28946 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.113816 29027 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.135352 29027 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.114099 28971 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.105780 29029 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.146034 28971 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.147850 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:16.148556 28682 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.143607 29029 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.157184 28796 tablet_bootstrap.cc:492] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.157657 28796 ts_tablet_manager.cc:1403] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.233s	user 0.020s	sys 0.010s
I20260709 12:17:16.163112 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:16.167186 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.168777 28755 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:16.165376 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.170914 28751 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:16.177865 28648 leader_election.cc:343] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.179207 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.190078 29058 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:16.190100 28825 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.197038 28825 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.197798 28799 tablet_bootstrap.cc:492] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.199846 28825 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.200073 28799 ts_tablet_manager.cc:1403] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.010s
I20260709 12:17:16.180842 28682 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:16.202471 28571 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:16.203284 28799 raft_consensus.cc:359] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.204038 28799 raft_consensus.cc:385] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.204365 28799 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.202591 29027 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.205152 28799 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.206382 28751 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:16.209478 28606 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.212366 28799 ts_tablet_manager.cc:1434] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:16.212512 29067 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:16.213501 28799 tablet_bootstrap.cc:492] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.213696 29067 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:16.214638 29067 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.220466 28971 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.219861 28796 raft_consensus.cc:359] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.222396 28796 raft_consensus.cc:385] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.222702 28796 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.224855 28796 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.229516 28796 ts_tablet_manager.cc:1434] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 12:17:16.229473 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.227924 29027 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.230629 28796 tablet_bootstrap.cc:492] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.230229 28751 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.212229 28825 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.243494 28974 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.244199 28974 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.222826 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:16.251277 28797 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:16.251808 28797 ts_tablet_manager.cc:1403] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.223s	user 0.015s	sys 0.007s
I20260709 12:17:16.252039 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:16.253788 28799 tablet_bootstrap.cc:654] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.255304 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:16.252065 28974 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:17:16.262130 28648 leader_election.cc:343] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:16.263299 28648 leader_election.cc:343] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.260205 29064 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:17:16.262447 28722 leader_election.cc:343] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.268146 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.269937 28751 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:16.264504 29064 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:16.273284 28720 leader_election.cc:343] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.274981 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.276096 28976 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.279369 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.279736 29064 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.280529 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.282090 28825 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:16.282622 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:16.282987 28571 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:16.286350 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.286916 28751 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.289189 28796 tablet_bootstrap.cc:654] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.289044 29064 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.288028 28504 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.294377 28751 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:16.290302 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.290592 28797 raft_consensus.cc:359] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.298905 28797 raft_consensus.cc:385] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.299436 29058 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:16.300200 29058 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:16.300418 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.301514 29058 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.303169 29024 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:16.303659 29024 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:16.304507 29024 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.311667 28796 tablet_bootstrap.cc:492] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.312127 28796 ts_tablet_manager.cc:1403] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.082s	user 0.005s	sys 0.022s
I20260709 12:17:16.315857 28796 raft_consensus.cc:359] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.316542 28796 raft_consensus.cc:385] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.316794 28796 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.317428 28796 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.319401 28796 ts_tablet_manager.cc:1434] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:17:16.321516 28796 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.299413 28797 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.328760 28797 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.331869 28796 tablet_bootstrap.cc:654] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.336913 28799 tablet_bootstrap.cc:492] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.339054 28799 ts_tablet_manager.cc:1403] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.004s
I20260709 12:17:16.337602 28797 ts_tablet_manager.cc:1434] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 12:17:16.341333 28796 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.341324 28797 tablet_bootstrap.cc:492] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:16.341817 28796 ts_tablet_manager.cc:1403] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 12:17:16.343722 28796 raft_consensus.cc:359] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.344363 28796 raft_consensus.cc:385] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.344671 28796 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.345314 28796 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.346789 28799 raft_consensus.cc:359] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.347301 28796 ts_tablet_manager.cc:1434] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:17:16.347523 28799 raft_consensus.cc:385] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.347860 28799 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.348165 28796 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.354446 28796 tablet_bootstrap.cc:654] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.357359 28799 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.363358 28797 tablet_bootstrap.cc:654] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.367007 29058 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.367631 29058 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.369907 28799 ts_tablet_manager.cc:1434] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:17:16.370599 29067 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.370831 28799 tablet_bootstrap.cc:492] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.370759 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:16.371114 29067 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:16.372329 28648 leader_election.cc:343] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.373405 29067 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.374547 28504 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.378343 28504 catalog_manager.cc:5697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.381529 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.382138 28751 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:16.383128 29067 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.383291 29058 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.383687 29067 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.384598 28573 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:16.385434 29064 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.385798 29064 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.386111 29064 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.386364 29067 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.389271 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.389652 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:16.392055 28571 leader_election.cc:343] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.392761 29064 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.393497 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.394089 28751 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:16.394721 29064 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.395309 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.396337 28971 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.396551 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.396705 28971 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.396808 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:16.397106 28971 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.397126 28752 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:16.398129 28571 leader_election.cc:343] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.398921 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.399688 28751 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:16.403404 28752 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:16.403692 28971 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.404335 28573 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:16.405575 28573 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:16.406293 29067 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.406461 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:16.406601 29064 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:16.407820 29064 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:17:16.408229 28648 leader_election.cc:343] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.408699 29064 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.410753 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.411320 28751 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.414238 28796 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.414844 29067 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.415082 28796 ts_tablet_manager.cc:1403] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.004s
I20260709 12:17:16.409130 28971 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.418864 29058 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.419641 29058 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.421460 28751 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:16.425519 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:16.425998 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.426827 28799 tablet_bootstrap.cc:654] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.427166 29024 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:16.427230 28504 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.427821 29024 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:16.430763 29024 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.432659 28796 raft_consensus.cc:359] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.433315 28796 raft_consensus.cc:385] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.433578 28796 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.434432 28796 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.435148 28974 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.435618 28974 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.438985 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:16.440270 28722 leader_election.cc:343] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.441246 28974 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:16.442258 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:16.444864 28720 leader_election.cc:343] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.445248 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.447610 28800 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.448912 28796 ts_tablet_manager.cc:1434] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:17:16.451722 28796 tablet_bootstrap.cc:492] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.453809 29058 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:16.445863 28648 leader_election.cc:343] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.459160 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.459789 28751 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:16.462602 28799 tablet_bootstrap.cc:492] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.463056 28799 ts_tablet_manager.cc:1403] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.092s	user 0.009s	sys 0.003s
I20260709 12:17:16.463660 28825 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.465695 28799 raft_consensus.cc:359] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.466270 28799 raft_consensus.cc:385] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.466531 28799 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.466427 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.467352 28799 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.468475 29058 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.469465 29058 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.470662 28796 tablet_bootstrap.cc:654] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.469944 29058 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.476903 28797 tablet_bootstrap.cc:492] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:16.477487 28797 ts_tablet_manager.cc:1403] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.136s	user 0.020s	sys 0.011s
I20260709 12:17:16.483285 28799 ts_tablet_manager.cc:1434] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 12:17:16.483992 28799 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.487239 28797 raft_consensus.cc:359] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.488056 28797 raft_consensus.cc:385] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.488327 28797 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.489629 28797 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.492417 28858 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.492910 28858 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.497372 28858 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.497408 28797 ts_tablet_manager.cc:1434] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:17:16.499184 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.499850 28797 tablet_bootstrap.cc:492] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:16.499810 28751 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:16.501045 28504 catalog_manager.cc:5697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.502470 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:16.503536 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:16.503796 28971 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.504242 28971 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.504592 28971 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.501602 29058 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:16.508844 28648 leader_election.cc:343] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.510521 29058 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.512089 28971 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.516817 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:16.519533 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.520109 28756 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.521085 28797 tablet_bootstrap.cc:654] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.523660 28971 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:16.526847 28648 leader_election.cc:343] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.527215 28799 tablet_bootstrap.cc:654] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.528208 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:16.530267 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.530814 28751 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.532277 28756 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
W20260709 12:17:16.533280 28648 leader_election.cc:343] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.533412 29027 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.533974 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.534679 29024 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:16.535128 29024 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:16.535914 29024 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.542842 28796 tablet_bootstrap.cc:492] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.543437 28796 ts_tablet_manager.cc:1403] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.000s
I20260709 12:17:16.546090 28796 raft_consensus.cc:359] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.546730 28796 raft_consensus.cc:385] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.546988 28796 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.550773 28796 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.553893 28799 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.554352 28799 ts_tablet_manager.cc:1403] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.070s	user 0.005s	sys 0.010s
I20260709 12:17:16.555456 28796 ts_tablet_manager.cc:1434] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:16.557782 28799 raft_consensus.cc:359] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.558480 28799 raft_consensus.cc:385] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.558620 28796 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.558770 28799 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.559458 28799 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.562225 28799 ts_tablet_manager.cc:1434] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:17:16.563083 28799 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.540338 28751 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:16.564476 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.570415 28971 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:16.572734 28971 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:16.573561 28971 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.582342 28505 catalog_manager.cc:5697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.595726 28797 tablet_bootstrap.cc:492] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:16.596220 28797 ts_tablet_manager.cc:1403] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.015s
I20260709 12:17:16.598382 28799 tablet_bootstrap.cc:654] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.600904 28796 tablet_bootstrap.cc:654] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.601395 28797 raft_consensus.cc:359] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.602063 28797 raft_consensus.cc:385] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.602572 28976 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.603052 28976 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.605079 28976 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:16.606805 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:16.608210 28722 leader_election.cc:343] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.609159 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:16.610528 28720 leader_election.cc:343] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.608068 28503 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:16.610929 28720 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.612080 28976 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.602416 28797 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.614279 28797 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.616673 28797 ts_tablet_manager.cc:1434] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:17:16.618115 28797 tablet_bootstrap.cc:492] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:16.619323 28799 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.619767 28799 ts_tablet_manager.cc:1403] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.013s
I20260709 12:17:16.623055 28799 raft_consensus.cc:359] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.623682 28799 raft_consensus.cc:385] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.623953 28799 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.624610 28799 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.626844 28799 ts_tablet_manager.cc:1434] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:17:16.626982 28797 tablet_bootstrap.cc:654] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.627678 28799 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.633843 28799 tablet_bootstrap.cc:654] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.637141 29067 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.649263 28799 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.649729 28799 ts_tablet_manager.cc:1403] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.007s
I20260709 12:17:16.649863 28796 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.650475 28796 ts_tablet_manager.cc:1403] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.035s
I20260709 12:17:16.652809 28797 tablet_bootstrap.cc:492] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:16.652567 28799 raft_consensus.cc:359] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.653120 28796 raft_consensus.cc:359] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.654783 28799 raft_consensus.cc:385] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.654871 28796 raft_consensus.cc:385] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.655107 28799 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.655247 28796 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.656064 28797 ts_tablet_manager.cc:1403] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.002s
I20260709 12:17:16.655815 28799 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.657317 29067 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.659008 28799 ts_tablet_manager.cc:1434] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:16.656695 28796 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.661341 28796 ts_tablet_manager.cc:1434] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:17:16.662257 28797 raft_consensus.cc:359] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.673763 28797 raft_consensus.cc:385] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.674028 28797 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.662312 28796 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.662472 28799 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.677731 28797 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.685063 28797 ts_tablet_manager.cc:1434] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:17:16.686560 28797 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:16.696170 29067 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.696982 29067 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.698556 28796 tablet_bootstrap.cc:654] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.699563 29067 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.700213 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.701383 28799 tablet_bootstrap.cc:654] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.701675 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.702455 28752 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:16.705305 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:16.706372 29064 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.711359 29064 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.716244 28797 tablet_bootstrap.cc:654] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.720924 28799 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.721369 28799 ts_tablet_manager.cc:1403] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 12:17:16.724187 28799 raft_consensus.cc:359] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.724838 28799 raft_consensus.cc:385] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.725104 28799 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.726220 28799 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.728196 28799 ts_tablet_manager.cc:1434] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:16.729243 28799 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.740885 28797 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:16.740986 28799 tablet_bootstrap.cc:654] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.741448 28797 ts_tablet_manager.cc:1403] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.055s	user 0.005s	sys 0.012s
I20260709 12:17:16.741621 28796 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.742067 28796 ts_tablet_manager.cc:1403] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.003s
I20260709 12:17:16.744206 28797 raft_consensus.cc:359] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.744998 28797 raft_consensus.cc:385] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.745069 28796 raft_consensus.cc:359] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.745407 28797 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.745769 28796 raft_consensus.cc:385] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.746060 28796 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.746409 28797 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.746783 28796 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.749154 28796 ts_tablet_manager.cc:1434] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:16.750046 28796 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.758281 28971 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.766247 28796 tablet_bootstrap.cc:654] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.772467 28797 ts_tablet_manager.cc:1434] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:17:16.774034 29058 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.774530 29058 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.776506 29058 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.778189 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.779006 28752 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 1: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:17:16.780769 28797 tablet_bootstrap.cc:492] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:16.782752 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:16.782940 28648 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.784830 28648 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.785854 28971 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.800388 28971 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.805560 28797 tablet_bootstrap.cc:654] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.809806 28799 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.810252 28799 ts_tablet_manager.cc:1403] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.081s	user 0.035s	sys 0.021s
I20260709 12:17:16.813671 28796 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.814138 28796 ts_tablet_manager.cc:1403] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.020s
I20260709 12:17:16.816116 28799 raft_consensus.cc:359] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.816794 28799 raft_consensus.cc:385] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.816588 28796 raft_consensus.cc:359] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.817158 28799 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.817313 28796 raft_consensus.cc:385] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:17:16.817616 28648 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:16.817629 28796 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.817847 28799 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.818711 28796 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.819386 28797 tablet_bootstrap.cc:492] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:16.819933 28799 ts_tablet_manager.cc:1434] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 12:17:16.820091 28797 ts_tablet_manager.cc:1403] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.001s
I20260709 12:17:16.820799 28796 ts_tablet_manager.cc:1434] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:16.820847 28799 tablet_bootstrap.cc:492] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.821321 29064 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.821791 28796 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.821780 29064 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.823096 28797 raft_consensus.cc:359] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.823794 28797 raft_consensus.cc:385] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.823911 29064 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.824169 28797 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.825142 28797 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.825496 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.826308 28752 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:16.826105 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.827891 28799 tablet_bootstrap.cc:654] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.828838 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:16.829979 29067 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.831873 28797 ts_tablet_manager.cc:1434] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:17:16.832967 28796 tablet_bootstrap.cc:654] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.833609 28797 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:16.843606 28799 tablet_bootstrap.cc:492] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:16.844048 28799 ts_tablet_manager.cc:1403] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 12:17:16.846472 28797 tablet_bootstrap.cc:654] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.851547 28799 raft_consensus.cc:359] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.852025 28976 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.852591 28799 raft_consensus.cc:385] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.852676 28976 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.853070 28799 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.854260 28799 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.855494 28976 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:16.856705 29058 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.857337 29058 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.858170 28796 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:16.858316 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.858641 28796 ts_tablet_manager.cc:1403] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.017s
I20260709 12:17:16.858918 28680 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:16.859992 29058 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.861289 28796 raft_consensus.cc:359] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.861948 28796 raft_consensus.cc:385] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.862227 28796 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.862391 29064 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.863269 28799 ts_tablet_manager.cc:1434] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:17:16.863322 28796 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.866806 28796 ts_tablet_manager.cc:1434] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:16.864164 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:16.867738 28796 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:16.870795 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:16.871892 28976 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.872262 28976 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.872826 28976 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.874276 28796 tablet_bootstrap.cc:654] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:16.872160 28722 leader_election.cc:343] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.883564 28799 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:16.889264 28799 tablet_bootstrap.cc:654] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.899784 29067 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.906445 29029 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.906956 29029 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.907931 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:16.909348 28648 leader_election.cc:343] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.909514 29029 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.909806 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.910418 28751 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:16.910862 29029 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.913455 28648 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:16.915118 29058 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.915460 29058 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.915724 29024 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:16.915769 29058 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.919384 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:16.922495 28571 leader_election.cc:343] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.925194 28797 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:16.925752 28797 ts_tablet_manager.cc:1403] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.092s	user 0.031s	sys 0.012s
I20260709 12:17:16.929025 28797 raft_consensus.cc:359] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.930106 28797 raft_consensus.cc:385] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:16.930433 28797 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:16.931212 28797 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.933391 28797 ts_tablet_manager.cc:1434] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:16.934321 28797 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:16.938333 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.938984 28752 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:16.940784 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:16.942339 29110 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.942777 29110 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.943246 29110 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.942817 29058 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.945760 29064 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.946240 29064 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.947654 29027 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:16.948058 29058 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.950920 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:16.951241 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:16.951736 28755 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:16.948200 29064 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:16.954177 28648 leader_election.cc:343] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.955277 28606 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.955638 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:16.957875 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:16.961716 29110 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.963344 28858 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:16.962545 28797 tablet_bootstrap.cc:654] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:16.962810 29064 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:16.968004 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.968143 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:16.968621 28752 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.972198 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:16.972795 28753 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:16.976620 28752 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
W20260709 12:17:16.977545 28571 leader_election.cc:343] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:16.980844 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:16.981945 29064 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:16.982925 29064 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:16.984695 29027 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.985162 29027 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.987150 29027 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.984180 29064 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:16.989203 29110 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:16.991360 28753 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:16.992194 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:16.994419 28606 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:16.995939 28648 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:16.996645 29027 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:16.996979 29027 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.997360 29027 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.003985 28797 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.004662 29024 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:17.008759 28797 ts_tablet_manager.cc:1403] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.009s
I20260709 12:17:17.016283 28648 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:17.017295 29024 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:17.017949 29024 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:17.012768 29027 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.019104 29024 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.020541 29027 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.017472 28797 raft_consensus.cc:359] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.021595 28797 raft_consensus.cc:385] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.021956 28797 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.022852 28797 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.024252 29027 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:17.028138 28797 ts_tablet_manager.cc:1434] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:17:17.029397 28797 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.038671 28797 tablet_bootstrap.cc:654] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.053366 28797 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.053946 28797 ts_tablet_manager.cc:1403] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.001s
I20260709 12:17:17.058102 28797 raft_consensus.cc:359] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.058997 28797 raft_consensus.cc:385] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.059317 28797 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.060489 28797 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.072566 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:17.073292 28603 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.078711 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:17.079562 28755 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:17.087266 28974 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.087764 28974 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.090622 28974 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.090866 28797 ts_tablet_manager.cc:1434] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:17:17.090729 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:17.091946 28722 leader_election.cc:343] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.093314 28797 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.107683 28797 tablet_bootstrap.cc:654] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.133744 28974 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.134480 28974 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.137864 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:17.137967 28974 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.138716 28606 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:17.140141 28722 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:17.003825 28976 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.141546 28800 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.141997 28800 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.142367 28800 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.142712 28976 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.148056 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:17.152823 28800 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.158380 29058 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:17.160938 28800 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.163058 28504 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:17.167560 28722 leader_election.cc:343] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.173348 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:17.173868 28606 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.168998 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.084273 28603 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:17.166952 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.186398 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:17.187019 28753 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.179736 29058 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.188589 29058 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.191192 29058 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.195711 28796 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.196174 28796 ts_tablet_manager.cc:1403] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.329s	user 0.049s	sys 0.106s
W20260709 12:17:17.201823 28720 leader_election.cc:343] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.199888 28796 raft_consensus.cc:359] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.202260 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:17.206252 28799 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:17.206856 28799 ts_tablet_manager.cc:1403] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.323s	user 0.060s	sys 0.079s
W20260709 12:17:17.203032 28720 leader_election.cc:343] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.210126 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:17.203455 28796 raft_consensus.cc:385] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.210850 28678 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.210969 28796 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.211697 28796 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.213795 28796 ts_tablet_manager.cc:1434] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:17:17.214699 28796 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:17.215698 28799 raft_consensus.cc:359] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.208053 28720 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:17.202783 28753 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:17.216701 28799 raft_consensus.cc:385] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.217018 28974 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:17.220235 28799 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
W20260709 12:17:17.218357 28720 leader_election.cc:343] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.221909 28799 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.223865 28678 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:17.226085 28797 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.227202 28796 tablet_bootstrap.cc:654] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:17.230850 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45953.2us
I20260709 12:17:17.233531 28797 ts_tablet_manager.cc:1403] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.142s	user 0.040s	sys 0.045s
I20260709 12:17:17.203738 28606 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:17.233880 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:17.234777 28974 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:17.235244 28722 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:17.236024 28800 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:17.236423 28800 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:17.236815 28797 raft_consensus.cc:359] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.237530 28797 raft_consensus.cc:385] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.237386 28800 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.237831 28797 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.238538 28797 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.240844 28797 ts_tablet_manager.cc:1434] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:17.232364 28799 ts_tablet_manager.cc:1434] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
I20260709 12:17:17.235263 28974 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:17.241834 28797 tablet_bootstrap.cc:492] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.241868 28974 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.248898 28797 tablet_bootstrap.cc:654] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.250675 28796 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.251283 28796 ts_tablet_manager.cc:1403] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.004s
I20260709 12:17:17.252521 28799 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:17.256223 28796 raft_consensus.cc:359] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.262354 28797 tablet_bootstrap.cc:492] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.262454 28796 raft_consensus.cc:385] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.262827 28797 ts_tablet_manager.cc:1403] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.002s
I20260709 12:17:17.262764 28796 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.263509 28796 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.265827 28796 ts_tablet_manager.cc:1434] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:17:17.258246 28648 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:17.266811 29126 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:17.266927 28796 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:17.268489 28797 raft_consensus.cc:359] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.269188 28797 raft_consensus.cc:385] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.269435 28797 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.270165 29126 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:17.270076 28797 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.272156 28797 ts_tablet_manager.cc:1434] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:17:17.272094 29126 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.273073 28797 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.275177 28796 tablet_bootstrap.cc:654] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.276090 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:17.278924 28797 tablet_bootstrap.cc:654] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.281848 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:17.282501 28755 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:17.281837 28606 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.289629 28505 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:17.301060 28796 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.301556 28796 ts_tablet_manager.cc:1403] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.000s
I20260709 12:17:17.304689 28796 raft_consensus.cc:359] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.305488 28796 raft_consensus.cc:385] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.305748 28796 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.306455 28796 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.316807 28607 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.318945 28799 tablet_bootstrap.cc:654] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.331880 28503 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:17.345553 28797 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.346056 28797 ts_tablet_manager.cc:1403] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.073s	user 0.005s	sys 0.036s
I20260709 12:17:17.348694 28797 raft_consensus.cc:359] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.350306 28797 raft_consensus.cc:385] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.350585 28797 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.352232 28796 ts_tablet_manager.cc:1434] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:17:17.351344 28797 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.334233 28503 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:17.355556 28797 ts_tablet_manager.cc:1434] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:17.356509 28797 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.358711 29125 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.359237 29125 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.361289 29125 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:17.363569 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:17.364576 28797 tablet_bootstrap.cc:654] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.367904 28796 tablet_bootstrap.cc:492] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
W20260709 12:17:17.372469 28648 leader_election.cc:343] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.375191 28796 tablet_bootstrap.cc:654] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.376024 28971 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:17.376140 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:17.376243 28648 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:17.376974 28755 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:17.377179 29121 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.377592 29121 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.377945 29121 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.379210 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:17.381614 28797 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.382537 28797 ts_tablet_manager.cc:1403] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.026s	user 0.002s	sys 0.007s
I20260709 12:17:17.385542 28797 raft_consensus.cc:359] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.386229 28797 raft_consensus.cc:385] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.386500 28797 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.387159 28797 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.387795 28799 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:17.388420 28799 ts_tablet_manager.cc:1403] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.005s
I20260709 12:17:17.389284 28797 ts_tablet_manager.cc:1434] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:17:17.384852 29121 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.390197 28797 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.391343 29121 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.394174 28505 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:17.396248 28797 tablet_bootstrap.cc:654] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.398672 29064 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:17.416355 28571 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:17.417333 29067 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.417992 29067 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.427547 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:17.429842 28571 leader_election.cc:343] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.430893 29125 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.431411 29125 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.433425 29125 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.435148 29067 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.437147 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:17.437817 28753 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:17.439146 28573 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:17.440307 29064 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.440820 29064 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.441236 29064 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.443688 29110 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.444352 29110 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.448208 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:17.448947 28753 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:17.450313 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:17.452068 29029 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.452564 29029 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.453014 29029 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.458043 29110 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.391891 28799 raft_consensus.cc:359] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.459749 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.459741 28799 raft_consensus.cc:385] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.462091 28799 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.462658 28796 tablet_bootstrap.cc:492] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.463135 28796 ts_tablet_manager.cc:1403] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.095s	user 0.032s	sys 0.039s
I20260709 12:17:17.463028 28799 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.465685 28796 raft_consensus.cc:359] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.466308 28796 raft_consensus.cc:385] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.466555 28796 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.467173 28796 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.468844 28796 ts_tablet_manager.cc:1434] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:17:17.469697 28796 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:17.472899 28799 ts_tablet_manager.cc:1434] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 12:17:17.475028 28799 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:17.475579 28796 tablet_bootstrap.cc:654] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.475759 28797 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.476212 28797 ts_tablet_manager.cc:1403] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.062s
I20260709 12:17:17.478771 28797 raft_consensus.cc:359] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.479420 28797 raft_consensus.cc:385] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.479703 28797 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.479785 29029 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.480754 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:17.480500 28797 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.482656 28797 ts_tablet_manager.cc:1434] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:17.483654 28797 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.491451 28796 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.491932 28796 ts_tablet_manager.cc:1403] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 12:17:17.494823 28797 tablet_bootstrap.cc:654] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.500299 28796 raft_consensus.cc:359] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.501062 28796 raft_consensus.cc:385] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.501353 28796 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.502060 28796 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.504001 28796 ts_tablet_manager.cc:1434] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:17:17.505093 28796 tablet_bootstrap.cc:492] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:17.513411 28799 tablet_bootstrap.cc:654] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.518072 28796 tablet_bootstrap.cc:654] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.532532 28797 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.533053 28797 ts_tablet_manager.cc:1403] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.004s
I20260709 12:17:17.535852 28797 raft_consensus.cc:359] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.539106 28797 raft_consensus.cc:385] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.539391 28797 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.540066 28797 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.541599 28797 ts_tablet_manager.cc:1434] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:17:17.542587 28797 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.547202 28799 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:17.547789 28799 ts_tablet_manager.cc:1403] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.000s
I20260709 12:17:17.549194 28797 tablet_bootstrap.cc:654] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.550742 28799 raft_consensus.cc:359] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.551774 28799 raft_consensus.cc:385] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.552119 28799 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.552968 28799 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.554813 29067 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.555333 29067 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.557507 29067 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.559731 28796 tablet_bootstrap.cc:492] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.560593 28797 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.561184 28797 ts_tablet_manager.cc:1403] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:17:17.560225 28796 ts_tablet_manager.cc:1403] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.019s
I20260709 12:17:17.563978 28796 raft_consensus.cc:359] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.564703 28796 raft_consensus.cc:385] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.564990 28796 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.565114 28797 raft_consensus.cc:359] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.565888 28797 raft_consensus.cc:385] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.565738 28796 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.566198 28797 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.567025 28797 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.567802 28796 ts_tablet_manager.cc:1434] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:17:17.568847 28796 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:17.569113 28797 ts_tablet_manager.cc:1434] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:17.570082 28797 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.574179 28974 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.574870 28799 ts_tablet_manager.cc:1434] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:17:17.574750 28974 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.575994 28799 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:17.577131 28974 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.577597 28797 tablet_bootstrap.cc:654] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.578655 28796 tablet_bootstrap.cc:654] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.585193 28799 tablet_bootstrap.cc:654] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.591130 28796 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.591768 28796 ts_tablet_manager.cc:1403] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.001s
I20260709 12:17:17.601012 28796 raft_consensus.cc:359] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.601821 28796 raft_consensus.cc:385] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.602164 28796 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.604911 28796 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.605558 29029 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.606850 28796 ts_tablet_manager.cc:1434] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.006s
I20260709 12:17:17.607880 28796 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:17.619062 28796 tablet_bootstrap.cc:654] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.627842 28797 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.628343 28797 ts_tablet_manager.cc:1403] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.010s
I20260709 12:17:17.631184 28797 raft_consensus.cc:359] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.631917 28797 raft_consensus.cc:385] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.632203 28797 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.633210 28974 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.633738 28974 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.635972 28974 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.638183 29064 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.640388 29064 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.643064 28796 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.643667 28796 ts_tablet_manager.cc:1403] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.004s
I20260709 12:17:17.633252 28797 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.646799 28796 raft_consensus.cc:359] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.647532 28796 raft_consensus.cc:385] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.647831 28796 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.648348 28797 ts_tablet_manager.cc:1434] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260709 12:17:17.648698 28796 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.650461 28797 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.651453 28799 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:17.651859 28796 ts_tablet_manager.cc:1434] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:17:17.651881 28799 ts_tablet_manager.cc:1403] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.012s
I20260709 12:17:17.652881 28796 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:17.653102 29029 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.653566 29029 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.654719 28799 raft_consensus.cc:359] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.655431 28799 raft_consensus.cc:385] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.655735 28799 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.656337 28799 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.658849 28799 ts_tablet_manager.cc:1434] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:17:17.658901 28797 tablet_bootstrap.cc:654] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.659726 28796 tablet_bootstrap.cc:654] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.660207 28799 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:17.667526 28799 tablet_bootstrap.cc:654] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.655452 29029 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.677139 28796 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:17.677670 28796 ts_tablet_manager.cc:1403] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.003s
I20260709 12:17:17.682575 28796 raft_consensus.cc:359] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.683322 28796 raft_consensus.cc:385] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.683609 28796 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.684350 28796 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.687816 28796 ts_tablet_manager.cc:1434] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:17:17.689327 28797 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:17.689778 28797 ts_tablet_manager.cc:1403] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.003s
I20260709 12:17:17.689911 28799 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:17.690348 28799 ts_tablet_manager.cc:1403] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.003s
I20260709 12:17:17.692925 28799 raft_consensus.cc:359] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.693653 28799 raft_consensus.cc:385] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.693753 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:17.693953 28799 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.692395 28797 raft_consensus.cc:359] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.694444 28797 raft_consensus.cc:385] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.694706 28797 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.695179 28799 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.695372 28797 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.698618 28799 ts_tablet_manager.cc:1434] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:17:17.698539 28606 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:17.699882 28799 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:17.700035 28797 ts_tablet_manager.cc:1434] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:17:17.700953 28797 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:17.720225 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.720861 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:17.721101 28678 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:17:17.721324 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:17.721488 28677 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.721954 28679 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.726739 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:17.728669 28679 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:17.729085 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.729734 28682 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:17.731973 28677 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
W20260709 12:17:17.734340 28722 leader_election.cc:343] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.735749 28571 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:17.738062 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:17.749017 29158 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.749624 28601 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.749807 29159 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:17.749904 29158 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.752620 29158 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.753185 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:17.753818 28605 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:17.754961 28722 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:17.756187 29159 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.756626 29159 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.756982 29159 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.765232 28799 tablet_bootstrap.cc:654] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.765183 29159 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.765974 29158 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:17.769990 29145 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:17.770496 29145 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:17.769389 29159 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.771294 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:17.772101 28605 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.772392 29162 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:17.772897 29162 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:17:17.774830 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 324611us
I20260709 12:17:17.773753 29162 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.771339 29145 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.785902 28605 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:17.789870 28722 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:17.792155 29159 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:17.792675 29159 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:17.793506 29159 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.794368 28799 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:17.794811 28799 ts_tablet_manager.cc:1403] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.000s
I20260709 12:17:17.796681 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:17.797513 28751 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.797658 28799 raft_consensus.cc:359] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.798622 28799 raft_consensus.cc:385] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:17.798965 28799 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:17.800473 28799 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.800988 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:17.801745 28756 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.803612 28799 ts_tablet_manager.cc:1434] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:17:17.804945 28799 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:17.808140 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:17.809966 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:17.810807 28753 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:17.819599 28799 tablet_bootstrap.cc:654] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.834985 28756 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:17.839571 28751 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:17.858214 29158 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.860960 29158 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.863113 29158 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.850906 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:17.865084 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:17:17.866950 28722 leader_election.cc:343] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.871455 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.872890 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.873723 28680 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:17.875097 28682 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.891230 29067 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:17.891587 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:17.891927 29067 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.892366 29067 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.898309 29067 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.898834 29166 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.899261 29166 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.899605 29166 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.911216 28974 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.911969 28974 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.912966 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.913714 28677 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:17.914592 28974 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.915285 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:17.915884 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:17:17.917142 28722 leader_election.cc:343] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.918033 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.919854 28571 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:17.920379 28858 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.920848 29132 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.967983 29132 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.968389 29132 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.950786 29166 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.970388 29166 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:17.953959 28797 tablet_bootstrap.cc:654] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:17.954536 28680 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
I20260709 12:17:17.958930 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:17.976306 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:17.962040 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:17.976908 28753 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.964460 28976 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.958946 28796 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Bootstrap starting.
I20260709 12:17:17.977087 28750 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:17.980731 28976 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:17.974800 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55030.5us
I20260709 12:17:17.980247 28974 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.964583 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.965894 28503 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:17.966737 28720 leader_election.cc:343] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:17.927268 29159 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.974431 29162 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.985667 28503 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:17.959846 28648 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:17.984637 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:17.977265 29064 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.962163 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.982784 28976 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:17.986510 29159 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.989204 29158 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:17.989691 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:17.980377 28679 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:17.994680 29158 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.990630 29064 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.990729 29162 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.996646 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:17.977459 28858 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:17.982791 28974 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.009001 29159 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:18.005272 29024 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:18.009802 29024 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.010332 29024 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.011052 28796 tablet_bootstrap.cc:654] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:18.009702 28858 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.001034 29158 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.020187 28800 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:18.000905 29064 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.017159 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:18.028734 28676 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:17:18.031967 28720 leader_election.cc:343] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:18.032518 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:18.033170 28800 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:18.034106 28720 leader_election.cc:343] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:18.035429 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:18.036074 28800 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:18.037173 28800 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:17:18.038802 28720 leader_election.cc:343] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:18.058728 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:18.045316 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:18.045578 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:18.078909 29166 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.096733 28602 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 1: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:17:18.094862 29166 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.066401 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:18.111027 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:18.169724 28797 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:18.169955 28974 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:18.170233 28797 ts_tablet_manager.cc:1403] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.469s	user 0.015s	sys 0.022s
I20260709 12:17:18.183555 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:18.186932 28720 leader_election.cc:343] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:18.188020 28720 leader_election.cc:343] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:18.174151 29162 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.194778 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:18.199294 29166 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:18.201372 28722 leader_election.cc:343] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:18.223917 28648 leader_election.cc:343] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:18.217005 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:18.235759 29064 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.237860 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:18.238677 28751 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:18.236881 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:18.240465 28606 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 1: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:17:18.240758 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:18.241341 28751 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.244632 29064 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.209507 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:18.222112 28756 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:18.259178 28753 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:18.262799 28796 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: No bootstrap required, opened a new log
I20260709 12:17:18.263309 28796 ts_tablet_manager.cc:1403] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent bootstrapping tablet: real 0.305s	user 0.015s	sys 0.018s
I20260709 12:17:18.206452 29132 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.256496 29064 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:18.225071 28722 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:18.261937 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:18.304199 28648 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:18.298825 28796 raft_consensus.cc:359] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.348719 28796 raft_consensus.cc:385] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:18.349036 28796 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Initialized, Role: FOLLOWER
I20260709 12:17:18.347645 28797 raft_consensus.cc:359] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.350539 28797 raft_consensus.cc:385] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:18.351254 28797 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:18.352026 28799 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:18.352630 28799 ts_tablet_manager.cc:1403] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.548s	user 0.016s	sys 0.023s
W20260709 12:17:18.352923 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48855.3us
I20260709 12:17:18.352128 28797 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.349749 28796 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.357121 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:18.355427 29125 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:18.358827 28796 ts_tablet_manager.cc:1434] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent starting tablet: real 0.095s	user 0.012s	sys 0.007s
I20260709 12:17:18.365990 28797 ts_tablet_manager.cc:1434] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.191s	user 0.008s	sys 0.008s
I20260709 12:17:18.367388 28799 raft_consensus.cc:359] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.368316 28799 raft_consensus.cc:385] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:18.368672 28799 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:18.371109 28799 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.363688 29159 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:18.307753 29064 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.348886 29158 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.299144 29024 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.384035 29158 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:18.345669 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:17:18.430757 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 85041.4us
I20260709 12:17:18.432551 28573 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:18.437114 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:18.438634 28674 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.450547 28598 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.454217 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:18.455807 28680 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:18.457437 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:18.464010 28603 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 0.
W20260709 12:17:18.375286 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 176772us
I20260709 12:17:18.377553 28755 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:18.477065 29132 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:18.478129 29064 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.479610 29192 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:17:18.498924 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66733.1us
I20260709 12:17:18.480301 29192 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:17:18.508940 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 150291us
I20260709 12:17:18.516693 29184 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:18.521301 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:18.524009 28722 leader_election.cc:343] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:18.524753 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:18.480228 29064 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:18.517678 29192 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.532263 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:18.476884 29024 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.482048 29067 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:18.536629 28799 ts_tablet_manager.cc:1434] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.164s	user 0.009s	sys 0.000s
I20260709 12:17:18.563431 28797 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:18.533675 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:17:18.574832 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51138.5us
I20260709 12:17:18.601626 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:18.603529 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:18.603623 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:18.605252 28681 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.605547 28573 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:18.606642 29162 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:18.562512 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:18.527566 29064 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:18.584771 28679 consensus_meta.cc:287] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.014s
I20260709 12:17:18.614555 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:17:18.620666 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58394.8us
W20260709 12:17:18.621132 28720 leader_election.cc:343] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:18.621824 28679 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:18.582958 29144 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:17:18.625083 29180 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.301s	user 0.002s	sys 0.002s
I20260709 12:17:18.630070 29175 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:18.628501 28601 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.536243 28674 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:18.641919 29175 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:18.534611 29158 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:18.647881 28799 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:18.654810 28971 raft_consensus.cc:2764] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:17:18.569928 28751 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:18.657987 28800 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:18.658425 28800 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.658746 28800 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.630872 29064 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.666399 29196 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.573261 29067 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.631722 29144 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.669819 28976 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:18.670001 29196 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.675081 29196 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.682322 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:18.686529 29144 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:18.679394 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 64977us
I20260709 12:17:18.679929 28800 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.705996 29067 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.707207 28681 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:18.707764 28800 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:17:18.711350 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf5c0 after lost signal to thread 27449
W20260709 12:17:18.712754 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08001ac7e0 after lost signal to thread 28539
W20260709 12:17:18.712810 28722 leader_election.cc:343] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:18.714288 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb0a0 after lost signal to thread 28631
W20260709 12:17:18.715452 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb8e0 after lost signal to thread 28706
I20260709 12:17:18.716411 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:18.717324 28750 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:18.723405 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:18.724156 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08002af580 after lost signal to thread 28780
W20260709 12:17:18.724960 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080029e1e0 after lost signal to thread 29109
I20260709 12:17:18.728255 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:18.728989 28752 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.729609 29184 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:18.723474 28601 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:18.736891 28674 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.740490 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:18.746066 29144 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:18.741567 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:18.752207 28573 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:18.755306 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:18.753346 29196 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:18.755851 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:18.758931 29110 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:18.758976 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:18.759521 28505 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:18.747717 29144 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:17:18.764655 28601 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:18.769877 29110 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:18.771227 29029 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:18.771683 29029 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.772089 29029 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.779230 28800 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:18.779817 29110 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.776896 29184 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:17:18.744369 29064 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.792164 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:18.793707 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:18.793922 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:18.793960 28800 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:18.795740 28800 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.797269 28800 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:18.794750 28752 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:18.803894 28797 tablet_bootstrap.cc:654] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:18.804774 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:18.806787 29158 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:18.807291 29158 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:18.808308 29158 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.811440 29193 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:18.811961 29193 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.797794 29029 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.818755 28602 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 1: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:17:18.827366 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:18.839608 28976 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.840091 28976 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.842183 28976 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:18.842231 28504 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:17:18.844216 29193 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:18.856978 28607 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:17:18.859192 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:18.862166 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:18.862717 29029 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.862811 28752 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.853771 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:18.865088 29184 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:17:18.876190 28722 leader_election.cc:343] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:18.876883 29190 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:18.877305 29190 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:18.871377 29064 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:18.879413 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:18.879441 29190 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.882325 28749 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:18.881628 29190 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.885799 28752 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:18.887027 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:18.887998 28756 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:17:18.887794 29029 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:18.889429 29029 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:18.890446 29029 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.905186 28799 tablet_bootstrap.cc:654] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:18.898667 28601 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:17:18.914314 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:18.924651 29195 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:18.925165 29195 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:18.926079 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:18.931291 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:17:18.938059 29202 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:17:18.945519 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:18.946861 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:18.942030 28648 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:18.955830 29192 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:17:18.950137 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:18.948984 29110 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:17:18.978490 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:18.978816 29125 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:18.979400 29125 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:18.980667 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:18.980515 29125 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:18.982424 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:18.981886 29110 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:18.994172 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:18.986439 29192 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:19.002008 28800 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:18.926054 29195 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.006656 28800 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:19.016361 28797 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:19.019014 29177 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:17:19.021067 28720 leader_election.cc:343] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:19.021560 28720 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:19.019789 29177 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.025950 28677 raft_consensus.cc:2410] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:17:19.033203 28797 ts_tablet_manager.cc:1403] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.470s	user 0.010s	sys 0.031s
I20260709 12:17:19.036281 28800 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:19.040606 28720 leader_election.cc:343] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:19.046092 28720 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:19.048404 28720 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:19.049021 28976 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:19.050752 29193 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:19.056833 29170 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:19.074555 28797 raft_consensus.cc:359] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.075145 28797 raft_consensus.cc:385] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:19.075397 28797 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:19.076072 28797 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:19.069223 29205 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:17:19.088711 29168 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:17:19.118479 28797 ts_tablet_manager.cc:1434] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.003s
I20260709 12:17:19.154796 29177 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:19.156594 29192 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.157160 29192 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.184019 29192 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:19.184643 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:19.184773 28797 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:19.185602 28679 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:17:19.193817 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:19.196292 28799 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:19.198143 28799 ts_tablet_manager.cc:1403] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.551s	user 0.035s	sys 0.034s
I20260709 12:17:19.204924 28797 tablet_bootstrap.cc:654] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:19.225746 28797 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:19.226311 28797 ts_tablet_manager.cc:1403] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.004s
I20260709 12:17:19.229178 28797 raft_consensus.cc:359] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.231491 28797 raft_consensus.cc:385] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:19.231801 28797 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:19.232513 28797 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.234805 28797 ts_tablet_manager.cc:1434] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:17:19.235877 28797 tablet_bootstrap.cc:492] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:19.206032 28799 raft_consensus.cc:359] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.237998 28799 raft_consensus.cc:385] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:19.238272 28799 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:19.239065 28799 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:19.241173 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 120617us
I20260709 12:17:19.243448 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:19.248289 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:19.249361 29192 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:19.249922 29145 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:19.257781 28799 ts_tablet_manager.cc:1434] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:17:19.258863 28799 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:19.264683 29166 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:19.267107 28797 tablet_bootstrap.cc:654] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:19.267644 29145 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:19.269006 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:19.276350 29168 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.276870 29168 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.279201 29168 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:19.279798 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:19.281111 28571 leader_election.cc:343] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:19.280977 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:19.283691 28749 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:19.285351 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:19.288164 29168 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:17:19.289198 28573 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:19.290270 29168 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:19.290694 29168 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.291085 29168 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:19.291421 29166 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:19.299481 28799 tablet_bootstrap.cc:654] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:19.327498 29189 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.327487 28503 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.338500 29168 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.350859 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:19.353024 29024 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:19.328177 29189 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.358033 29189 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:19.368212 29158 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:19.397524 29168 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:19.398412 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:19.399037 28749 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:19.411288 28504 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.425300 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:19.428128 28606 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 1: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:17:19.432217 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:19.434036 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:17:19.439038 28571 leader_election.cc:343] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:19.439489 28678 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:17:19.439947 28678 pending_rounds.cc:85] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 0
I20260709 12:17:19.440238 28678 pending_rounds.cc:107] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:17:19.442727 28678 raft_consensus.cc:2889] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:19.467864 28752 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:19.469378 28797 tablet_bootstrap.cc:492] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:19.468043 28648 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:17:19.470049 28720 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:19.479035 29184 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:19.479712 28799 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:19.480216 28799 ts_tablet_manager.cc:1403] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.222s	user 0.014s	sys 0.021s
I20260709 12:17:19.482540 29029 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:19.495728 29029 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:19.497773 29190 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:19.553483 28797 ts_tablet_manager.cc:1403] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.318s	user 0.040s	sys 0.022s
I20260709 12:17:19.560767 28749 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:19.564136 28573 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:19.569525 28799 raft_consensus.cc:359] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.571188 28799 raft_consensus.cc:385] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:19.571647 28799 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:19.572783 28799 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.567492 29168 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:19.576164 29168 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:19.577060 29168 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.573594 28797 raft_consensus.cc:359] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.582484 28797 raft_consensus.cc:385] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:19.582692 28797 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:19.584419 28799 ts_tablet_manager.cc:1434] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.008s
I20260709 12:17:19.590417 28797 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.597229 28797 ts_tablet_manager.cc:1434] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 12:17:19.603505 28797 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:19.606387 28503 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 2 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.608914 28799 tablet_bootstrap.cc:492] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
W20260709 12:17:19.614032 29236 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 12:17:19.630434 28503 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.646761 29058 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:17:19.666767 29170 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:19.671231 28974 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:19.738274 29241 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:17:19.744421 28797 tablet_bootstrap.cc:654] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:19.747044 28505 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.767295 28974 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:17:19.771426 28505 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 0 to 1, leader changed from <none> to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.747264 29184 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:19.786573 28799 tablet_bootstrap.cc:654] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:19.795068 29243 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:19.790881 28974 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:17:19.851465 28503 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.881884 28797 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:19.882390 28797 ts_tablet_manager.cc:1403] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.284s	user 0.023s	sys 0.033s
I20260709 12:17:19.883379 29192 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.883890 29192 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.884968 28797 raft_consensus.cc:359] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.885622 28797 raft_consensus.cc:385] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:19.885890 28799 tablet_bootstrap.cc:492] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:19.889758 28799 ts_tablet_manager.cc:1403] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.304s	user 0.018s	sys 0.013s
I20260709 12:17:19.895092 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:19.895924 29192 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:19.897894 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:17:19.899531 28571 leader_election.cc:343] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:19.900259 28799 raft_consensus.cc:359] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.901101 28799 raft_consensus.cc:385] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:19.901393 28799 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:19.902048 28799 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.904398 28799 ts_tablet_manager.cc:1434] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.000s
I20260709 12:17:19.905437 28799 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:19.900323 28751 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:19.911867 28799 tablet_bootstrap.cc:654] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:19.885876 28797 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:19.913332 28797 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.917537 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:19.918598 29192 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:19.919085 29192 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.919307 28797 ts_tablet_manager.cc:1434] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
W20260709 12:17:19.920598 28553 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:19.920791 28797 tablet_bootstrap.cc:492] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:19.919499 29192 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:19.924008 28799 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:19.924575 28799 ts_tablet_manager.cc:1403] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.012s
I20260709 12:17:19.928018 28799 raft_consensus.cc:359] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.928920 28799 raft_consensus.cc:385] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:19.929723 28799 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:19.930897 28674 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:19.930631 28799 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.933169 28799 ts_tablet_manager.cc:1434] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:17:19.934194 28799 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:19.928992 28797 tablet_bootstrap.cc:654] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:19.940737 28799 tablet_bootstrap.cc:654] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:19.955752 29192 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.962913 29177 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.963418 29177 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:19.965372 29192 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:19.965416 29177 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:19.969483 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:19.970170 28601 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:19.967967 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:19.986581 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:19.987744 29190 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:19.988164 29190 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.988562 29190 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:19.994918 28755 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:20.015525 28799 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:20.016069 28799 ts_tablet_manager.cc:1403] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 12:17:20.020671 28797 tablet_bootstrap.cc:492] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:20.021149 28797 ts_tablet_manager.cc:1403] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.025s
I20260709 12:17:20.021766 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:20.022432 28679 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.023701 28797 raft_consensus.cc:359] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.024382 28797 raft_consensus.cc:385] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:20.024672 28797 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:20.025302 28797 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.027300 28797 ts_tablet_manager.cc:1434] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:20.028277 28797 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Bootstrap starting.
I20260709 12:17:20.045799 28797 tablet_bootstrap.cc:654] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:20.052053 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:20.052711 28754 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.052368 28799 raft_consensus.cc:359] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.053309 28799 raft_consensus.cc:385] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:20.053658 28799 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:20.054888 28799 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.065979 28799 ts_tablet_manager.cc:1434] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:17:20.048486 29190 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.086045 29190 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:20.089454 28799 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:20.071408 28679 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:20.093542 28971 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.094002 28971 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.068347 28754 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:20.095324 29145 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:20.095870 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:20.096661 29145 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:20.097117 29145 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:20.097347 28971 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:20.097297 28571 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:20.099092 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:20.098991 29145 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.099707 28601 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.102648 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:20.106736 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:20.106876 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:20.107322 28755 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.107507 28756 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:20.111693 28601 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:20.114674 28799 tablet_bootstrap.cc:654] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:20.116612 28755 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:20.123886 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:20.133399 28971 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:20.133798 28971 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.134121 28971 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:20.142944 28971 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.145448 28799 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:20.145947 28799 ts_tablet_manager.cc:1403] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.078s	user 0.006s	sys 0.005s
I20260709 12:17:20.147414 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:20.148272 29190 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:20.148805 29190 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:20.148839 28799 raft_consensus.cc:359] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.149835 28799 raft_consensus.cc:385] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:20.150110 28799 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:20.151353 28799 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.152508 28797 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: No bootstrap required, opened a new log
I20260709 12:17:20.153071 28797 ts_tablet_manager.cc:1403] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.003s
I20260709 12:17:20.155246 28503 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.150044 29190 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.167958 28799 ts_tablet_manager.cc:1434] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:17:20.169114 28799 tablet_bootstrap.cc:492] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Bootstrap starting.
I20260709 12:17:20.156162 28797 raft_consensus.cc:359] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.180315 28799 tablet_bootstrap.cc:654] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:20.171322 28797 raft_consensus.cc:385] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:20.184859 28797 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Initialized, Role: FOLLOWER
I20260709 12:17:20.190224 28797 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.198589 28971 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:20.203696 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:20.205502 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:20.206120 28755 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:20.214573 28797 ts_tablet_manager.cc:1434] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 12:17:20.220757 28755 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:20.222393 28799 tablet_bootstrap.cc:492] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: No bootstrap required, opened a new log
I20260709 12:17:20.222927 28799 ts_tablet_manager.cc:1403] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.002s
I20260709 12:17:20.225978 28799 raft_consensus.cc:359] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.226742 28799 raft_consensus.cc:385] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:20.227025 28799 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Initialized, Role: FOLLOWER
I20260709 12:17:20.230506 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:20.231268 29177 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:20.233649 29177 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:20.234584 29177 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.242430 28799 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.243167 28505 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.247421 28799 ts_tablet_manager.cc:1434] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 12:17:20.275723 28503 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.404810 29190 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.405339 29190 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.407218 29190 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:20.407895 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:20.408582 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:20.410033 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:20.410632 29190 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:20.504258 29110 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.504830 29110 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.507025 29110 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:20.507664 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:20.507983 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:20.508250 28679 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:20.508682 28750 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 0.
I20260709 12:17:20.509284 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:20.510022 29110 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:20.510428 29110 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.510715 29110 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.516142 29110 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.517863 29110 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:20.518615 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:20.518784 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:20.519273 28679 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.519373 28750 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.525102 28750 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:20.526121 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:20.526072 29190 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.526882 29110 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:20.527544 29110 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:20.527319 29190 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.528496 29110 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.531581 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:20.532265 28598 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 0.
I20260709 12:17:20.535331 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:20.536273 29126 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:20.536477 28679 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:20.536710 29126 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.537259 29126 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.548030 29126 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.550560 29190 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:20.551374 29126 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:20.553325 28503 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.557107 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:20.557729 28601 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.560770 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:20.561344 28755 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.561707 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:20.576086 28677 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:20.578209 28755 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:20.582485 29177 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:20.582634 28601 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:20.584270 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:20.585599 29190 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:20.616936 29190 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:20.627256 29190 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.650856 28971 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:20.670415 28674 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:20.675197 29192 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:20.677038 29192 consensus_queue.cc:1243] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:17:20.677552 29168 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:20.677908 29168 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:20.678702 29168 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:20.679966 29168 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:20.687254 28505 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 0 to 1, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:20.715054 28598 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:17:20.715515 28598 pending_rounds.cc:85] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 0
I20260709 12:17:20.715869 28598 pending_rounds.cc:107] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:17:20.716208 28598 raft_consensus.cc:2889] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:20.726852 29126 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:20.740056 28755 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:17:20.743783 29190 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:20.926513 29110 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:20.955426 29192 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:21.107024 29126 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:21.135134 29058 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:22.630920 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:22.679752 29281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:22.680462 29279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:22.697220 27446 server_base.cc:1061] running on GCE node
W20260709 12:17:22.697383 29283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:22.699685 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:22.700011 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:22.700256 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599442700239 us; error 0 us; skew 500 ppm
I20260709 12:17:22.701067 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:22.704860 27446 webserver.cc:533] Webserver started at http://127.26.205.132:46481/ using document root <none> and password file <none>
I20260709 12:17:22.705549 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:22.705807 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:22.706224 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:22.707969 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-3-root/instance:
uuid: "5b3b2f4041a24b05983f30878f16db9d"
format_stamp: "Formatted at 2026-07-09 12:17:22 on dist-test-slave-673s"
I20260709 12:17:22.715662 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:22.721949 29288 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:22.723603 27446 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:17:22.724014 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-3-root
uuid: "5b3b2f4041a24b05983f30878f16db9d"
format_stamp: "Formatted at 2026-07-09 12:17:22 on dist-test-slave-673s"
I20260709 12:17:22.724411 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:22.741099 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:22.743032 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:22.745229 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:22.749958 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:22.750241 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:22.750550 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:22.750802 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:22.852146 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.132:46291
I20260709 12:17:22.852267 29351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.132:46291 every 8 connection(s)
I20260709 12:17:22.877427 27446 auto_leader_rebalancer-test.cc:439] add a tserver: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:22.901298 29352 heartbeater.cc:344] Connected to a master server at 127.26.205.190:43093
I20260709 12:17:22.901803 29352 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:22.902698 29352 heartbeater.cc:507] Master 127.26.205.190:43093 requested a full tablet report, sending...
I20260709 12:17:22.904901 28504 ts_manager.cc:194] Registered new tserver with Master: 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:22.906386 28504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39986
I20260709 12:17:23.166416 28674 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:23.186101 28598 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.187278 29058 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.188402 28755 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.192335 29278 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.202730 29058 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.220899 28677 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:23.233959 28504 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:23.235646 28647 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ad958cd19754b4b9c2817e4b5cd7ded. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.252635 28601 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.267205 28754 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
W20260709 12:17:23.291013 28647 consensus_peers.cc:597] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae666b5b049a49c0bd0b0969e6b2b154. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.293854 28601 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.295279 28754 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.299183 29363 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.301846 29277 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.339417 29364 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.342133 28754 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.354548 28600 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.373273 28503 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:23.405534 28601 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:23.427294 28755 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.427922 28674 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.430287 29324 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.431936 29110 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:23.449781 29374 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.451462 28755 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.454422 28677 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.474298 28503 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
W20260709 12:17:23.500970 28572 consensus_peers.cc:597] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1632d712fbcd489da9624b1f43ff7f96. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.507943 28677 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:17:23.525220 28647 consensus_peers.cc:597] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7f9c29f436b4c6bbfb909b71ca1d309. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:23.526144 28755 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.526918 28600 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:23.528035 29277 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.528976 29364 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:23.545589 29364 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.547350 28755 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.557224 28600 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:23.566947 28505 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:23.640184 29381 ts_tablet_manager.cc:933] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:23.653667 29381 tablet_copy_client.cc:323] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:23.669461 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet 1ad958cd19754b4b9c2817e4b5cd7ded from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:23.670099 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet 1ad958cd19754b4b9c2817e4b5cd7ded from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-1ad958cd19754b4b9c2817e4b5cd7ded
I20260709 12:17:23.678256 28692 tablet_copy_source_session.cc:215] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:23.682173 29381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad958cd19754b4b9c2817e4b5cd7ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:23.698676 29381 tablet_copy_client.cc:806] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:23.699409 29381 tablet_copy_client.cc:670] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:23.710103 29381 tablet_copy_client.cc:538] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:23.723223 29381 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:23.752058 29381 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:23.753232 29381 tablet_bootstrap.cc:492] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:23.753927 29381 ts_tablet_manager.cc:1403] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.007s
I20260709 12:17:23.756915 29381 raft_consensus.cc:359] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:23.757823 29381 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:23.758514 29381 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:23.768157 29352 heartbeater.cc:499] Master 127.26.205.190:43093 was elected leader, sending a full tablet report...
I20260709 12:17:23.771039 29381 ts_tablet_manager.cc:1434] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 12:17:23.772904 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-1ad958cd19754b4b9c2817e4b5cd7ded received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:23.773391 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-1ad958cd19754b4b9c2817e4b5cd7ded on tablet 1ad958cd19754b4b9c2817e4b5cd7ded with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:23.795768 29387 ts_tablet_manager.cc:933] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:17:23.798738 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57089.9us
I20260709 12:17:23.808399 29387 tablet_copy_client.cc:323] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:23.810314 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet ae666b5b049a49c0bd0b0969e6b2b154 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:23.810882 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet ae666b5b049a49c0bd0b0969e6b2b154 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-ae666b5b049a49c0bd0b0969e6b2b154
I20260709 12:17:23.816591 28692 tablet_copy_source_session.cc:215] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:23.820210 29387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae666b5b049a49c0bd0b0969e6b2b154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:23.831835 29387 tablet_copy_client.cc:806] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:23.832653 29387 tablet_copy_client.cc:670] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:23.835894 29387 tablet_copy_client.cc:538] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:23.843423 29387 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:23.869637 29387 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:23.879809 29387 tablet_bootstrap.cc:492] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:23.880551 29387 ts_tablet_manager.cc:1403] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.008s
I20260709 12:17:23.883391 29387 raft_consensus.cc:359] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:23.886750 29381 ts_tablet_manager.cc:933] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:23.912606 29387 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:23.913601 29387 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:23.929114 29381 tablet_copy_client.cc:323] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:23.930294 29387 ts_tablet_manager.cc:1434] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.000s
I20260709 12:17:23.933148 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ae666b5b049a49c0bd0b0969e6b2b154 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:23.933629 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ae666b5b049a49c0bd0b0969e6b2b154 on tablet ae666b5b049a49c0bd0b0969e6b2b154 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:23.946228 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet 1632d712fbcd489da9624b1f43ff7f96 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:23.946826 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet 1632d712fbcd489da9624b1f43ff7f96 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-1632d712fbcd489da9624b1f43ff7f96
I20260709 12:17:23.955946 28617 tablet_copy_source_session.cc:215] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:23.959347 29381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1632d712fbcd489da9624b1f43ff7f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:23.977588 29381 tablet_copy_client.cc:806] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:23.978276 29381 tablet_copy_client.cc:670] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:23.990787 29381 tablet_copy_client.cc:538] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:23.999694 29381 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:24.020393 29381 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:24.024281 29381 tablet_bootstrap.cc:492] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:24.025259 29381 ts_tablet_manager.cc:1403] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.007s
I20260709 12:17:24.029827 29381 raft_consensus.cc:359] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:24.030755 29381 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:24.031489 29381 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:24.037339 29381 ts_tablet_manager.cc:1434] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:17:24.040185 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-1632d712fbcd489da9624b1f43ff7f96 received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:24.040644 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-1632d712fbcd489da9624b1f43ff7f96 on tablet 1632d712fbcd489da9624b1f43ff7f96 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:24.162451 29381 ts_tablet_manager.cc:933] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:24.188637 29381 tablet_copy_client.cc:323] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:24.190423 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet a7f9c29f436b4c6bbfb909b71ca1d309 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:24.191035 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet a7f9c29f436b4c6bbfb909b71ca1d309 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-a7f9c29f436b4c6bbfb909b71ca1d309
I20260709 12:17:24.210647 28692 tablet_copy_source_session.cc:215] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:24.214879 29381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f9c29f436b4c6bbfb909b71ca1d309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:24.249495 29327 raft_consensus.cc:1217] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:24.270170 29381 tablet_copy_client.cc:806] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:24.270793 29381 tablet_copy_client.cc:670] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:24.275856 29381 tablet_copy_client.cc:538] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:24.292505 29381 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:24.317018 29381 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:24.317830 29381 tablet_bootstrap.cc:492] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:24.318377 29381 ts_tablet_manager.cc:1403] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.011s
I20260709 12:17:24.320180 29381 raft_consensus.cc:359] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:24.320814 29381 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:24.321446 29381 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:24.323652 29381 ts_tablet_manager.cc:1434] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:17:24.325348 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-a7f9c29f436b4c6bbfb909b71ca1d309 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:24.325752 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-a7f9c29f436b4c6bbfb909b71ca1d309 on tablet a7f9c29f436b4c6bbfb909b71ca1d309 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:24.333077 29327 raft_consensus.cc:1217] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:24.483384 29327 raft_consensus.cc:1217] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:24.685453 29058 raft_consensus.cc:1064] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:24.688350 29058 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:24.696280 28756 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.697796 28601 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.698122 29327 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.701673 29364 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.703547 29364 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.730355 29277 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:24.755751 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 56379.5us
W20260709 12:17:24.758528 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 57883.1us
W20260709 12:17:24.838780 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 59713.6us
I20260709 12:17:24.877184 29327 raft_consensus.cc:1217] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:24.903393 29363 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:24.915597 29277 raft_consensus.cc:1064] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:24.916016 28756 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:24.917970 29277 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:24.922049 29327 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:24.929473 28755 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.932873 29326 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.935171 28600 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:24.937574 29058 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.939438 29058 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.940847 29277 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.967964 28503 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:24.991420 29399 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:24.996246 29326 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:24.991355 28601 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.016987 28755 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.023105 29393 raft_consensus.cc:1064] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:25.031876 29393 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:25.036238 28601 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.073891 29326 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.074203 28750 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.075644 29110 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:25.076746 29374 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:25.080389 28679 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.082486 29110 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:25.143283 28502 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.148614 29399 raft_consensus.cc:1064] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:25.156188 28679 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:25.151973 29399 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:25.181582 28674 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:25.193982 29327 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.195739 29277 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.243085 29327 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.243747 29058 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.245477 29327 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.255720 28750 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.246258 28601 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.271776 28504 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.283315 29363 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.359483 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet ae666b5b049a49c0bd0b0969e6b2b154 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:25.372509 29393 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.382112 29397 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.384181 29397 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.383767 29327 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.388044 28750 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.388880 28601 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.395529 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ae666b5b049a49c0bd0b0969e6b2b154 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:25.401605 29323 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:25.401536 28502 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.403891 28755 raft_consensus.cc:2955] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.410265 29397 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:25.420272 29399 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.425379 29398 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:25.444775 29326 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.448221 29364 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:25.454509 28601 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:25.473183 29325 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.477381 29374 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.459411 29418 tablet_replica.cc:333] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:25.485013 28755 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.488003 29403 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.493378 28504 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.503822 29418 raft_consensus.cc:2243] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:25.504645 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ad958cd19754b4b9c2817e4b5cd7ded with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:25.505947 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1ad958cd19754b4b9c2817e4b5cd7ded with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:25.507380 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1632d712fbcd489da9624b1f43ff7f96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:25.508713 29325 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.513723 28606 raft_consensus.cc:2955] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.528822 28754 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.546691 29364 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.504684 29418 raft_consensus.cc:2272] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.571825 29422 tablet_replica.cc:333] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:25.573159 29422 raft_consensus.cc:2243] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:25.573909 29422 raft_consensus.cc:2272] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.578076 29418 ts_tablet_manager.cc:1916] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:25.583838 29422 ts_tablet_manager.cc:1916] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:25.589217 29326 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.591408 28754 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.600421 28504 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.619926 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet 1632d712fbcd489da9624b1f43ff7f96 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:25.630597 29425 tablet_replica.cc:333] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:25.631660 29425 raft_consensus.cc:2243] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:25.636770 29418 ts_tablet_manager.cc:1929] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:25.637427 29418 log.cc:1199] T ae666b5b049a49c0bd0b0969e6b2b154 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/ae666b5b049a49c0bd0b0969e6b2b154
I20260709 12:17:25.638490 29374 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.638999 28504 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.659873 28755 raft_consensus.cc:2955] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.632278 29425 pending_rounds.cc:70] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: Trying to abort 1 pending ops.
I20260709 12:17:25.667026 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet ae666b5b049a49c0bd0b0969e6b2b154 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:25.666349 29425 pending_rounds.cc:77] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305623326819254272 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "1632d712fbcd489da9624b1f43ff7f96" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } } }
I20260709 12:17:25.667747 29425 raft_consensus.cc:2917] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:17:25.672984 29425 raft_consensus.cc:2889] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:17:25.682601 28674 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:25.684993 28606 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.702190 29425 raft_consensus.cc:2272] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.702865 29326 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.704454 29364 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.704859 28755 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:25.706987 29364 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.682567 29422 ts_tablet_manager.cc:1929] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:25.712674 29422 log.cc:1199] T 1ad958cd19754b4b9c2817e4b5cd7ded P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/1ad958cd19754b4b9c2817e4b5cd7ded
I20260709 12:17:25.714469 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet 1ad958cd19754b4b9c2817e4b5cd7ded (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:25.720054 29399 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.739032 29326 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.744864 29425 ts_tablet_manager.cc:1916] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:25.745772 28755 raft_consensus.cc:2955] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.751418 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7f9c29f436b4c6bbfb909b71ca1d309 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:25.757803 28503 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:25.776958 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet a7f9c29f436b4c6bbfb909b71ca1d309 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:25.778000 29418 tablet_replica.cc:333] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:25.779084 29418 raft_consensus.cc:2243] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:25.779850 29418 raft_consensus.cc:2272] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:25.782877 29418 ts_tablet_manager.cc:1916] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:25.789062 29425 ts_tablet_manager.cc:1929] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:25.789690 29425 log.cc:1199] T 1632d712fbcd489da9624b1f43ff7f96 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/1632d712fbcd489da9624b1f43ff7f96
I20260709 12:17:25.791973 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet 1632d712fbcd489da9624b1f43ff7f96 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:25.796608 29418 ts_tablet_manager.cc:1929] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:25.796978 29418 log.cc:1199] T a7f9c29f436b4c6bbfb909b71ca1d309 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/a7f9c29f436b4c6bbfb909b71ca1d309
I20260709 12:17:25.798306 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet a7f9c29f436b4c6bbfb909b71ca1d309 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:26.859486 28755 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:26.865813 28674 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.867314 28601 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.869396 29417 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:26.870857 29427 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:26.894259 29427 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:26.895936 28601 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:26.895887 28674 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
W20260709 12:17:26.899397 28721 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ea376f5c1af47d79a1871ab80a23cdb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:26.922320 28601 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:26.923820 28502 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:26.936869 28572 consensus_peers.cc:597] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7fa5ed3509d4939885ee0d39a32f20a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:26.937062 28754 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.938050 28674 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:26.939760 29403 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.941670 29110 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:26.956467 29403 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:26.959445 28754 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:26.986914 28677 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:26.989655 28674 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:26.996781 28503 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
W20260709 12:17:27.037542 28647 consensus_peers.cc:597] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec3dcbf1171d4cc9855730d6a1d6e0d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:27.038401 28601 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:27.037598 28755 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:27.039655 29397 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:27.040510 29399 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:27.050032 29364 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:27.051656 28755 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:27.058452 28601 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:27.062839 28600 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.069470 28503 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:27.080139 28572 consensus_peers.cc:597] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 509077a515a748899cf8ea0c5bac854a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:27.080648 28755 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:27.081934 28677 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:27.082051 29403 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:27.083575 29441 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:27.111955 29110 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:27.113581 28755 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:27.114655 28677 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:27.128721 28505 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.309921 29450 ts_tablet_manager.cc:933] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:27.311885 29450 tablet_copy_client.cc:323] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:27.325171 28766 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 8ea376f5c1af47d79a1871ab80a23cdb from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:27.325717 28766 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 8ea376f5c1af47d79a1871ab80a23cdb from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-8ea376f5c1af47d79a1871ab80a23cdb
I20260709 12:17:27.330996 28766 tablet_copy_source_session.cc:215] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:27.334141 29450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea376f5c1af47d79a1871ab80a23cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:27.345489 29453 ts_tablet_manager.cc:933] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:27.346211 29450 tablet_copy_client.cc:806] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:27.346886 29450 tablet_copy_client.cc:670] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:27.347525 29453 tablet_copy_client.cc:323] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:27.349612 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet f7fa5ed3509d4939885ee0d39a32f20a from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:27.350142 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet f7fa5ed3509d4939885ee0d39a32f20a from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-f7fa5ed3509d4939885ee0d39a32f20a
I20260709 12:17:27.350777 29450 tablet_copy_client.cc:538] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:27.358302 29450 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:27.358923 28617 tablet_copy_source_session.cc:215] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:27.363673 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fa5ed3509d4939885ee0d39a32f20a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:27.381354 29450 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:27.382333 29450 tablet_bootstrap.cc:492] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:27.383000 29450 ts_tablet_manager.cc:1403] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.000s
I20260709 12:17:27.388247 29453 tablet_copy_client.cc:806] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:27.388911 29453 tablet_copy_client.cc:670] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:27.390046 29450 raft_consensus.cc:359] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.390895 29450 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:27.392514 29450 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.393153 29453 tablet_copy_client.cc:538] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:27.402837 29453 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:27.410705 29450 ts_tablet_manager.cc:1434] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 12:17:27.412998 28766 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-8ea376f5c1af47d79a1871ab80a23cdb received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:27.413453 28766 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-8ea376f5c1af47d79a1871ab80a23cdb on tablet 8ea376f5c1af47d79a1871ab80a23cdb with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:27.426967 29453 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:27.427899 29453 tablet_bootstrap.cc:492] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:27.428598 29453 ts_tablet_manager.cc:1403] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 12:17:27.431847 29453 raft_consensus.cc:359] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.432678 29453 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:27.433276 29453 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.435469 29453 ts_tablet_manager.cc:1434] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:17:27.436995 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-f7fa5ed3509d4939885ee0d39a32f20a received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:27.437408 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-f7fa5ed3509d4939885ee0d39a32f20a on tablet f7fa5ed3509d4939885ee0d39a32f20a with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:27.518503 29453 ts_tablet_manager.cc:933] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:27.521173 29453 tablet_copy_client.cc:323] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:27.522624 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet 509077a515a748899cf8ea0c5bac854a from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:27.523135 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet 509077a515a748899cf8ea0c5bac854a from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-509077a515a748899cf8ea0c5bac854a
I20260709 12:17:27.530639 28617 tablet_copy_source_session.cc:215] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:27.533500 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509077a515a748899cf8ea0c5bac854a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:27.549134 29453 tablet_copy_client.cc:806] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:27.549708 29453 tablet_copy_client.cc:670] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:27.553298 29453 tablet_copy_client.cc:538] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:27.561888 29453 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:27.577978 29453 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:27.578727 29453 tablet_bootstrap.cc:492] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:27.579276 29453 ts_tablet_manager.cc:1403] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:17:27.581786 29453 raft_consensus.cc:359] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.582569 29453 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:27.583087 29453 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.585541 29453 ts_tablet_manager.cc:1434] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:17:27.587101 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-509077a515a748899cf8ea0c5bac854a received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:27.587499 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-509077a515a748899cf8ea0c5bac854a on tablet 509077a515a748899cf8ea0c5bac854a with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:27.660496 29453 ts_tablet_manager.cc:933] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:27.662081 29453 tablet_copy_client.cc:323] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:27.663450 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:27.663897 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-ec3dcbf1171d4cc9855730d6a1d6e0d7
I20260709 12:17:27.669829 28692 tablet_copy_source_session.cc:215] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:27.672658 29453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:27.686295 29453 tablet_copy_client.cc:806] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:27.686826 29453 tablet_copy_client.cc:670] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:27.691735 29453 tablet_copy_client.cc:538] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:27.698825 29453 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:27.733117 29453 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:27.733837 29453 tablet_bootstrap.cc:492] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:27.734421 29453 ts_tablet_manager.cc:1403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.012s
I20260709 12:17:27.736310 29453 raft_consensus.cc:359] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.736930 29453 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:27.737392 29453 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:27.739099 29453 ts_tablet_manager.cc:1434] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:17:27.740909 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ec3dcbf1171d4cc9855730d6a1d6e0d7 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:27.741321 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ec3dcbf1171d4cc9855730d6a1d6e0d7 on tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:27.767621 29326 raft_consensus.cc:1217] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:27.817075 29326 raft_consensus.cc:1217] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:27.961856 29326 raft_consensus.cc:1217] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:28.070822 29326 raft_consensus.cc:1217] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:28.238925 29427 raft_consensus.cc:1064] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:28.242664 29427 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:28.249490 28677 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.249888 29326 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.251011 29462 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.252786 29417 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.258224 28606 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.260478 29417 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.296406 29466 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.347586 29326 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.370793 28502 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:28.375576 28677 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.411820 29437 raft_consensus.cc:1064] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:28.414356 29437 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:28.420521 28606 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.433449 28755 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:28.434074 29326 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.434417 28749 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.436224 29110 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.437413 28677 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.437937 29110 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.438498 29326 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:28.440116 28600 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:28.440826 29427 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.443462 29403 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.446784 29466 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.448527 29427 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.451897 29325 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.459051 28606 raft_consensus.cc:2955] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.471982 29110 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.473814 29327 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.477695 28505 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.486325 28755 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.493542 28677 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.505443 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ea376f5c1af47d79a1871ab80a23cdb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:28.518330 28503 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:28.522171 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ea376f5c1af47d79a1871ab80a23cdb with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:28.535141 28606 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:28.537542 29477 tablet_replica.cc:333] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:28.542161 29327 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:28.542912 29403 raft_consensus.cc:1064] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:28.545706 29403 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:28.547675 28677 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:28.538684 29477 raft_consensus.cc:2243] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:28.553776 29476 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.556849 29477 raft_consensus.cc:2272] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:28.560835 29477 ts_tablet_manager.cc:1916] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:28.563910 28755 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.606551 28674 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.609740 29327 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.624524 29477 ts_tablet_manager.cc:1929] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:28.625608 29477 log.cc:1199] T 8ea376f5c1af47d79a1871ab80a23cdb P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/8ea376f5c1af47d79a1871ab80a23cdb
I20260709 12:17:28.632087 29325 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.640033 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet 8ea376f5c1af47d79a1871ab80a23cdb (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:28.644918 29110 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:17:28.645283 29476 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:17:28.654544 29403 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.698479 29397 raft_consensus.cc:1064] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:28.705572 29476 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:28.729856 29397 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:28.751205 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7fa5ed3509d4939885ee0d39a32f20a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:17:28.752521 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 75979.6us
W20260709 12:17:28.753592 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 77598.9us
I20260709 12:17:28.765563 29476 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.781960 29327 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.784891 28677 raft_consensus.cc:2955] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.797847 29325 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.800500 29364 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:28.806125 28606 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.807871 29399 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.808725 28502 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.818714 28755 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.833668 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet f7fa5ed3509d4939885ee0d39a32f20a with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:28.844515 28504 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.846237 29110 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:28.863015 29490 tablet_replica.cc:333] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:28.869050 29490 raft_consensus.cc:2243] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:28.870185 29490 raft_consensus.cc:2272] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:28.874702 28754 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:28.878443 29490 ts_tablet_manager.cc:1916] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:28.900089 28674 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.904507 29364 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.906356 29325 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.908452 29490 ts_tablet_manager.cc:1929] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:28.908978 29490 log.cc:1199] T f7fa5ed3509d4939885ee0d39a32f20a P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/f7fa5ed3509d4939885ee0d39a32f20a
I20260709 12:17:28.910868 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet f7fa5ed3509d4939885ee0d39a32f20a (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:28.921801 28598 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.925309 29486 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:28.928671 28503 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:28.985471 28755 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.492103 28679 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:29.492213 28606 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:29.499850 29325 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.500077 28755 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.502617 29486 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.505913 28679 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.507251 29325 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:29.507565 29403 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.509291 29403 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.512737 29364 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:29.516294 28674 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.516635 29110 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.521278 29325 raft_consensus.cc:2955] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.526171 29364 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.536953 29327 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.542337 28755 raft_consensus.cc:2955] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.541014 28503 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.560472 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 509077a515a748899cf8ea0c5bac854a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:29.564643 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:29.591962 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet 509077a515a748899cf8ea0c5bac854a with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:29.598094 28505 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:29.604167 29498 tablet_replica.cc:333] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:29.613844 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:29.614923 29498 raft_consensus.cc:2243] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:29.615801 29498 raft_consensus.cc:2272] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:29.616159 29499 tablet_replica.cc:333] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:29.617564 29499 raft_consensus.cc:2243] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:29.618314 29499 raft_consensus.cc:2272] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:29.619115 29498 ts_tablet_manager.cc:1916] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:29.621814 29499 ts_tablet_manager.cc:1916] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:29.635576 29498 ts_tablet_manager.cc:1929] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:29.636075 29498 log.cc:1199] T 509077a515a748899cf8ea0c5bac854a P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/509077a515a748899cf8ea0c5bac854a
I20260709 12:17:29.637239 29499 ts_tablet_manager.cc:1929] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:29.637365 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet 509077a515a748899cf8ea0c5bac854a (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:29.637710 29499 log.cc:1199] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/ec3dcbf1171d4cc9855730d6a1d6e0d7
I20260709 12:17:29.639110 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet ec3dcbf1171d4cc9855730d6a1d6e0d7 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:30.701928 28598 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:30.708247 28755 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.709051 28679 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:30.709715 28572 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bc886982591478e97f84ddb724a679a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.709635 29110 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.710537 29403 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.718256 29500 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.719820 28679 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.719923 28749 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.735827 28674 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:30.736790 28504 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 2 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:30.746625 28749 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:30.747411 28647 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f23bf973b94c463f8da13a996fc7f221. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.748910 29493 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:30.749331 28598 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:30.752259 29493 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:17:30.773716 29486 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.778280 28749 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.780864 28598 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.793701 28502 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:30.800177 28755 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:17:30.823885 28721 consensus_peers.cc:597] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aacf3b2dee3345268f9d3c9b6a1e4779. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.824126 28679 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:30.826524 28598 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:30.825487 29513 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.828019 29466 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.834136 29466 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.835774 28679 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.838325 28606 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.847991 28755 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:17:30.856645 28721 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14b09750d07a41f39c2913b5d03c6994. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:30.858027 28598 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:30.860108 29482 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.862188 28674 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:30.863859 29482 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.862943 28503 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:30.891469 29482 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.900887 28606 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.926146 28674 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:30.935438 28503 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:31.277738 29520 ts_tablet_manager.cc:933] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:31.279716 29520 tablet_copy_client.cc:323] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:31.281842 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet 4bc886982591478e97f84ddb724a679a from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:31.282312 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet 4bc886982591478e97f84ddb724a679a from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-4bc886982591478e97f84ddb724a679a
I20260709 12:17:31.288015 28617 tablet_copy_source_session.cc:215] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:31.291604 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc886982591478e97f84ddb724a679a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:31.304373 29520 tablet_copy_client.cc:806] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:31.305104 29520 tablet_copy_client.cc:670] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:31.311367 29520 tablet_copy_client.cc:538] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:31.317806 29522 ts_tablet_manager.cc:933] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:31.323453 29520 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:31.337911 29524 ts_tablet_manager.cc:933] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:31.344981 29524 tablet_copy_client.cc:323] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:31.347829 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet f23bf973b94c463f8da13a996fc7f221 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:31.348402 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet f23bf973b94c463f8da13a996fc7f221 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-f23bf973b94c463f8da13a996fc7f221
I20260709 12:17:31.366986 29520 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:31.368499 29520 tablet_bootstrap.cc:492] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:31.369529 29520 ts_tablet_manager.cc:1403] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.046s	user 0.034s	sys 0.001s
I20260709 12:17:31.373849 29520 raft_consensus.cc:359] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:31.376991 29520 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:31.372593 28692 tablet_copy_source_session.cc:215] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:31.377795 29520 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:31.381026 29522 tablet_copy_client.cc:323] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:31.381644 29524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23bf973b94c463f8da13a996fc7f221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:31.388856 28766 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet aacf3b2dee3345268f9d3c9b6a1e4779 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:31.389458 28766 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet aacf3b2dee3345268f9d3c9b6a1e4779 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-aacf3b2dee3345268f9d3c9b6a1e4779
I20260709 12:17:31.404492 28766 tablet_copy_source_session.cc:215] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:31.405822 29520 ts_tablet_manager.cc:1434] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.005s
I20260709 12:17:31.409003 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-4bc886982591478e97f84ddb724a679a received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:31.409466 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-4bc886982591478e97f84ddb724a679a on tablet 4bc886982591478e97f84ddb724a679a with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:31.415647 29524 tablet_copy_client.cc:806] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:31.417491 29524 tablet_copy_client.cc:670] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:31.422271 29524 tablet_copy_client.cc:538] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:31.422596 29522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aacf3b2dee3345268f9d3c9b6a1e4779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:31.431568 29524 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:31.438843 29522 tablet_copy_client.cc:806] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:31.439412 29522 tablet_copy_client.cc:670] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:31.443460 29522 tablet_copy_client.cc:538] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:31.452499 29522 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:31.476758 29520 ts_tablet_manager.cc:933] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:31.496780 29524 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:31.496942 29520 tablet_copy_client.cc:323] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:31.492306 29522 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:31.497824 29524 tablet_bootstrap.cc:492] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:31.498526 29522 tablet_bootstrap.cc:492] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:31.498575 29524 ts_tablet_manager.cc:1403] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.026s
I20260709 12:17:31.498621 28766 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 14b09750d07a41f39c2913b5d03c6994 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:31.499323 28766 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 14b09750d07a41f39c2913b5d03c6994 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-14b09750d07a41f39c2913b5d03c6994
I20260709 12:17:31.499403 29522 ts_tablet_manager.cc:1403] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.009s
I20260709 12:17:31.501899 29524 raft_consensus.cc:359] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:31.502348 29522 raft_consensus.cc:359] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:31.502840 29524 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:31.503221 29522 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:31.504027 29524 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:31.504027 29522 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:31.516306 29522 ts_tablet_manager.cc:1434] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:17:31.519202 28765 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-aacf3b2dee3345268f9d3c9b6a1e4779 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:31.519686 28765 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-aacf3b2dee3345268f9d3c9b6a1e4779 on tablet aacf3b2dee3345268f9d3c9b6a1e4779 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:31.524802 29524 ts_tablet_manager.cc:1434] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:17:31.526506 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-f23bf973b94c463f8da13a996fc7f221 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:31.526907 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-f23bf973b94c463f8da13a996fc7f221 on tablet f23bf973b94c463f8da13a996fc7f221 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:31.535122 28766 tablet_copy_source_session.cc:215] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:31.537971 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b09750d07a41f39c2913b5d03c6994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:31.553257 29520 tablet_copy_client.cc:806] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:31.553866 29520 tablet_copy_client.cc:670] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:31.557307 29520 tablet_copy_client.cc:538] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:31.563516 29520 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:31.580859 29520 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:31.581694 29520 tablet_bootstrap.cc:492] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:31.582368 29520 ts_tablet_manager.cc:1403] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.009s
I20260709 12:17:31.584965 29520 raft_consensus.cc:359] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:31.585570 29520 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:31.586135 29520 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:31.588240 29520 ts_tablet_manager.cc:1434] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:17:31.590018 28766 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-14b09750d07a41f39c2913b5d03c6994 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:31.590417 28766 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-14b09750d07a41f39c2913b5d03c6994 on tablet 14b09750d07a41f39c2913b5d03c6994 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:31.772406 29325 raft_consensus.cc:1217] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:17:31.804421 29325 raft_consensus.cc:1217] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:31.836233 29325 raft_consensus.cc:1217] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:32.097527 29327 raft_consensus.cc:1217] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:32.258387 29533 raft_consensus.cc:1064] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:32.261413 29533 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:32.262458 29534 raft_consensus.cc:1064] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:32.265080 29534 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:32.273157 29327 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:32.275198 29327 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.276782 28674 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:32.277993 29403 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.278165 29493 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.282222 28756 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:32.283460 28749 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.284551 29534 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:32.286139 29493 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.287700 28600 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.288503 29504 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.291651 29397 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.339704 29534 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.342883 29482 raft_consensus.cc:1064] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:32.350124 29482 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:32.342599 28756 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.373322 29397 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.415319 29325 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.461148 28503 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.469328 29327 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.471915 28601 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.485023 29327 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.488461 29466 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.495566 29519 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:17:32.498648 28674 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:32.501044 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 120425us
I20260709 12:17:32.512833 28755 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.520367 28598 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.526732 28674 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.527501 28502 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.531071 29548 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.554486 29482 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.555998 29327 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.562485 28679 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.570523 28598 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.586628 28601 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:32.600225 29466 raft_consensus.cc:1064] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:32.602823 29466 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:32.607057 28679 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:32.608817 29325 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:32.610205 28755 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:32.613212 29534 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.615062 29534 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.616989 28601 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:32.619230 29327 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:32.620057 29323 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.623303 29397 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.624380 29550 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:32.625000 29327 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.620196 29403 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.618217 28679 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.631873 29548 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.632812 28601 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:32.635332 29548 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.638844 29397 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.641106 29323 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.645363 29482 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:32.625713 28504 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.659521 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4bc886982591478e97f84ddb724a679a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:32.658030 28601 raft_consensus.cc:2955] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.673094 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f23bf973b94c463f8da13a996fc7f221 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:32.689577 29466 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.691711 28679 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:32.696249 28490 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet f23bf973b94c463f8da13a996fc7f221 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
W20260709 12:17:32.697053 28492 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 4bc886982591478e97f84ddb724a679a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:17:32.695521 28502 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 2 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.706768 28598 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.710762 28755 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:32.716565 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 80808.7us
I20260709 12:17:32.720201 28756 raft_consensus.cc:2955] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.728152 28674 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:32.717953 29323 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.730495 29325 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:32.734203 29482 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.735925 29482 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.745245 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc886982591478e97f84ddb724a679a with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:32.745404 29549 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.748234 29567 tablet_replica.cc:333] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:32.749363 29567 raft_consensus.cc:2243] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:32.750238 29567 raft_consensus.cc:2272] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:32.755483 29567 ts_tablet_manager.cc:1916] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:32.757130 28679 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.773577 29567 ts_tablet_manager.cc:1929] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:17:32.774181 29567 log.cc:1199] T 4bc886982591478e97f84ddb724a679a P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/4bc886982591478e97f84ddb724a679a
I20260709 12:17:32.777045 28505 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.778437 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet 4bc886982591478e97f84ddb724a679a (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:32.742723 28501 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.754721 29325 raft_consensus.cc:2955] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.779405 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aacf3b2dee3345268f9d3c9b6a1e4779 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:32.798664 28755 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:32.804286 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet f23bf973b94c463f8da13a996fc7f221 with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:32.805603 28598 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:32.806921 29482 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.810892 29325 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:32.814002 29466 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:32.815538 28505 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.822710 29466 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.826519 28598 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.830423 29325 raft_consensus.cc:2955] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:32.836102 29568 tablet_replica.cc:333] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:32.841027 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet aacf3b2dee3345268f9d3c9b6a1e4779 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:32.848749 29568 raft_consensus.cc:2243] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:32.851833 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14b09750d07a41f39c2913b5d03c6994 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:32.852712 29569 tablet_replica.cc:333] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:32.854753 29569 raft_consensus.cc:2243] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:32.855446 29569 raft_consensus.cc:2272] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:32.858554 29568 raft_consensus.cc:2272] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:32.861506 29569 ts_tablet_manager.cc:1916] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:32.865386 29568 ts_tablet_manager.cc:1916] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:32.864061 28501 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:32.882170 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet 14b09750d07a41f39c2913b5d03c6994 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:32.883112 29567 tablet_replica.cc:333] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:32.884110 29567 raft_consensus.cc:2243] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:32.884871 29567 raft_consensus.cc:2272] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:32.887029 29568 ts_tablet_manager.cc:1929] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:32.887507 29568 log.cc:1199] T f23bf973b94c463f8da13a996fc7f221 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/f23bf973b94c463f8da13a996fc7f221
I20260709 12:17:32.888935 29569 ts_tablet_manager.cc:1929] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:32.889185 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet f23bf973b94c463f8da13a996fc7f221 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:32.889402 29569 log.cc:1199] T aacf3b2dee3345268f9d3c9b6a1e4779 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/aacf3b2dee3345268f9d3c9b6a1e4779
I20260709 12:17:32.892087 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet aacf3b2dee3345268f9d3c9b6a1e4779 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:32.892462 29567 ts_tablet_manager.cc:1916] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:32.903163 29567 ts_tablet_manager.cc:1929] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:32.903484 29567 log.cc:1199] T 14b09750d07a41f39c2913b5d03c6994 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/14b09750d07a41f39c2913b5d03c6994
I20260709 12:17:32.904692 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet 14b09750d07a41f39c2913b5d03c6994 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:33.956995 28678 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:17:33.963282 28647 consensus_peers.cc:597] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac62777e94e1417c867cb2ac80a55824. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:33.963636 28598 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:33.963995 28756 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:33.964839 29550 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:33.965746 29571 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:33.976756 29546 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:33.985649 28749 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:33.999178 28678 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.004971 28503 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:34.042100 28749 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:34.043013 28604 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:34.043761 29578 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:34.045185 29546 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:34.046604 28647 consensus_peers.cc:597] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2c936ab911d48fba6cc944d81f99fb1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:34.052327 28598 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.086902 29575 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.091909 28755 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.092496 28604 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.108484 28756 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.109678 28504 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
W20260709 12:17:34.121429 28721 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b35b6c6fffe3416bb8f69b556040e319. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:34.122189 28678 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:34.123508 29466 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:34.129158 28604 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:34.130425 29466 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:34.131980 29466 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.155874 28604 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.156566 28756 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.157945 28678 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.155495 28503 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:34.179749 28721 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6828c27180d54395aa62e49037e09909. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:34.180727 28679 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:34.180928 28604 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:34.182417 29587 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:34.183349 29466 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:34.205720 29466 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.210074 28598 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.211410 28678 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:34.227583 28503 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:34.474572 29594 ts_tablet_manager.cc:933] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:34.477181 29594 tablet_copy_client.cc:323] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:34.478909 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet ac62777e94e1417c867cb2ac80a55824 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:34.479460 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet ac62777e94e1417c867cb2ac80a55824 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-ac62777e94e1417c867cb2ac80a55824
I20260709 12:17:34.489979 28692 tablet_copy_source_session.cc:215] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:34.493335 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac62777e94e1417c867cb2ac80a55824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:34.506084 29594 tablet_copy_client.cc:806] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:34.506671 29594 tablet_copy_client.cc:670] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:34.510118 29594 tablet_copy_client.cc:538] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:34.516947 29594 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:34.533555 29594 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:34.534449 29594 tablet_bootstrap.cc:492] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:34.535127 29594 ts_tablet_manager.cc:1403] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.001s
I20260709 12:17:34.537976 29594 raft_consensus.cc:359] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.538816 29594 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:34.539517 29594 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.545665 29594 ts_tablet_manager.cc:1434] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:34.548221 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ac62777e94e1417c867cb2ac80a55824 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:34.548668 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ac62777e94e1417c867cb2ac80a55824 on tablet ac62777e94e1417c867cb2ac80a55824 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:34.660983 29594 ts_tablet_manager.cc:933] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:34.662815 29594 tablet_copy_client.cc:323] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:34.665447 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet f2c936ab911d48fba6cc944d81f99fb1 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:34.665987 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet f2c936ab911d48fba6cc944d81f99fb1 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-f2c936ab911d48fba6cc944d81f99fb1
I20260709 12:17:34.673796 28692 tablet_copy_source_session.cc:215] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:34.676976 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c936ab911d48fba6cc944d81f99fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:34.693697 29594 tablet_copy_client.cc:806] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:34.694351 29594 tablet_copy_client.cc:670] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:34.698621 29594 tablet_copy_client.cc:538] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:34.708680 29594 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:34.727188 29601 ts_tablet_manager.cc:933] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:34.735549 29601 tablet_copy_client.cc:323] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:34.736570 29603 ts_tablet_manager.cc:933] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:34.742599 28766 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet b35b6c6fffe3416bb8f69b556040e319 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:34.743245 28766 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet b35b6c6fffe3416bb8f69b556040e319 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-b35b6c6fffe3416bb8f69b556040e319
I20260709 12:17:34.744323 29603 tablet_copy_client.cc:323] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:34.751670 28765 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 6828c27180d54395aa62e49037e09909 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:34.752225 28765 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 6828c27180d54395aa62e49037e09909 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-6828c27180d54395aa62e49037e09909
I20260709 12:17:34.760469 28765 tablet_copy_source_session.cc:215] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:34.766906 29603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6828c27180d54395aa62e49037e09909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:34.769847 28766 tablet_copy_source_session.cc:215] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:34.773743 29601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35b6c6fffe3416bb8f69b556040e319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:34.779686 29594 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:34.780714 29594 tablet_bootstrap.cc:492] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:34.781427 29594 ts_tablet_manager.cc:1403] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.073s	user 0.037s	sys 0.035s
I20260709 12:17:34.784672 29594 raft_consensus.cc:359] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.785540 29594 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:34.786217 29594 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.795063 29603 tablet_copy_client.cc:806] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:34.796909 29603 tablet_copy_client.cc:670] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:34.802282 29594 ts_tablet_manager.cc:1434] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:17:34.806258 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-f2c936ab911d48fba6cc944d81f99fb1 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:34.806672 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-f2c936ab911d48fba6cc944d81f99fb1 on tablet f2c936ab911d48fba6cc944d81f99fb1 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:34.808641 29601 tablet_copy_client.cc:806] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:34.809244 29601 tablet_copy_client.cc:670] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:34.810755 29603 tablet_copy_client.cc:538] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:34.815780 29601 tablet_copy_client.cc:538] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:34.823308 29603 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:34.834403 29601 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:34.852402 29603 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:34.853384 29603 tablet_bootstrap.cc:492] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:34.856819 29603 ts_tablet_manager.cc:1403] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.020s
I20260709 12:17:34.860117 29603 raft_consensus.cc:359] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.861255 29603 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:34.861802 29601 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:34.861960 29603 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.862756 29601 tablet_bootstrap.cc:492] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:34.863513 29601 ts_tablet_manager.cc:1403] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.013s
I20260709 12:17:34.867229 29601 raft_consensus.cc:359] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.868139 29601 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:34.868832 29601 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:34.870507 29603 ts_tablet_manager.cc:1434] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:17:34.871425 29601 ts_tablet_manager.cc:1434] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:17:34.872237 28766 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-6828c27180d54395aa62e49037e09909 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:34.873613 28766 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-6828c27180d54395aa62e49037e09909 on tablet 6828c27180d54395aa62e49037e09909 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:34.874648 28765 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-b35b6c6fffe3416bb8f69b556040e319 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:34.875027 28765 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-b35b6c6fffe3416bb8f69b556040e319 on tablet b35b6c6fffe3416bb8f69b556040e319 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:34.978549 29327 raft_consensus.cc:1217] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:35.232952 29327 raft_consensus.cc:1217] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:35.269124 29327 raft_consensus.cc:1217] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:35.329134 29327 raft_consensus.cc:1217] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:35.457911 29576 raft_consensus.cc:1064] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:35.460479 29576 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:35.466998 29327 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.467188 28749 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.468586 29576 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.469493 29571 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.470934 28598 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.473065 29576 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.485857 29578 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.487591 29327 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.493252 28598 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.502710 28749 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.511993 28501 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:35.547593 28679 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:35.552577 29327 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:35.554095 29578 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:35.556663 28756 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:35.561451 29578 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:35.564954 29571 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.570799 29327 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.577605 28749 raft_consensus.cc:2955] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.584838 28504 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.593647 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac62777e94e1417c867cb2ac80a55824 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:35.608755 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet ac62777e94e1417c867cb2ac80a55824 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:35.611063 29618 tablet_replica.cc:333] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:35.612038 29618 raft_consensus.cc:2243] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:35.612857 29618 raft_consensus.cc:2272] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:35.617259 29618 ts_tablet_manager.cc:1916] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:35.645445 29618 ts_tablet_manager.cc:1929] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:35.645853 29618 log.cc:1199] T ac62777e94e1417c867cb2ac80a55824 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/ac62777e94e1417c867cb2ac80a55824
I20260709 12:17:35.647369 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet ac62777e94e1417c867cb2ac80a55824 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:35.705987 29466 raft_consensus.cc:1064] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:35.707845 29466 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:35.713934 29327 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.714565 28679 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.716403 29589 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:35.717326 29607 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.720455 28598 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.726790 29589 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:35.754019 29620 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.761144 28678 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.770845 28601 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.778026 29327 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.795024 28503 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.828763 28756 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:35.838085 29327 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:35.839620 28598 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:35.840050 29620 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:35.841732 29578 raft_consensus.cc:1064] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:35.842650 29620 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:35.844195 29578 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:35.854547 29624 raft_consensus.cc:1064] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:35.856779 29327 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.857159 29624 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:35.858135 29571 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.870496 28749 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.871447 29466 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.879926 28598 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.881115 29608 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:35.882062 29323 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.883920 29576 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.895409 28679 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.896924 29589 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.905314 29326 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.904743 28598 raft_consensus.cc:2955] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.909495 29620 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:35.913722 29608 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.915622 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b35b6c6fffe3416bb8f69b556040e319 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:35.923967 28601 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:35.926366 28749 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.931480 29620 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:17:35.939036 28505 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.953377 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet b35b6c6fffe3416bb8f69b556040e319 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:35.962337 28505 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:35.966020 29633 tablet_replica.cc:333] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:35.972419 29466 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.978195 28598 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.985617 29323 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.986505 28679 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:35.997881 28600 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.004427 29633 raft_consensus.cc:2243] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:36.005422 29633 raft_consensus.cc:2272] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:36.005216 29327 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.008814 29633 ts_tablet_manager.cc:1916] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:36.031136 28505 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:36.043970 29633 ts_tablet_manager.cc:1929] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:36.044528 29633 log.cc:1199] T b35b6c6fffe3416bb8f69b556040e319 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/b35b6c6fffe3416bb8f69b556040e319
I20260709 12:17:36.046149 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet b35b6c6fffe3416bb8f69b556040e319 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:36.051762 28749 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:36.060905 29327 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:36.061564 28598 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:36.062587 29607 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:36.063535 29466 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:36.070359 28678 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:36.072806 29589 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.074271 29327 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.085250 28598 raft_consensus.cc:2955] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.086261 29323 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:36.087695 29571 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:36.095465 28600 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:36.094714 29578 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.098243 29608 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:36.099001 28501 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.101102 29323 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.105795 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2c936ab911d48fba6cc944d81f99fb1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:36.109001 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6828c27180d54395aa62e49037e09909 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:36.104561 28600 raft_consensus.cc:2955] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:36.122463 28503 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:36.133458 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet 6828c27180d54395aa62e49037e09909 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:36.134326 29633 tablet_replica.cc:333] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:36.135375 29633 raft_consensus.cc:2243] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:36.136085 29633 raft_consensus.cc:2272] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:36.138094 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c936ab911d48fba6cc944d81f99fb1 with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:36.149130 29633 ts_tablet_manager.cc:1916] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:36.169818 29634 tablet_replica.cc:333] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:36.170607 29634 raft_consensus.cc:2243] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:36.170676 29633 ts_tablet_manager.cc:1929] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:36.171106 29633 log.cc:1199] T 6828c27180d54395aa62e49037e09909 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/6828c27180d54395aa62e49037e09909
I20260709 12:17:36.171298 29634 raft_consensus.cc:2272] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:36.172600 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet 6828c27180d54395aa62e49037e09909 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:36.174077 29634 ts_tablet_manager.cc:1916] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:36.185691 29634 ts_tablet_manager.cc:1929] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:36.186013 29634 log.cc:1199] T f2c936ab911d48fba6cc944d81f99fb1 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/f2c936ab911d48fba6cc944d81f99fb1
I20260709 12:17:36.187322 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet f2c936ab911d48fba6cc944d81f99fb1 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:37.236204 28756 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:37.242321 28679 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:37.242749 28721 consensus_peers.cc:597] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecb84065af5c41b0aaee71485ad69560. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:37.243445 28600 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:37.244917 29589 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:37.246363 29636 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:37.257663 29589 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.259436 28598 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.261123 28679 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.282848 28504 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.292477 28598 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:17:37.317226 28572 consensus_peers.cc:597] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09b12c4abe49469ebd1ae7c30355cef2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:37.317353 28678 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:37.319754 28749 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:37.321553 29598 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:37.322939 29534 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:37.362962 28755 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.361189 29645 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.386327 28678 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.391619 28679 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:37.400137 28505 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.446583 28749 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:37.447964 28600 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:37.448822 29640 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:37.451783 28647 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 316dc144dbef470e8e17c2e02887dfd8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:37.453146 29640 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:37.460008 29571 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.480123 28749 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.481884 28600 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.478166 28755 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:37.497365 28501 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:37.503130 28721 consensus_peers.cc:597] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1548a806b02a4f79b5010615f560d2bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:37.506084 28679 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:37.507078 28600 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:37.507448 29589 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:37.508380 29636 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:37.519017 29636 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.521399 28679 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.523629 28600 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:37.537364 28501 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:37.728631 29659 ts_tablet_manager.cc:933] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:37.730659 29659 tablet_copy_client.cc:323] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:37.732098 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet 09b12c4abe49469ebd1ae7c30355cef2 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:37.732666 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet 09b12c4abe49469ebd1ae7c30355cef2 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-09b12c4abe49469ebd1ae7c30355cef2
I20260709 12:17:37.737850 28617 tablet_copy_source_session.cc:215] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:37.740576 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b12c4abe49469ebd1ae7c30355cef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.752336 29659 tablet_copy_client.cc:806] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:37.752939 29659 tablet_copy_client.cc:670] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:37.756724 29659 tablet_copy_client.cc:538] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:37.763769 29659 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:37.782768 29659 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:37.783753 29659 tablet_bootstrap.cc:492] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:37.784449 29659 ts_tablet_manager.cc:1403] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.021s	user 0.022s	sys 0.000s
I20260709 12:17:37.786706 29659 raft_consensus.cc:359] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:37.787529 29659 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:37.788224 29659 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:37.791733 29659 ts_tablet_manager.cc:1434] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:37.793666 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-09b12c4abe49469ebd1ae7c30355cef2 received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:37.794039 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-09b12c4abe49469ebd1ae7c30355cef2 on tablet 09b12c4abe49469ebd1ae7c30355cef2 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:37.843727 29659 ts_tablet_manager.cc:933] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:37.846930 29659 tablet_copy_client.cc:323] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:37.848472 28765 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet ecb84065af5c41b0aaee71485ad69560 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:37.849021 28765 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet ecb84065af5c41b0aaee71485ad69560 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-ecb84065af5c41b0aaee71485ad69560
I20260709 12:17:37.856519 28765 tablet_copy_source_session.cc:215] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:37.871510 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb84065af5c41b0aaee71485ad69560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.888197 29659 tablet_copy_client.cc:806] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:37.888849 29659 tablet_copy_client.cc:670] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:37.892553 29659 tablet_copy_client.cc:538] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:37.899982 29659 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:37.916994 29659 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:37.917687 29659 tablet_bootstrap.cc:492] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:37.918234 29659 ts_tablet_manager.cc:1403] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 12:17:37.920897 29659 raft_consensus.cc:359] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:37.921839 29659 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:37.922540 29659 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:37.924737 29659 ts_tablet_manager.cc:1434] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:17:37.927115 28765 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ecb84065af5c41b0aaee71485ad69560 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:37.927526 28765 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ecb84065af5c41b0aaee71485ad69560 on tablet ecb84065af5c41b0aaee71485ad69560 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:37.945827 29659 ts_tablet_manager.cc:933] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:37.950716 29659 tablet_copy_client.cc:323] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:37.952390 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet 316dc144dbef470e8e17c2e02887dfd8 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:37.952952 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet 316dc144dbef470e8e17c2e02887dfd8 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-316dc144dbef470e8e17c2e02887dfd8
I20260709 12:17:37.960757 28692 tablet_copy_source_session.cc:215] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:37.963732 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 316dc144dbef470e8e17c2e02887dfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:37.978267 29659 tablet_copy_client.cc:806] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:37.978807 29659 tablet_copy_client.cc:670] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:37.983253 29659 tablet_copy_client.cc:538] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:37.993040 29659 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:38.011775 29659 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:38.012766 29659 tablet_bootstrap.cc:492] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:38.013439 29659 ts_tablet_manager.cc:1403] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:17:38.015537 29659 raft_consensus.cc:359] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:38.016104 29659 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:38.016707 29659 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:38.020504 29659 ts_tablet_manager.cc:1434] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:38.022013 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-316dc144dbef470e8e17c2e02887dfd8 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:38.022390 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-316dc144dbef470e8e17c2e02887dfd8 on tablet 316dc144dbef470e8e17c2e02887dfd8 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:38.072175 29659 ts_tablet_manager.cc:933] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:38.073747 29659 tablet_copy_client.cc:323] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:38.076208 28765 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 1548a806b02a4f79b5010615f560d2bb from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:38.076818 28765 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 1548a806b02a4f79b5010615f560d2bb from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-1548a806b02a4f79b5010615f560d2bb
I20260709 12:17:38.083923 28765 tablet_copy_source_session.cc:215] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:38.087525 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1548a806b02a4f79b5010615f560d2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:38.104220 29659 tablet_copy_client.cc:806] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:38.104811 29659 tablet_copy_client.cc:670] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:38.108192 29659 tablet_copy_client.cc:538] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:38.115378 29659 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:38.130348 29659 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:38.131011 29659 tablet_bootstrap.cc:492] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:38.131512 29659 ts_tablet_manager.cc:1403] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.003s
I20260709 12:17:38.133361 29659 raft_consensus.cc:359] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:38.134039 29659 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:38.134605 29659 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:38.136511 29659 ts_tablet_manager.cc:1434] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:17:38.139739 28765 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-1548a806b02a4f79b5010615f560d2bb received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:38.140139 28765 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-1548a806b02a4f79b5010615f560d2bb on tablet 1548a806b02a4f79b5010615f560d2bb with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:38.275840 29327 raft_consensus.cc:1217] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:38.334889 29327 raft_consensus.cc:1217] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:38.354067 29323 raft_consensus.cc:1217] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:38.577462 29323 raft_consensus.cc:1217] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:38.802603 29649 raft_consensus.cc:1064] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:38.806007 29649 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:38.813660 28754 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:38.813987 29323 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:38.816546 28678 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:38.817915 29534 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:38.819941 29534 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.823175 29640 raft_consensus.cc:1064] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:38.829689 29640 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:38.833696 29649 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.845607 28755 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:38.849145 29655 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:38.854278 28604 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:38.845728 29326 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:38.861368 29649 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:38.863292 29653 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:38.865998 28679 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:38.869262 29571 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:38.977417 29326 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:38.962805 28755 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:38.995674 29640 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:38.998826 29323 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.032325 28604 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.035851 28501 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:39.038173 29466 raft_consensus.cc:1064] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:39.091269 28754 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.094944 29466 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:39.141855 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 102868us
W20260709 12:17:39.143280 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46667.9us
I20260709 12:17:39.161684 28678 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.161855 29327 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.168704 29685 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:39.171591 29684 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:39.177491 29681 raft_consensus.cc:1064] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:39.180145 29681 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:39.189122 28600 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.191844 29684 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:39.204668 29466 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.206017 29323 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.210431 29636 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:39.216835 28503 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.223515 28604 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:39.229148 28606 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.229297 28600 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.238834 28674 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.244319 28678 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:39.247123 29684 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:39.252957 29684 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:39.270306 29327 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:39.271906 29598 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:39.275265 28677 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:39.288702 29327 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:39.291105 29534 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.300698 29686 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:39.302450 28606 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:39.308777 29679 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.313714 29323 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.314467 29689 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:39.317543 28678 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:39.319851 29325 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.324326 29598 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:39.343963 28606 raft_consensus.cc:2955] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.345561 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 09b12c4abe49469ebd1ae7c30355cef2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:39.323396 29327 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.362334 28674 raft_consensus.cc:2955] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.366066 28501 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:39.392241 28504 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:39.393123 29684 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.407047 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 316dc144dbef470e8e17c2e02887dfd8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:39.406045 29326 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.432978 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b12c4abe49469ebd1ae7c30355cef2 with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
W20260709 12:17:39.433306 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 75498.3us
I20260709 12:17:39.449395 28600 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.449941 28503 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.451602 28503 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.455236 29704 tablet_replica.cc:333] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:39.456532 29704 raft_consensus.cc:2243] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:39.457348 29704 raft_consensus.cc:2272] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:39.465572 29704 ts_tablet_manager.cc:1916] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:39.469936 28674 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.479151 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet 316dc144dbef470e8e17c2e02887dfd8 with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:39.481560 29704 ts_tablet_manager.cc:1929] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:39.482191 29704 log.cc:1199] T 09b12c4abe49469ebd1ae7c30355cef2 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/09b12c4abe49469ebd1ae7c30355cef2
I20260709 12:17:39.485247 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet 09b12c4abe49469ebd1ae7c30355cef2 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:39.485495 29704 tablet_replica.cc:333] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:39.486835 29704 raft_consensus.cc:2243] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:39.487644 28754 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:39.487668 29704 raft_consensus.cc:2272] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:39.499646 29327 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:39.503484 28754 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:39.502624 28674 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:39.505246 29636 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:39.506556 29589 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:39.512470 29589 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.511008 29704 ts_tablet_manager.cc:1916] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:39.515130 29327 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.523164 29326 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:39.524746 29681 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:39.525651 28674 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:39.525202 28679 raft_consensus.cc:2955] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.529874 29681 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:39.534968 29704 ts_tablet_manager.cc:1929] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:39.535497 29704 log.cc:1199] T 316dc144dbef470e8e17c2e02887dfd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/316dc144dbef470e8e17c2e02887dfd8
I20260709 12:17:39.538057 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet 316dc144dbef470e8e17c2e02887dfd8 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:39.538831 29681 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.539955 29325 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.546864 28678 raft_consensus.cc:2955] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.558450 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1548a806b02a4f79b5010615f560d2bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:39.557945 28505 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:39.567644 28503 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:39.571239 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb84065af5c41b0aaee71485ad69560 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:39.575278 29705 tablet_replica.cc:333] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:39.576609 29705 raft_consensus.cc:2243] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:39.577265 29705 raft_consensus.cc:2272] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:39.581247 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ecb84065af5c41b0aaee71485ad69560 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:39.584678 29705 ts_tablet_manager.cc:1916] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:39.588219 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet 1548a806b02a4f79b5010615f560d2bb with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:39.607129 29705 ts_tablet_manager.cc:1929] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:39.607733 29705 log.cc:1199] T ecb84065af5c41b0aaee71485ad69560 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/ecb84065af5c41b0aaee71485ad69560
I20260709 12:17:39.609581 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet ecb84065af5c41b0aaee71485ad69560 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:39.609753 29705 tablet_replica.cc:333] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:39.610776 29705 raft_consensus.cc:2243] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:39.611524 29705 raft_consensus.cc:2272] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:39.615057 29705 ts_tablet_manager.cc:1916] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:39.628546 29705 ts_tablet_manager.cc:1929] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:39.628952 29705 log.cc:1199] T 1548a806b02a4f79b5010615f560d2bb P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/1548a806b02a4f79b5010615f560d2bb
I20260709 12:17:39.630496 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet 1548a806b02a4f79b5010615f560d2bb (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:40.658601 28755 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:17:40.664806 28721 consensus_peers.cc:597] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fa8c90dea5b494e9adb22b30b41b45c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.666188 28679 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:40.666234 28606 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:40.667435 29708 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.668330 29681 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.676285 29681 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.677677 28679 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.700140 28598 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.704473 28505 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.709086 28679 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:17:40.779672 28647 consensus_peers.cc:597] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5898a5306cc40cb9c97dff5f6ab3cd8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.806870 28749 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:40.812639 28598 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:40.808602 29721 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:17:40.824611 29720 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.844498 29724 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.847208 28600 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.853878 28749 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.864059 28504 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.866003 28606 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:40.880167 28678 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:40.880643 28572 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a975dd4c5a744a1d98c05841000796f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.882385 29670 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.885713 28749 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:40.888427 29670 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.910224 29703 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.913185 28679 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.914315 28755 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.925329 28679 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:40.933243 28755 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:40.933588 28600 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:40.934579 28647 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ae65c3f66064ac694864cddddad892d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:40.934990 29724 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.935811 29723 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.938694 28503 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.944042 29709 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.951098 28606 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:40.975126 28505 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.978468 28755 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:41.053463 29733 ts_tablet_manager.cc:933] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:41.056861 29733 tablet_copy_client.cc:323] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:41.059386 28765 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 4fa8c90dea5b494e9adb22b30b41b45c from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:41.060004 28765 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 4fa8c90dea5b494e9adb22b30b41b45c from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-4fa8c90dea5b494e9adb22b30b41b45c
I20260709 12:17:41.066332 28765 tablet_copy_source_session.cc:215] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:41.069638 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa8c90dea5b494e9adb22b30b41b45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.082036 29733 tablet_copy_client.cc:806] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:41.082571 29733 tablet_copy_client.cc:670] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:41.086715 29733 tablet_copy_client.cc:538] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:41.095594 29733 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:41.117228 29733 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:41.118141 29733 tablet_bootstrap.cc:492] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:41.118883 29733 ts_tablet_manager.cc:1403] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.024s	user 0.023s	sys 0.000s
I20260709 12:17:41.121872 29733 raft_consensus.cc:359] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:41.122821 29733 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:41.123580 29733 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:41.128986 29733 ts_tablet_manager.cc:1434] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 12:17:41.130658 28765 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-4fa8c90dea5b494e9adb22b30b41b45c received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:41.131184 28765 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-4fa8c90dea5b494e9adb22b30b41b45c on tablet 4fa8c90dea5b494e9adb22b30b41b45c with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:41.363651 29733 ts_tablet_manager.cc:933] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:41.365281 29733 tablet_copy_client.cc:323] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:41.366834 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet c5898a5306cc40cb9c97dff5f6ab3cd8 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:41.367396 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet c5898a5306cc40cb9c97dff5f6ab3cd8 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-c5898a5306cc40cb9c97dff5f6ab3cd8
I20260709 12:17:41.374694 28692 tablet_copy_source_session.cc:215] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:41.379031 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5898a5306cc40cb9c97dff5f6ab3cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.400866 29733 tablet_copy_client.cc:806] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:41.401448 29733 tablet_copy_client.cc:670] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:41.402714 29738 ts_tablet_manager.cc:933] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:41.413960 29733 tablet_copy_client.cc:538] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:41.427038 29738 tablet_copy_client.cc:323] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:41.431924 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet 6ae65c3f66064ac694864cddddad892d from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:41.432708 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet 6ae65c3f66064ac694864cddddad892d from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-6ae65c3f66064ac694864cddddad892d
I20260709 12:17:41.439932 29733 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:41.442224 28692 tablet_copy_source_session.cc:215] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:41.445860 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae65c3f66064ac694864cddddad892d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.453393 29740 ts_tablet_manager.cc:933] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:41.471297 29738 tablet_copy_client.cc:806] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:41.471833 29738 tablet_copy_client.cc:670] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:41.475457 29740 tablet_copy_client.cc:323] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:41.477106 29733 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:41.477675 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet a975dd4c5a744a1d98c05841000796f8 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:41.478075 29733 tablet_bootstrap.cc:492] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:41.479472 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet a975dd4c5a744a1d98c05841000796f8 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-a975dd4c5a744a1d98c05841000796f8
I20260709 12:17:41.479861 29733 ts_tablet_manager.cc:1403] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.040s	user 0.029s	sys 0.012s
I20260709 12:17:41.481348 29738 tablet_copy_client.cc:538] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:41.482949 29733 raft_consensus.cc:359] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:41.483790 29733 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:41.484465 29733 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:41.497094 28617 tablet_copy_source_session.cc:215] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:41.497215 29733 ts_tablet_manager.cc:1434] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:17:41.499410 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-c5898a5306cc40cb9c97dff5f6ab3cd8 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:41.499850 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-c5898a5306cc40cb9c97dff5f6ab3cd8 on tablet c5898a5306cc40cb9c97dff5f6ab3cd8 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:41.505815 29738 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:41.509958 29740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a975dd4c5a744a1d98c05841000796f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:41.529747 29738 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:41.530781 29738 tablet_bootstrap.cc:492] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:41.531505 29738 ts_tablet_manager.cc:1403] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 12:17:41.531603 29740 tablet_copy_client.cc:806] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:41.532197 29740 tablet_copy_client.cc:670] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:41.536194 29740 tablet_copy_client.cc:538] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:41.535872 29738 raft_consensus.cc:359] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:41.536896 29738 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:41.537640 29738 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:41.542982 29738 ts_tablet_manager.cc:1434] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:17:41.544842 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-6ae65c3f66064ac694864cddddad892d received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:41.545249 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-6ae65c3f66064ac694864cddddad892d on tablet 6ae65c3f66064ac694864cddddad892d with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:41.546147 29740 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:41.575325 29740 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:41.576298 29740 tablet_bootstrap.cc:492] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:41.577064 29740 ts_tablet_manager.cc:1403] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.003s
I20260709 12:17:41.580662 29740 raft_consensus.cc:359] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:41.581588 29740 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:41.582300 29740 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:41.587878 29740 ts_tablet_manager.cc:1434] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:17:41.591454 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-a975dd4c5a744a1d98c05841000796f8 received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:41.591907 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-a975dd4c5a744a1d98c05841000796f8 on tablet a975dd4c5a744a1d98c05841000796f8 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:41.620509 29325 raft_consensus.cc:1217] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:41.831215 29325 raft_consensus.cc:1217] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:41.929582 29325 raft_consensus.cc:1217] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:42.011602 29325 raft_consensus.cc:1217] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:42.193593 29746 raft_consensus.cc:1064] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:42.195925 29746 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:42.202709 28678 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.202732 29325 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.204474 29714 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.205274 29746 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.206830 28606 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.208276 29714 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.223979 29746 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.226820 28606 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.230971 28678 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.240777 29325 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.255781 29745 raft_consensus.cc:1064] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:42.255239 28505 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.258388 29745 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:42.280004 28754 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.280138 29325 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.281939 29720 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.282792 28606 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.284029 29709 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:42.290992 29709 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.318936 29709 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.320526 28600 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.336529 28754 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.332041 28749 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:42.353341 29325 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.364311 29326 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:42.369546 29758 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:42.370047 28600 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:42.371628 29758 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:42.357483 28505 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.386791 29327 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.388218 29670 raft_consensus.cc:1064] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:42.383034 29715 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.410383 28678 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:42.416426 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fa8c90dea5b494e9adb22b30b41b45c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:42.407428 29670 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:42.421051 29325 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:42.422533 29709 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:42.433291 29760 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:42.434414 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67826.4us
I20260709 12:17:42.436866 29325 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.450039 28754 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:42.461292 28501 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.478547 29723 raft_consensus.cc:1064] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:42.479490 28504 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.481261 29723 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:42.485941 28749 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.486156 28674 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.488065 29762 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.488852 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa8c90dea5b494e9adb22b30b41b45c with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:42.491703 29327 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.497784 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet c5898a5306cc40cb9c97dff5f6ab3cd8 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:42.499969 28600 raft_consensus.cc:2955] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.501055 29670 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:42.503208 29767 tablet_replica.cc:333] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:42.506223 29767 raft_consensus.cc:2243] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:42.509713 29767 raft_consensus.cc:2272] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:42.511873 29706 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.515255 29325 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.518916 29720 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.519133 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5898a5306cc40cb9c97dff5f6ab3cd8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:42.524019 29767 ts_tablet_manager.cc:1916] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:42.524678 29764 tablet_replica.cc:333] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:42.528752 29723 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:42.537997 28749 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.536187 29761 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.548645 29764 raft_consensus.cc:2243] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:42.549633 29764 raft_consensus.cc:2272] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:42.539736 28606 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:42.538367 28754 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.552845 28749 raft_consensus.cc:2955] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.557621 29325 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.561453 29767 ts_tablet_manager.cc:1929] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:42.566284 29767 log.cc:1199] T c5898a5306cc40cb9c97dff5f6ab3cd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/c5898a5306cc40cb9c97dff5f6ab3cd8
I20260709 12:17:42.575901 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet c5898a5306cc40cb9c97dff5f6ab3cd8 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:42.563616 29764 ts_tablet_manager.cc:1916] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:42.565572 29720 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.587723 28504 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.589195 29723 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:42.600533 28674 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.627776 28598 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:42.627776 29745 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.629237 28600 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.636121 29325 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:42.637919 29670 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:42.646279 28755 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:42.648500 29706 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:42.649245 28755 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.646831 29761 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.656553 29325 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.657300 28754 raft_consensus.cc:2955] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.667361 28504 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.668918 29327 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.675886 28501 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.687402 28674 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:42.692878 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a975dd4c5a744a1d98c05841000796f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:42.699873 29325 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:42.701298 28600 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:42.701313 29709 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:42.700899 29764 ts_tablet_manager.cc:1929] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:42.705420 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet a975dd4c5a744a1d98c05841000796f8 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:42.706430 29709 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:42.717478 29745 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.719167 28598 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.703655 29764 log.cc:1199] T 4fa8c90dea5b494e9adb22b30b41b45c P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/4fa8c90dea5b494e9adb22b30b41b45c
I20260709 12:17:42.737632 29325 raft_consensus.cc:2955] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.744553 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ae65c3f66064ac694864cddddad892d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:42.766263 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet 4fa8c90dea5b494e9adb22b30b41b45c (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:42.764302 28503 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:42.768005 29764 tablet_replica.cc:333] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:42.769163 29764 raft_consensus.cc:2243] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:42.769830 29764 raft_consensus.cc:2272] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:42.775853 29764 ts_tablet_manager.cc:1916] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:42.778316 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ae65c3f66064ac694864cddddad892d with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:42.780144 29773 tablet_replica.cc:333] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:42.785386 29773 raft_consensus.cc:2243] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:42.786134 29773 raft_consensus.cc:2272] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:42.790508 29773 ts_tablet_manager.cc:1916] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:42.792690 29764 ts_tablet_manager.cc:1929] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:42.793219 29764 log.cc:1199] T a975dd4c5a744a1d98c05841000796f8 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/a975dd4c5a744a1d98c05841000796f8
I20260709 12:17:42.794925 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet a975dd4c5a744a1d98c05841000796f8 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:42.807852 29773 ts_tablet_manager.cc:1929] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:42.808240 29773 log.cc:1199] T 6ae65c3f66064ac694864cddddad892d P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/6ae65c3f66064ac694864cddddad892d
I20260709 12:17:42.809705 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet 6ae65c3f66064ac694864cddddad892d (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:42.878551 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:42.933296 28754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:42.933815 28754 raft_consensus.cc:606] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:42.946036 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:42.946657 28674 raft_consensus.cc:606] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:42.960125 28598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:42.960669 28598 raft_consensus.cc:606] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:42.963001 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e53cc7795245709057efe9ca977661"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:42.963449 28674 raft_consensus.cc:606] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:42.965667 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:42.966099 28674 raft_consensus.cc:606] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:42.968291 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:42.968901 28674 raft_consensus.cc:606] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:42.970177 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:42.971467 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:42.972247 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:43.259122 29714 raft_consensus.cc:993] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:43.259663 29758 raft_consensus.cc:1081] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:43.261512 29323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:17:43.262032 29323 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.262315 29323 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.283905 29323 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.286198 29323 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:43.287317 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:43.287319 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:43.288036 28754 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.288165 28600 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.288434 28754 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:43.289250 28754 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.290382 28754 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.294950 28600 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:43.295823 28754 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:43.296015 29670 raft_consensus.cc:993] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:43.296669 29670 raft_consensus.cc:1081] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:43.296731 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:43.298420 29779 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.298456 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:17:43.299134 28754 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.299444 28754 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.299681 29779 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:43.300607 29779 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.303916 29709 raft_consensus.cc:993] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:43.304489 29745 raft_consensus.cc:1081] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:43.306185 29323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:17:43.306674 29323 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.307015 29323 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.307503 28754 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.310166 28754 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:43.309597 28504 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.311893 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:43.310981 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:43.312461 28679 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.312716 28600 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.313033 28600 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:43.313614 29323 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.313762 28600 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.314978 28600 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.316350 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:43.316972 28598 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.325608 29745 raft_consensus.cc:993] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:43.326012 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:43.327813 28674 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.328127 28674 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:43.328892 28674 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.329543 29720 raft_consensus.cc:1081] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:43.329850 28674 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.330119 28679 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:43.333477 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:43.334424 29778 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.334872 29778 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:43.334877 29325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:17:43.335603 29325 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.335958 29325 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.335811 29778 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.342926 29325 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.345559 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:43.326061 28600 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:43.326845 28598 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:43.327064 29709 raft_consensus.cc:993] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:43.346120 28679 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.346457 28679 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:43.346562 29709 raft_consensus.cc:1081] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:43.327176 29323 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:43.347208 28679 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.347680 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:43.348600 29779 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.349095 29779 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:43.349843 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71e53cc7795245709057efe9ca977661"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:43.348348 28679 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.349961 29779 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.351055 28754 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.351785 28754 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.360451 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:43.361323 28755 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.355930 28674 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:43.371282 28755 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:43.372856 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:43.373987 29780 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.375223 29325 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:43.375679 28754 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.376335 29780 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:43.377319 28679 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:43.377262 29780 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:43.378945 28754 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:43.380478 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:43.380997 28600 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.381052 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:43.381762 28674 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.382113 28674 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:43.375905 28504 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.382864 28674 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.384070 28674 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.389612 28600 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:43.390751 28505 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.392990 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:43.393862 29778 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.393909 28674 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:43.394431 29778 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:43.395308 29778 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.413471 28505 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.414054 28504 catalog_manager.cc:5697] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.498550 29709 raft_consensus.cc:993] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:43.499091 29783 raft_consensus.cc:1081] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:43.500941 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:43.501489 28754 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:43.501791 28754 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.507684 28754 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.509485 28754 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:43.510280 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:43.510280 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:43.511021 28598 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.511121 28674 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:43.511487 28674 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:43.512202 28674 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.513325 28674 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.517334 28598 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:43.518325 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:43.519079 29778 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:43.519515 29778 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:43.519598 28674 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:43.520653 29778 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:43.530277 28504 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:43.749064 28674 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.750228 29778 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:43.761354 28749 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:43.762969 29780 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:43.770669 28600 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.772835 29778 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:43.795794 28600 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:43.797250 29779 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:43.828190 28674 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:43.829913 29780 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:43.848695 28674 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.851606 28749 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:43.852824 29780 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:43.853507 29796 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:43.875375 28598 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.880366 29796 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:43.911178 28600 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:43.932591 28606 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:43.934569 29780 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:43.935145 28754 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:43.936918 29670 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:43.938140 28674 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:43.939549 29670 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:43.940573 28674 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:43.940567 28572 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 793ab78ecea2432e8fdb088474026ce1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:43.942142 29778 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:43.956880 28678 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:43.956059 29807 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:43.958880 29780 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:43.963861 28754 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:43.973644 28606 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:43.975522 28674 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:43.978235 28600 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.979946 29778 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:43.994982 28501 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.020866 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:44.036876 28678 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:44.038494 28754 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:44.040689 29761 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.042874 29670 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:44.038537 28572 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff1532cf86464920afb02490b110f356. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.108290 29807 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.110008 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:44.110625 28749 raft_consensus.cc:606] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:44.112843 28749 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.113878 28755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:44.114483 28755 raft_consensus.cc:606] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:44.117520 29778 raft_consensus.cc:993] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:44.117949 29778 raft_consensus.cc:1081] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:44.119702 28674 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.128360 28679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:44.128988 28679 raft_consensus.cc:606] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:44.133828 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:44.134426 28674 raft_consensus.cc:606] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:44.135106 28678 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:44.136319 28501 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.138149 29323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:17:44.138480 28754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:44.138917 29323 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.139284 29323 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.141110 28754 raft_consensus.cc:606] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:44.144780 28600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:44.145327 28600 raft_consensus.cc:606] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:44.147075 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:44.148824 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:44.149544 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:44.156359 29323 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:44.166354 28647 consensus_peers.cc:597] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52e0d44a1cde4f32b60dd0ed014922ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.167871 28754 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:44.169365 29745 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.169677 28600 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:44.170997 29709 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.174566 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:44.175158 28749 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:44.175437 28749 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:44.176278 28749 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.177383 28749 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.179632 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:44.180243 28678 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.174080 29323 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:44.186158 28749 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:44.187546 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:44.188427 29788 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:44.188941 29788 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:44.188832 29709 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.189828 29788 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.192148 28754 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.198695 28600 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.221333 28678 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:44.220283 28754 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:44.228245 28504 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:44.225909 28501 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.237524 29714 raft_consensus.cc:993] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:44.238687 29796 raft_consensus.cc:1081] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
W20260709 12:17:44.242053 28721 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fe68878605a4b8ab3302650b63aae98. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:44.245339 28606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:17:44.245920 28606 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.246279 28606 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.250576 28600 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:44.250730 28674 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:44.252709 29796 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.252957 28606 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:44.255738 29778 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.259341 28606 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:44.259809 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:44.260821 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:44.262156 29783 raft_consensus.cc:993] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:44.263123 28749 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:44.263262 29783 raft_consensus.cc:1081] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:44.263473 28749 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:44.264346 28749 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:44.265424 28749 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.265441 29323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:17:44.266255 29323 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.266578 29323 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.268952 28674 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.274067 29323 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.278656 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:44.279225 28677 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:44.279521 28677 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:44.280233 28677 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.281260 28677 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.283294 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:44.283882 28598 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.288476 29323 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:44.290403 28598 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:44.291358 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:44.292272 29788 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:44.292894 29788 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:44.293918 29788 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.302817 28749 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:44.304164 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:44.299896 28677 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:44.305114 29807 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:44.305564 29807 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:44.306341 29807 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:44.310892 28674 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:44.327812 29830 ts_tablet_manager.cc:933] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:44.331645 29714 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.334924 28501 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 2 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.339043 28503 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:44.361194 28679 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.351668 28606 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:44.380324 28505 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:44.413163 29830 tablet_copy_client.cc:323] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:44.418757 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet 793ab78ecea2432e8fdb088474026ce1 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:44.419317 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet 793ab78ecea2432e8fdb088474026ce1 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-793ab78ecea2432e8fdb088474026ce1
I20260709 12:17:44.427456 28617 tablet_copy_source_session.cc:215] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:44.430675 29830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793ab78ecea2432e8fdb088474026ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:44.447490 29830 tablet_copy_client.cc:806] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:44.448112 29830 tablet_copy_client.cc:670] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:44.452656 29830 tablet_copy_client.cc:538] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:44.463066 29830 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:44.529237 29830 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:44.531476 29830 tablet_bootstrap.cc:492] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:44.532820 29830 ts_tablet_manager.cc:1403] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.027s
I20260709 12:17:44.536042 29830 raft_consensus.cc:359] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:44.536978 29830 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:44.537714 29830 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:44.540633 29830 ts_tablet_manager.cc:1434] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:17:44.542416 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-793ab78ecea2432e8fdb088474026ce1 received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:44.542842 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-793ab78ecea2432e8fdb088474026ce1 on tablet 793ab78ecea2432e8fdb088474026ce1 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:44.546008 29830 ts_tablet_manager.cc:933] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:44.555581 29830 tablet_copy_client.cc:323] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:44.558518 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet ff1532cf86464920afb02490b110f356 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:44.559052 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet ff1532cf86464920afb02490b110f356 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-ff1532cf86464920afb02490b110f356
I20260709 12:17:44.561173 29714 raft_consensus.cc:993] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:44.561656 29824 raft_consensus.cc:1081] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:44.563030 29323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:17:44.563557 29323 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.563899 29323 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.567552 28617 tablet_copy_source_session.cc:215] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:44.570324 29323 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.573235 29830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1532cf86464920afb02490b110f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:44.574021 29323 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:44.573215 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:44.574693 28604 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.574705 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:44.577062 28749 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:44.577345 28749 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:44.578037 28749 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.579032 28749 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.586069 28604 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:44.587426 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:44.588317 29788 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:44.588804 29788 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:44.589643 29788 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.594099 29833 ts_tablet_manager.cc:933] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:44.595067 29830 tablet_copy_client.cc:806] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:44.595690 29830 tablet_copy_client.cc:670] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:44.597425 29833 tablet_copy_client.cc:323] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:44.599385 28755 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:44.599812 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet 52e0d44a1cde4f32b60dd0ed014922ec from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:44.600368 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet 52e0d44a1cde4f32b60dd0ed014922ec from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-52e0d44a1cde4f32b60dd0ed014922ec
I20260709 12:17:44.601089 29830 tablet_copy_client.cc:538] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:44.601168 29779 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:44.608393 28749 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:44.610349 29830 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:44.614395 28692 tablet_copy_source_session.cc:215] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:44.620129 29833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e0d44a1cde4f32b60dd0ed014922ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:44.621719 28503 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:44.632776 29761 raft_consensus.cc:993] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:44.633287 29761 raft_consensus.cc:1081] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:44.636225 28755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:17:44.636831 28755 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.637181 28755 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.638739 29783 raft_consensus.cc:993] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:44.639245 29783 raft_consensus.cc:1081] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:44.642452 29325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:17:44.642978 29325 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.643290 29325 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.645720 28755 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:44.648213 28755 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:44.657711 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:44.658339 28604 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:44.658653 28604 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:44.658839 28679 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:44.659549 28604 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:44.660817 28604 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.685212 28604 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:44.700937 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:44.701879 29824 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:44.702406 29824 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:44.703302 29824 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:44.708846 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:44.709566 28677 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:44.721043 29325 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:44.723040 28677 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:44.732602 29780 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:17:44.954475 29833 tablet_copy_client.cc:806] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:44.962707 29325 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:45.015600 28677 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:44.995348 29833 tablet_copy_client.cc:670] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:45.021838 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:45.022600 28677 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:45.022957 28677 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:45.023823 28677 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:45.025483 28677 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:45.037639 29779 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:45.092541 28677 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:45.080680 29830 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:45.111737 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:45.139902 28678 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:45.118512 29833 tablet_copy_client.cc:538] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:45.144196 29788 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:45.196859 29830 tablet_bootstrap.cc:492] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:45.273659 29788 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:45.275485 29788 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:45.327651 29830 ts_tablet_manager.cc:1403] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.716s	user 0.048s	sys 0.019s
W20260709 12:17:45.388967 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 160226us
I20260709 12:17:45.395761 29816 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.162s
W20260709 12:17:45.396759 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 241382us
I20260709 12:17:45.398837 28754 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:45.405030 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:45.405632 28755 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:45.406046 29327 raft_consensus.cc:1217] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:17:45.418685 29852 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.080s	user 0.000s	sys 0.003s
W20260709 12:17:45.422226 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 131816us
I20260709 12:17:45.437186 29780 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:17:45.452889 28681 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:45.468802 29856 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 12:17:45.478466 28604 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:45.478884 28607 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:45.467157 28755 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
W20260709 12:17:45.482191 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 50035.8us
I20260709 12:17:45.479257 29847 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:17:45.487532 29870 ts_tablet_manager.cc:933] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:45.506429 29830 raft_consensus.cc:359] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:45.511006 29830 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:45.512831 29830 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:45.509608 28598 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:45.509513 29833 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:45.517378 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:45.542276 28503 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.545969 29714 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:45.528631 29865 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:45.536072 28501 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.559899 28756 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:45.529743 29788 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:45.534354 29859 raft_consensus.cc:1064] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:45.564033 29807 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:45.567003 29859 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:45.536763 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 105329us
I20260709 12:17:45.680399 29830 ts_tablet_manager.cc:1434] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.330s	user 0.006s	sys 0.008s
I20260709 12:17:45.685145 28755 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:45.701951 29870 tablet_copy_client.cc:323] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:45.749871 29321 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:45.792228 28680 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:45.796377 29865 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:45.808833 28680 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:45.812800 29842 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:17:45.817343 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ff1532cf86464920afb02490b110f356 received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:45.817799 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-ff1532cf86464920afb02490b110f356 on tablet ff1532cf86464920afb02490b110f356 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:45.818172 29761 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:45.845481 28765 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 4fe68878605a4b8ab3302650b63aae98 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:45.877203 28765 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 4fe68878605a4b8ab3302650b63aae98 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-4fe68878605a4b8ab3302650b63aae98
I20260709 12:17:45.890384 28747 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:45.824754 29874 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:17:45.907449 29788 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:17:45.919919 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 115846us
I20260709 12:17:45.939015 29322 raft_consensus.cc:1217] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:45.947660 28765 tablet_copy_source_session.cc:215] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:45.951258 29870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe68878605a4b8ab3302650b63aae98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:45.969424 29874 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:45.979583 29325 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:45.988229 28674 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.012444 29833 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:46.013525 29833 tablet_bootstrap.cc:492] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:46.014268 29833 ts_tablet_manager.cc:1403] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.505s	user 0.019s	sys 0.021s
I20260709 12:17:46.029086 28747 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.033753 29833 raft_consensus.cc:359] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:46.034660 29833 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:46.035287 29833 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:46.040375 29833 ts_tablet_manager.cc:1434] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260709 12:17:46.048758 29870 tablet_copy_client.cc:806] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:46.049378 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-52e0d44a1cde4f32b60dd0ed014922ec received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:46.049634 29870 tablet_copy_client.cc:670] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:46.049862 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-52e0d44a1cde4f32b60dd0ed014922ec on tablet 52e0d44a1cde4f32b60dd0ed014922ec with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:46.057863 29870 tablet_copy_client.cc:538] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:46.059630 28503 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.092119 28599 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:46.102636 29325 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:46.104063 28681 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:46.104064 29842 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:46.106856 29670 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:46.113811 28681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:46.114620 28681 raft_consensus.cc:606] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:46.115712 29670 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.117983 28681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:46.117640 29321 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.118564 28681 raft_consensus.cc:606] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:46.121299 28599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:46.123492 28599 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:46.128044 29870 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:46.131249 28681 raft_consensus.cc:2955] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.132763 28680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:46.133354 28680 raft_consensus.cc:606] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:46.135958 28680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:46.136495 28680 raft_consensus.cc:606] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:46.138815 29745 raft_consensus.cc:993] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:46.139250 29745 raft_consensus.cc:1081] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:46.141029 29321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:17:46.142740 29321 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.143178 29321 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.138833 28505 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.152653 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:46.160488 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet 793ab78ecea2432e8fdb088474026ce1 with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:46.160912 29321 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:46.163992 29321 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:46.164561 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:46.165148 28681 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:46.165403 28681 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:46.166011 28681 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:46.166939 28681 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.171916 28681 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:46.173887 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:46.175009 29779 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:46.175535 29779 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:46.176393 29779 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:46.180537 29905 tablet_replica.cc:333] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:46.181636 29905 raft_consensus.cc:2243] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.182355 29905 raft_consensus.cc:2272] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.183658 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:46.186441 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:46.187167 28598 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.189141 29905 ts_tablet_manager.cc:1916] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:46.191037 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:46.195796 28598 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:46.213290 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 793ab78ecea2432e8fdb088474026ce1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:46.230672 28503 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.239831 29321 raft_consensus.cc:1217] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:46.277264 29870 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:46.278185 29870 tablet_bootstrap.cc:492] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:46.278899 29870 ts_tablet_manager.cc:1403] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.009s
I20260709 12:17:46.281793 29870 raft_consensus.cc:359] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:46.282656 29870 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:46.283339 29870 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:46.285874 29870 ts_tablet_manager.cc:1434] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:46.288537 28765 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-4fe68878605a4b8ab3302650b63aae98 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:46.288949 28765 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-4fe68878605a4b8ab3302650b63aae98 on tablet 4fe68878605a4b8ab3302650b63aae98 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:46.288926 29905 ts_tablet_manager.cc:1929] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:46.292948 29905 log.cc:1199] T 793ab78ecea2432e8fdb088474026ce1 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/793ab78ecea2432e8fdb088474026ce1
I20260709 12:17:46.294884 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet 793ab78ecea2432e8fdb088474026ce1 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:46.391055 29670 raft_consensus.cc:993] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:46.391517 29842 raft_consensus.cc:1081] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:46.393038 28681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34892
I20260709 12:17:46.393550 28681 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.393883 28681 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.400337 28681 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:46.402226 28681 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:46.403376 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:46.403626 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:46.403968 28756 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.404201 28599 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:46.406287 28599 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:46.410729 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:46.413967 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:46.414815 29745 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:46.415514 29745 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:46.416411 29745 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:46.418093 28599 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:46.419476 28599 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.437021 29842 raft_consensus.cc:1064] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:46.441206 29842 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:46.442854 28503 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:46.449275 28599 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:46.459012 28756 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:46.461242 28674 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:46.462252 29321 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:46.462646 29670 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:46.463804 29842 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:46.465062 29807 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:46.495427 29745 raft_consensus.cc:993] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:46.495955 29745 raft_consensus.cc:1081] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:46.497000 29874 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.500676 28747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:46.501245 28747 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.501586 28747 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.500109 28674 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.509964 28756 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.519863 28747 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:46.522943 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:46.523581 28599 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.528164 28503 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.531850 28599 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:46.539201 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:46.540525 28674 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:46.540890 28674 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:46.539974 28747 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:46.542502 28722 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:46.543305 29824 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:46.559692 29824 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:46.550284 29321 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.542766 28674 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:46.560667 29824 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:46.563485 28674 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.570936 28674 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:46.557744 28599 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:46.600600 29321 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:46.602170 29842 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:46.607002 29325 raft_consensus.cc:1217] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:46.611764 29321 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.614923 28747 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:46.610245 29807 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.623011 28606 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:46.624941 29788 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:46.629662 29897 raft_consensus.cc:993] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:46.630671 29894 raft_consensus.cc:1081] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:46.630856 29670 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:46.632294 29325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:17:46.632879 29325 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.633273 29325 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.641790 28503 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.644992 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff1532cf86464920afb02490b110f356 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:46.645360 28747 raft_consensus.cc:2955] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:46.672382 29894 raft_consensus.cc:993] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:46.672917 29894 raft_consensus.cc:1081] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:46.689350 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet ff1532cf86464920afb02490b110f356 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:46.703519 28674 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:46.709261 29864 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:46.717545 29325 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:46.699090 28504 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:46.721113 28747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:46.721716 28747 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.722084 28747 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.724191 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:46.724944 28599 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.730731 28747 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:46.735139 28747 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:46.737040 29325 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:46.739207 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:46.739816 28681 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:46.740168 28681 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:46.741285 28681 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:46.743779 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:46.757117 28599 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:46.759545 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:46.762790 28680 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:46.763119 28680 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:46.763880 28680 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:46.765067 28680 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.744712 28602 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.774397 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:46.786582 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:46.787617 29788 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:46.787878 28681 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:46.788118 29788 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:46.789160 29788 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:46.813616 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45000.2us
I20260709 12:17:46.812885 28503 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.842118 28720 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:46.861172 28681 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:46.868182 29917 tablet_replica.cc:333] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:46.870431 29917 raft_consensus.cc:2243] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:46.871217 29917 raft_consensus.cc:2272] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:46.868731 29855 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:46.872800 28602 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:46.872794 29855 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:46.874348 29855 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:46.876477 29917 ts_tablet_manager.cc:1916] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:46.900776 28503 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:46.902657 29917 ts_tablet_manager.cc:1929] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:46.903041 29917 log.cc:1199] T ff1532cf86464920afb02490b110f356 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/ff1532cf86464920afb02490b110f356
I20260709 12:17:46.904690 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet ff1532cf86464920afb02490b110f356 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:46.931413 28747 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:46.932875 29745 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:46.949811 28599 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:46.950657 28602 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:46.952394 29745 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:46.952039 29922 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:17:46.969050 29321 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Advancing to term 2
I20260709 12:17:46.969376 28681 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:46.971248 29824 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.005620 29321 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:47.007736 29855 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.025305 29922 raft_consensus.cc:1064] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:47.027921 29922 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.036291 28674 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:47.036662 28599 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:47.037366 29321 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:47.037834 29868 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:47.038667 29824 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:47.039491 29924 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:47.048731 29824 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.050474 28674 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.050464 29321 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.069482 28504 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.071010 28602 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.088616 28747 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.112972 29321 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:47.114609 29924 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.120366 28681 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:47.122925 29924 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.124953 29924 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.134893 29855 raft_consensus.cc:1064] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:47.134374 29325 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.137362 29855 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.131774 28680 raft_consensus.cc:2955] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.170640 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52e0d44a1cde4f32b60dd0ed014922ec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:47.177938 28504 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 4 to 5, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.191123 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet 52e0d44a1cde4f32b60dd0ed014922ec with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:47.200330 29321 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:47.201903 28602 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:47.201845 29924 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:47.203825 29924 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.207788 28676 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:47.209390 29855 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.212169 29932 tablet_replica.cc:333] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:47.213430 29932 raft_consensus.cc:2243] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.214391 29932 raft_consensus.cc:2272] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.222415 29932 ts_tablet_manager.cc:1916] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:47.233544 29924 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.247306 29932 ts_tablet_manager.cc:1929] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:47.248893 29932 log.cc:1199] T 52e0d44a1cde4f32b60dd0ed014922ec P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/52e0d44a1cde4f32b60dd0ed014922ec
I20260709 12:17:47.248600 28602 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.252794 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet 52e0d44a1cde4f32b60dd0ed014922ec (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:47.257408 28676 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.264673 28503 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.268292 29321 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.271386 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:47.303802 28756 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.311998 28606 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:47.315436 29321 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:47.316753 29922 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:47.323671 29855 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:47.325796 29855 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.327075 29321 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.347927 28599 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:47.348555 28676 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:47.351423 29864 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.353358 28505 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.362807 29868 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:47.370738 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fe68878605a4b8ab3302650b63aae98 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:47.372192 29917 tablet_replica.cc:333] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:47.373173 29917 raft_consensus.cc:2243] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:47.373878 29917 raft_consensus.cc:2272] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:47.378252 28602 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:47.378991 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fe68878605a4b8ab3302650b63aae98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:47.386227 29917 ts_tablet_manager.cc:1916] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:47.388641 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:47.389215 28756 raft_consensus.cc:606] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:47.391112 29864 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.391855 28602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:47.392373 28602 raft_consensus.cc:606] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:47.394901 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:47.395406 28674 raft_consensus.cc:606] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:47.396690 28606 raft_consensus.cc:2955] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:47.407440 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6828c27180d54395aa62e49037e09909"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:47.410094 28756 raft_consensus.cc:606] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:47.412093 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:47.413839 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:47.425271 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:47.436977 28676 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:47.443029 29924 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:47.475651 29924 raft_consensus.cc:993] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:47.476572 29855 raft_consensus.cc:1081] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:47.485565 29922 raft_consensus.cc:993] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:47.486032 29922 raft_consensus.cc:1081] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:47.487670 28674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:17:47.488194 28674 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.488634 28674 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.488713 28606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6828c27180d54395aa62e49037e09909"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:17:47.489295 28606 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.489615 28606 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.498799 28674 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:47.500553 28674 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:47.501590 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:47.502192 28756 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:47.502251 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:47.502588 28756 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:47.502879 28602 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.503321 28756 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:47.504684 28756 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.511044 28756 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:47.512157 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:47.512729 28602 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:47.513082 29894 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:47.513600 29894 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:47.514393 29894 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:47.515805 28606 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.518369 29917 ts_tablet_manager.cc:1929] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:47.518559 28606 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:47.519412 29917 log.cc:1199] T 4fe68878605a4b8ab3302650b63aae98 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/4fe68878605a4b8ab3302650b63aae98
I20260709 12:17:47.519477 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:17:47.520144 29321 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.522187 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet 4fe68878605a4b8ab3302650b63aae98 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:47.527580 29321 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:47.518311 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:47.528714 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:47.529172 28756 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:47.529469 29874 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:47.529503 28756 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:47.530123 29874 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:47.530606 28756 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.530997 29874 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.533069 28756 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.540045 28756 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:47.556272 28504 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.562670 28503 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 2 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.732082 29807 raft_consensus.cc:993] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:47.732565 29670 raft_consensus.cc:1081] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:47.733815 28676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34892
I20260709 12:17:47.734292 28676 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.734599 28676 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.739660 28676 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.741643 28676 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:47.742555 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:17:47.742789 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:47.743182 29321 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.743363 28606 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:47.743737 28606 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:47.744408 28606 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.745520 28606 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.749167 29321 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:47.750200 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:47.750991 29918 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:47.751356 28606 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:47.751524 29918 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:47.752537 29918 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:47.762652 28503 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:47.900952 29918 raft_consensus.cc:993] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:47.901487 29894 raft_consensus.cc:1081] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:47.903002 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:47.903471 28754 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:47.903775 28754 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.908417 28754 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:47.909931 28754 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:47.910799 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:47.910854 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:47.911466 28606 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.911578 28676 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:47.912066 28676 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:47.912859 28676 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:47.913823 28676 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:47.916642 28606 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:47.917743 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:47.918413 29924 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:47.918905 29924 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:47.918915 28754 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:47.919759 28676 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:47.919770 29924 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:47.921682 29894 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.932792 28503 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.934931 28606 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:47.935762 28754 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:47.936955 29874 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.941319 29918 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:47.960623 29321 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:47.962507 29670 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:48.221351 29325 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:48.222474 29918 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:48.231247 28606 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:48.233474 29918 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:48.373391 28674 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:48.374894 29924 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.386513 28606 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:48.388139 29922 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.447728 28674 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:48.453703 28756 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:48.454366 28647 consensus_peers.cc:597] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 663f0169fb984cfe963338bade0eabbb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:48.454813 28606 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:48.454905 29894 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.456221 29943 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.467111 28602 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.465385 29894 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.476068 28756 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.483274 28754 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:48.488937 28503 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:48.501227 28674 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:48.502321 28721 consensus_peers.cc:597] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 302623a332a2421e848283481e8010f6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:48.504009 29924 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.521009 28606 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:48.522456 29937 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.526067 29922 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.531775 28674 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.538760 28602 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.561538 28756 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:48.561530 28504 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:48.571398 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:48.580360 28674 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:17:48.580823 28721 consensus_peers.cc:597] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30c9fa2ab7fb487da44a0d6de40286ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:48.581934 29963 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:48.586452 28602 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:48.588178 29922 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:48.591755 29963 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.593549 28674 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.611752 28505 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 3, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.616608 28756 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:48.623770 28602 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
W20260709 12:17:48.633806 28721 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 683aa452755144abbbeaff5aa710e8ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:48.633913 28674 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:48.634135 28599 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:48.635373 29962 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.637218 29922 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:48.680917 29922 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.684388 28599 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.689069 28674 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:48.690340 28680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:48.690928 28680 raft_consensus.cc:606] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:48.697153 28754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:48.697742 28754 raft_consensus.cc:606] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:48.710165 28505 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:48.711942 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:48.712570 28674 raft_consensus.cc:606] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:48.716609 28754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:48.717147 28754 raft_consensus.cc:606] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:48.721019 28602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:48.721550 28602 raft_consensus.cc:606] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:48.724275 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:48.726006 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:48.729103 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:48.867698 29956 raft_consensus.cc:993] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:48.868835 29956 raft_consensus.cc:1081] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:48.871511 28680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34892
I20260709 12:17:48.889863 28680 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:48.890460 28680 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.914048 29918 raft_consensus.cc:993] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:48.915068 29894 raft_consensus.cc:1081] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:48.917838 28756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:48.918634 28756 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:48.919127 28756 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.959656 29894 raft_consensus.cc:993] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:48.960366 29894 raft_consensus.cc:1081] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:48.962978 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:48.963819 28754 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:48.964359 28754 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:48.979874 28680 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:48.981227 29937 raft_consensus.cc:993] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:48.981890 29937 raft_consensus.cc:1081] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:48.982489 28680 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:48.984107 29325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:17:48.984696 29325 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:48.985026 29325 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.985662 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:48.986040 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:48.986609 28747 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.986680 28606 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:48.987138 28606 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:48.988016 28606 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:48.989498 28606 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.995059 28747 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:48.995728 28754 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:48.997449 28756 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:48.993040 29325 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:49.000909 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:49.001420 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:49.003841 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:49.004168 28602 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.004592 28599 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.005079 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:49.005816 28680 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:49.009229 29943 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:49.009888 29943 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:49.012560 28756 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:49.013751 29325 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:49.013105 29943 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:49.015486 28599 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:49.016867 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:49.017031 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:49.017619 28674 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:49.017902 28674 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:49.020488 29922 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:49.020390 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:49.021032 29922 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:49.021338 28756 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:49.021698 28756 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:49.022176 29922 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:49.025556 28756 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:49.078642 28606 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:49.079936 29974 ts_tablet_manager.cc:933] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:49.080519 28756 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:49.080735 28674 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:49.097452 28674 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.097999 28756 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:17:49.024852 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:49.081997 28602 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:49.080353 29973 ts_tablet_manager.cc:933] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:49.099442 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:49.099555 28676 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:49.103148 28676 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:49.109443 28754 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:49.136631 29974 tablet_copy_client.cc:323] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:49.142966 28680 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:17:49.144552 29978 ts_tablet_manager.cc:933] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:49.145285 28503 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 3, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.168416 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:49.171619 29922 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:49.172293 29922 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:49.173369 29922 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:49.148526 28674 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:49.108086 29972 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:49.114722 28676 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:49.154418 28505 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:49.187119 29978 tablet_copy_client.cc:323] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:49.189949 29985 ts_tablet_manager.cc:933] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:49.192058 29985 tablet_copy_client.cc:323] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:49.179563 29972 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:49.196630 29973 tablet_copy_client.cc:323] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
W20260709 12:17:49.207206 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58051.6us
I20260709 12:17:49.212735 28765 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 302623a332a2421e848283481e8010f6 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:49.213073 28766 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 683aa452755144abbbeaff5aa710e8ca from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:49.213426 28765 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 302623a332a2421e848283481e8010f6 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-302623a332a2421e848283481e8010f6
I20260709 12:17:49.214237 28766 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 683aa452755144abbbeaff5aa710e8ca from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-683aa452755144abbbeaff5aa710e8ca
I20260709 12:17:49.214931 28764 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 30c9fa2ab7fb487da44a0d6de40286ff from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:49.215559 28764 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 30c9fa2ab7fb487da44a0d6de40286ff from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-30c9fa2ab7fb487da44a0d6de40286ff
I20260709 12:17:49.216040 29972 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:49.227557 28676 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.263564 28765 tablet_copy_source_session.cc:215] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:49.257089 28766 tablet_copy_source_session.cc:215] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:49.267565 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet 663f0169fb984cfe963338bade0eabbb from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:49.268159 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet 663f0169fb984cfe963338bade0eabbb from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-663f0169fb984cfe963338bade0eabbb
I20260709 12:17:49.268728 28676 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:49.284324 29985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302623a332a2421e848283481e8010f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.288918 29978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683aa452755144abbbeaff5aa710e8ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.292646 28692 tablet_copy_source_session.cc:215] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:49.294356 28764 tablet_copy_source_session.cc:215] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:49.293951 28505 catalog_manager.cc:5697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:49.297008 29937 raft_consensus.cc:993] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:49.297534 29937 raft_consensus.cc:1081] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:49.300993 29973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663f0169fb984cfe963338bade0eabbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.313606 28602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:17:49.314265 28602 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:49.314631 28602 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.321054 29974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c9fa2ab7fb487da44a0d6de40286ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:49.334275 28602 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:49.336203 29978 tablet_copy_client.cc:806] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:49.340956 29978 tablet_copy_client.cc:670] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:49.342722 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:49.343256 28602 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:49.343429 28505 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 2 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 3 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:49.345695 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:17:49.343391 28754 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:49.346154 29985 tablet_copy_client.cc:806] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:49.346284 29323 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.353390 29985 tablet_copy_client.cc:670] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:49.348203 29978 tablet_copy_client.cc:538] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:49.359966 29323 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:49.348487 29973 tablet_copy_client.cc:806] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:49.361344 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:49.346380 28754 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:49.363322 29984 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:49.363863 29984 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:49.364100 28754 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:49.365465 28754 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:49.364840 29984 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:49.371439 29985 tablet_copy_client.cc:538] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:49.372001 28754 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:49.351601 29974 tablet_copy_client.cc:806] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:49.374019 29974 tablet_copy_client.cc:670] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:49.361476 29973 tablet_copy_client.cc:670] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:49.377672 29978 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:49.383809 29974 tablet_copy_client.cc:538] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:49.386261 29973 tablet_copy_client.cc:538] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:49.388512 28505 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 2 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.393663 29985 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:49.404989 29973 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:49.420682 28676 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:49.422472 29963 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:49.425874 29974 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:49.447976 28598 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:49.449077 29978 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:49.449719 29979 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:49.450098 29978 tablet_bootstrap.cc:492] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:49.458452 29978 ts_tablet_manager.cc:1403] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.005s
I20260709 12:17:49.467275 29978 raft_consensus.cc:359] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:49.468875 29978 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:49.468146 29985 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:49.477803 29985 tablet_bootstrap.cc:492] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:49.478801 29985 ts_tablet_manager.cc:1403] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.012s
I20260709 12:17:49.483450 28602 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:49.484833 29924 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:49.498255 29985 raft_consensus.cc:359] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:49.508673 29985 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:49.510533 29985 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:49.506695 29978 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:49.529764 28756 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:49.534960 29943 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:49.537526 29978 ts_tablet_manager.cc:1434] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.077s	user 0.001s	sys 0.005s
I20260709 12:17:49.541368 28764 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-683aa452755144abbbeaff5aa710e8ca received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:49.542016 28764 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-683aa452755144abbbeaff5aa710e8ca on tablet 683aa452755144abbbeaff5aa710e8ca with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:49.550240 29985 ts_tablet_manager.cc:1434] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.001s
I20260709 12:17:49.551966 28764 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-302623a332a2421e848283481e8010f6 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:49.552414 28764 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-302623a332a2421e848283481e8010f6 on tablet 302623a332a2421e848283481e8010f6 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:49.569990 29973 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:49.576071 29973 tablet_bootstrap.cc:492] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:49.576911 29973 ts_tablet_manager.cc:1403] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.172s	user 0.023s	sys 0.005s
I20260709 12:17:49.587276 29973 raft_consensus.cc:359] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:49.588063 29973 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:49.588681 29973 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:49.603363 28754 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:49.605180 29973 ts_tablet_manager.cc:1434] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:17:49.607129 29972 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:49.613787 29325 raft_consensus.cc:1217] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:49.616880 29974 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:49.617908 29974 tablet_bootstrap.cc:492] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:49.618652 29974 ts_tablet_manager.cc:1403] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.193s	user 0.023s	sys 0.010s
I20260709 12:17:49.622189 29974 raft_consensus.cc:359] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:49.622910 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-663f0169fb984cfe963338bade0eabbb received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:49.623035 29974 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:49.623387 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-663f0169fb984cfe963338bade0eabbb on tablet 663f0169fb984cfe963338bade0eabbb with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:49.623800 29974 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:49.628592 29974 ts_tablet_manager.cc:1434] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:17:49.630299 28764 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-30c9fa2ab7fb487da44a0d6de40286ff received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:49.630826 28764 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-30c9fa2ab7fb487da44a0d6de40286ff on tablet 30c9fa2ab7fb487da44a0d6de40286ff with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:49.652154 28674 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:49.653631 29972 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:49.734578 29325 raft_consensus.cc:1217] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:49.739672 28606 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:49.741168 29963 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:49.755759 28674 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:49.759738 29988 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:49.808314 28755 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:49.809727 29874 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:49.818816 29325 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:49.820279 29984 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:49.888983 29325 raft_consensus.cc:1217] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:49.914049 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:49.966255 28606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:49.967715 28606 raft_consensus.cc:606] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:49.971248 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:49.971845 28674 raft_consensus.cc:606] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:49.975571 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:49.976127 28756 raft_consensus.cc:606] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:49.977455 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:49.979064 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:49.980988 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:50.080819 29325 raft_consensus.cc:1217] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:50.097462 29894 raft_consensus.cc:993] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:50.097910 29894 raft_consensus.cc:1081] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:50.099210 28756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:50.099649 28756 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:50.099954 28756 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:50.106021 28756 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.109365 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:50.109515 28756 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:50.109913 28598 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:50.111462 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:50.111984 28674 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:50.112265 28674 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:50.112988 28674 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.113952 28674 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:50.118373 28598 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:50.128731 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:50.129979 30004 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:50.130460 30004 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:50.131924 30004 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.132712 29894 raft_consensus.cc:1064] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:50.135192 29894 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:50.160036 29325 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.162087 29894 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.171486 28503 catalog_manager.cc:5697] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:50.174857 28755 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.154286 28674 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:50.177331 28598 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.178629 29943 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.189878 29894 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.218497 29943 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.221161 29325 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.231833 28598 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.242831 28755 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.249547 28505 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.275362 28676 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:50.285024 28602 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:50.285429 29323 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:50.287689 29943 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.290892 29943 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.295872 29894 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.297997 29924 raft_consensus.cc:1064] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:50.301090 29924 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:50.304987 29325 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.307206 28598 raft_consensus.cc:2955] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.325636 29323 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.325831 28602 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.327256 30004 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.328365 28676 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.332095 30004 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:50.334770 29988 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.338732 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 663f0169fb984cfe963338bade0eabbb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:50.348392 29988 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.350768 28501 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:50.350585 28680 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.358701 29322 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.365504 28598 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.374120 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet 663f0169fb984cfe963338bade0eabbb with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:50.376962 30028 tablet_replica.cc:333] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:50.376859 28505 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:50.378151 30028 raft_consensus.cc:2243] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:50.378872 30028 raft_consensus.cc:2272] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:50.383455 30028 ts_tablet_manager.cc:1916] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:50.395411 28756 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:50.410982 28676 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:50.412248 29924 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.421725 29322 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:50.423317 29924 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.581902 30004 raft_consensus.cc:993] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:50.582721 30004 raft_consensus.cc:1081] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:50.590595 28602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:17:50.591127 28602 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:50.591457 28602 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.623556 28602 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.630211 28602 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:50.636655 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 96685.9us
I20260709 12:17:50.646965 30028 ts_tablet_manager.cc:1929] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:50.647508 30028 log.cc:1199] T 663f0169fb984cfe963338bade0eabbb P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/663f0169fb984cfe963338bade0eabbb
I20260709 12:17:50.658774 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet 663f0169fb984cfe963338bade0eabbb (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:50.658056 29988 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:50.670504 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 58576.3us
I20260709 12:17:50.678783 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:50.679365 28681 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.682592 28674 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.691988 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 302623a332a2421e848283481e8010f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:50.697346 28676 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:50.703127 30030 raft_consensus.cc:993] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:50.703631 30030 raft_consensus.cc:1081] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:50.705353 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:50.705981 28750 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:50.706272 28750 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:50.706981 28750 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.710305 28750 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.714217 28681 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:17:50.716609 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:50.718691 28503 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:50.719719 28750 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:17:50.720466 30032 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:50.721017 30032 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:50.721036 29322 raft_consensus.cc:2955] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.722065 30032 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.728484 28676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34892
I20260709 12:17:50.729089 28676 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:50.729427 28676 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:50.731681 30004 raft_consensus.cc:1064] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:50.736331 28676 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.734298 30004 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:50.740329 28676 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:50.742434 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:50.742693 30045 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:50.743047 28750 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:50.752517 28750 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:50.753523 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:50.755402 30035 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:50.755874 30035 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:50.756842 30035 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.800879 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet 302623a332a2421e848283481e8010f6 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:50.804180 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:50.804867 28606 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:50.805161 28606 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:50.805804 28606 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:50.807034 28606 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:50.812377 28503 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:50.814427 29325 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:50.815932 29924 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.822316 28680 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:50.829563 30049 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.837984 28606 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:50.839960 30054 tablet_replica.cc:333] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:50.844316 28504 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:50.851763 30054 raft_consensus.cc:2243] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:50.855041 30054 raft_consensus.cc:2272] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:50.860162 28606 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:50.863605 30054 ts_tablet_manager.cc:1916] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:50.866314 29924 raft_consensus.cc:1064] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:50.872018 29924 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:50.871832 30034 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.876475 28680 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.868377 28606 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:50.887732 29322 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.889909 30034 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:50.893285 30004 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:50.914072 28503 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.923651 28680 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.924248 28602 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.924494 29322 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:50.925808 30049 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.927533 30034 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.932857 30045 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.940805 30054 ts_tablet_manager.cc:1929] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:50.945458 28605 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:50.942179 30054 log.cc:1199] T 302623a332a2421e848283481e8010f6 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/302623a332a2421e848283481e8010f6
I20260709 12:17:50.952741 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet 302623a332a2421e848283481e8010f6 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:50.995213 28755 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:50.996863 30045 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.002104 29325 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.014441 29323 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:51.015142 28605 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.017658 29924 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:51.016985 28680 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.022976 28674 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:51.026537 30034 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:51.031160 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:51.031075 29988 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.037334 29323 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.038686 28504 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.045150 28676 raft_consensus.cc:2955] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.061733 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 30c9fa2ab7fb487da44a0d6de40286ff with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:51.081028 28503 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 4 to 5, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.083575 28755 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:51.098749 29325 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:51.100703 29924 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:51.107074 28605 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:51.108481 29988 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:51.115931 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet 30c9fa2ab7fb487da44a0d6de40286ff with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:51.117357 30054 tablet_replica.cc:333] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:51.118499 30049 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.139720 28674 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:51.143258 30046 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:51.147989 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 683aa452755144abbbeaff5aa710e8ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:51.152776 28680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:51.153017 30054 raft_consensus.cc:2243] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.153401 28680 raft_consensus.cc:606] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:51.153684 30054 raft_consensus.cc:2272] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.157477 30054 ts_tablet_manager.cc:1916] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:51.159075 28750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:51.159724 28750 raft_consensus.cc:606] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:51.163210 28605 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.164247 28750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:51.164844 28750 raft_consensus.cc:606] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:51.169760 28598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:51.169714 29323 raft_consensus.cc:2955] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:51.170644 28598 raft_consensus.cc:606] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:51.172756 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:51.174476 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:51.175494 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:51.188192 28505 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.203042 28750 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:51.205180 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet 683aa452755144abbbeaff5aa710e8ca with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:51.208865 30067 tablet_replica.cc:333] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:51.209046 30046 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:51.210158 30067 raft_consensus.cc:2243] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:51.210376 30054 ts_tablet_manager.cc:1929] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:51.210886 30054 log.cc:1199] T 30c9fa2ab7fb487da44a0d6de40286ff P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/30c9fa2ab7fb487da44a0d6de40286ff
I20260709 12:17:51.211184 30067 raft_consensus.cc:2272] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:51.212559 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet 30c9fa2ab7fb487da44a0d6de40286ff (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:51.217578 30067 ts_tablet_manager.cc:1916] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:51.253695 30067 ts_tablet_manager.cc:1929] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:51.254189 30067 log.cc:1199] T 683aa452755144abbbeaff5aa710e8ca P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/683aa452755144abbbeaff5aa710e8ca
I20260709 12:17:51.255844 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet 683aa452755144abbbeaff5aa710e8ca (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:51.257135 28605 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:51.258517 30036 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:51.259505 30037 raft_consensus.cc:993] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:51.260015 30040 raft_consensus.cc:1081] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:51.264041 28750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:17:51.264564 28750 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:51.264889 28750 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.274469 28755 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:51.275974 30036 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:51.286940 28750 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.290045 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:51.290836 28605 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:51.291239 28605 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:51.292831 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:51.293558 28681 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.292369 28605 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.301923 28605 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.309294 28605 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:51.289446 28750 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:51.310312 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:51.311131 30038 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:51.311584 30038 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:51.312420 30038 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.315114 28681 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:51.340803 28503 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.641083 30038 raft_consensus.cc:993] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:51.641588 30045 raft_consensus.cc:1081] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:51.642994 28598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:17:51.643518 28598 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:51.643862 28598 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.649377 28598 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.650987 28598 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:51.651551 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:51.651927 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:51.652750 28674 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.652856 28750 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:51.653234 28750 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:51.653967 28750 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.655380 28750 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.658596 28674 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:17:51.659672 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:51.660310 30040 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:51.660714 28750 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:17:51.660789 30040 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:51.661759 30040 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.682565 28503 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.694548 30036 raft_consensus.cc:993] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:51.695070 30036 raft_consensus.cc:1081] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:51.695632 30045 raft_consensus.cc:993] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:51.696120 30045 raft_consensus.cc:1081] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:51.697588 28674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:17:51.698069 28750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:51.698544 28674 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:51.698626 28750 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:51.698863 28674 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.699100 28750 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.705467 28674 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.706271 28750 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.707049 28674 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:51.708153 28750 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:51.708209 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:51.708935 28755 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:51.709163 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:51.709306 28755 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:51.709626 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:51.709824 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:51.709843 28674 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:51.710196 28598 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.710427 28602 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.710480 28674 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:51.710522 28755 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.711835 28755 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.711495 28674 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.724640 28674 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:51.730376 28602 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:51.733081 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:51.731297 28755 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:51.733992 30035 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:51.734462 30035 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:51.735302 30035 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.736588 28674 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:51.737763 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:51.738646 30045 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:51.740744 30045 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:51.741827 28598 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:51.741706 30045 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:51.753753 28503 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.757001 28501 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.919451 28598 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:51.920641 30045 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:51.940104 28674 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:51.942391 30045 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.074365 28750 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:52.075408 30046 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:52.083600 28674 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:52.085337 30040 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:52.120391 28750 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:52.121572 30035 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.133708 28602 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:52.135574 30035 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.158193 28602 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:52.159507 30045 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.169371 28674 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:52.170637 29988 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.266021 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:52.281394 28674 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:17:52.296064 28647 consensus_peers.cc:597] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dcb1386731ec4c46bd9cc992c2ffc31b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.296686 28750 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:52.299957 30035 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.301982 28602 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:52.304221 30015 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.320719 30036 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.322510 28750 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.323879 28681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:52.325076 28681 raft_consensus.cc:606] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:52.332422 28755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:52.333014 28755 raft_consensus.cc:606] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:52.339326 28598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:52.339936 28598 raft_consensus.cc:606] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:52.339488 28602 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.345194 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:52.343276 28503 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.347645 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:52.347645 28750 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:52.348637 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:52.361626 28721 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cdf685c3207841c286a253af2d105972. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.363132 28602 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:52.366510 28681 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:52.368145 29988 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.369059 30038 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.398083 30085 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.414598 28674 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.426568 28605 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.447078 28504 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.449319 30045 raft_consensus.cc:993] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:52.449942 30045 raft_consensus.cc:1081] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:52.451653 29325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:17:52.452208 29325 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.452632 29325 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.456924 28681 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:52.459614 29325 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:52.464748 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:52.465234 28674 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.474731 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:52.475510 28755 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.475867 28755 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:52.476727 28755 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:52.477843 28755 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.478972 28750 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:52.479256 28674 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:52.480631 30015 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.481616 29325 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:52.482036 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:52.482096 28602 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:52.484001 30048 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.485807 30015 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.487705 30048 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:52.489650 30048 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:52.491609 28755 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
W20260709 12:17:52.493379 28647 consensus_peers.cc:597] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2cf259cdc3c4cdfb64950de8d1adb98. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.515793 30036 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.520504 28755 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.521324 28605 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.533298 28501 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.539654 28681 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:52.546567 28503 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
W20260709 12:17:52.553552 28647 consensus_peers.cc:597] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5e3c15999a1401a85e85110ac625d58. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.554196 28755 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:52.555776 30015 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.561136 28605 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:52.563462 30015 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.566937 30015 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.569501 28755 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.572865 28605 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:52.598313 28503 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 2, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.659709 30036 raft_consensus.cc:993] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:52.660207 30036 raft_consensus.cc:1081] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:52.666319 28755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:52.666898 28755 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.667263 28755 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.674880 28755 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:52.679735 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:52.680344 28681 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.680655 28681 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:52.681718 28755 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:52.681406 28681 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:52.682641 28681 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.683866 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:17:52.684417 29323 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.691182 28681 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:52.692329 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:52.693203 30038 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.693682 30038 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:52.694550 30038 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:52.707393 29323 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:52.716825 28505 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.743886 30046 raft_consensus.cc:993] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:52.744412 30037 raft_consensus.cc:1081] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:52.746366 28681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34892
I20260709 12:17:52.746930 28681 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:52.747255 28681 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.752617 28681 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:52.754141 28681 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:52.755014 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:52.755218 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:52.755633 28605 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:52.755801 28755 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.755872 28605 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:52.756959 28605 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:52.757957 28605 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:52.762353 28755 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:52.763546 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:52.764268 30015 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:52.764775 30015 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:52.765672 30015 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:52.764748 28605 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:52.779439 28505 catalog_manager.cc:5697] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:52.811997 30108 ts_tablet_manager.cc:933] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:52.814179 30108 tablet_copy_client.cc:323] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:52.815737 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet dcb1386731ec4c46bd9cc992c2ffc31b from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:52.816322 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet dcb1386731ec4c46bd9cc992c2ffc31b from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-dcb1386731ec4c46bd9cc992c2ffc31b
I20260709 12:17:52.821950 28692 tablet_copy_source_session.cc:215] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:52.824733 30108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcb1386731ec4c46bd9cc992c2ffc31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.839003 30108 tablet_copy_client.cc:806] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:52.839586 30108 tablet_copy_client.cc:670] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:52.843173 30108 tablet_copy_client.cc:538] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:52.856369 30108 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:52.870582 30110 ts_tablet_manager.cc:933] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:52.870610 30111 ts_tablet_manager.cc:933] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:52.879797 30111 tablet_copy_client.cc:323] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:52.882033 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet d2cf259cdc3c4cdfb64950de8d1adb98 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:52.882767 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet d2cf259cdc3c4cdfb64950de8d1adb98 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-d2cf259cdc3c4cdfb64950de8d1adb98
I20260709 12:17:52.901701 30108 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:52.902786 30108 tablet_bootstrap.cc:492] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:52.903528 30108 ts_tablet_manager.cc:1403] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.007s
I20260709 12:17:52.920625 28692 tablet_copy_source_session.cc:215] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:52.921968 30110 tablet_copy_client.cc:323] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:52.923709 28764 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet cdf685c3207841c286a253af2d105972 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:52.924248 28764 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet cdf685c3207841c286a253af2d105972 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-cdf685c3207841c286a253af2d105972
I20260709 12:17:52.906998 30108 raft_consensus.cc:359] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:52.929360 30108 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:52.931059 30108 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:52.935524 30108 ts_tablet_manager.cc:1434] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:17:52.937402 28691 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-dcb1386731ec4c46bd9cc992c2ffc31b received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:52.937867 28691 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-dcb1386731ec4c46bd9cc992c2ffc31b on tablet dcb1386731ec4c46bd9cc992c2ffc31b with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:52.948913 28764 tablet_copy_source_session.cc:215] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:52.954350 30111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cf259cdc3c4cdfb64950de8d1adb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.965417 30110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf685c3207841c286a253af2d105972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:52.982630 30111 tablet_copy_client.cc:806] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:52.983274 30111 tablet_copy_client.cc:670] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:52.985555 30110 tablet_copy_client.cc:806] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:52.991703 30110 tablet_copy_client.cc:670] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:52.992501 28681 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:52.993789 30111 tablet_copy_client.cc:538] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:52.993957 30048 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:52.998909 30108 ts_tablet_manager.cc:933] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:53.009917 30111 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:53.016104 30110 tablet_copy_client.cc:538] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:53.028462 30108 tablet_copy_client.cc:323] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:53.036880 30110 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:53.044592 30111 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:53.045639 30111 tablet_bootstrap.cc:492] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:53.046386 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet b5e3c15999a1401a85e85110ac625d58 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:53.047003 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet b5e3c15999a1401a85e85110ac625d58 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-b5e3c15999a1401a85e85110ac625d58
I20260709 12:17:53.061947 30111 ts_tablet_manager.cc:1403] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.009s
I20260709 12:17:53.062918 28692 tablet_copy_source_session.cc:215] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:53.070533 30108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e3c15999a1401a85e85110ac625d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:53.082407 28755 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:53.078626 30111 raft_consensus.cc:359] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:53.089938 30111 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:53.092093 30111 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:53.096771 30111 ts_tablet_manager.cc:1434] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 12:17:53.101524 30048 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:53.116228 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-d2cf259cdc3c4cdfb64950de8d1adb98 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:53.116662 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-d2cf259cdc3c4cdfb64950de8d1adb98 on tablet d2cf259cdc3c4cdfb64950de8d1adb98 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:53.121471 30110 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:53.122484 30110 tablet_bootstrap.cc:492] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:53.123195 30110 ts_tablet_manager.cc:1403] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.087s	user 0.027s	sys 0.026s
I20260709 12:17:53.135416 30110 raft_consensus.cc:359] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:53.136325 30110 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:53.137010 30110 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:53.139493 30110 ts_tablet_manager.cc:1434] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:17:53.144829 28764 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-cdf685c3207841c286a253af2d105972 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:53.145247 28764 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-cdf685c3207841c286a253af2d105972 on tablet cdf685c3207841c286a253af2d105972 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:53.174799 30108 tablet_copy_client.cc:806] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:53.175395 30108 tablet_copy_client.cc:670] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:53.178822 30108 tablet_copy_client.cc:538] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:53.190980 30108 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:53.199352 28755 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.200565 30015 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.206643 29325 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:53.208057 30038 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:53.225831 28605 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:53.230619 30036 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:53.239843 28680 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:53.251436 30085 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:53.284214 30108 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:53.296232 30108 tablet_bootstrap.cc:492] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:53.297282 30108 ts_tablet_manager.cc:1403] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.107s	user 0.020s	sys 0.004s
I20260709 12:17:53.317847 30108 raft_consensus.cc:359] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:53.318841 30108 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:53.319530 30108 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:53.326848 30108 ts_tablet_manager.cc:1434] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:17:53.329001 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-b5e3c15999a1401a85e85110ac625d58 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:53.329461 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-b5e3c15999a1401a85e85110ac625d58 on tablet b5e3c15999a1401a85e85110ac625d58 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:53.389237 29325 raft_consensus.cc:1217] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:53.414835 29325 raft_consensus.cc:1217] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:53.427564 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:53.439767 29325 raft_consensus.cc:1217] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:53.479851 29325 raft_consensus.cc:1217] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:53.483875 28680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:53.484481 28680 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:53.487324 28755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:53.487859 28755 raft_consensus.cc:606] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:53.489355 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:17:53.491019 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:53.492007 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:53.549726 30038 raft_consensus.cc:993] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:53.550210 30038 raft_consensus.cc:1081] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:53.560326 28602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:17:53.560981 28602 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:53.561571 28602 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.573568 28602 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:53.575685 28602 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:53.576416 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:53.576735 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:53.577023 28680 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.577342 28749 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:53.577625 28749 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:53.578250 28749 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:53.579167 28749 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.584846 28749 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:17:53.585614 28680 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:17:53.585768 28573 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:53.587124 30040 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:53.588300 30040 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:53.589062 30040 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:53.602281 28503 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:53.802206 30036 raft_consensus.cc:1064] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:53.805918 30036 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:53.826364 29325 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.826611 28755 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.827826 28602 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.828047 30036 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:53.829391 30035 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:53.830137 30015 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:53.842590 30015 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:53.844940 28755 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:53.858692 30036 raft_consensus.cc:1064] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:53.861652 30036 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:53.871187 28503 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:53.889832 28602 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:53.896580 28754 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.899263 29322 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.900394 30036 raft_consensus.cc:1064] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:53.900584 29323 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:53.903133 28606 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.903020 30036 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:53.910686 30035 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:53.924642 30144 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:53.927220 30142 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:53.943461 28754 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.943832 28598 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.946789 30035 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:53.948038 30144 raft_consensus.cc:993] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:53.949920 30144 raft_consensus.cc:1081] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:53.950954 30142 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:53.952140 30045 raft_consensus.cc:1064] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:53.952265 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:53.952844 28754 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:53.953157 28754 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.963878 28754 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:53.969393 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62832.7us
I20260709 12:17:53.967108 30045 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:53.980013 30144 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:53.983894 29322 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:53.986851 28754 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:53.990636 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:53.991117 30015 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:53.994776 28606 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.996563 28680 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:53.996948 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:53.997582 28681 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:53.997905 28681 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:53.998782 28681 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:54.000082 28681 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.015867 28681 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:17:54.016697 28606 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:17:54.018220 28754 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.018662 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:54.021077 29323 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:54.021236 29321 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:54.022837 30038 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:54.023303 30038 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:54.024680 30085 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:54.027168 28681 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:54.027865 28606 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:54.033110 28606 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:54.024142 30038 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:54.029614 30143 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:17:54.036361 30142 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:54.079319 30161 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:54.093986 28602 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.107402 28606 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:54.153776 30140 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:17:54.202664 30156 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:17:54.215503 28754 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.225628 28503 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.230178 28505 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 3, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.250254 28756 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:54.120103 30146 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.104188 30147 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.277355 28681 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:54.307140 30168 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:54.324777 28598 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:54.333352 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 278817us
I20260709 12:17:54.337594 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dcb1386731ec4c46bd9cc992c2ffc31b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:54.341104 29323 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:54.343231 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 71706.2us
I20260709 12:17:54.347414 28505 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.351775 30168 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:17:54.339676 29327 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.361726 28503 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:54.408030 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 57807.8us
I20260709 12:17:54.415885 30157 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.425685 29323 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:54.469323 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43658.4us
I20260709 12:17:54.506296 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet dcb1386731ec4c46bd9cc992c2ffc31b with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
W20260709 12:17:54.524876 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 116019us
I20260709 12:17:54.531188 29323 raft_consensus.cc:2955] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:17:54.532992 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 43854.8us
I20260709 12:17:54.557551 28681 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.570875 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:54.600047 30189 tablet_replica.cc:333] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:54.601204 30189 raft_consensus.cc:2243] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:54.630266 28606 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.604362 30189 raft_consensus.cc:2272] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:54.645329 28598 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:54.656211 30171 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:54.666915 30189 ts_tablet_manager.cc:1916] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:54.668210 28503 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 2 to 3, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.698002 28674 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:54.706339 30159 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:54.739576 28754 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:54.736949 28673 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:54.748143 28679 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:54.750425 29325 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:54.752108 30157 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:54.754316 29325 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:54.757247 28606 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:54.761407 30163 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:54.763481 30171 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.780648 28756 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:54.782739 30163 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:54.787864 30146 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:54.786295 30144 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.796892 29326 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:54.796368 28606 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.802834 29325 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.810917 30170 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:54.810775 29326 raft_consensus.cc:2955] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.824466 28598 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:54.830204 30038 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:54.835790 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cdf685c3207841c286a253af2d105972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:54.839609 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:54.840253 28756 raft_consensus.cc:606] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:54.860086 30189 ts_tablet_manager.cc:1929] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:54.860596 30189 log.cc:1199] T dcb1386731ec4c46bd9cc992c2ffc31b P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/dcb1386731ec4c46bd9cc992c2ffc31b
I20260709 12:17:54.858099 28504 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.862287 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet dcb1386731ec4c46bd9cc992c2ffc31b (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:54.866228 28602 raft_consensus.cc:2955] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.867873 28606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:17:54.869262 28606 raft_consensus.cc:606] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:54.876482 30170 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.891304 28754 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.893615 28503 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 3 to 4, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 1 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.895803 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5e3c15999a1401a85e85110ac625d58 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:54.907305 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:54.907914 28756 raft_consensus.cc:606] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:17:54.909214 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:54.909651 29325 raft_consensus.cc:2955] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.910887 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:54.911739 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:54.921397 30159 raft_consensus.cc:993] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:54.921944 30156 raft_consensus.cc:1081] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:54.927799 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet b5e3c15999a1401a85e85110ac625d58 with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60476
I20260709 12:17:54.928982 30189 tablet_replica.cc:333] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:17:54.930097 30189 raft_consensus.cc:2243] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:54.930856 30189 raft_consensus.cc:2272] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:54.935791 30189 ts_tablet_manager.cc:1916] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:54.977422 28505 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 3 to 4, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 1 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:17:54.994444 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet d2cf259cdc3c4cdfb64950de8d1adb98 with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:54.996783 30193 tablet_replica.cc:333] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:17:54.998119 30193 raft_consensus.cc:2243] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:54.999020 30193 raft_consensus.cc:2272] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:55.008358 30193 ts_tablet_manager.cc:1916] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:55.022923 28490 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d2cf259cdc3c4cdfb64950de8d1adb98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:55.097594 30193 ts_tablet_manager.cc:1929] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:55.098415 30193 log.cc:1199] T d2cf259cdc3c4cdfb64950de8d1adb98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/d2cf259cdc3c4cdfb64950de8d1adb98
I20260709 12:17:55.132195 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet d2cf259cdc3c4cdfb64950de8d1adb98 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
W20260709 12:17:55.133279 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 98726.4us
I20260709 12:17:55.136497 28673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:17:55.137231 28673 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:55.137662 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet cdf685c3207841c286a253af2d105972 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34870
I20260709 12:17:55.137693 28673 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:55.154584 30194 tablet_replica.cc:333] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:17:55.155730 30194 raft_consensus.cc:2243] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:55.156594 30194 raft_consensus.cc:2272] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:55.159902 30194 ts_tablet_manager.cc:1916] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:55.162348 30189 ts_tablet_manager.cc:1929] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:55.162824 30189 log.cc:1199] T b5e3c15999a1401a85e85110ac625d58 P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/b5e3c15999a1401a85e85110ac625d58
I20260709 12:17:55.153080 28673 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.164460 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet b5e3c15999a1401a85e85110ac625d58 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:55.165233 30168 raft_consensus.cc:993] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:55.166131 30168 raft_consensus.cc:1081] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:55.171152 28673 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:55.173655 28750 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:17:55.174245 28750 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:55.174571 28750 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:55.176141 30159 raft_consensus.cc:993] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:55.176667 30159 raft_consensus.cc:1081] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:55.180958 30194 ts_tablet_manager.cc:1929] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:55.181452 30194 log.cc:1199] T cdf685c3207841c286a253af2d105972 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/cdf685c3207841c286a253af2d105972
I20260709 12:17:55.183024 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet cdf685c3207841c286a253af2d105972 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:17:55.188638 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:55.189220 28602 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:55.190212 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:55.190470 28673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:17:55.190768 28754 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:55.191061 28673 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:55.192200 28673 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.194094 28754 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:55.187393 28750 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.196038 28602 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:55.196154 28750 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:55.196744 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:55.197314 28598 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:55.198033 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:55.197517 28754 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.198446 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:55.199187 28679 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:55.199311 30146 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:55.199599 28754 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:55.199622 28673 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.200068 30146 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:55.197630 28598 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:55.201246 30146 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.201794 28598 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.203049 28598 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:55.205796 28673 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:55.207265 28754 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:55.207512 28679 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:55.208855 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:55.211045 30159 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:55.211534 30159 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:55.212266 30159 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.213627 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:55.214180 28754 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:55.215451 28754 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:55.217068 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:55.217324 28598 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:17:55.217662 28605 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.216312 28754 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.219923 28754 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:55.225132 28605 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:55.226969 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:55.228227 30146 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:55.228834 30146 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:55.229768 30146 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:55.231675 28754 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:55.234934 28505 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:55.240715 28501 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.264276 28501 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.610471 28673 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:55.611665 30038 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:55.625034 28605 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:55.626307 30038 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:55.665791 28750 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:55.667383 30144 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:55.678781 28605 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:55.680089 30204 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:55.701505 28754 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:55.702610 30146 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:55.725113 28598 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:55.726769 30035 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:56.076315 28750 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.084290 28598 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:56.084296 28679 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:17:56.084913 28721 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5dc72678108404787b2aa034d4a7243. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:56.085759 30159 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:56.086591 30157 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:56.108289 30157 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.111303 28598 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.114310 28679 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.125860 28750 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.142973 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:56.149049 28721 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3be2bcd2a3b04c82bbf14413a7011c12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:56.150853 28679 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:56.157545 30159 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:56.157473 28503 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 3, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.162771 28598 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:56.170053 30159 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:56.185869 30038 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.205502 28754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:56.215776 28754 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:56.223749 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:56.221031 28602 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.224480 28674 raft_consensus.cc:606] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:56.227604 28673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:56.228207 28673 raft_consensus.cc:606] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:56.227420 28679 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.229626 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:56.231242 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:56.231947 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:56.243933 30157 raft_consensus.cc:993] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:56.245476 28501 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:56.248031 28572 consensus_peers.cc:597] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c60bef772ef04194a01b6f8f5423dd5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:56.249075 28754 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:56.250779 30168 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:56.253535 28602 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.258118 30212 raft_consensus.cc:1081] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:17:56.263188 28598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:17:56.267367 28598 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:56.267745 28598 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.272356 28673 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:56.274859 28598 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.282550 28598 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:56.283470 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:56.284107 28754 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:56.285008 30168 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.286744 28750 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.292040 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:56.284472 28754 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:56.292654 28674 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.293299 28754 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.295684 28754 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.301718 28674 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:17:56.305192 30178 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:56.301826 28754 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:17:56.306877 28505 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.312191 28673 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.308364 28571 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:56.315591 30219 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:56.331248 28647 consensus_peers.cc:597] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05ef99f51b5a4b959e982c258f2aafcc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:56.332176 28754 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:56.333026 28598 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:56.333624 30144 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:56.334592 30146 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:56.336313 30219 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:56.339321 28679 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.343575 30219 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.358853 30144 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.362442 28606 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.362974 28754 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.367904 28501 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 3 to 4, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 4 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.384087 28503 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 4, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:17:56.385975 28606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:56.386713 28606 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Received request to transfer leadership
I20260709 12:17:56.393251 28606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:56.393867 28606 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Received request to transfer leadership
I20260709 12:17:56.394428 30146 raft_consensus.cc:993] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:17:56.394966 30146 raft_consensus.cc:1081] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
W20260709 12:17:56.395166 28492 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 3be2bcd2a3b04c82bbf14413a7011c12 already in progress [suppressed 3 similar messages]
I20260709 12:17:56.397218 29326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:17:56.397708 29326 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:56.398057 29326 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:56.406816 29326 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:56.408051 28602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42084
I20260709 12:17:56.408640 28602 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Received request to transfer leadership
I20260709 12:17:56.409236 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:56.409832 28679 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:56.410012 29326 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:56.410044 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:56.410935 28754 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:56.410116 28679 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:56.412510 28679 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:56.413645 28679 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:56.417716 28754 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
W20260709 12:17:56.418911 28553 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 12:17:56.419277 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:56.420058 28679 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:56.420142 30213 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:56.420725 30213 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:17:56.421582 30213 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:56.419421 28553 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 3be2bcd2a3b04c82bbf14413a7011c12 already in progress
W20260709 12:17:56.422984 28553 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 3be2bcd2a3b04c82bbf14413a7011c12 already in progress
I20260709 12:17:56.439399 28501 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:56.492116 30229 ts_tablet_manager.cc:933] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:56.494727 30229 tablet_copy_client.cc:323] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:17:56.496604 28764 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet a5dc72678108404787b2aa034d4a7243 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:17:56.497088 28764 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet a5dc72678108404787b2aa034d4a7243 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-a5dc72678108404787b2aa034d4a7243
I20260709 12:17:56.507103 28764 tablet_copy_source_session.cc:215] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:56.510840 30229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5dc72678108404787b2aa034d4a7243. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:56.527279 30229 tablet_copy_client.cc:806] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:56.527841 30229 tablet_copy_client.cc:670] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:56.531463 30229 tablet_copy_client.cc:538] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:56.540689 30229 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:56.565182 30229 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.566093 30229 tablet_bootstrap.cc:492] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:56.566746 30229 ts_tablet_manager.cc:1403] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 12:17:56.569653 30229 raft_consensus.cc:359] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.570485 30229 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:56.571118 30229 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.573555 30229 ts_tablet_manager.cc:1434] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:17:56.575644 28764 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-a5dc72678108404787b2aa034d4a7243 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:17:56.576035 28764 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-a5dc72678108404787b2aa034d4a7243 on tablet a5dc72678108404787b2aa034d4a7243 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:56.624796 30146 raft_consensus.cc:993] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:56.625283 30144 raft_consensus.cc:1081] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:17:56.626801 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:17:56.627327 28754 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:56.627663 28754 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:56.634238 28754 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:56.636402 28754 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:56.637024 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:56.636953 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:56.637794 28606 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:56.638293 28679 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:56.638616 28679 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:56.639561 28679 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:56.640866 28679 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:56.645150 28606 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:17:56.647694 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:56.648671 30038 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:56.649169 30038 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:17:56.649693 28679 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:17:56.649951 30038 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:56.662003 28501 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 3, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:56.741463 28679 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:56.743204 30168 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:56.751492 30219 raft_consensus.cc:993] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:56.752038 30222 raft_consensus.cc:1081] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:17:56.758719 28679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34892
I20260709 12:17:56.765125 28756 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:56.798535 30229 ts_tablet_manager.cc:933] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:56.825583 28679 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:56.826066 28679 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.832598 30178 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:56.837539 30229 tablet_copy_client.cc:323] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:17:56.839178 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet 05ef99f51b5a4b959e982c258f2aafcc from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:17:56.839828 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet 05ef99f51b5a4b959e982c258f2aafcc from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-05ef99f51b5a4b959e982c258f2aafcc
W20260709 12:17:56.848271 28572 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3be2bcd2a3b04c82bbf14413a7011c12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:56.854449 28692 tablet_copy_source_session.cc:215] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:56.858119 30229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ef99f51b5a4b959e982c258f2aafcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:56.869910 29326 raft_consensus.cc:1217] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:56.870311 28679 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.886924 30229 tablet_copy_client.cc:806] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:56.887521 30229 tablet_copy_client.cc:670] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:56.888541 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:56.890564 28679 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:56.895828 30229 tablet_copy_client.cc:538] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:56.896677 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:17:56.897285 28606 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:56.897579 28606 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:17:56.899206 28606 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.900925 28606 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.903235 28674 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:56.905202 30174 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:56.907918 28606 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:17:56.916698 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:56.917382 30229 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:56.918588 30238 ts_tablet_manager.cc:933] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:56.918799 30146 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:56.919322 30146 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:17:56.920209 30146 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.940307 30238 tablet_copy_client.cc:323] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:17:56.942610 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet c60bef772ef04194a01b6f8f5423dd5f from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:17:56.943267 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet c60bef772ef04194a01b6f8f5423dd5f from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-c60bef772ef04194a01b6f8f5423dd5f
I20260709 12:17:56.952184 30229 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:56.953292 30229 tablet_bootstrap.cc:492] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:56.953802 28617 tablet_copy_source_session.cc:215] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:56.954039 30229 ts_tablet_manager.cc:1403] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.019s
I20260709 12:17:56.958148 30229 raft_consensus.cc:359] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.958963 30229 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:56.959547 30229 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:56.960928 30238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c60bef772ef04194a01b6f8f5423dd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:56.965785 30229 ts_tablet_manager.cc:1434] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 12:17:56.984490 28754 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:56.994930 30233 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:57.000202 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-05ef99f51b5a4b959e982c258f2aafcc received from {username='slave'} at 127.0.0.1:60198
I20260709 12:17:57.000797 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-05ef99f51b5a4b959e982c258f2aafcc on tablet 05ef99f51b5a4b959e982c258f2aafcc with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:17:57.005688 30238 tablet_copy_client.cc:806] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:57.006539 30238 tablet_copy_client.cc:670] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:57.007252 28501 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 4 to 5, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 5 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:57.012856 30238 tablet_copy_client.cc:538] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:57.023275 30238 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:17:57.057927 30238 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:57.058950 30238 tablet_bootstrap.cc:492] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:17:57.059696 30238 ts_tablet_manager.cc:1403] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.008s
I20260709 12:17:57.062652 30238 raft_consensus.cc:359] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:57.063544 30238 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:17:57.064266 30238 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:57.066797 30238 ts_tablet_manager.cc:1434] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:17:57.068920 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-c60bef772ef04194a01b6f8f5423dd5f received from {username='slave'} at 127.0.0.1:39434
I20260709 12:17:57.069301 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-c60bef772ef04194a01b6f8f5423dd5f on tablet c60bef772ef04194a01b6f8f5423dd5f with peer 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:17:58.232592 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.000s	sys 0.020s
W20260709 12:17:58.254606 29290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.020s	sys 0.002s
W20260709 12:17:58.274441 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.000s	sys 0.021s
W20260709 12:17:58.274693 29290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.021s	sys 0.002s
I20260709 12:17:58.299991 30249 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.300595 30249 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:58.302542 29289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.010s
W20260709 12:17:58.305183 29289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.013s	sys 0.010s
I20260709 12:17:58.317162 30249 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.319831 30249 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.320623 30249 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.324579 30248 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.324872 30253 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.325155 30248 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.325394 30253 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.327468 30213 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.328320 30249 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.328101 30213 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.328872 30249 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.331684 30249 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:58.332983 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.001s	sys 0.013s
W20260709 12:17:58.333329 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.002s	sys 0.014s
I20260709 12:17:58.333819 30249 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.330413 30213 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.342015 30213 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.342700 30213 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.346101 30255 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.346701 30255 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.347187 30213 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.349721 30255 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.355790 30255 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.356353 30255 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.358098 30255 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.359915 30255 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.360463 30255 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.362557 30255 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.369096 30261 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.374646 30261 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.378427 30259 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.379604 30259 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.381093 30261 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.381958 30255 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.382131 30259 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.378742 30257 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.382525 30255 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.383011 30257 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.384752 30255 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.385572 30257 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.413121 30259 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.413790 30259 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.416235 30259 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.431242 30246 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.432091 30246 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.434321 30246 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.440132 30255 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.440649 30213 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.441365 30213 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.440761 30255 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.560520 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:58.669646 30261 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.670432 30261 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.671151 30259 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.671797 30259 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.672801 30261 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.673369 30261 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.673821 30261 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.674486 30259 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.675083 30259 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.675839 30261 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.675554 30259 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.677691 30213 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.677731 30259 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.686302 30267 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.686902 30267 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.689162 30267 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.689651 30257 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.689709 30267 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.690284 30257 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.690377 30267 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.692902 30264 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.693262 30246 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.693439 30267 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.693482 30264 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.693794 30246 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.695513 30264 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.696120 30246 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.692339 30257 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.676378 30261 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.701013 30261 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.703261 30261 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.722517 30261 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.725622 30266 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.726248 30258 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.726421 30266 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.727052 30258 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.735608 30262 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.736210 30262 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.739215 30262 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.739758 30262 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.740401 30262 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.754235 30262 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.746100 30266 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:17:58.749418 28646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.530s	user 0.095s	sys 0.170s
W20260709 12:17:58.757380 28646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.538s	user 0.095s	sys 0.171s
I20260709 12:17:58.750649 30258 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.746279 30261 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.763271 30261 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.769198 30263 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.769970 30263 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.775363 30255 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.776587 30275 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.777168 30275 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.779424 30275 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.781494 30275 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.782023 30275 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.783644 30277 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.785362 30276 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.785872 30276 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.784178 30275 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.788195 30275 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.788539 30246 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.788664 30275 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.794864 30275 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.789091 30253 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:58.795989 30274 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.796706 30276 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.796777 30274 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.789109 30246 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.790051 30264 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.791255 30263 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.804399 30253 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.805675 30260 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.805753 30253 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.807327 30258 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.807711 30274 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.807220 30255 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.806468 30174 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.784214 30277 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.797401 30276 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.808548 30263 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.809248 30255 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.809108 30258 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.813812 30174 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.813792 30261 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:58.854632 30261 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.856046 30174 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.831190 30253 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.833520 30246 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.806247 30260 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.813201 30277 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.807459 30264 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:58.856688 28719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.019s	sys 0.017s
I20260709 12:17:58.857313 30261 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.853097 30266 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.889665 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:58.890048 30266 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.890471 28605 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:58.892948 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:58.893549 28600 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:58.860848 30252 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.894482 30252 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.867841 30268 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.874497 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:58.898479 28602 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:58.875511 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:58.899863 28599 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:58.876236 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:58.869448 30263 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.888173 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:58.888811 30264 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:58.888916 28719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.020s	sys 0.017s
I20260709 12:17:58.883795 30253 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.905807 30253 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.907107 30263 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.907773 30253 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.907943 28607 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:58.892168 30266 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.901116 28606 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:17:58.894201 30255 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.912307 29325 raft_consensus.cc:1217] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:17:58.869240 30276 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.913544 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:58.914453 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:58.919385 30278 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:58.913564 30263 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.923101 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:58.923787 29325 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:58.917732 30258 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.920228 30263 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:58.916778 30268 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.928084 30276 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.919902 30278 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.925264 30272 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.926879 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:58.929432 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:58.930421 30260 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.930799 29325 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:58.928752 30263 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.930775 30278 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.954571 30248 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:58.957566 30264 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.958029 30277 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.958168 30264 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.958643 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:58.958546 30277 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.960319 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:58.963407 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:58.961695 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:58.961782 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:58.966321 28676 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:58.966575 28679 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:58.964805 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:58.960340 30264 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.976019 30280 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:58.978134 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:58.928756 30268 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.934989 30252 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:58.960413 30277 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:58.966231 28674 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:58.982494 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:58.976819 30280 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.980448 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:58.934321 30272 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.985129 30247 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.946630 30174 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.985857 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:58.987857 30271 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.988896 29320 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:58.988914 30271 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:58.991649 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.200522 30038 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.208349 30275 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:59.208582 30277 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.208670 30278 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.209575 30275 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.209707 30277 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:59.209926 30278 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.211273 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.100663 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.213989 30279 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.214160 30264 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:59.215699 30279 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.217290 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.217763 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.218734 28756 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:17:59.002118 30159 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:58.988713 30247 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.220260 30282 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.220513 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.197578 30263 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.204172 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.044592 30250 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:59.214040 30276 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.224859 29327 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:59.204236 30246 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:59.227465 30270 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.227837 30284 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.228104 30246 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.225250 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.221908 30282 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.233989 30268 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.234794 30267 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:59.235102 30268 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:59.240411 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.214288 30274 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.242719 30274 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.232719 30038 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:59.244635 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.228497 30270 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.248899 30263 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.251933 30247 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.251866 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.252779 30247 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.252918 28675 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:59.253296 30262 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.253516 30247 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.254120 30262 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.256610 30276 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.256932 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.256886 30264 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:58.991710 30174 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.256297 30247 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.260604 30286 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.263283 30174 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.228900 30284 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.272473 30284 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.215866 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.235901 30267 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.281610 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.282711 30038 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.246253 30275 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.294045 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.294341 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.296015 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.296243 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.297569 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.297756 30271 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.298251 28682 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:17:59.298616 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.235154 30250 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.304988 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.310369 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.311527 28749 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:59.312531 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.313113 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.313412 28755 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:17:59.314260 28750 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:17:59.314500 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.315061 30279 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.264009 30286 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.269250 30278 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.305899 28756 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:59.320310 30272 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.288134 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.322515 30246 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.327474 30260 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.327642 30270 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.328935 30282 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.330163 30268 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.326607 30250 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.331202 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.333710 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.335852 30283 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.332283 30285 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.337899 28753 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:17:59.338570 30276 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.338492 30159 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.339696 30283 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.342790 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.348373 30267 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.349462 30277 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.349517 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.350798 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.350952 30174 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.351745 29321 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:17:59.353199 30174 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.353592 30263 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.355439 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.357491 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.357913 30264 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.328341 30260 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.361326 30260 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.361534 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.364127 30250 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.364940 30250 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:59.366456 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.367228 28680 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:59.369827 30159 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.371728 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.372848 28673 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:59.373980 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.372463 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.374570 30280 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.375444 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.376087 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.376472 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.377317 28676 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:17:59.374629 28679 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:17:59.378988 30174 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.379899 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:59.382720 30274 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.383978 30273 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.383023 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.388839 30262 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.390883 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.391716 30250 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.392011 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.392385 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.392710 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.392966 28603 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:17:59.392778 30285 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:59.395936 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.399874 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.402392 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.402302 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.384778 30273 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.407101 30261 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.406540 30252 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.408250 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.408553 30252 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.410964 30250 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.411198 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.407995 30261 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:59.411708 30250 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.413151 30260 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.413764 30261 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.414011 30250 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.413866 30260 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.415239 30252 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.417586 28676 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:59.418041 30260 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.418977 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.421198 30286 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.423728 30283 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.434726 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.436043 30285 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.437997 28753 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.440847 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.434983 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.443375 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.443879 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.445353 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.446043 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.443928 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.446858 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:59.446273 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080029e360 after lost signal to thread 27449
W20260709 12:17:59.448402 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080029db80 after lost signal to thread 28539
I20260709 12:17:59.438056 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.444005 28676 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
W20260709 12:17:59.451104 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080015f760 after lost signal to thread 28631
I20260709 12:17:59.454305 30283 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:17:59.454744 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2000 after lost signal to thread 28706
I20260709 12:17:59.455066 30283 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:59.456300 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08000325c0 after lost signal to thread 28780
W20260709 12:17:59.456713 28777 debug-util.cc:398] Leaking SignalData structure 0x7b0800270e40 after lost signal to thread 28781
I20260709 12:17:59.457669 30283 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.459949 28605 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:59.464618 28777 debug-util.cc:398] Leaking SignalData structure 0x7b0800331ea0 after lost signal to thread 29351
I20260709 12:17:59.465442 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.468159 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:17:59.440881 30273 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.482540 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:59.483085 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.483731 30255 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.484129 30274 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.484756 30274 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:59.485186 30274 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.484213 30255 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.488641 30255 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.488847 28753 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:59.492726 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.493559 28679 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:17:59.494030 28571 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.495347 30260 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.495747 30260 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.496145 30260 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.497785 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.498942 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.499826 30289 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.500490 30289 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.500957 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.485085 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:59.501777 30261 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.502022 30174 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.502209 30261 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:59.502511 30174 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.502744 30261 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.502859 30289 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:17:59.502941 30174 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.503975 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.502367 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.507593 30268 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.507992 30268 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.508421 30268 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.511041 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.513659 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.518443 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:17:59.519567 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 52050.3us
I20260709 12:17:59.521351 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.521222 30252 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.521888 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.522477 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.523015 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.523422 30252 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:17:59.523525 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.524139 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.524544 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.524781 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.525161 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.525393 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.523617 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.525794 28747 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:59.526374 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.526520 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.526995 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.528889 28750 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:59.529060 28747 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:59.525148 28753 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:59.529513 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.530156 28752 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:17:59.527215 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.531343 28749 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:17:59.533274 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:17:59.534874 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:59.536047 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:59.537039 30248 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.537109 30252 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.537528 30248 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.537595 30252 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.538040 30248 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.538089 30252 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.533864 30260 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.540825 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.548594 30248 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.550894 30248 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.553227 30268 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:17:59.557080 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47441us
I20260709 12:17:59.558971 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.560482 30263 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.560952 30263 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.561434 30263 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.562728 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.563006 30288 raft_consensus.cc:1064] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:17:59.563459 28754 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:17:59.564790 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.564536 30255 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.565336 28754 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:17:59.565840 30288 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.566630 30255 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.567010 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.571413 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.571594 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.537554 30261 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.573050 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.574409 30261 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.558220 30268 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.576872 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.579831 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.580060 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.581286 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.576472 30263 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.582499 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.584293 30277 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.584718 30277 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:17:59.585100 30277 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.584318 30263 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.529073 30174 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.585561 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.588474 30260 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.579874 30252 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.592754 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.594051 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:17:59.595275 30255 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.596264 30255 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.596782 30255 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.597015 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.599795 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.601418 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.601574 30252 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.595788 30264 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.602172 30264 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.602567 30264 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.603230 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.603585 30274 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.604365 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.595355 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.606043 30174 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.609640 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.609977 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.610684 28750 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:17:59.615792 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.617059 30263 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.617494 30263 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.617835 30263 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.621732 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.622372 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.620537 29321 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:59.616019 30264 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.624742 30264 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.626403 30268 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.626168 30277 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.626830 30268 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.627247 30268 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.627271 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.629057 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.617096 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.626211 30263 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.626216 30255 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.630913 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.656344 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.632650 30283 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:17:59.635152 30280 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.659210 30280 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.659366 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:17:59.659590 30280 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.661353 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.661605 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.662707 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.642390 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.636669 30268 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.669246 30268 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.671861 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.673659 30280 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.675752 30280 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.644721 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.630643 30277 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.677099 30260 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.693107 30260 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.679181 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.679977 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.680584 30261 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.693125 29319 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:59.693611 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:59.693552 30260 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.682902 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.696220 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.684728 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:59.650913 30255 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.651290 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.697435 30267 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.651783 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.653406 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.653957 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.699366 30267 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.642894 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.699731 30267 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.700094 30267 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.638629 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.643220 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.647394 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.650408 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:17:59.701541 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54232.3us
I20260709 12:17:59.654353 30264 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:17:59.702028 30261 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.702971 30264 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.703107 30294 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.703418 30264 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.703620 30294 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.703893 30264 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.697440 30255 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.650022 29325 raft_consensus.cc:1217] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:17:59.640645 30263 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.704428 30255 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.643589 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:17:59.644930 30274 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.705104 30260 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.705832 30255 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.705958 28571 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:17:59.707592 30260 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.707827 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:59.710152 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:59.704037 30294 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.717562 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:59.718386 28676 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:59.708230 30260 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.720706 30260 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.721094 30260 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:59.725185 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:59.725406 30294 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.726008 28679 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:17:59.731221 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:59.732059 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:59.700989 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:59.696100 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:59.741631 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:59.733455 30288 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:59.748790 28679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:17:59.749637 28679 raft_consensus.cc:606] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:17:59.749823 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53661.3us
I20260709 12:17:59.752724 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:59.755043 30293 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.755468 30293 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.755854 30293 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.746858 30274 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.727559 30294 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:17:59.757519 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 74693.2us
I20260709 12:17:59.761185 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:59.760069 30283 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:17:59.761344 30174 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.757303 30277 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.763741 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:59.765326 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:17:59.766400 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70350.5us
I20260709 12:17:59.765789 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:17:59.757478 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.758359 30274 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.764185 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:59.768719 28747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:17:59.769878 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:17:59.772650 30282 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.765158 30263 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.773104 30274 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.765358 30174 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:17:59.765166 30277 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.775106 29290 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:59.776018 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:59.786526 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:17:59.776083 30282 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.780213 30174 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.777326 30276 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.777073 30294 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:59.785470 30252 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:59.776048 30263 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.803555 30263 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.777506 28747 raft_consensus.cc:606] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:59.791201 30255 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.778568 30264 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.794185 30261 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:59.782102 30283 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.779284 30246 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.781489 30277 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.809904 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.812249 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.775940 30267 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.805568 30282 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.810696 30272 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.812224 30246 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.813181 30283 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.853487 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.820673 30289 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.852255 30283 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.807929 30260 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:17:59.852370 30246 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:59.882086 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106135us
W20260709 12:17:59.885401 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 77314.4us
I20260709 12:17:59.894954 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.900225 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.879042 30295 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:59.896605 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 91576.9us
I20260709 12:17:59.906870 30255 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.908988 30264 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.910156 30267 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:17:59.909919 30174 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:17:59.912554 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:59.915964 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:59.912010 30174 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.918787 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.927884 28573 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.933588 30260 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:17:59.905480 30299 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.934250 30299 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.934643 30299 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.937952 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:17:59.953883 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.955900 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.957057 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.948945 30299 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:17:59.952097 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 144381us
I20260709 12:17:59.963799 30268 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:59.964565 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.939913 30261 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.939286 30255 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:59.957888 30267 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.967365 30295 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:59.967772 30295 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.968104 30295 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.969341 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:59.964216 30268 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:17:59.980306 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.973155 30261 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:59.986163 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:17:59.986403 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 199909us
I20260709 12:17:59.980367 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:17:59.995682 30301 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:59.996129 30301 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:17:59.996519 30301 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:59.997483 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:17:59.998656 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:17:59.971897 30260 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.000813 28676 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.001217 30297 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:59.999573 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 80871.4us
I20260709 12:17:59.967947 30277 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.977916 30268 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.009132 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.011453 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.012688 30260 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.013648 30260 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.013963 30260 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:00.014927 30260 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:17:59.984090 30263 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.016243 30260 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.017361 30174 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:00.017416 30263 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.017885 30174 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:00.018319 30174 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.018340 28674 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:00.019104 30274 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.024515 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.004818 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.029793 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:00.031780 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:00.032001 29325 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.035151 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:00.035847 30271 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:00.037429 30285 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:00.037461 30264 raft_consensus.cc:993] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:18:00.037920 30285 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:00.038323 30264 raft_consensus.cc:1081] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:18:00.038437 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.038776 30285 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.039353 30174 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.039789 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.040098 30285 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.043350 28680 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.040719 30255 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.045957 28747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:18:00.046635 28747 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:00.047034 28747 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.047128 30291 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:00.048303 30291 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:00.048696 30291 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:00.049111 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.049137 30303 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.049639 30291 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.051329 30291 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:00.053100 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48374.1us
I20260709 12:18:00.053917 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.054425 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.052349 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.059304 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.060931 30296 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.059624 30297 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.065805 30277 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.067224 30299 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:00.067387 30283 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:00.067943 28647 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3be2bcd2a3b04c82bbf14413a7011c12. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:00.068733 28755 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:00.069111 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.069813 30283 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:00.070838 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.071319 30280 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.072597 30264 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.072065 30276 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:00.073884 30276 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.074229 30276 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:00.075013 30276 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:00.078661 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 69472.9us
I20260709 12:18:00.080039 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.080466 30296 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.083585 30261 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.083525 30294 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:00.084057 30261 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:00.084990 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.084959 30261 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.086408 30261 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.087620 30293 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.081658 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.088956 30296 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:00.089359 30296 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:00.090293 30296 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.052412 30298 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.095033 30276 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.083647 30297 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.099905 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.100776 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.101325 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.101617 30297 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:00.102066 30297 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:00.102294 30303 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.102491 30297 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.103127 30303 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:00.105469 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.072021 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.108214 29321 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.108075 30303 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:00.109344 30303 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.091730 30296 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.111217 30280 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.096711 30174 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.116191 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.116809 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.120239 28676 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.121819 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.123777 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.123886 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.126219 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.128813 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.128990 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.129463 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.131830 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.132285 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.133345 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.134618 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.134716 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.137878 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.141427 28677 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.141513 30299 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.143327 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.143371 30274 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.138029 30298 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.145253 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.152149 30293 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.153964 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.153884 30268 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.155181 28681 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:00.161626 28677 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:18:00.162966 30268 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:00.163900 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.108419 28747 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:00.137562 30261 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.170542 30282 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.171432 30304 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:00.123044 30283 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:18:00.177870 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.179948 30304 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:00.180075 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.180519 30304 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.180809 28605 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:00.184644 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.184815 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.187703 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.188668 28604 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:00.185863 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.127519 30295 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:00.191130 30252 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.195065 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:00.197037 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:00.200251 30283 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.201768 30283 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:00.202255 30283 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:00.207870 30250 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:00.210830 30250 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.212929 30286 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:00.213459 30286 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:00.214772 30286 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.203984 30283 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.219869 30283 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.224844 29317 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.221596 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.222050 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:00.166350 30246 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:00.229763 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:00.233580 28599 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:00.236477 29321 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.238998 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:00.241361 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:00.242242 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:00.242731 29326 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.244896 28679 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:00.191529 30289 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:18:00.235867 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.257059 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.256204 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.265004 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:00.265189 30290 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.197794 30297 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.270882 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:00.273921 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.238778 30273 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:18:00.274502 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:00.253893 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:00.264597 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:00.281503 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.284188 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.277880 30277 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.282021 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.290675 30295 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.291790 30264 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.295858 28598 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
W20260709 12:18:00.298202 28572 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42096 dropped due to backpressure: service queue is full with 50 items
I20260709 12:18:00.286151 28747 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:00.303871 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.304977 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.305522 29319 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.298669 30282 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.299762 30290 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:00.309135 30290 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:00.312845 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.310164 30290 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.320979 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.321862 28600 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:00.296206 30301 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.333292 28674 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
W20260709 12:18:00.337971 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:00.339718 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 72708.8us
W20260709 12:18:00.432940 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.435331 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.300872 28572 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42096 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1430)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1421)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1423)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1429)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1846)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1433)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1431)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1840)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1841)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1842)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1847)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1850)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1851)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1852)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1855)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1856)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1860)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1420)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1440)
W20260709 12:18:00.440073 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 99648.9us
I20260709 12:18:00.447291 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:00.454911 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.443537 30268 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:00.444839 30246 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.460668 30297 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:00.464170 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.453087 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:00.469462 30309 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:18:00.470382 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.470300 30268 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.469508 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.473165 28602 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 1.
I20260709 12:18:00.473387 30301 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.474001 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.474998 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.475915 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.477567 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:00.478971 28753 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:00.477550 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.486272 30288 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.486685 30288 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:00.454178 30303 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.488294 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.489409 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.477651 30268 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:00.489431 30303 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:00.496929 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.497099 28607 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:00.497525 28606 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:00.497983 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.498315 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.498410 30304 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.499116 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.499851 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.476428 28602 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:00.500990 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.501080 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.501752 28602 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:00.502151 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.509052 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.509925 28600 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:00.510207 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.510747 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.510833 28603 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:00.511375 28600 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:00.511814 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.512714 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.502444 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.509120 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.512187 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.503047 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.500301 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.507364 29319 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.507781 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.508791 30268 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:00.515183 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.517179 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.526393 28600 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.513250 28601 raft_consensus.cc:2376] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4. Re-sending same reply.
I20260709 12:18:00.527550 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.533385 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.533922 28674 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:00.534219 28674 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:00.534706 28679 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.534966 28674 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:00.536185 28674 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.538925 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.540215 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.545095 28674 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:00.512353 28603 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.563155 28680 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.560339 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.565809 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:00.566431 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51354.2us
I20260709 12:18:00.566692 28647 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.567847 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.486330 30277 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.568981 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.573269 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:00.573949 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.540715 30320 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.578861 28598 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:00.581226 28605 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:00.589191 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.589329 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.590551 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.594113 28681 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:18:00.565408 28607 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:00.620211 28605 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:00.620486 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:00.621204 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47336.7us
I20260709 12:18:00.579222 30297 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.622383 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:00.596930 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 78354.6us
I20260709 12:18:00.625423 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:00.626062 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.626929 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.629109 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.630271 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.630661 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.595705 30274 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:00.597026 30268 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.631412 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.598284 30261 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.631873 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.634857 30321 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:00.635223 30318 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.635459 30321 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:00.631731 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.594754 30296 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:00.633496 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.580569 30295 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:18:00.639429 30314 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.639819 30295 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:00.640192 30295 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:00.641211 30295 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.638242 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.648674 30318 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.649577 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.651355 30296 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.625187 30267 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:18:00.653007 30267 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:00.656385 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.657485 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.653353 30267 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:00.658524 28602 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:00.659337 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.633253 28673 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.631800 30271 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:00.634058 30297 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.636981 30273 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:00.663492 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.647254 30295 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.647817 29318 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.666893 28600 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:00.667815 30319 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:00.658403 30296 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:00.673363 28599 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.674165 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.670810 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.660789 30250 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.661887 30315 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:00.662482 30283 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:00.667811 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.672662 30267 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.682487 30250 raft_consensus.cc:2764] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:18:00.691979 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.692325 28599 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.687300 30315 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:00.687786 30310 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:00.667812 30273 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:00.679072 28600 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:00.665185 30271 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:00.787385 30271 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.680001 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:00.691229 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.793959 30271 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.693001 30274 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.694187 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.689808 30283 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:00.794991 30274 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.795249 30283 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:00.795490 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 101365us
I20260709 12:18:00.795713 30274 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:00.796293 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.798707 30271 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:00.798800 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.799535 30318 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.800189 30318 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:00.800133 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.800745 30318 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:00.801092 30280 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.801622 30318 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:00.811092 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:00.794219 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 103024us
I20260709 12:18:00.673203 30321 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:00.695295 30315 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.696383 30273 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:00.685282 28606 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:00.700423 30324 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:00.702908 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.704849 30267 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.715008 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:00.719765 30326 ts_tablet_manager.cc:933] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:00.829077 30283 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.831881 30283 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:00.837996 30290 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.847416 30273 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.875365 30315 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:00.734517 30286 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.762864 28601 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:00.782529 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 162135us
I20260709 12:18:00.879751 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:00.673230 30289 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:00.817646 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.694584 28602 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:00.720690 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49970.3us
I20260709 12:18:01.295406 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:01.296676 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.297448 30313 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.297825 30313 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:01.298385 30313 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:00.887141 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 69560.4us
I20260709 12:18:01.299741 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:01.300696 30262 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.300928 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.301676 30277 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.302096 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:00.891827 30326 tablet_copy_client.cc:323] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:18:00.895884 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.890286 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:00.897996 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:00.896629 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:00.939726 28603 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:00.969856 30328 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:00.969913 28755 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.303890 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1846) took 1092 ms. Trace:
I20260709 12:18:01.303949 30328 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.304296 28603 rpcz_store.cc:276] 0709 12:18:00.211138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.511527 (+300389us) service_pool.cc:224] Handling call
0709 12:18:01.303807 (+792280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:00.959649 28604 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:01.306247 30328 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:01.306301 28599 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:18:01.307657 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1438) took 1011 ms. Trace:
I20260709 12:18:01.031142 30272 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.183964 30291 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:01.183565 28607 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.308694 30291 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:01.309155 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1439) took 1012 ms. Trace:
I20260709 12:18:01.309517 28607 rpcz_store.cc:276] 0709 12:18:00.297028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.698718 (+401690us) service_pool.cc:224] Handling call
0709 12:18:01.183344 (+484626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:01.308911 (+125567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.309102 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:01.309602 30291 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:01.220782 30329 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:01.311124 30291 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.310868 30329 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.313517 30329 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:01.195425 30285 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:01.315860 28676 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.228540 30288 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.251083 30311 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:18:01.255548 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.317970 30311 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.264024 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 248) took 1211 ms. Trace:
I20260709 12:18:01.270434 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:01.225354 30315 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.318491 28753 rpcz_store.cc:276] 0709 12:18:00.052873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.053313 (+   440us) service_pool.cc:224] Handling call
0709 12:18:01.263808 (+1210495us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540003e654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:01.263932 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947480448}
W20260709 12:18:01.319396 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.278331 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.322009 30324 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:01.323040 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 432787us
I20260709 12:18:01.324124 30263 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.324653 30263 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.281409 29320 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:01.325580 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.315860 30285 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.328202 30285 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:01.279873 28501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 301) took 1050 ms. Trace:
I20260709 12:18:00.885876 30298 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.302273 30277 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.334095 28501 rpcz_store.cc:276] 0709 12:18:00.229345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.234802 (+  5457us) service_pool.cc:224] Handling call
0709 12:18:01.279691 (+1044889us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":518854,"reported_tablets":1}
I20260709 12:18:01.202193 30289 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:01.318854 30311 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.335557 30289 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.336213 30311 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.324550 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.340467 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.341712 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.325198 28605 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.344619 30248 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.345357 30248 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.345917 30248 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.347613 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.348867 30295 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.350839 28598 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.297783 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:01.352037 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 54326.7us
I20260709 12:18:01.352494 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1839) took 1144 ms. Trace:
I20260709 12:18:01.352885 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:01.352854 28605 rpcz_store.cc:276] 0709 12:18:00.209204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.633762 (+424558us) service_pool.cc:224] Handling call
0709 12:18:00.634029 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:01.342508 (+708479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.352226 (+  9718us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54003dbdd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:01.352401 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589070080}
I20260709 12:18:01.353650 30252 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.355140 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.352032 30315 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:01.356750 30315 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:01.357204 30315 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.357559 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1424) took 1081 ms. Trace:
I20260709 12:18:01.357919 28598 rpcz_store.cc:276] 0709 12:18:00.275828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.227367 (+951539us) service_pool.cc:224] Handling call
0709 12:18:01.350644 (+123277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:01.351341 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.357372 (+  6031us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b54000a8050. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:01.357503 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216116096}
I20260709 12:18:01.356374 30288 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.360634 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.362200 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.276868 30304 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.364408 30252 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.364097 30263 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.365607 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.366318 30252 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.366675 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.367305 30252 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.368095 30305 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.368610 30324 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.369419 30262 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:01.275470 30273 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.369854 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.350924 30297 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.370540 30297 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:01.371526 30283 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:01.369946 30262 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:01.371439 30297 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.372394 30262 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.373203 30297 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.368151 30318 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:18:01.377296 30318 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:01.377637 30318 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.378152 30262 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.378487 30318 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:01.379761 30318 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.307966 28599 rpcz_store.cc:276] 0709 12:18:00.296751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.694525 (+397774us) service_pool.cc:224] Handling call
0709 12:18:01.306078 (+611553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.306753 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.307488 (+   735us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b5400093150. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:01.307608 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145409280}
I20260709 12:18:01.385119 30273 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:01.386243 30273 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.386600 30273 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.387537 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:01.387425 28501 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 2, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 2 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.388247 28753 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:01.371086 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:01.389556 30273 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.390450 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.391253 30329 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:01.391597 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:01.391634 30329 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:01.392246 30329 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.392349 30283 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.380304 30262 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.397679 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:01.399235 29320 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.399258 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:01.400334 29319 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:01.401028 29320 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.402220 30290 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:01.402225 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:01.403009 30290 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.403550 29319 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:01.404035 30290 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:01.406577 28599 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.407881 30271 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:18:01.408795 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106753us
I20260709 12:18:01.408885 30271 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:01.409636 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.409904 30271 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.410243 30298 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.410750 30298 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:01.410810 30316 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.411167 30298 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.411181 30316 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.414042 30324 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:01.414113 30316 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.415318 30324 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.415442 30316 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.415702 30324 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.413101 30305 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.416846 30324 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.418143 30324 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.420012 30298 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.409291 30288 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:01.410290 30271 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.422881 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:01.423336 30286 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.423734 30286 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.424310 29320 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.424794 30286 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.425827 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:01.426353 30286 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.427930 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:01.428902 30271 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.429692 30285 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:01.430162 29327 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.430421 30271 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.430770 30285 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.431245 30285 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.431878 29327 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.432293 30285 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.433202 30298 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:01.433786 30285 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.428929 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:01.369472 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:01.441253 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71857.9us
I20260709 12:18:01.442193 30277 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:01.442701 30277 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.443707 30277 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.444252 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:01.445025 29327 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:01.449510 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.450271 28599 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 2: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:01.453529 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:01.455034 29327 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:01.460753 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.464231 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.467002 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.467744 28599 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:01.469398 30315 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.470692 30271 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.471113 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:01.471207 30271 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.471994 28599 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:01.473325 30271 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.473768 30273 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.476699 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:01.479065 28598 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:01.479434 30289 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.475564 28599 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:01.474226 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.482862 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.483455 30272 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.484721 30272 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.485095 30272 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.485396 30252 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.485906 30272 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.487001 30272 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.487916 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.490049 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:01.490636 28599 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:01.494166 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:01.502422 30252 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:01.502914 30252 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:01.503897 30252 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.516918 30329 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.524737 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:01.526355 30304 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.527793 30252 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:01.528551 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:01.529018 30304 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.533135 30304 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:01.534085 30304 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.535476 30304 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.540656 30305 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.541935 30263 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.542316 30263 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.542924 30285 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.543393 30285 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:01.543373 30263 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.544063 30285 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.546803 30263 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.544800 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52339.5us
I20260709 12:18:01.545006 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:01.548065 30298 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.549362 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.550097 30305 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:01.551357 30305 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.552620 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:01.554577 28648 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.560398 30288 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.561396 30288 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.562703 30277 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.565346 30298 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.566406 30297 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.566797 30297 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:01.567440 30298 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:01.567759 30297 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.568617 30295 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.568987 30295 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:01.569279 30297 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.569775 30295 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.571022 30295 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.502782 28753 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:01.553297 30305 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.573340 30305 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.574558 30305 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.575965 30305 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.579881 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:01.581281 30295 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.581876 30288 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.583623 30295 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:01.584687 30295 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.555066 30313 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.589471 30313 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.557000 28599 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.557212 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:01.590950 30252 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.553121 30289 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.560410 28747 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.592147 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.592798 30252 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:01.593937 30248 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.594271 30248 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:01.595072 30248 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.596022 30248 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.598943 28747 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:01.555125 30324 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:01.602478 30324 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.603434 30324 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:01.557502 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60102.2us
I20260709 12:18:01.605306 30315 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.605504 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:01.605967 30329 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.606500 30315 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:01.607900 30315 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:01.608357 30315 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.563104 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:01.614249 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:01.616851 30291 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.586265 30298 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.615603 30329 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.618525 30329 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.619272 30329 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.620394 30329 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:01.560184 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.621276 30291 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.621717 30291 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:01.622761 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:01.622694 30291 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.623618 30299 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.624037 30291 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.629247 30299 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.630466 30328 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.630832 30328 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:01.631187 30299 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.631624 30328 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.632285 30296 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.632687 30296 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:01.633083 30328 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.633523 30296 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.635406 30296 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:01.642273 30272 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:01.644490 30272 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.645229 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:01.645469 30272 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.664336 30273 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:01.664777 30273 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.665139 30273 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.647964 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:01.652236 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.652693 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.666983 30299 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.667583 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.669991 28676 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:18:01.653147 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.654228 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.655160 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.655824 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.656636 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:01.657018 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.673667 28679 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:01.657104 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:01.656669 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.658005 30263 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:01.674429 28674 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:01.659171 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet 3be2bcd2a3b04c82bbf14413a7011c12 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:18:01.667589 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.661912 30329 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.663475 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 100432us
I20260709 12:18:01.658107 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.675225 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet 3be2bcd2a3b04c82bbf14413a7011c12 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-3be2bcd2a3b04c82bbf14413a7011c12
I20260709 12:18:01.677513 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:01.679947 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.680308 28605 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:01.677038 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.682468 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:01.684842 28753 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.688081 28605 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:01.688681 28749 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.688642 28756 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:01.695086 28752 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.706025 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.707262 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.677604 30263 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.712560 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:01.713316 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.692198 30289 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:01.691533 30304 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:01.715911 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.720780 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.734094 30273 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.735132 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.738755 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.689333 30305 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:01.740015 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.711246 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.752647 28605 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.741673 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.716743 30248 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.736541 30273 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.714582 30313 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.773483 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.774164 28675 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.774801 30252 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:01.776327 28607 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 2: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:01.716754 30288 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.720105 30289 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.777401 30289 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.777899 30315 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.779935 30315 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:01.780678 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.733026 30311 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:18:01.784217 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 65054us
I20260709 12:18:01.747576 30316 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.740504 30286 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:01.786103 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.759179 30290 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:01.788261 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:01.783676 30262 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:01.788594 30313 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:01.792526 28692 tablet_copy_source_session.cc:215] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:01.793005 28605 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:01.793538 30273 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.793681 30263 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:01.736697 30304 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.802747 29319 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:01.802592 30321 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:01.804993 30304 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:01.805763 30273 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.807122 30285 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.807897 30273 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:01.809289 30285 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:01.816798 28604 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:01.818053 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:01.819068 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.821607 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:01.822202 28747 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:01.820544 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:01.824927 28682 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:01.830862 28605 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:01.827723 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:01.819161 28675 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:01.819514 28604 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:01.833946 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.834687 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:01.835455 30286 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:01.836105 30286 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.836627 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:01.836995 30285 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:01.837555 30315 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:01.837486 30286 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.838498 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:01.839183 30273 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:01.839556 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:01.839640 30273 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.840715 30273 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.863101 30289 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.845562 30315 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:18:01.866617 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 109464us
I20260709 12:18:01.871646 28675 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:01.878242 30315 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:01.879570 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 97773.2us
I20260709 12:18:01.885447 30272 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:18:01.906486 30289 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:01.906569 30277 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.907184 30277 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.909456 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:01.910131 28607 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.910394 30285 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:01.910825 30285 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.889436 30315 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.912804 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:01.913054 30352 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.913211 30318 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:01.913429 28675 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.914245 30352 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.914605 30352 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.889511 30326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2bcd2a3b04c82bbf14413a7011c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:01.883055 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:01.919517 30339 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:01.919898 30339 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.920758 30339 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.921856 30339 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.888562 28628 debug-util.cc:398] Leaking SignalData structure 0x7b08000cdd80 after lost signal to thread 27449
I20260709 12:18:01.924180 28607 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:01.908365 30277 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:01.926514 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:01.927713 30277 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.890331 30297 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.929175 30297 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.929543 30289 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:01.931265 30297 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:01.890488 30338 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:18:01.933691 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:01.934101 30338 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.934319 28755 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:01.934556 30338 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.935389 30338 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.935758 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:01.884532 30288 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:18:01.937534 29322 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEARNER]: Advancing to term 4
W20260709 12:18:01.938210 28628 debug-util.cc:398] Leaking SignalData structure 0x7b0800194a60 after lost signal to thread 28539
I20260709 12:18:01.938766 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:01.939463 28628 debug-util.cc:398] Leaking SignalData structure 0x7b0800337b40 after lost signal to thread 28631
W20260709 12:18:01.940721 28628 debug-util.cc:398] Leaking SignalData structure 0x7b080033f6e0 after lost signal to thread 28706
W20260709 12:18:01.941838 28628 debug-util.cc:398] Leaking SignalData structure 0x7b080039b4e0 after lost signal to thread 28780
I20260709 12:18:01.941905 30321 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:01.942381 30321 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:01.942728 30321 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:01.943087 28628 debug-util.cc:398] Leaking SignalData structure 0x7b080039abc0 after lost signal to thread 29351
I20260709 12:18:01.917858 30272 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:18:01.945413 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:01.946178 29327 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:01.946228 30272 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.946645 30272 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:01.947623 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:01.947469 30272 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.950593 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:01.951876 28755 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:01.930248 30289 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:01.962633 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:01.969771 28755 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:01.963721 28749 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:01.957347 28501 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 2 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 3 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.966239 28747 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:01.966711 28607 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:01.967653 30297 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:01.978336 30297 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.915679 30352 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:01.958040 30338 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.982163 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:01.978711 30297 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.975397 30272 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.990037 30318 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.999993 28503 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 2, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 2 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:02.001747 28675 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:02.003810 29322 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:01.957783 30355 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:02.007201 30352 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.981693 30329 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:02.007480 30263 consensus_queue.cc:1175] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" responder_term: 2 status { last_received { term: 2 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 2 index: 1 } }
I20260709 12:18:01.964510 30356 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:18:01.988349 30305 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:18:01.988180 30351 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:18:02.014173 30329 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.016919 30289 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.027243 30329 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:02.028833 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:02.029445 28598 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:02.030673 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:01.990700 30288 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:18:02.033386 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.037292 30351 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:02.042778 30329 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:02.063097 28604 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.051265 30299 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.055383 30351 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:02.058212 30329 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.051353 30315 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:18:02.072768 28604 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:02.057082 30285 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.075831 28749 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:02.085120 28753 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:02.073638 30248 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:02.073648 30329 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.088055 30349 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.094249 30349 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.068778 30299 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.107721 28752 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:02.100083 30295 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:18:02.104911 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.118185 28677 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:02.106019 28604 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.106127 30318 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:02.107841 30285 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:02.112284 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.128823 28679 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:02.131062 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:02.126354 28756 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:02.071326 30364 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:18:02.086784 30324 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:18:02.088138 30248 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.145291 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:02.141104 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:02.139674 30328 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:02.128924 30338 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:18:02.181846 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:02.079046 30351 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.159584 30344 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:02.161346 30328 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.159987 30299 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.189896 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:02.190649 28752 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:02.167991 30321 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.158998 30277 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:18:02.184882 30315 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:02.174826 30349 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.203797 28605 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:02.189929 30295 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.190141 30328 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:02.207453 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 53571us
I20260709 12:18:02.213150 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:02.225107 30248 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:02.225102 28677 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:02.221455 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:02.201005 30329 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.208711 30364 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:18:02.245738 30351 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.257686 28752 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:02.194823 30344 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.257269 30355 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:02.264550 30376 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.212661 30295 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:02.279237 30321 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.280779 30321 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:02.281011 30344 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.289438 30329 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:02.290969 30297 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.291476 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:02.295008 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:02.295615 28755 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.295539 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:02.296459 28677 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.266794 30376 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.298373 30376 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.309782 30295 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.281152 30321 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:02.310755 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.310982 30321 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.311584 28679 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:02.312192 30321 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.277509 30374 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:02.313284 28571 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:02.313023 30374 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.317755 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:02.319806 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:02.314915 30295 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:02.324396 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:02.332353 28756 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:18:02.326478 28752 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:02.308123 28677 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:02.333971 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:02.315927 30297 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.341491 30297 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:02.336763 30318 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:18:02.341975 30297 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:02.342773 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 129690us
I20260709 12:18:02.330873 30296 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.353040 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.353853 28679 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:02.331826 30295 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.355084 28755 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:02.350726 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.335217 30329 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:02.356082 28680 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:02.342469 30318 consensus_queue.cc:1243] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:18:02.365211 30374 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.331579 30272 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:18:02.356901 30295 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.371064 29327 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:02.362407 30326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39252 (request call id 538) took 1797 ms. Trace:
I20260709 12:18:02.363076 30297 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.370131 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:02.393275 28755 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:02.395115 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:02.335505 30277 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:18:02.376386 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:02.382030 28677 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:02.385025 30286 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:02.408828 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.355824 30296 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.395778 30375 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:18:02.456102 30328 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.405292 30299 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.408154 30374 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.465898 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:02.467417 28756 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.446828 30355 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:02.468731 29319 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:02.463987 30299 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:02.450907 30315 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:18:02.504846 28600 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:02.506774 28606 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:02.507000 30347 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:02.507736 30347 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.509980 30352 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:02.510367 30347 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:02.470350 30355 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:02.522521 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.465122 30328 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.523439 28677 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:02.503722 30299 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:02.529615 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.530344 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:02.472412 30374 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.523833 30355 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:02.516273 30352 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:02.470144 30376 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.533031 30372 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:02.533372 30283 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:02.503147 30273 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:18:02.533913 30328 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:02.382509 30326 rpcz_store.cc:276] 0709 12:18:00.569790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.578683 (+  8893us) service_pool.cc:224] Handling call
0709 12:18:00.829282 (+250599us) ts_tablet_manager.cc:934] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
0709 12:18:01.879676 (+1050394us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:02.149145 (+269469us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:02.159519 (+ 10374us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:02.352122 (+192603us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:02.361915 (+  9793us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:02.362268 (+   353us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:02.362333 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":313,"tablet-copy.queue_time_us":117827,"thread_start_us":108978,"threads_started":2}
I20260709 12:18:02.537029 30372 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:02.552044 28501 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 3 to 4, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:18:02.538116 30288 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:18:02.587945 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:02.578341 30372 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:02.603657 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:02.615214 28682 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.030s
W20260709 12:18:02.626099 28682 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.011s	sys 0.030s
I20260709 12:18:02.648133 30400 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.653797 30400 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.659231 30400 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:02.668916 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 335017us
I20260709 12:18:02.670851 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.671708 28679 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:02.675897 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:02.676460 28679 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.681941 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.682296 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.682875 28674 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:02.685160 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:02.685880 28674 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:02.687865 30396 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.688621 30396 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.565495 30328 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.699083 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:02.699564 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46443.4us
I20260709 12:18:02.608333 30296 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.700107 28674 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:02.585427 30352 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.701148 30396 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:02.701361 30378 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:18:02.712899 28756 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:02.714093 30383 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.002s
I20260709 12:18:02.714385 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:02.714785 28756 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:02.715668 30296 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:02.716245 30382 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:18:02.716195 30296 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:02.720570 30328 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:02.705672 30374 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:02.722391 28607 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:18:02.723964 30398 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:18:02.719398 30318 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:02.716280 30364 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:18:02.696074 28679 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:02.705453 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:02.703935 30297 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.721376 30296 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:02.772245 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 67863.6us
I20260709 12:18:02.735386 30318 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:02.744045 30315 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 12:18:02.799384 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.792372 28605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.026s	sys 0.050s
W20260709 12:18:02.809721 28605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.027s	sys 0.052s
I20260709 12:18:02.774822 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:02.773557 28598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.008s	sys 0.010s
I20260709 12:18:02.751861 30352 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:02.811975 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.023s	sys 0.015s
W20260709 12:18:02.821234 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.023s	sys 0.015s
W20260709 12:18:02.811960 28598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.009s	sys 0.010s
W20260709 12:18:02.821653 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 597797us
I20260709 12:18:02.825531 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:02.826350 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:02.827061 28599 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:02.829950 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:02.841486 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:02.842296 28602 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:02.846675 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:02.850615 28604 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:02.847455 29321 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:02.824177 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:02.773553 30396 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.865013 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:02.865438 29325 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:02.865700 28752 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:02.805096 30285 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:02.810807 30364 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:02.868836 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.850034 30347 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.771899 30297 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:02.869164 30396 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:02.877101 30377 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:02.877614 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:02.878610 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:02.886665 30311 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.872066 30285 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:02.876418 30364 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:02.900020 30392 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.875135 30374 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:02.903893 30295 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.000s
I20260709 12:18:02.911348 28753 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:02.899165 30328 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:02.909987 30324 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.901389 30347 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.919984 30328 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.924273 30329 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:02.906912 30311 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.921581 30392 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.947412 30392 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.947487 30277 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.948096 30277 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.943588 30328 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:02.925326 30295 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:02.935621 30324 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.937182 30299 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.977074 28606 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:02.951161 30329 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:02.985841 30402 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.982334 30329 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:02.989126 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:02.989924 28604 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:02.987342 30402 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:02.987605 30283 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:02.967203 30364 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:02.999063 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:03.002647 30376 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.003477 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.004259 28604 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:03.007988 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:02.994534 30283 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:03.000491 30397 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260709 12:18:02.998008 30277 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:02.996291 30329 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:03.004050 30355 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.001701 30326 tablet_copy_client.cc:806] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:02.998359 30297 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.015719 30396 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.026351 30373 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:03.026767 30403 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:03.028388 30283 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:02.989769 30372 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.016175 30347 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:03.025651 30285 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:03.046804 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 175357us
W20260709 12:18:03.047860 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 274760us
I20260709 12:18:03.073989 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:03.037519 30402 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.076005 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:03.051133 30410 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.075217 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:03.072032 30324 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.033108 29317 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:03.031255 30329 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.088666 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:03.089653 28677 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:03.090310 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:03.091053 28679 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:03.080551 30347 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.069823 30376 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.084877 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.094990 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:03.102368 28600 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:03.102771 28674 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:18:03.073277 30283 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:03.076018 30326 tablet_copy_client.cc:670] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:03.078989 30297 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.109634 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:03.110126 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:03.107607 28678 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:03.112141 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:03.107733 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:03.108155 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:03.113013 28682 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:03.113862 28681 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:03.078810 30411 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.073133 30373 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.088511 30410 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:03.123572 28571 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:03.101253 30402 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:18:03.124553 30296 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.124464 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:03.105958 30311 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.125459 30321 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.104599 30283 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:03.111865 30297 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.129316 30296 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.145409 30296 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.127162 30295 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.121196 30411 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:03.158840 30402 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.159379 30402 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.159804 30402 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.132083 30299 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.133270 30355 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:03.144279 30297 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.130853 30410 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.105497 30347 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.134516 30321 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.140159 30283 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:03.108784 30376 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.143982 30345 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.152364 30396 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.138769 29322 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:03.164707 30352 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:03.149724 30418 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.184113 28753 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:03.177501 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:03.181461 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:03.182438 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:03.165098 30411 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.187119 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:03.185124 29327 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:03.190109 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:03.191476 29326 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:03.191783 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:03.192591 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:03.176872 30345 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:03.176970 30321 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:03.194707 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 82640.8us
I20260709 12:18:03.178411 30396 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.177019 30299 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.187117 30313 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.202625 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:03.178817 30311 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:03.201789 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:03.199149 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:03.206842 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:03.199818 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:03.171005 30295 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 12:18:03.197515 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 189614us
I20260709 12:18:03.203233 28751 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.189589 30379 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.196949 30345 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.214918 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:03.201998 30396 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.187728 30352 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:03.277711 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.208941 30392 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.206736 30299 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:03.279634 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 72903.8us
I20260709 12:18:03.280061 30430 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:03.277665 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62874us
W20260709 12:18:03.285895 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 86158.7us
I20260709 12:18:03.299911 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.300829 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:03.301631 28604 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:03.276240 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:03.208786 30313 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.284771 30351 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:03.307343 30425 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:03.305656 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.212783 30311 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.307331 30426 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.288582 30329 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.286530 30372 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:03.190558 30418 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.308766 30356 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:03.296206 30392 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.328696 30373 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.333848 30426 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.334398 30424 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:18:03.355252 30424 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.338713 28756 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:03.330487 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.223544 30379 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.365934 30328 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.339293 30425 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:03.368726 28600 raft_consensus.cc:2368] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3.
I20260709 12:18:03.369982 28598 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:03.358558 28605 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:03.328569 30351 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:03.381418 30414 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:18:03.382476 30392 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.374308 30376 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.335623 30416 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.378196 30426 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.388684 28751 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 12:18:03.392472 30423 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:18:03.374233 30347 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:03.398806 30421 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.380667 30324 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:03.372365 30425 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.392782 30352 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.342095 30356 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:03.407614 30394 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.732s	user 0.000s	sys 0.004s
I20260709 12:18:03.395713 30351 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.355882 30424 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.414713 30313 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.416028 30297 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.402076 30328 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.394568 30416 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.419130 30402 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:03.421929 30387 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.747s	user 0.003s	sys 0.000s
I20260709 12:18:03.422616 30409 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:03.399425 30421 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:03.432358 30429 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:18:03.432176 30409 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.432940 30409 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:03.420393 30419 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.408831 30324 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.425392 30347 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.426527 30416 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.429764 30299 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.441102 30297 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.443193 30311 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.459664 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:03.459893 30418 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.463685 30356 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.465082 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:03.467082 30411 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.468318 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:03.441982 30347 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.470742 29322 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:03.462121 30297 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.484884 30351 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.499195 29327 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:03.470762 30402 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.496573 30321 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.505146 30347 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.494681 30329 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:03.508384 30421 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:03.456934 30419 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.512666 29319 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:03.506239 28748 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:03.501103 30313 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:03.526170 30422 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:18:03.502121 30297 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:03.518620 30321 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:03.556607 30352 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:03.556839 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:03.557298 30352 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.559686 30352 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.502843 30351 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:03.538312 30356 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.561255 28681 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:03.564903 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:03.569370 28676 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.583735 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.528357 30329 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.549614 30324 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.575825 30402 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.595706 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.599896 28682 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:03.601197 28599 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:03.601333 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:03.602223 28751 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:03.577919 30299 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.548784 30313 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.584141 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:03.606457 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:03.609727 28750 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:03.584008 30328 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.608644 28752 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:03.579212 30356 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:03.601850 30311 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.607105 30402 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.609099 30299 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:03.608879 30283 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:03.738876 30296 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.004s
I20260709 12:18:03.825901 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.621680 28675 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:04.325507 30296 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.326032 28601 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:04.327080 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.708940 30439 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.327822 28601 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:03.824955 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:03.896966 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.329164 28602 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:03.709913 30411 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:04.325103 28676 consensus_meta.cc:287] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.755s	user 0.036s	sys 0.046s
I20260709 12:18:04.336899 28676 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:04.325843 30356 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:04.320150 28605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.002s	sys 0.011s
W20260709 12:18:04.339527 28605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.003s	sys 0.011s
I20260709 12:18:04.324000 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:04.340183 28598 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
W20260709 12:18:03.847581 29326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.054s
W20260709 12:18:04.340906 29326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.005s	sys 0.058s
W20260709 12:18:03.849668 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 255265us
I20260709 12:18:04.324172 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:04.344063 28599 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:04.323143 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:03.627552 30321 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.670015 30434 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:04.320986 30432 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.019s	sys 0.031s
W20260709 12:18:03.804579 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 180465us
I20260709 12:18:04.427552 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:03.619050 30286 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:04.334000 30297 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:04.345736 28607 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:04.435981 28749 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:03.709292 30374 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:03.756734 30410 consensus_meta.cc:287] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.571s	user 0.005s	sys 0.006s
W20260709 12:18:04.297727 30421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.004s	sys 0.008s
I20260709 12:18:03.838076 30400 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.900264 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:03.625710 30441 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.884578 30324 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.884986 30442 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.756661 30419 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:03.632447 30418 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:03.756704 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1886) took 1430 ms. Trace:
I20260709 12:18:04.328045 30296 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:03.674877 30433 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:04.336195 30313 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:04.433538 30432 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.020s	sys 0.032s
I20260709 12:18:03.624903 30328 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.420746 30356 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.727471 30396 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:03.710413 30409 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.633183 30311 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:03.727481 30416 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.432331 30344 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:03.709978 30345 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.328094 30439 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.434911 30286 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:03.819872 30318 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.433806 30321 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.724027 30324 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.700738 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1493) took 1121 ms. Trace:
I20260709 12:18:04.647431 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:04.454196 30421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.005s	sys 0.008s
I20260709 12:18:04.494879 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:04.439885 30438 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:04.746114 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.748799 30427 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:18:04.653903 30425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.013s	sys 0.049s
I20260709 12:18:04.752542 30273 raft_consensus.cc:1064] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:18:04.756341 30470 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:04.494630 29320 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:04.473094 30435 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.541488 30315 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:04.444144 30395 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.773s	user 0.008s	sys 0.012s
W20260709 12:18:04.763901 30381 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 2.120s	user 0.006s	sys 0.016s
I20260709 12:18:04.726321 28606 rpcz_store.cc:276] 0709 12:18:03.579271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.579466 (+   195us) service_pool.cc:224] Handling call
0709 12:18:03.579825 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:03.580079 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:03.621662 (+ 41583us) log.cc:844] Serialized 14 byte log entry
0709 12:18:04.700321 (+1078659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:04.700382 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:04.700423 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:04.700553 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:04.700677 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":754609,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":9759,"spinlock_wait_cycles":15596288,"thread_start_us":395267,"threads_started":2}
I20260709 12:18:04.764549 28571 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:04.750367 30471 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.444263 30297 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:04.767463 28604 raft_consensus.cc:2368] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:04.767477 28751 raft_consensus.cc:2368] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4.
I20260709 12:18:04.768710 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:04.709123 30402 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:04.605428 30454 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.552984 30351 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:04.537014 30453 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:04.708748 30346 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.556602 30440 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.571599 30449 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:04.758184 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 330728us
I20260709 12:18:04.471182 30400 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.790313 30299 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:04.738255 30313 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.778877 30467 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:04.784135 30464 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:04.780393 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 471) took 1935 ms. Trace:
I20260709 12:18:04.785127 30439 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:04.785517 30416 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:04.785669 30379 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:04.759268 30419 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.766768 30433 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.725688 28603 rpcz_store.cc:276] 0709 12:18:02.325802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.330762 (+  4960us) service_pool.cc:224] Handling call
0709 12:18:02.344265 (+ 13503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:02.672455 (+328190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.672502 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:02.673047 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.858581 (+185534us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:02.868210 (+  9629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.755754 (+887544us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000bed54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:03.755817 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:03.755871 (+    54us) raft_consensus.cc:1685] finished
0709 12:18:03.755889 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.756607 (+   718us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156092,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":148,"spinlock_wait_cycles":278513408,"thread_start_us":323415,"threads_started":2,"wal-append.queue_time_us":291098,"wal-append.run_cpu_time_us":1957,"wal-append.run_wall_time_us":1051050}
I20260709 12:18:04.736917 30304 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:04.457126 30434 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.765192 30438 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.760921 30418 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.788236 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:04.458461 30374 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.766434 30427 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:04.776031 30425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.014s	sys 0.053s
I20260709 12:18:04.764261 30296 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:04.777902 30421 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.759796 30356 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.792371 30471 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:04.790009 30388 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 2.136s	user 0.008s	sys 0.008s
I20260709 12:18:04.448755 30410 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:04.737841 30344 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.791379 30318 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:04.842293 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:05.074849 28598 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
W20260709 12:18:04.762259 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 114922us
I20260709 12:18:04.788919 30283 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:04.790686 30315 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.792982 30328 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:04.776554 30408 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.849296 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 477) took 1628 ms. Trace:
I20260709 12:18:04.776008 30474 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:04.724030 30442 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.780758 30462 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:04.495164 30441 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.792520 30469 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:04.792452 30297 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.817910 30458 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:04.914651 28720 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.567s (SENT) [suppressed 2 similar messages]
I20260709 12:18:04.839728 30351 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.759092 30444 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:05.090451 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:04.931244 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 326) took 2459 ms. Trace:
I20260709 12:18:04.853077 30321 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:04.850863 30456 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:04.775532 30463 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.952026 30451 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:04.838927 30453 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.781096 30470 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.104406 30324 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:04.858381 30313 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.071375 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:05.125800 28606 raft_consensus.cc:2368] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:04.933123 30286 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:05.130383 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:05.108676 30409 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:04.943503 30304 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.792964 30435 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.949890 30427 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:05.078009 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106775us
I20260709 12:18:05.114898 30458 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:05.082621 28753 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:05.039369 30374 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:04.929904 30419 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.039260 30418 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.111814 30457 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:05.130403 30324 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:04.858731 30440 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.137038 30400 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.111706 30444 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.116858 30451 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.135311 30472 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:05.136415 30476 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.098630 30462 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.119431 30456 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.097563 30273 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.076653 30468 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.192360 30286 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:04.928675 30464 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.840339 30346 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.086580 30425 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:05.231132 30425 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:04.956174 30296 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:04.836247 30402 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:18:04.917426 29320 rpcz_store.cc:276] 0709 12:18:02.845247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.851195 (+  5948us) service_pool.cc:224] Handling call
0709 12:18:03.837709 (+986514us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:04.780302 (+942593us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3089280}
I20260709 12:18:05.040122 30421 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.095957 30328 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:05.113922 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 1926) took 2859 ms. Trace:
I20260709 12:18:05.109081 28680 rpcz_store.cc:276] 0709 12:18:02.463270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.468189 (+  4919us) service_pool.cc:224] Handling call
0709 12:18:02.468497 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:02.468795 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.468823 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:02.469315 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.670529 (+201214us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:02.670566 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.670626 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:04.442017 (+1771391us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:04.918019 (+476002us) raft_consensus.cc:1685] finished
0709 12:18:04.918043 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:04.922138 (+  4095us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1111,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":19554,"spinlock_wait_cycles":66212608,"thread_start_us":200794,"threads_started":1,"wal-append.queue_time_us":200809}
I20260709 12:18:04.848778 30449 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:05.109475 30452 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:18:05.116546 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:04.918939 30467 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.091315 30408 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.118942 30459 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:05.040540 28607 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:05.262755 28747 rpcz_store.cc:276] 0709 12:18:02.254931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.255196 (+   265us) service_pool.cc:224] Handling call
0709 12:18:02.255521 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:02.255851 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.255882 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:02.260582 (+  4700us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.663548 (+402966us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:02.663585 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.663646 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:04.649924 (+1986278us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:05.110251 (+460327us) raft_consensus.cc:1685] finished
0709 12:18:05.110272 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.113838 (+  3566us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2871,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":126617984,"thread_start_us":402587,"threads_started":1,"wal-append.queue_time_us":385432}
I20260709 12:18:05.099310 30474 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.131191 28678 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.075742 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:05.134707 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:05.285180 30483 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.285465 30295 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:05.286015 30295 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.286687 30295 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.285985 30483 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.289255 30451 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:05.291625 30486 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.292373 30486 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:05.102804 30465 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:05.115875 30289 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:04.824047 30454 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.295204 30465 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.107779 30351 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:05.282081 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 206372us
I20260709 12:18:05.297528 30351 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.297729 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:05.298902 30351 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:05.299393 30351 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.300879 30374 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:05.301272 30374 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.301601 30374 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:05.301903 30351 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.114565 30463 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.146121 30479 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:05.146489 30437 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:18:05.092904 30413 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:05.306438 30413 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.192914 30468 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.193128 30286 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.226065 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:05.309504 28756 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:05.309949 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 1938) took 1482 ms. Trace:
I20260709 12:18:05.310217 28756 rpcz_store.cc:276] 0709 12:18:03.827678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.225715 (+1398037us) service_pool.cc:224] Handling call
0709 12:18:05.309895 (+ 84180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:05.311276 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:05.311811 28756 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
W20260709 12:18:05.227458 28600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 234) took 1992 ms (client timeout 2161 ms). Trace:
I20260709 12:18:05.109174 30469 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:05.312587 28600 rpcz_store.cc:269] 0709 12:18:03.198751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.198902 (+   151us) service_pool.cc:224] Handling call
0709 12:18:05.191179 (+1992277us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000a6c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:05.191372 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372197760}
I20260709 12:18:05.229530 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:05.313763 28679 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:05.233289 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.168365 30324 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.318384 30324 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:05.256044 28604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1495) took 1672 ms (client timeout 1715 ms). Trace:
W20260709 12:18:05.318907 28604 rpcz_store.cc:269] 0709 12:18:03.583377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.583493 (+   116us) service_pool.cc:224] Handling call
0709 12:18:05.255757 (+1672264us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400234e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:05.255960 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2700769024}
I20260709 12:18:05.324810 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:05.327126 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:05.327785 30400 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:05.327877 28756 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:05.328423 30400 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.334415 30374 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.341337 28679 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:05.341190 30295 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:05.268103 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 353445us
I20260709 12:18:05.270519 30453 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:18:05.271978 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:05.342938 28680 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:05.342214 28679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1425) took 1778 ms (client timeout 1510 ms). Trace:
I20260709 12:18:05.277092 28676 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:05.279745 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 301088us
W20260709 12:18:05.345013 28679 rpcz_store.cc:269] 0709 12:18:03.563451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.563626 (+   175us) service_pool.cc:224] Handling call
0709 12:18:05.229327 (+1665701us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:05.342122 (+112795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7933184}
I20260709 12:18:05.121215 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:05.189141 30475 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:05.115360 28603 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
W20260709 12:18:05.345983 28749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1459) took 2090 ms (client timeout 1993 ms). Trace:
I20260709 12:18:05.346203 28677 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:05.295284 30289 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.350713 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:05.350981 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:05.351538 28679 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:05.349861 28749 rpcz_store.cc:269] 0709 12:18:03.180968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.182190 (+  1222us) service_pool.cc:224] Handling call
0709 12:18:05.271328 (+2089138us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001b49d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:05.271435 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2874904448}
W20260709 12:18:05.344512 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.355003 30451 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.156790 30457 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.351747 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:05.261768 30344 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:05.360874 28750 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:05.188860 30476 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.385226 28682 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:05.353732 30409 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:05.271382 30328 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.358623 30356 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.348098 30345 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.305274 30479 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.386112 30453 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:05.378441 30442 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.355885 30315 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:05.352380 30418 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:18:05.406394 30470 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:05.410249 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 1936) took 1583 ms. Trace:
I20260709 12:18:05.360143 30451 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.395654 30402 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:05.423804 28756 rpcz_store.cc:276] 0709 12:18:03.827110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.328745 (+1501635us) service_pool.cc:224] Handling call
0709 12:18:05.329028 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.354129 (+ 25101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:05.354160 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:05.354201 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:05.354230 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.410014 (+ 55784us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b54001c4654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:05.410058 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.410183 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57278720}
W20260709 12:18:05.435400 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 83718us
I20260709 12:18:05.438243 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:05.186020 30472 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.399544 30304 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.396049 30409 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.435504 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:05.436851 30402 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:05.451886 30345 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:05.455354 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 414975us
I20260709 12:18:05.347723 30458 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.434906 30453 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.467835 30313 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:05.362682 30475 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:05.457698 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:05.458124 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:05.482163 28673 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:05.482321 30489 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:05.458986 30482 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.483131 30329 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:05.482831 30489 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:05.468670 30402 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:05.900404 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.955570 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.001s	sys 0.008s
W20260709 12:18:05.955978 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.001s	sys 0.008s
I20260709 12:18:05.539593 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:05.956591 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 661711us
I20260709 12:18:05.957366 28674 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:05.716949 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.526244 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:05.961239 28752 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:05.531781 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:05.962548 29321 raft_consensus.cc:2368] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
W20260709 12:18:05.531148 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.964234 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:05.965008 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:05.966009 28749 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:05.967162 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:05.967931 28747 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:05.969650 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:05.481155 28675 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.155s	user 0.012s	sys 0.000s
I20260709 12:18:05.975193 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:06.023849 28606 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:06.024048 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1900) took 1254 ms. Trace:
I20260709 12:18:05.965293 28754 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:05.667043 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 53508.1us
I20260709 12:18:05.947395 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:05.534233 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:05.514459 28678 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:05.545051 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:06.017129 28607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1899) took 1248 ms (client timeout 1648 ms). Trace:
W20260709 12:18:06.022717 28752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 1934) took 2135 ms (client timeout 2200 ms). Trace:
I20260709 12:18:06.022967 28747 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:06.024505 28605 rpcz_store.cc:276] 0709 12:18:04.769311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.769431 (+   120us) service_pool.cc:224] Handling call
0709 12:18:04.769700 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:04.947639 (+177939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.947682 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:04.947739 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:04.947794 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.023818 (+1076024us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540022f954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:06.023867 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.023993 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408679808}
W20260709 12:18:06.070302 28607 rpcz_store.cc:269] 0709 12:18:04.768229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.768388 (+   159us) service_pool.cc:224] Handling call
0709 12:18:05.522934 (+754546us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400093654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:06.017061 (+494127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568074112}
I20260709 12:18:06.040844 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:05.483284 30460 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:05.472890 30345 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:06.039970 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:06.290339 30328 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:06.975337 28606 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:06.356808 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:06.976109 30465 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:06.420989 30364 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:05.546458 30296 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:06.173743 30493 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:05.875030 30453 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:06.977901 30493 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:06.734282 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.978369 30493 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:06.978559 28678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1430) took 1860 ms (client timeout 1905 ms). Trace:
W20260709 12:18:06.400520 28753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1462) took 3211 ms (client timeout 2149 ms). Trace:
W20260709 12:18:06.979087 28678 rpcz_store.cc:269] 0709 12:18:05.117874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.118024 (+   150us) service_pool.cc:224] Handling call
0709 12:18:06.978495 (+1860471us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:06.979679 28753 rpcz_store.cc:269] 0709 12:18:03.189703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.189808 (+   105us) service_pool.cc:224] Handling call
0709 12:18:06.400235 (+3210427us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54003e9254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:06.400409 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4349746432}
I20260709 12:18:05.592823 29318 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:06.784559 30399 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 4.120s	user 0.018s	sys 0.018s
I20260709 12:18:06.231258 30449 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:06.981021 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 500) took 1570 ms. Trace:
W20260709 12:18:06.357743 28681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1423) took 2806 ms (client timeout 2194 ms). Trace:
W20260709 12:18:06.148972 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 201688us
I20260709 12:18:06.981828 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 1929) took 4576 ms. Trace:
I20260709 12:18:06.402118 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:05.535235 30482 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:05.541196 30433 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.533803 30346 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:06.357249 29327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 492) took 2892 ms (client timeout 2099 ms). Trace:
I20260709 12:18:06.982455 28755 rpcz_store.cc:276] 0709 12:18:02.405860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.406034 (+   174us) service_pool.cc:224] Handling call
0709 12:18:02.406449 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:02.406847 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.406884 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:02.452696 (+ 45812us) log.cc:844] Serialized 26 byte log entry
0709 12:18:02.667772 (+215076us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:02.690096 (+ 22324us) log.cc:844] Serialized 14 byte log entry
0709 12:18:02.699069 (+  8973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.699145 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:04.473258 (+1774113us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b180015c520. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db
0709 12:18:06.678730 (+2205472us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:06.981614 (+302884us) raft_consensus.cc:1685] finished
0709 12:18:06.981633 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.981757 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8694,"prepare.queue_time_us":21756,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":13819,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":44960,"spinlock_wait_cycles":101678336,"thread_start_us":176995,"threads_started":1,"wal-append.queue_time_us":193429}
I20260709 12:18:05.785463 30475 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:06.984274 29327 rpcz_store.cc:269] 0709 12:18:03.464570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.464774 (+   204us) service_pool.cc:224] Handling call
0709 12:18:06.357070 (+2892296us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5400790254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:06.357175 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32588672}
I20260709 12:18:05.974874 30454 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:06.149369 29317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 473) took 3193 ms (client timeout 2264 ms). Trace:
I20260709 12:18:06.075098 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:06.071283 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:06.356354 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:05.737037 30459 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:06.986554 29325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 506) took 1456 ms (client timeout 1806 ms). Trace:
I20260709 12:18:05.083478 29326 rpcz_store.cc:276] 0709 12:18:03.213260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.213879 (+   619us) service_pool.cc:224] Handling call
0709 12:18:03.214282 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:03.218194 (+  3912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:03.218237 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:03.285408 (+ 67171us) log.cc:844] Serialized 26 byte log entry
0709 12:18:04.341351 (+1055943us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:04.840981 (+499630us) log.cc:844] Serialized 14 byte log entry
0709 12:18:04.841400 (+   419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:04.841511 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:04.841548 (+    37us) raft_consensus.cc:1685] finished
0709 12:18:04.841580 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:04.841732 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4868,"prepare.queue_time_us":740024,"raft.queue_time_us":5633,"raft.run_cpu_time_us":900,"raft.run_wall_time_us":75518,"thread_start_us":1454275,"threads_started":2,"wal-append.queue_time_us":1088212}
W20260709 12:18:06.071182 28752 rpcz_store.cc:269] 0709 12:18:03.826430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.826569 (+   139us) service_pool.cc:224] Handling call
0709 12:18:05.526047 (+1699478us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:05.961684 (+435637us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15775616}
I20260709 12:18:06.361205 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1895) took 2536 ms. Trace:
I20260709 12:18:06.074158 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:06.071887 28677 raft_consensus.cc:2376] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4. Re-sending same reply.
I20260709 12:18:06.986320 28749 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:18:06.986747 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 915441us
W20260709 12:18:05.737747 30491 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:18:06.974676 30435 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:06.147792 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:06.976485 28674 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:07.048933 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1440) took 1671 ms (client timeout 1868 ms). Trace:
W20260709 12:18:05.920997 30318 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.011s
I20260709 12:18:07.049713 29323 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.976217 28602 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:06.358426 30476 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:06.987059 29325 rpcz_store.cc:269] 0709 12:18:05.530448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.530601 (+   153us) service_pool.cc:224] Handling call
0709 12:18:06.986499 (+1455898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:06.988325 28601 rpcz_store.cc:276] 0709 12:18:03.825162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.353934 (+528772us) service_pool.cc:224] Handling call
0709 12:18:04.354357 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:04.916423 (+562066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.916484 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:04.916542 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:04.916586 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.360911 (+1444325us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54000a7154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:06.360986 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.361139 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1291978624}
I20260709 12:18:06.991133 28754 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:07.053543 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1478) took 1082 ms. Trace:
I20260709 12:18:06.980551 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:05.623641 30472 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:06.222890 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1466) took 2626 ms. Trace:
I20260709 12:18:06.982661 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:06.973968 30409 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:06.991879 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 918157us
W20260709 12:18:07.060953 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.040946 30454 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:18:07.062424 28645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.009s	sys 0.011s
W20260709 12:18:07.062893 28645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.009s	sys 0.011s
W20260709 12:18:07.063319 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.065610 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:06.981489 29318 rpcz_store.cc:276] 0709 12:18:05.410946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.413746 (+  2800us) service_pool.cc:224] Handling call
0709 12:18:06.980957 (+1567211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.066406 28752 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
W20260709 12:18:07.043738 28677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1444) took 1568 ms (client timeout 1510 ms). Trace:
I20260709 12:18:07.066812 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:05.697759 30457 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.043164 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:05.504573 30486 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:05.544693 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:07.048415 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.012s	sys 0.001s
I20260709 12:18:05.854434 30451 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:06.977329 30364 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.050403 28756 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 2: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:07.095373 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1473) took 1131 ms. Trace:
I20260709 12:18:07.095762 28756 rpcz_store.cc:276] 0709 12:18:05.964064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.964195 (+   131us) service_pool.cc:224] Handling call
0709 12:18:07.095320 (+1131125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:05.938510 30427 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.781s	user 0.008s	sys 0.000s
I20260709 12:18:07.074976 30476 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:07.100574 30476 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.100544 30427 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.101130 30476 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.102826 30427 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.104875 30364 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.100603 30345 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.008574 28598 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:07.108812 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 505) took 1578 ms. Trace:
W20260709 12:18:07.109251 28598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1505) took 2149 ms (client timeout 2842 ms). Trace:
I20260709 12:18:05.975035 30413 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:05.553409 30434 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:07.109899 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1438) took 1751 ms. Trace:
I20260709 12:18:05.975283 30489 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:07.054669 28678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1443) took 1597 ms (client timeout 1838 ms). Trace:
W20260709 12:18:07.110498 28678 rpcz_store.cc:269] 0709 12:18:05.458703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.980214 (+1521511us) service_pool.cc:224] Handling call
0709 12:18:07.054624 (+ 74410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.110324 28680 rpcz_store.cc:276] 0709 12:18:05.358152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.358275 (+   123us) service_pool.cc:224] Handling call
0709 12:18:05.358593 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:05.358924 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:05.358970 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:05.362719 (+  3749us) log.cc:844] Serialized 26 byte log entry
0709 12:18:05.458610 (+ 95891us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:05.458648 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.458706 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:07.109669 (+1650963us) raft_consensus.cc:1685] finished
0709 12:18:07.109691 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.109820 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":573,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":25581,"spinlock_wait_cycles":647040,"thread_start_us":70295,"threads_started":1,"wal-append.queue_time_us":97998}
I20260709 12:18:07.111835 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.112495 28678 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:06.361984 30400 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:07.049448 28674 rpcz_store.cc:269] 0709 12:18:05.377652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.026406 (+648754us) service_pool.cc:224] Handling call
0709 12:18:07.048855 (+1022449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.112912 30425 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.113662 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:07.114230 28674 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:07.049181 29292 connection.cc:256] RPC call timeout handler was delayed by -2.6838119750002534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
I20260709 12:18:07.053953 28754 rpcz_store.cc:276] 0709 12:18:05.971187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.073943 (+102756us) service_pool.cc:224] Handling call
0709 12:18:07.053483 (+979540us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.055280 28602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1502) took 2208 ms (client timeout 1962 ms). Trace:
W20260709 12:18:07.115947 29292 connection.cc:256] RPC call timeout handler was delayed by -2.1645426900001894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 12:18:07.116405 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:06.229153 30441 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:07.116446 29292 connection.cc:256] RPC call timeout handler was delayed by -2.1645426900001894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 12:18:07.116341 28602 rpcz_store.cc:269] 0709 12:18:04.842213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.842319 (+   106us) service_pool.cc:224] Handling call
0709 12:18:06.356687 (+1514368us) spinlock_profiling.cc:243] Waited 960 us on lock 0x7b5800003398. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ae9c 00007f6fe095aa5b 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:07.050822 (+694135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207488}
W20260709 12:18:07.118185 29292 connection.cc:256] RPC call timeout handler was delayed by -2.1591426900001807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:18:07.118505 29292 connection.cc:256] RPC call timeout handler was delayed by -2.1591426900001807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:18:07.118826 29292 connection.cc:256] RPC call timeout handler was delayed by -2.1393426900001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 12:18:07.119105 29292 connection.cc:256] RPC call timeout handler was delayed by -2.1042426900000919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:18:06.982008 28681 rpcz_store.cc:269] 0709 12:18:03.551064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.551242 (+   178us) service_pool.cc:224] Handling call
0709 12:18:06.357542 (+2806300us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b540019f854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:06.357647 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8160512}
I20260709 12:18:07.119259 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.119870 28754 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:07.119972 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.096962 30459 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:07.120647 28681 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:07.120841 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.121116 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1445) took 1405 ms. Trace:
I20260709 12:18:06.040843 28675 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:06.074097 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:06.204138 30456 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.065725 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:07.059110 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76506.9us
W20260709 12:18:07.067237 28677 rpcz_store.cc:269] 0709 12:18:05.475554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.533908 (+ 58354us) service_pool.cc:224] Handling call
0709 12:18:07.043672 (+1509764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.122205 28755 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:07.069705 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:07.122921 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53291.2us
W20260709 12:18:07.109671 28598 rpcz_store.cc:269] 0709 12:18:04.959878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.081685 (+121807us) service_pool.cc:224] Handling call
0709 12:18:06.356192 (+1274507us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800003398. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:07.109183 (+752991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24086400}
I20260709 12:18:07.056794 30494 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.119426 29292 connection.cc:256] RPC call timeout handler was delayed by -2.1042426900000919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 12:18:07.122951 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:07.124246 29292 connection.cc:256] RPC call timeout handler was delayed by -1.9863426900001286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 12:18:07.124580 29292 connection.cc:256] RPC call timeout handler was delayed by -1.9647426900000937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 12:18:07.124871 29292 connection.cc:256] RPC call timeout handler was delayed by -1.9485426900000675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 12:18:07.124787 28571 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:07.070873 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:07.125273 29292 connection.cc:256] RPC call timeout handler was delayed by -1.87744269000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:18:07.125571 29292 connection.cc:256] RPC call timeout handler was delayed by -1.8702426900001683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 12:18:07.125836 29292 connection.cc:256] RPC call timeout handler was delayed by -1.8702426900001683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 12:18:07.126096 29292 connection.cc:256] RPC call timeout handler was delayed by -1.8470264900001894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 12:18:07.072156 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:06.985690 29317 rpcz_store.cc:269] 0709 12:18:02.845901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.850432 (+  4531us) service_pool.cc:224] Handling call
0709 12:18:05.517726 (+2667294us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54007a5b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:06.039211 (+521485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287755136}
I20260709 12:18:06.984915 30482 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.126180 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.062762 30454 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:07.051973 30460 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.099915 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:07.112941 28678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1442) took 1657 ms (client timeout 1847 ms). Trace:
I20260709 12:18:07.141145 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:07.227751 28674 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:07.228482 28678 rpcz_store.cc:269] 0709 12:18:05.455510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.111574 (+1656064us) service_pool.cc:224] Handling call
0709 12:18:07.112877 (+  1303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.229096 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1447) took 1211 ms. Trace:
I20260709 12:18:05.918851 28673 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:07.229612 28674 rpcz_store.cc:276] 0709 12:18:06.017800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.113418 (+1095618us) service_pool.cc:224] Handling call
0709 12:18:07.229043 (+115625us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.119391 30402 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.045s	user 0.005s	sys 0.004s
I20260709 12:18:07.229663 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:07.230764 28678 raft_consensus.cc:2376] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3. Re-sending same reply.
I20260709 12:18:07.121433 28681 rpcz_store.cc:276] 0709 12:18:05.715848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.119747 (+1403899us) service_pool.cc:224] Handling call
0709 12:18:07.121066 (+  1319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.071024 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.231967 28747 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:07.205168 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.201809 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1901) took 2431 ms. Trace:
I20260709 12:18:07.122056 29321 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:07.151801 28749 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:07.233356 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 507) took 1702 ms. Trace:
W20260709 12:18:07.233458 28749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1477) took 1262 ms (client timeout 1566 ms). Trace:
W20260709 12:18:07.233923 28749 rpcz_store.cc:269] 0709 12:18:05.970894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.074867 (+103973us) service_pool.cc:224] Handling call
0709 12:18:07.233401 (+1158534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.147004 30400 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:07.232705 28754 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:07.233135 28599 rpcz_store.cc:276] 0709 12:18:04.770007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.770142 (+   135us) service_pool.cc:224] Handling call
0709 12:18:04.770407 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.108404 (+337997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:05.108463 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:05.108523 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:05.108571 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.201547 (+2092976us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54002c0454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:07.201591 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.201721 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776753920}
I20260709 12:18:07.140785 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.236253 28756 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:18:07.061733 30433 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:07.228010 29323 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:07.209744 28752 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:18:07.237155 28755 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:07.226270 28571 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:07.210790 29292 connection.cc:256] RPC call timeout handler was delayed by -1.8144426900000781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 12:18:07.348457 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76105.3us
W20260709 12:18:07.362545 29292 connection.cc:256] RPC call timeout handler was delayed by -1.7721426900000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
I20260709 12:18:06.360598 28501 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 303) took 4025 ms. Trace:
W20260709 12:18:07.243614 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 102536us
I20260709 12:18:07.272395 30410 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:07.365020 30458 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:07.365314 30349 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.365423 30458 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:07.365973 30458 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.365953 30349 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.369546 30489 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.368296 30349 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.372306 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:07.373242 30364 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:07.373651 30364 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.374040 30364 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:07.373750 30458 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.301242 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 496) took 1914 ms. Trace:
I20260709 12:18:07.376293 29320 rpcz_store.cc:276] 0709 12:18:05.386608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.388152 (+  1544us) service_pool.cc:224] Handling call
0709 12:18:06.351891 (+963739us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:06.352202 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.405272 (+ 53070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:06.430436 (+ 25164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:06.462008 (+ 31572us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:07.300857 (+838849us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54003ffd20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39fa733 00007f6fe3a7fdbf 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c
0709 12:18:07.300920 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.301005 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.301179 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61694592}
W20260709 12:18:07.377264 28682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1433) took 2255 ms (client timeout 1712 ms). Trace:
W20260709 12:18:07.363977 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 137821us
I20260709 12:18:07.378034 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:07.233811 29321 rpcz_store.cc:276] 0709 12:18:05.530927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.073834 (+542907us) service_pool.cc:224] Handling call
0709 12:18:07.233301 (+1159467us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.362901 29292 connection.cc:256] RPC call timeout handler was delayed by -1.7604426900002181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 12:18:07.075031 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.012s	sys 0.001s
I20260709 12:18:07.237067 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1446) took 1277 ms. Trace:
W20260709 12:18:07.303267 28751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 1937) took 3475 ms (client timeout 1657 ms). Trace:
W20260709 12:18:07.379544 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 1.35601e+06us
I20260709 12:18:07.380075 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:07.271947 28720 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.567s (SENT)
W20260709 12:18:07.377625 28682 rpcz_store.cc:269] 0709 12:18:05.122375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.122537 (+   162us) service_pool.cc:224] Handling call
0709 12:18:07.377097 (+2254560us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b54003750d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:07.377199 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229881728}
I20260709 12:18:07.381162 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:07.386023 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:07.386142 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 132140us
I20260709 12:18:07.391070 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.392930 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.393810 29321 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:07.137970 30498 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:07.332789 30482 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.395138 30498 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.384887 30458 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.395805 30498 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.395467 30482 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.397401 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:07.397699 29325 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:07.273398 30469 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.200196 30311 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:07.136631 30441 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:07.200194 30421 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:07.272761 30497 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:07.135424 30494 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.383941 30489 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.381539 30457 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:07.204357 30483 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:07.228901 28675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1422) took 3678 ms (client timeout 2160 ms). Trace:
I20260709 12:18:07.306298 30346 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:07.135502 30419 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:07.298588 30286 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:07.235357 30402 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.227713 30454 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:07.380831 28677 rpcz_store.cc:276] 0709 12:18:05.960105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.229007 (+1268902us) service_pool.cc:224] Handling call
0709 12:18:07.236606 (+  7599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.236757 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.236780 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.236818 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:07.236850 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.236917 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.237012 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.379438 29292 connection.cc:256] RPC call timeout handler was delayed by -1.7334426900001745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 12:18:07.400657 30296 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:07.401592 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.347798 30476 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.400466 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:07.403697 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.405171 28721 leader_election.cc:400] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:07.397019 30430 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:07.410866 30457 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:07.406749 30482 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.435612 30430 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:07.298904 30456 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:07.435802 30482 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:07.272794 30460 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.404556 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.273597 30318 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:07.412451 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.384420 30289 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.150578 30444 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.364485 30433 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:07.109257 29319 rpcz_store.cc:276] 0709 12:18:05.530006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.539541 (+  9535us) service_pool.cc:224] Handling call
0709 12:18:07.108743 (+1569202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.380026 28751 rpcz_store.cc:269] 0709 12:18:03.827384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.451364 (+623980us) service_pool.cc:224] Handling call
0709 12:18:07.302999 (+2851635us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54003e8854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:07.303179 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64615808}
I20260709 12:18:07.310401 30464 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.154489 30471 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:07.272877 28673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1419) took 4176 ms (client timeout 1838 ms). Trace:
I20260709 12:18:07.399868 30409 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:07.414577 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:07.405666 30458 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:07.437945 30456 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.448148 30433 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.448531 30502 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:07.453385 30458 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:07.453738 30502 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:07.454167 30502 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.436666 30457 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.420130 28680 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:07.442719 30318 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.457564 30318 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:07.456254 28673 rpcz_store.cc:269] 0709 12:18:03.096710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.098232 (+  1522us) service_pool.cc:224] Handling call
0709 12:18:05.450701 (+2352469us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:07.238529 (+1787828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24469376}
W20260709 12:18:07.420856 29290 connection.cc:256] RPC call timeout handler was delayed by -1.6507428150000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30610000000000004s for a response
I20260709 12:18:07.425171 28679 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:07.403014 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:07.135195 30493 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.428188 28721 leader_election.cc:403] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:07.428525 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:07.466872 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 85955.6us
W20260709 12:18:07.411376 28675 rpcz_store.cc:269] 0709 12:18:03.550133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.551851 (+  1718us) service_pool.cc:224] Handling call
0709 12:18:07.220918 (+3669067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.431479 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:07.433979 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1441) took 1975 ms. Trace:
W20260709 12:18:07.436959 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.412827 30441 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:07.472743 28676 rpcz_store.cc:276] 0709 12:18:05.451703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.136654 (+1684951us) service_pool.cc:224] Handling call
0709 12:18:07.137015 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.233646 (+ 96631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.233673 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.234112 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:18:07.412984 (+178872us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:07.413022 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.413089 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:07.427280 (+ 14191us) raft_consensus.cc:1685] finished
0709 12:18:07.427302 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.427446 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5037,"raft.queue_time_us":97614,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"thread_start_us":70472,"threads_started":1,"wal-append.queue_time_us":127262}
I20260709 12:18:07.523144 30441 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.474900 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:07.454507 30458 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.442375 29325 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:07.427512 30296 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:07.446557 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.452067 30396 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:07.419895 29292 connection.cc:256] RPC call timeout handler was delayed by -1.6965426900001148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:18:07.545137 29292 connection.cc:256] RPC call timeout handler was delayed by -1.6740426900000784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:18:07.466014 29290 connection.cc:256] RPC call timeout handler was delayed by -1.0114645880000808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3209s for a response
W20260709 12:18:07.545512 29292 connection.cc:256] RPC call timeout handler was delayed by -1.6740426900000784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:18:07.545837 29292 connection.cc:256] RPC call timeout handler was delayed by -1.6389426900000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 12:18:07.546124 29292 connection.cc:256] RPC call timeout handler was delayed by -1.6389426900000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 12:18:07.416059 30346 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:07.466884 28677 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:07.475857 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:07.478879 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.447420 30430 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.364385 28501 rpcz_store.cc:276] 0709 12:18:02.335308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.338398 (+  3090us) service_pool.cc:224] Handling call
0709 12:18:06.360487 (+4022089us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:03.124664 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:03.125243 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:03.125279 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:18:03.125292 (+    13us) tablet.cc:662] Decoding operations
0709 12:18:03.125648 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:03.125723 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:03.125750 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:03.125985 (+   235us) tablet.cc:701] Row locks acquired
0709 12:18:03.126013 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:18:03.126191 (+   178us) write_op.cc:270] Start()
0709 12:18:03.126326 (+   135us) write_op.cc:276] Timestamp: P: 1783599483126134 usec, L: 0
0709 12:18:03.126355 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:18:03.191721 (+ 65366us) log.cc:844] Serialized 544 byte log entry
0709 12:18:04.324260 (+1132539us) op_driver.cc:464] REPLICATION: finished
0709 12:18:04.634696 (+310436us) write_op.cc:301] APPLY: starting
0709 12:18:04.637237 (+  2541us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:04.662858 (+ 25621us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:04.677155 (+ 14297us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:04.677441 (+   286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:04.677659 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:18:04.677727 (+    68us) write_op.cc:312] APPLY: finished
0709 12:18:04.677975 (+   248us) log.cc:844] Serialized 23 byte log entry
0709 12:18:04.678173 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:04.678278 (+   105us) write_op.cc:454] Released schema lock
0709 12:18:04.678324 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:04.678804 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:04.678854 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":212144,"apply.run_cpu_time_us":2346,"apply.run_wall_time_us":82490,"num_ops":1,"prepare.queue_time_us":492936,"prepare.run_cpu_time_us":39454,"prepare.run_wall_time_us":217901,"raft.queue_time_us":740365,"raft.run_cpu_time_us":44041,"raft.run_wall_time_us":107932,"replication_time_us":1197719,"thread_start_us":1680802,"threads_started":4,"wal-append.queue_time_us":299472,"wal-append.run_cpu_time_us":64698,"wal-append.run_wall_time_us":2352351}]]}
I20260709 12:18:07.153014 30462 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.058600 28748 rpcz_store.cc:276] 0709 12:18:03.596642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.599615 (+  2973us) service_pool.cc:224] Handling call
0709 12:18:03.630752 (+ 31137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:04.331257 (+700505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.336748 (+  5491us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:04.535951 (+199203us) log.cc:844] Serialized 26 byte log entry
0709 12:18:04.753069 (+217118us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:04.753129 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:04.753235 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.516172 (+762937us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b24003e9d08. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08189c4 00007f6fe0816acb 00007f6fe09d1dc9 00007f6fe09d1a55 00007f6fe09d0fb0 00007f6fe3647488 00007f6fe3647be8 00007f6fe361f398 00007f6fe361a76a 00007f6fe3619bb6
0709 12:18:06.189162 (+672990us) raft_consensus.cc:1685] finished
0709 12:18:06.194427 (+  5265us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.222787 (+ 28360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45230,"raft.queue_time_us":77553,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":19354368,"thread_start_us":90679,"threads_started":1,"wal-append.queue_time_us":155706,"wal-append.run_cpu_time_us":31443,"wal-append.run_wall_time_us":2472348}
I20260709 12:18:07.430076 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:07.543043 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 68239.5us
I20260709 12:18:07.555006 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:07.556859 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:07.557255 30273 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:07.557474 29319 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.557641 30273 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.557796 30346 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.558058 30273 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:07.543792 30296 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.416545 30497 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.541638 30483 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.549273 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.549861 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.581967 28679 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:07.465517 30297 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.466872 30464 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:07.552423 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.581274 29326 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:07.592509 28677 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:07.526578 30471 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.445887 30482 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.466861 30438 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:07.548743 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.466377 30364 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.599612 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.559638 30462 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:07.589970 30433 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.590492 30494 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.591624 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.551263 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.596560 29325 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:07.616044 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.617287 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.626564 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.627156 28755 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:07.627166 28679 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:07.628700 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.622450 30472 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:07.629779 30482 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.629740 30472 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.628772 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:07.602471 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:07.632985 28679 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:07.605348 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.633953 29326 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:07.547955 30311 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:07.620350 28750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 1939) took 3792 ms (client timeout 1669 ms). Trace:
I20260709 12:18:07.622848 28682 raft_consensus.cc:2368] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:07.632174 30472 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:07.647013 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.648547 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.649238 29322 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:07.650687 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.650812 30476 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.652081 30493 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.652616 28752 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:07.652733 30497 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:07.635268 28750 rpcz_store.cc:269] 0709 12:18:03.828023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.787965 (+959942us) service_pool.cc:224] Handling call
0709 12:18:07.620182 (+2832217us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54001c3c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:07.620287 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958461824}
I20260709 12:18:07.599146 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:07.640034 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.654109 28751 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:07.645125 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:07.616236 30462 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.639218 29321 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:07.629822 28748 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:07.734000 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:07.734757 28750 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:07.593237 30483 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:07.638991 30311 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.748840 30456 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.749783 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.594178 30464 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.659813 30462 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.764590 30364 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.620826 30318 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:07.766556 30502 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.767009 30318 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.768661 30502 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.768836 30464 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.752887 30311 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:07.781294 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:07.787655 28754 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:07.786725 30433 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.795200 30471 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:07.808092 30483 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.809077 30273 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.814100 30498 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.815374 28674 raft_consensus.cc:2368] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:07.815085 30457 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.817117 30454 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:07.817802 30463 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.822602 30462 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.826826 30498 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.826853 30457 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.819139 30454 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:07.828760 30462 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:07.828336 30296 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:07.830603 30296 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:08.376354 28681 raft_consensus.cc:2368] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5.
W20260709 12:18:08.836095 28536 debug-util.cc:398] Leaking SignalData structure 0x7b08000344e0 after lost signal to thread 27449
I20260709 12:18:09.113443 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:09.117583 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.118425 28747 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:09.119227 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.119627 28747 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:09.120232 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.120688 28747 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:09.121270 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.122005 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.122735 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.123441 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.123858 28747 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:09.124353 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.125054 28747 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:09.126266 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.127318 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.127909 28747 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:18:09.129369 29323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 503) took 3705 ms (client timeout 1993 ms). Trace:
W20260709 12:18:09.129796 29323 rpcz_store.cc:269] 0709 12:18:05.424237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.424379 (+   142us) service_pool.cc:224] Handling call
0709 12:18:06.401905 (+977526us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:09.129191 (+2727286us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b5400780354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:09.129301 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178581632}
W20260709 12:18:09.140033 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.145397 28722 connection.cc:256] RPC call timeout handler was delayed by -3.6417245760001151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 12:18:09.146528 28722 connection.cc:256] RPC call timeout handler was delayed by -2.5344863120001264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 12:18:09.146925 28722 connection.cc:256] RPC call timeout handler was delayed by -2.3940863120001268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 12:18:09.147229 28722 connection.cc:256] RPC call timeout handler was delayed by -2.2266863120000835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2304s for a response
W20260709 12:18:09.147593 28722 connection.cc:256] RPC call timeout handler was delayed by -1.9980863119999412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25579999999999997s for a response
W20260709 12:18:09.147893 28722 connection.cc:256] RPC call timeout handler was delayed by -1.623856743000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2842s for a response
W20260709 12:18:09.148139 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.676s	user 0.005s	sys 0.029s
W20260709 12:18:09.148639 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.676s	user 0.006s	sys 0.029s
W20260709 12:18:09.148857 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 1.71729e+06us
I20260709 12:18:09.149610 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.149689 30511 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.150198 30511 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:09.150226 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.150570 30511 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.151011 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.151597 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.152395 28648 leader_election.cc:400] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4.
I20260709 12:18:09.152679 28648 leader_election.cc:403] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:09.155386 30469 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:09.155905 30469 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.157797 30511 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.158272 30469 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:09.158804 30469 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:09.159255 30469 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.160215 30511 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.160951 30511 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:09.161221 30469 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.161374 30511 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.163558 30511 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:09.168066 28648 connection.cc:256] RPC call timeout handler was delayed by -2.9027132930002608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260709 12:18:09.168412 30346 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.168915 30346 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.169237 30346 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:09.168512 28648 connection.cc:256] RPC call timeout handler was delayed by -2.8991216280001026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2705s for a response
W20260709 12:18:09.170166 28648 connection.cc:256] RPC call timeout handler was delayed by -1.8370902020001267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 12:18:09.170536 28648 connection.cc:256] RPC call timeout handler was delayed by -1.6156902019999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 12:18:09.170897 28648 connection.cc:256] RPC call timeout handler was delayed by -1.5697902020001493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:18:09.171243 28648 connection.cc:256] RPC call timeout handler was delayed by -1.5670902020001449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20260709 12:18:09.171594 28648 connection.cc:256] RPC call timeout handler was delayed by -1.4707902019999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 12:18:09.171952 28648 connection.cc:256] RPC call timeout handler was delayed by -1.4275902020001467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 12:18:09.172353 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2169902020000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 12:18:09.173015 28648 connection.cc:256] RPC call timeout handler was delayed by -1.012690202000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24260000000000004s for a response
I20260709 12:18:09.181519 30346 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.183715 30346 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:09.184332 30346 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.185346 30346 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:09.185700 30346 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.194175 30346 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.197077 30346 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.197692 30346 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.197978 30346 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.198341 30346 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.205958 30474 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.206496 30346 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:09.207427 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1452) took 1805 ms (client timeout 2229 ms). Trace:
W20260709 12:18:09.207828 28674 rpcz_store.cc:269] 0709 12:18:07.402276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.402772 (+   496us) service_pool.cc:224] Handling call
0709 12:18:09.207219 (+1804447us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b540016c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:09.207368 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801809152}
I20260709 12:18:09.208664 30346 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.209070 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.209257 30346 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.209632 30346 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:09.209790 28674 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
I20260709 12:18:09.210055 30346 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:09.210513 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1445) took 1741 ms (client timeout 2134 ms). Trace:
W20260709 12:18:09.210855 28674 rpcz_store.cc:269] 0709 12:18:07.469348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.208789 (+1739441us) service_pool.cc:224] Handling call
0709 12:18:09.210453 (+  1664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.211782 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.212345 28674 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
W20260709 12:18:09.213974 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1456) took 1743 ms (client timeout 2166 ms). Trace:
W20260709 12:18:09.214359 28674 rpcz_store.cc:269] 0709 12:18:07.470998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.211529 (+1740531us) service_pool.cc:224] Handling call
0709 12:18:09.213917 (+  2388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.214757 28677 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:09.215690 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.216261 28674 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
W20260709 12:18:09.216733 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1455) took 1745 ms (client timeout 2221 ms). Trace:
W20260709 12:18:09.217124 28674 rpcz_store.cc:269] 0709 12:18:07.470863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.215444 (+1744581us) service_pool.cc:224] Handling call
0709 12:18:09.216682 (+  1238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.217060 30346 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.218026 30476 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.218104 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.218904 28674 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.219244 30346 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:09.219306 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1458) took 1678 ms (client timeout 2164 ms). Trace:
W20260709 12:18:09.220472 28674 rpcz_store.cc:269] 0709 12:18:07.541369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.217880 (+1676511us) service_pool.cc:224] Handling call
0709 12:18:09.219259 (+  1379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.220574 30346 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:09.221554 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.221331 30346 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.222348 28674 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.222795 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1460) took 1669 ms. Trace:
I20260709 12:18:09.223140 28674 rpcz_store.cc:276] 0709 12:18:07.552965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.221316 (+1668351us) service_pool.cc:224] Handling call
0709 12:18:09.222749 (+  1433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.223477 30346 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.224086 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.224577 30476 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4.
I20260709 12:18:09.224867 28674 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.225425 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1448) took 1755 ms. Trace:
I20260709 12:18:09.226595 30273 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.227177 28674 rpcz_store.cc:276] 0709 12:18:07.469775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.223883 (+1754108us) service_pool.cc:224] Handling call
0709 12:18:09.225375 (+  1492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.228426 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.228935 28674 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:09.229277 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1457) took 1750 ms. Trace:
I20260709 12:18:09.229846 28674 rpcz_store.cc:276] 0709 12:18:07.478730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.228172 (+1749442us) service_pool.cc:224] Handling call
0709 12:18:09.229244 (+  1072us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.230572 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.231069 28674 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.231384 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1452) took 1761 ms. Trace:
I20260709 12:18:09.231612 28674 rpcz_store.cc:276] 0709 12:18:07.470422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.230410 (+1759988us) service_pool.cc:224] Handling call
0709 12:18:09.231350 (+   940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.232863 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1443) took 1764 ms. Trace:
I20260709 12:18:09.233404 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.233219 28674 rpcz_store.cc:276] 0709 12:18:07.468939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.232114 (+1763175us) service_pool.cc:224] Handling call
0709 12:18:09.232366 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.232560 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.232584 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:09.232634 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:09.232663 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.232717 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.232819 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:09.235738 28720 connection.cc:256] RPC call timeout handler was delayed by -1.7533888339999066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 12:18:09.236304 28720 connection.cc:256] RPC call timeout handler was delayed by -1.6690075910000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260709 12:18:09.239791 28720 connection.cc:256] RPC call timeout handler was delayed by -1.50278609399993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2403s for a response
W20260709 12:18:09.240147 28720 connection.cc:256] RPC call timeout handler was delayed by -1.3322551510000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2842s for a response
I20260709 12:18:09.242794 28676 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
W20260709 12:18:09.244782 28720 connection.cc:256] RPC call timeout handler was delayed by -1.3231888339998932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
W20260709 12:18:09.245071 28676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1449) took 1775 ms (client timeout 1993 ms). Trace:
W20260709 12:18:09.245301 28720 connection.cc:256] RPC call timeout handler was delayed by -1.2658075909998843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 12:18:09.245626 28676 rpcz_store.cc:269] 0709 12:18:07.469916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.233184 (+1763268us) service_pool.cc:224] Handling call
0709 12:18:09.245015 (+ 11831us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:09.245814 28720 connection.cc:256] RPC call timeout handler was delayed by -1.2262075910000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260709 12:18:09.247378 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1451) took 1845 ms. Trace:
I20260709 12:18:09.247392 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.247785 28678 rpcz_store.cc:276] 0709 12:18:07.401960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.403378 (+  1418us) service_pool.cc:224] Handling call
0709 12:18:07.403653 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.599942 (+196289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.599974 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.600023 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:07.600049 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.247170 (+1647121us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540016d354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:09.247215 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.247328 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450957568}
I20260709 12:18:09.248378 28750 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:09.249051 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.249389 28678 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:09.249650 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.249966 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1451) took 1779 ms. Trace:
I20260709 12:18:09.250425 28678 rpcz_store.cc:276] 0709 12:18:07.470277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.248864 (+1778587us) service_pool.cc:224] Handling call
0709 12:18:09.249101 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.249740 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.249917 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.249675 28747 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:09.259730 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.260399 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.261564 28750 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:09.262076 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.262228 30351 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.262990 30351 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.263188 30476 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.263481 30351 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.263626 30476 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:09.264065 30311 consensus_meta.cc:287] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.494s	user 0.005s	sys 0.025s
I20260709 12:18:09.264148 30476 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.269697 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.270809 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.271245 30476 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.272482 28750 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.274991 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.275241 30476 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.275585 28678 raft_consensus.cc:2376] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4. Re-sending same reply.
I20260709 12:18:09.276589 30311 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:09.278718 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.279184 30311 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.279768 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.280361 28678 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:09.281211 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.282306 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.283257 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.283865 28678 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
I20260709 12:18:09.286324 30408 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:09.288740 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.289378 28676 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:09.290177 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.290707 28676 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:09.291479 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.292017 28676 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:09.292588 30351 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.295305 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.296823 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.297263 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.297371 28754 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.298501 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.299129 28678 raft_consensus.cc:2368] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3.
I20260709 12:18:09.299271 30440 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:09.299794 30355 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:09.300179 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.300326 30355 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.300946 28676 raft_consensus.cc:2410] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:09.301699 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.302315 28676 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.302368 30355 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:09.303126 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.303781 28676 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:07.812294 29319 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:09.307699 29319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 479) took 1759 ms (client timeout 2160 ms). Trace:
I20260709 12:18:09.308089 28754 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
W20260709 12:18:09.308089 29319 rpcz_store.cc:269] 0709 12:18:07.548646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.556504 (+  7858us) service_pool.cc:224] Handling call
0709 12:18:09.307642 (+1751138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.309132 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.310151 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.310689 28754 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:09.310763 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.311605 30440 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:09.311668 30318 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:09.312281 30440 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.312384 30318 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:09.312588 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.313897 30318 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.315048 30440 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:09.320233 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.321056 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 304) took 1548 ms. Trace:
I20260709 12:18:09.321393 28748 rpcz_store.cc:276] 0709 12:18:07.772387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.777395 (+  5008us) service_pool.cc:224] Handling call
0709 12:18:09.320997 (+1543602us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:09.322516 28647 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60198 dropped due to backpressure: service queue is full with 50 items
W20260709 12:18:09.324025 28675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1454) took 1853 ms (client timeout 1567 ms). Trace:
W20260709 12:18:09.324510 28675 rpcz_store.cc:269] 0709 12:18:07.470720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.550820 (+ 80100us) service_pool.cc:224] Handling call
0709 12:18:09.323945 (+1773125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.326264 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.326576 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.327226 28747 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.327467 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:09.327910 29290 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.693s (SENT)
I20260709 12:18:09.328012 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.328740 28747 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.331557 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.332500 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.322583 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:09.334316 29290 leader_election.cc:336] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.723s (SENT)
I20260709 12:18:09.334692 28748 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:09.335610 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.295289 30351 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:09.328058 28753 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.336689 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.333997 28750 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:09.338600 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.338817 30424 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.339090 28750 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.339546 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.340099 28598 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:09.333771 30295 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.335732 28754 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.341012 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:09.341315 29290 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.826s (SENT)
I20260709 12:18:09.341746 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:09.343840 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.344475 28604 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:18:09.346447 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.346807 30374 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.346904 28749 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:09.347121 28604 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:09.347877 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.348223 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.350476 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:09.350970 28598 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.355633 28747 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.356019 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.356628 29322 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.357285 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.357873 28605 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.358765 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.360706 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:09.361218 28600 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:09.363664 28682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1453) took 1961 ms (client timeout 1948 ms). Trace:
I20260709 12:18:09.364898 29322 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:09.365622 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.366294 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.366664 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:09.364086 28682 rpcz_store.cc:269] 0709 12:18:07.402653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.409152 (+  6499us) service_pool.cc:224] Handling call
0709 12:18:09.363476 (+1954324us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540013fe54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:09.363600 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379006720}
I20260709 12:18:09.367408 28605 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.368930 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.369611 29319 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.371503 30479 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.372638 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.373251 28602 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.374203 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.375111 28600 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
W20260709 12:18:09.366515 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.367677 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.377345 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.377648 28752 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:09.378552 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.379005 30468 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.379503 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.379052 28752 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:09.380921 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.381266 28751 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:09.381213 28598 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.381881 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:09.382262 28751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 303) took 1635 ms (client timeout 1984 ms). Trace:
W20260709 12:18:09.382822 28751 rpcz_store.cc:269] 0709 12:18:07.747394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.755720 (+  8326us) service_pool.cc:224] Handling call
0709 12:18:09.382104 (+1626384us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002d5fd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:09.382214 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3677174528}
I20260709 12:18:09.386265 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:09.386893 28600 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.387341 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:09.366314 28604 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:09.388504 30468 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:09.388620 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.389045 30468 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:09.389287 28604 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:09.390116 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.377679 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:09.380103 29317 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.390647 28605 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:09.391356 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.391530 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:09.392001 28599 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.392860 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.393378 28599 raft_consensus.cc:2376] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4. Re-sending same reply.
I20260709 12:18:09.394161 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:09.394472 28679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1447) took 1924 ms (client timeout 2118 ms). Trace:
I20260709 12:18:09.394701 28599 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
W20260709 12:18:09.394878 28679 rpcz_store.cc:269] 0709 12:18:07.469637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.644832 (+175195us) service_pool.cc:224] Handling call
0709 12:18:09.394389 (+1749557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.395555 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:09.396085 28599 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.396703 28676 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:09.348371 28749 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:18:09.398104 28606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1905) took 3265 ms (client timeout 1807 ms). Trace:
W20260709 12:18:09.398471 28606 rpcz_store.cc:269] 0709 12:18:06.132956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.397933 (+3264977us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:09.398032 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:18:09.399329 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.399853 28606 raft_consensus.cc:2376] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7. Re-sending same reply.
W20260709 12:18:09.401791 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58512.1us
I20260709 12:18:09.402381 28602 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:09.403102 28680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1439) took 4042 ms (client timeout 2076 ms). Trace:
W20260709 12:18:09.403457 28680 rpcz_store.cc:269] 0709 12:18:05.360599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.112335 (+1751736us) service_pool.cc:224] Handling call
0709 12:18:09.402940 (+2290605us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540016bf54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:09.403033 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696820608}
I20260709 12:18:09.403873 28749 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:09.406323 30419 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:09.407756 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:09.389954 30468 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.408188 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.408962 30467 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.409251 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.409873 28606 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:09.410660 30479 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.410742 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.411188 30479 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.411510 28603 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:09.384196 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:09.409868 28681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1441) took 1941 ms (client timeout 1567 ms). Trace:
W20260709 12:18:09.412794 28681 rpcz_store.cc:269] 0709 12:18:07.468407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.475467 (+  7060us) service_pool.cc:224] Handling call
0709 12:18:09.409696 (+1934229us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54000c7e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:09.409807 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904627584}
I20260709 12:18:09.413785 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.412123 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.414430 28681 raft_consensus.cc:2368] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:09.414573 28680 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2. Re-sending same reply.
I20260709 12:18:09.411609 30479 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.415045 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.415496 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.416188 28680 raft_consensus.cc:2368] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:09.416217 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.420068 28748 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:09.420198 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.415159 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.420975 28681 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:18:09.421082 30490 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 2.746s	user 0.023s	sys 0.012s
I20260709 12:18:09.421268 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.421833 28680 raft_consensus.cc:2376] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4. Re-sending same reply.
W20260709 12:18:09.418618 28677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1444) took 1949 ms (client timeout 2099 ms). Trace:
W20260709 12:18:09.422366 28677 rpcz_store.cc:269] 0709 12:18:07.469162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.597882 (+128720us) service_pool.cc:224] Handling call
0709 12:18:09.418420 (+1820538us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54001bd854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:09.418547 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3712930688}
I20260709 12:18:09.422681 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.423206 28680 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:09.423995 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.382171 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.426024 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.427609 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.428260 28677 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.426931 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.322943 28647 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60198 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 355)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 345)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1482)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 350)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1480)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 349)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 360)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 365)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1475)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1473)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 330)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 331)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 332)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 336)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 344)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 359)
I20260709 12:18:09.392001 28605 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.382400 28752 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.443982 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.447827 28680 raft_consensus.cc:2368] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:09.448159 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.448953 28756 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.347198 28754 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:09.356599 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:09.470661 28747 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.475231 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:09.476096 28751 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.476408 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.445875 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.479725 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:09.483130 28720 leader_election.cc:336] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.806s (SENT)
I20260709 12:18:09.483537 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:09.484429 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.485222 29321 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:09.485968 28753 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.480564 28680 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:09.487087 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.487635 28680 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:18:09.366389 28750 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.299815 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:09.484362 28720 leader_election.cc:336] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.099s (SENT)
I20260709 12:18:09.492529 28756 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
W20260709 12:18:09.493309 28720 leader_election.cc:336] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.105s (SENT)
W20260709 12:18:09.493929 28720 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.134s (SENT)
W20260709 12:18:09.494325 28720 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.149s (SENT)
W20260709 12:18:09.474351 28703 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 12:18:09.480602 30475 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.498261 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.498519 30475 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:09.498955 30475 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.499289 28755 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:09.499404 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.500511 28673 raft_consensus.cc:2368] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:09.500564 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.500782 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:09.501160 28673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1439) took 2033 ms (client timeout 2149 ms). Trace:
I20260709 12:18:09.501260 30346 raft_consensus.cc:2764] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:09.501451 29326 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:18:09.501827 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.502424 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.502907 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.500715 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 298) took 1863 ms. Trace:
I20260709 12:18:09.503724 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.504109 28755 rpcz_store.cc:276] 0709 12:18:07.637672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.646778 (+  9106us) service_pool.cc:224] Handling call
0709 12:18:09.500524 (+1853746us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b540012f554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:09.500661 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4257976704}
I20260709 12:18:09.504594 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.502970 29326 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:18:09.504925 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.506278 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.507365 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.504083 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.516477 29321 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:09.517608 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.524156 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.524784 28680 raft_consensus.cc:2368] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:09.524632 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.525523 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.531630 28747 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.532610 28677 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:09.533852 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.535138 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.535919 28677 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:18:09.474794 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.538570 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:09.539983 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 242722us
I20260709 12:18:09.540203 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.540783 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.540879 28677 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:18:09.541363 29327 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 1.
I20260709 12:18:09.538859 29323 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:09.543033 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:09.546478 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.516285 30364 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.551518 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.547670 29318 raft_consensus.cc:2376] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4. Re-sending same reply.
I20260709 12:18:09.542860 30438 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:18:09.539295 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.562965 28748 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:09.550303 29319 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:09.549096 30410 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.564822 30410 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:09.565235 30410 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.568456 29317 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:09.539398 30402 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:09.571246 30475 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.572575 30479 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.574282 30479 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.577718 30475 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.578313 30410 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.582676 30410 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.613984 28678 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.614671 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.617331 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.618784 28680 raft_consensus.cc:2368] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3.
I20260709 12:18:09.620347 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:09.621212 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 116510us
I20260709 12:18:09.623162 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:09.501531 28673 rpcz_store.cc:269] 0709 12:18:07.467874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.468180 (+   306us) service_pool.cc:224] Handling call
0709 12:18:09.501102 (+2032922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:09.626338 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.627882 28673 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:09.634022 28681 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:09.634141 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1446) took 2164 ms. Trace:
W20260709 12:18:09.634703 28647 connection.cc:256] RPC call timeout handler was delayed by -1.7759417659997325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2705s for a response
I20260709 12:18:09.621583 28680 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:18:09.661931 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.651461 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.655767 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.677251 28679 raft_consensus.cc:2368] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3.
I20260709 12:18:09.677706 28675 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:09.678418 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.679085 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.679486 28599 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.665150 30351 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.680074 28675 raft_consensus.cc:2368] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5.
I20260709 12:18:09.680332 30351 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:09.654706 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:09.680910 30351 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.681483 28607 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:09.681550 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.682420 28680 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:09.667395 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.684212 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.656985 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.685869 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:09.686388 28682 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.687006 29320 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:09.687424 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:09.687529 29320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 549) took 2298 ms (client timeout 2705 ms). Trace:
W20260709 12:18:09.687795 28536 debug-util.cc:398] Leaking SignalData structure 0x7b0800034bc0 after lost signal to thread 28539
W20260709 12:18:09.688017 29320 rpcz_store.cc:269] 0709 12:18:07.389418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.399050 (+  9632us) service_pool.cc:224] Handling call
0709 12:18:09.685485 (+2286435us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:09.687461 (+  1976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7473920}
W20260709 12:18:09.689988 28536 debug-util.cc:398] Leaking SignalData structure 0x7b08003847c0 after lost signal to thread 28631
W20260709 12:18:09.690382 28536 debug-util.cc:398] Leaking SignalData structure 0x7b0800376bc0 after lost signal to thread 28632
I20260709 12:18:09.685184 29290 leader_election.cc:400] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:09.663792 30346 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:09.645175 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.693034 30346 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.693542 30346 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:09.694300 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.695142 28673 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:09.675444 28674 rpcz_store.cc:276] 0709 12:18:07.469496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.234202 (+1764706us) service_pool.cc:224] Handling call
0709 12:18:09.234466 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.234644 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:09.296819 (+ 62175us) log.cc:844] Serialized 14 byte log entry
0709 12:18:09.633053 (+336234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:09.633214 (+   161us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:09.633398 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.633580 (+   182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.633878 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97823,"prepare.queue_time_us":62188,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":130954,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":256,"thread_start_us":299453,"threads_started":2,"wal-append.queue_time_us":237985}
I20260709 12:18:09.699875 29290 leader_election.cc:403] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:09.699973 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.653577 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:09.692086 28536 debug-util.cc:398] Leaking SignalData structure 0x7b080039ed60 after lost signal to thread 28706
I20260709 12:18:09.646387 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:09.680081 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.713932 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.702549 30525 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:09.703763 28600 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:09.702142 30364 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.716666 30364 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.717319 28676 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:18:09.718077 28679 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.718348 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.719046 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.719523 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.719976 28679 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.640017 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:09.709659 30326 tablet_copy_client.cc:538] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:18:09.707545 28536 debug-util.cc:398] Leaking SignalData structure 0x7b080039ed80 after lost signal to thread 28707
W20260709 12:18:09.720988 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 81428.7us
W20260709 12:18:09.722265 28536 debug-util.cc:398] Leaking SignalData structure 0x7b080028fe60 after lost signal to thread 28780
I20260709 12:18:09.722429 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:09.723201 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:09.710460 30355 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.725044 30472 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:09.688252 28682 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:09.646395 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.720340 28676 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:09.711971 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.714799 30273 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.696271 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.648245 28752 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
W20260709 12:18:09.722772 28536 debug-util.cc:398] Leaking SignalData structure 0x7b0800355840 after lost signal to thread 28781
I20260709 12:18:09.727597 30467 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:09.728163 28605 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:09.728257 30467 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:09.730405 30409 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:09.728333 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.731151 30471 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.647104 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.725790 30472 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:09.732942 28677 raft_consensus.cc:2368] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3.
I20260709 12:18:09.732242 30409 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.734129 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.733681 30472 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.735167 28677 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.704293 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:09.736223 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:09.736764 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 90602.2us
I20260709 12:18:09.737107 28677 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:09.715726 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69778.4us
I20260709 12:18:09.709942 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:09.724192 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 2.27829e+06us
I20260709 12:18:09.729880 30467 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.737614 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.710978 28503 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 3 to 4, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 4 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:09.737630 30479 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:09.740648 30479 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:09.740736 30518 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.741168 30518 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.741555 30518 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.742666 30479 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.745002 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.748320 28681 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:09.737305 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:09.750126 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.752614 30424 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:09.753652 30424 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.756233 30493 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:09.757187 30493 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.758064 30458 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:09.758908 30458 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.761165 30424 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:09.761413 30458 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:09.758890 28503 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 3, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:09.764581 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.765606 28676 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.769469 30351 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.771643 30351 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.771548 30346 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.773021 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.751725 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.774006 30486 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:09.774556 30486 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:09.774716 28680 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.776809 30475 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:09.777423 30475 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:09.774022 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:09.775648 30486 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.779326 28720 leader_election.cc:400] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
W20260709 12:18:09.782200 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 72489us
I20260709 12:18:09.781507 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.785079 28678 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.781567 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.788486 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:09.787395 28573 connection.cc:256] RPC call timeout handler was delayed by -4.2868492699997205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260709 12:18:09.791778 30346 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:09.764143 28503 catalog_manager.cc:5697] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.801869 30364 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.804131 30364 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.803625 30475 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.804634 30525 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.805160 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.805718 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.806042 28676 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:18:09.806318 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.814914 30525 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.816015 28602 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:09.805207 30410 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.809669 30493 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.816627 30410 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:09.817122 30410 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.817673 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.818610 28677 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:09.820011 28677 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:09.810645 28536 debug-util.cc:398] Leaking SignalData structure 0x7b0800278f80 after lost signal to thread 29351
I20260709 12:18:09.810982 28674 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:09.796248 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:09.816351 30525 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.816246 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.822816 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.824568 28679 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:09.816649 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.828233 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.826810 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.831805 28682 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:09.829891 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 92739.1us
W20260709 12:18:09.820641 28536 debug-util.cc:398] Leaking SignalData structure 0x7b08003668a0 after lost signal to thread 29352
I20260709 12:18:09.812029 28503 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:09.815184 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:09.841961 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 92091.1us
I20260709 12:18:09.841235 30351 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.843815 30351 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.844318 30351 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.844954 28720 leader_election.cc:400] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:09.845367 28720 leader_election.cc:403] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:18:09.851935 28681 raft_consensus.cc:2368] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:09.848747 28680 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.852057 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:09.865144 30419 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:09.865679 30419 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.866014 30419 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:09.868877 28503 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.877056 28678 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:09.878337 28678 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:09.879447 30410 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.881472 28674 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:09.882722 28674 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:09.886536 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.887603 30463 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:09.888187 30463 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:09.888609 30493 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:09.889703 29290 leader_election.cc:336] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.144s (SENT)
W20260709 12:18:09.893004 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 100276us
I20260709 12:18:09.894560 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:09.895241 28681 raft_consensus.cc:2368] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5.
I20260709 12:18:09.852908 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.887621 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.882936 30518 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.892729 30472 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.938742 28676 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:09.889365 30463 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:09.894388 30355 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:09.954880 30355 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.942149 28601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:09.985985 28601 raft_consensus.cc:606] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:18:09.986465 28601 raft_consensus.cc:614] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:09.942956 30364 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.987895 30364 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.943257 30410 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.990147 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:09.943559 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.943971 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:09.945808 28573 connection.cc:256] RPC call timeout handler was delayed by -3.04442389299993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 12:18:09.991909 28573 connection.cc:256] RPC call timeout handler was delayed by -2.913023892999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 12:18:09.939368 30486 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:09.901453 28675 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:09.894053 30467 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:09.956773 30351 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:09.889417 30493 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.960744 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.964722 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.965605 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:09.966442 30518 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:09.967185 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:09.975345 30419 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:09.977564 28681 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:09.990352 30364 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:09.943431 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:09.992583 28680 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:09.992322 28573 connection.cc:256] RPC call timeout handler was delayed by -2.7492238929999075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 12:18:10.002089 28573 connection.cc:256] RPC call timeout handler was delayed by -2.7186238929998581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:18:10.002579 28573 connection.cc:256] RPC call timeout handler was delayed by -2.6529238929999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 12:18:10.002954 28573 connection.cc:256] RPC call timeout handler was delayed by -2.6043238929999006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 12:18:10.003324 28573 connection.cc:256] RPC call timeout handler was delayed by -1.7574238929998955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29960000000000003s for a response
I20260709 12:18:09.993304 28678 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:10.007121 29290 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.161s (SENT)
W20260709 12:18:10.010064 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45509.4us
I20260709 12:18:10.007725 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.013585 28677 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:10.016661 30326 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
W20260709 12:18:10.016690 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 73459us
I20260709 12:18:10.019660 30364 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:10.019935 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:10.020164 30364 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.020618 30364 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:10.021148 29323 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:10.024818 28748 raft_consensus.cc:2368] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:10.025794 30351 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:10.026443 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 59425.6us
I20260709 12:18:10.027622 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.028688 28571 leader_election.cc:400] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:10.028944 28571 leader_election.cc:403] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:18:10.030337 29290 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.030474 30493 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:10.031430 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.032528 30486 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:10.032773 30346 raft_consensus.cc:2764] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:10.007339 30467 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:10.033609 30486 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.034840 30457 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:10.035246 30457 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.035589 30457 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.040832 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.041149 28571 leader_election.cc:400] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:10.041481 28571 leader_election.cc:403] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:18:10.041600 28602 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:10.042294 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:10.042606 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.043365 28605 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.008219 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:10.044225 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.047391 30518 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:10.047843 30518 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:10.049765 28752 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:10.049714 30355 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:10.050266 30355 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:10.034368 30467 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.050802 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.051460 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:10.052130 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.052650 30318 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:10.053256 30318 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:10.053865 30409 raft_consensus.cc:2764] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:18:10.054637 30409 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:10.054325 30318 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.056198 30479 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:10.056751 28571 leader_election.cc:400] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:10.053328 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.057330 28571 leader_election.cc:403] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:18:10.040144 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:10.018419 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 166417us
I20260709 12:18:10.048259 30518 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:10.066648 28601 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.072789 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.050832 30355 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:10.058406 30295 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:10.077772 28752 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:10.082949 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.086201 30479 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:10.093557 30479 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.086072 28601 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:10.098299 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.098395 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.086663 28571 leader_election.cc:400] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5.
I20260709 12:18:10.099110 28571 leader_election.cc:403] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:18:10.082515 30459 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:10.082823 30351 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:10.105161 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.106700 28752 raft_consensus.cc:2368] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:10.106911 30472 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
W20260709 12:18:10.109899 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44952.6us
I20260709 12:18:10.111148 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.111883 28600 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:10.109588 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:10.113950 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.119532 30424 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5.
I20260709 12:18:10.120508 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:10.137498 28599 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.140837 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.145360 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.118193 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.149689 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.135761 30475 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:10.142732 30424 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:10.164647 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.168855 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.163041 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.160311 30424 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.170801 30424 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:10.171190 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 61694.6us
I20260709 12:18:10.172719 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:10.175823 28600 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:10.129310 30364 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:10.151042 30346 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:10.186450 28601 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.189462 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.189651 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.198203 28600 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
W20260709 12:18:10.199501 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 55493us
I20260709 12:18:10.177188 30475 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:18:10.200845 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58722.9us
I20260709 12:18:10.202391 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.200536 30295 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:10.204156 30538 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:10.204455 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.204748 30295 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:10.205226 28747 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:10.205956 30295 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.207166 28681 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:10.209643 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:18:10.210666 28605 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
W20260709 12:18:10.212462 30533 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:18:10.212775 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:10.213538 28676 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.214656 28673 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:10.220881 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.223124 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:10.201434 30351 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:10.224334 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:10.226313 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.226933 28747 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.226958 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.228616 29292 leader_election.cc:400] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:10.228960 29292 leader_election.cc:403] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:18:10.229188 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.229815 28750 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:10.230487 30534 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.231029 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.232476 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.228657 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.240584 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.241372 28755 raft_consensus.cc:2368] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:10.242848 30424 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.247996 30364 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:10.186535 30346 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:10.229746 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:10.195350 30459 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:18:10.194505 30419 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:10.251428 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.198443 28748 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.258145 28675 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:10.259334 28674 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:10.260845 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:10.261965 28601 raft_consensus.cc:2368] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
W20260709 12:18:10.262801 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58876.5us
I20260709 12:18:10.252769 30318 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:10.264997 30318 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:10.265976 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:10.266364 30535 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:10.266785 30535 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.267166 30532 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:10.267354 30479 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:10.267872 30479 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:18:10.269590 30536 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:18:10.192452 30518 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:10.254918 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 82259.7us
I20260709 12:18:10.275113 28752 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:10.271400 29290 leader_election.cc:336] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.210s (SENT)
I20260709 12:18:10.254520 30459 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:10.278353 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.280186 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.280817 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.281565 28605 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:10.281883 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.282083 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.282480 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:10.282694 28604 raft_consensus.cc:2368] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4.
I20260709 12:18:10.283576 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.284164 28753 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:10.284514 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.284814 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.285367 28756 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:10.285596 28602 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:10.282704 28603 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:10.286614 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.278347 30459 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:10.287343 28607 raft_consensus.cc:2368] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3.
I20260709 12:18:10.280884 28600 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:10.289276 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.287889 30459 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.252936 30346 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:10.267160 30535 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.266000 30318 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.298504 30518 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:10.299091 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.299431 30479 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.297276 28753 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:10.305955 28747 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:10.306180 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.194778 30525 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.290005 30424 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:10.317672 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.318555 28754 raft_consensus.cc:2368] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5.
I20260709 12:18:10.318821 28751 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.322544 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.325119 28755 raft_consensus.cc:2368] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:10.325521 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:10.260159 30457 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.305821 30458 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:10.328383 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.330000 28756 raft_consensus.cc:2368] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
W20260709 12:18:10.330082 30542 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:18:10.328591 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.331005 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:10.324107 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.329095 28750 raft_consensus.cc:2368] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
W20260709 12:18:10.328958 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 74312.9us
I20260709 12:18:10.332556 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.345394 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.246834 30351 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.357061 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.358820 28751 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:10.296159 30409 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:18:10.360536 28754 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:10.329073 30459 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:10.362351 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 66048.8us
I20260709 12:18:10.330093 30458 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:10.364041 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.335247 30364 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:10.379107 30486 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:10.379575 30418 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:10.382766 30534 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:10.383489 28600 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:10.366233 28755 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:10.404713 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.405421 28601 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
W20260709 12:18:10.388209 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45841.2us
I20260709 12:18:10.405918 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:10.413573 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.366918 30458 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:10.388607 30486 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:10.414582 30460 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:10.427726 30460 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:10.428140 30460 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:10.420029 30493 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:10.426486 30364 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:10.427073 30486 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:10.364517 30475 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:10.448726 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 68363.4us
I20260709 12:18:10.448612 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.449839 28601 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.456454 29323 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:10.446619 30493 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:10.464224 28755 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:10.472615 28674 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:10.474468 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:10.479447 28677 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.457336 30355 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.473347 29322 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:10.489075 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:10.493134 30543 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 12:18:10.493331 29317 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:10.485056 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.505415 28603 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:10.505875 28603 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:10.507352 30544 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:10.507812 30544 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:10.508219 30544 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:10.511058 28720 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:10.512014 28720 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 3.302s (SENT) [suppressed 103 similar messages]
I20260709 12:18:10.512843 30471 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:10.513263 30471 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.513598 30471 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:10.482045 30458 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:10.514667 28748 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:10.515106 30458 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:10.482208 30525 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:10.516889 30493 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.521633 30355 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:10.522684 29320 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:10.523550 28598 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:10.542569 29292 connection.cc:256] RPC call timeout handler was delayed by -1.158957203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 12:18:10.543205 29292 connection.cc:256] RPC call timeout handler was delayed by -1.0537788130000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 12:18:10.543686 29292 connection.cc:256] RPC call timeout handler was delayed by -1.0375788129999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:18:10.550799 29292 leader_election.cc:336] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.649s (SENT)
W20260709 12:18:10.558270 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 143752us
W20260709 12:18:10.568723 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70117.5us
I20260709 12:18:10.570930 28573 leader_election.cc:400] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
W20260709 12:18:10.571750 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 59776.1us
I20260709 12:18:10.572847 30418 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:10.576205 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.577296 30472 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:10.581332 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.585435 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.587868 28601 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:10.598958 30535 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.601789 30535 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:10.599768 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.605310 30486 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.607532 30486 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:10.588647 30355 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:10.621141 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.622895 28598 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:10.623306 28677 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:10.624073 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47961.7us
W20260709 12:18:10.624835 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 64687.6us
I20260709 12:18:10.625669 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.625779 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:10.626267 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.626833 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.627380 30535 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:10.627408 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:10.627851 28573 leader_election.cc:400] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:10.627869 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.632112 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:10.633014 29317 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:10.634877 30295 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:10.636256 30555 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:10.632133 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 85819.2us
I20260709 12:18:10.636777 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:10.637770 29292 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.665s (SENT)
I20260709 12:18:10.636765 30555 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:10.641379 30555 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.638314 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:10.649201 28677 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:10.652693 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.629829 30561 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.679011 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.680697 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:10.681553 28600 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.636777 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:10.607931 30544 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:10.685510 29292 leader_election.cc:336] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.671s (SENT)
W20260709 12:18:10.686208 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58863.8us
I20260709 12:18:10.642820 30475 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:10.649001 30364 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:10.705515 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 71268.8us
I20260709 12:18:10.655253 30525 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:10.711869 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 84174.1us
I20260709 12:18:10.642132 30471 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:10.713841 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62034.3us
I20260709 12:18:10.709710 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.715862 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.716929 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:10.716080 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:10.688933 30535 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:10.719072 28674 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.716872 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:10.705060 30364 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:10.721011 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:10.706601 30472 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:10.726776 28678 raft_consensus.cc:2368] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 6.
I20260709 12:18:10.723336 28682 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.629177 30418 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.724550 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:10.775594 28681 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.776154 30525 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:10.777453 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:10.779071 30424 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:10.779359 30467 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:10.779634 30424 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:10.779774 30467 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:10.780169 30467 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:10.781517 30548 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.279s	user 0.008s	sys 0.007s
I20260709 12:18:10.781840 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:10.782611 28604 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:10.783339 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.718870 30535 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:10.744721 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 59252.2us
I20260709 12:18:10.728518 28675 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:10.729303 28673 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:10.772303 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 65559.1us
I20260709 12:18:10.713560 30355 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:10.724960 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.793920 28600 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:10.799314 28749 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:10.799700 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.800486 28751 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:10.800336 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.801148 28756 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:10.801338 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:10.801470 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.795238 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:10.802093 28747 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:10.802521 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.803700 28755 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:10.804817 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:18:10.805091 29292 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.693s (SENT)
I20260709 12:18:10.805755 28604 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:10.806025 28600 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:18:10.807430 28601 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:10.726044 30364 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:10.719342 30518 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:18:10.811554 28754 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:10.796156 30459 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:10.795648 30535 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.810289 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.810261 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:10.781517 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:10.812199 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.813283 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.813977 28750 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:10.807116 30532 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:18:10.830610 30561 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:10.783917 30346 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.827991 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.814731 30459 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:10.844388 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 120419us
W20260709 12:18:10.845031 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 137220us
I20260709 12:18:10.847473 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.797740 30460 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.856653 28680 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:10.848168 30459 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.845147 30419 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:18:10.864674 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 142858us
I20260709 12:18:10.865299 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.869421 28605 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:10.811437 30424 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.873277 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.870775 29317 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:10.875051 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70380.8us
I20260709 12:18:10.862493 30410 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:18:10.877219 30410 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:10.877803 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.878386 28603 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.878816 30410 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:10.879650 28603 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.879982 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:10.880738 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.889176 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.889983 28605 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:10.893664 30460 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:10.879902 30410 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:10.868633 30419 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:18:10.882447 30558 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
I20260709 12:18:10.885138 30472 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:10.898837 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93764.8us
I20260709 12:18:10.862808 30493 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:18:10.900748 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.886629 30532 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:18:10.902586 29292 leader_election.cc:336] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.732s (SENT)
I20260709 12:18:10.901993 30569 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:10.918992 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.923450 28605 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:10.898926 30472 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:10.925963 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.926250 28573 leader_election.cc:400] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:10.926625 28606 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:10.932505 30472 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.918443 30471 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:10.903378 30532 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:10.902101 30567 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:10.941143 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.938117 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:10.946766 30576 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:10.947309 30580 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:10.949393 30576 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:10.949844 30576 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:10.950947 30576 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.926836 30410 raft_consensus.cc:2764] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:18:10.924712 30569 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:10.959837 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:10.964829 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 63721.2us
I20260709 12:18:10.924288 30467 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:10.937124 30471 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:18:10.960891 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 65556.7us
I20260709 12:18:10.960891 30493 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:10.956979 30419 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:10.974220 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:10.978528 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.979996 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.963137 30569 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:10.987749 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:10.988480 28606 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 1.
I20260709 12:18:10.954668 30570 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:18:10.985128 30457 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:10.986231 29317 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:10.979869 30346 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:10.996497 30571 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:11.000720 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:11.002866 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.004356 28573 leader_election.cc:400] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5.
I20260709 12:18:11.003073 28606 raft_consensus.cc:2376] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4. Re-sending same reply.
I20260709 12:18:11.011657 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:11.007560 30535 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.015682 30535 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:11.021425 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.002883 30571 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:11.026865 28573 leader_election.cc:400] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:11.027295 28573 leader_election.cc:403] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:18:11.008641 30419 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:11.041905 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 150187us
I20260709 12:18:11.026198 30457 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:11.070389 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.106056 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:11.111057 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 89998.1us
I20260709 12:18:11.112985 28573 leader_election.cc:400] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:11.115289 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:11.117204 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.117575 29327 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:11.118764 30535 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.003135 30532 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.122066 28647 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:11.124567 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 242217us
I20260709 12:18:11.125185 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:11.126405 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:11.127166 28674 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:11.042716 30318 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.128578 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.129642 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.132802 28573 leader_election.cc:400] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:11.133569 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.053329 30460 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:11.111006 28603 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:11.134833 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:11.134312 28605 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4.
I20260709 12:18:11.027876 30575 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.196s
I20260709 12:18:11.140305 28602 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:11.127820 30463 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.142117 30590 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.143504 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.145399 28720 leader_election.cc:400] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 6.
I20260709 12:18:11.145929 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.148263 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.161250 28600 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:11.148974 30535 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:11.150703 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.102874 30467 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:11.156677 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:11.157232 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:11.140336 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.127702 30457 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:11.134291 30318 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.158432 30346 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:11.169498 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:11.178934 30555 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 12:18:11.178153 30364 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:11.179056 30318 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:11.179383 30555 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:11.181630 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 349383us
W20260709 12:18:11.184792 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.160274 28720 leader_election.cc:403] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:18:11.132419 30571 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.187659 30579 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.188424 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.188643 28599 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:11.198690 28605 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:11.188203 30457 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.189061 30460 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:11.155577 30486 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.189348 30569 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.178346 30588 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:11.191237 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.178396 29327 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.177080 30532 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:11.205855 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62591.2us
I20260709 12:18:11.204380 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:11.199726 29323 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:11.203531 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.203725 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:11.210525 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:11.211194 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:11.211585 30579 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.212962 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:11.221962 28752 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:11.213709 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:11.214596 28756 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:11.222822 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.202289 30588 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:11.215096 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:11.177068 29317 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:11.222204 28754 raft_consensus.cc:2376] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3. Re-sending same reply.
I20260709 12:18:11.198004 30364 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:11.240383 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.226948 30467 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:18:11.244128 29327 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.245625 30584 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:11.246199 30584 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:11.247107 30584 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:11.248260 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.249256 28753 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:11.254851 28748 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:11.256731 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:11.257776 30571 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:11.260812 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:11.262118 28747 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:11.200520 30535 consensus_queue.cc:1243] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:18:11.264011 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.209400 30346 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:11.268334 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:11.272181 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:11.272800 28678 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:11.215421 30460 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:11.221426 30575 consensus_queue.cc:1243] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:11.222474 30463 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:11.275242 29292 leader_election.cc:336] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.863s (SENT)
I20260709 12:18:11.276577 28681 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:11.277097 28674 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:11.277361 29327 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:11.277801 28752 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:11.283028 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:11.279632 28648 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.510s (SENT)
I20260709 12:18:11.285547 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:11.220167 30570 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 6.
I20260709 12:18:11.279466 29322 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.294552 28753 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:11.303926 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.304847 29327 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.275972 30418 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:11.308497 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.312901 28750 raft_consensus.cc:2368] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
W20260709 12:18:11.297899 29292 leader_election.cc:336] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.887s (SENT)
I20260709 12:18:11.314073 28674 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:11.320513 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.321924 28752 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:11.323609 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.323875 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.325593 28605 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:11.326736 29323 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.281150 30493 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:18:11.310802 30418 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:11.328495 29327 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.309295 30463 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:11.341702 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.342489 29325 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.341950 30463 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:11.343318 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.344035 29325 raft_consensus.cc:2368] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
W20260709 12:18:11.335407 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 65216.9us
I20260709 12:18:11.323807 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:11.336023 30419 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.336247 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.363780 29323 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.326581 30458 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:11.338369 30556 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.748s	user 0.002s	sys 0.000s
I20260709 12:18:11.355088 29327 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:11.355036 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.362366 28753 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
W20260709 12:18:11.365800 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 103697us
I20260709 12:18:11.367942 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.371996 28605 raft_consensus.cc:2376] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5. Re-sending same reply.
I20260709 12:18:11.334318 28675 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:11.375075 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:11.368394 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70541.6us
I20260709 12:18:11.334697 30418 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:11.373669 28752 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:18:11.333828 30555 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:11.377748 29292 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.905s (SENT)
I20260709 12:18:11.377156 30458 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:11.304489 30460 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.379105 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:11.376868 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:11.385470 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.388652 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.394155 29321 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.395048 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:11.390429 28648 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.648s (SENT)
I20260709 12:18:11.396381 29323 raft_consensus.cc:2376] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3. Re-sending same reply.
I20260709 12:18:11.395558 29325 raft_consensus.cc:2376] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4. Re-sending same reply.
I20260709 12:18:11.399106 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.400736 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:11.407565 28752 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:11.393630 30457 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:11.410952 28753 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:11.376479 30459 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.373323 30472 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:11.413918 29292 leader_election.cc:336] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.992s (SENT)
I20260709 12:18:11.414420 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.414810 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.415091 29323 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.372879 30346 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:11.417776 28722 leader_election.cc:336] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.715s (SENT)
I20260709 12:18:11.418545 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.410059 30581 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:11.422047 28756 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:11.423118 30472 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:11.424095 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.424309 28753 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:11.425411 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.425652 28753 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:11.426033 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.426769 28599 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:11.427619 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.429018 30418 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:11.429258 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:11.442152 29292 leader_election.cc:336] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.054s (SENT)
I20260709 12:18:11.430150 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.418495 30419 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.408730 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.431154 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:11.432619 30471 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:11.433964 28722 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.962s (SENT)
I20260709 12:18:11.448944 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.434973 28752 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:11.437258 28598 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:11.412343 30457 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:11.426195 28603 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.443095 28599 raft_consensus.cc:2376] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6. Re-sending same reply.
I20260709 12:18:11.417578 30569 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:11.443857 28749 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:11.413771 30579 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:11.445291 28604 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:18:11.435092 30581 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:11.463156 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:11.462251 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.463409 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:11.462922 28675 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:11.462792 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.457645 29322 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:11.461934 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.468178 29323 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:11.456938 30457 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.473012 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.474399 28604 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:11.477596 30585 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.341s	user 0.001s	sys 0.002s
I20260709 12:18:11.464607 30571 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.466063 30581 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.481298 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.482354 28677 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:11.480118 29292 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.101s (SENT)
I20260709 12:18:11.486685 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.490267 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.490957 29318 raft_consensus.cc:2376] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3. Re-sending same reply.
I20260709 12:18:11.491315 30472 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:11.491448 30590 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:11.492622 30472 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:11.493244 30590 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:11.493687 30590 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:11.494577 30590 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.496162 30590 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:11.498863 30579 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:11.499919 30579 consensus_queue.cc:1243] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:11.503389 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:11.504385 29318 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:11.505817 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:11.507076 29318 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 2: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:11.509349 29318 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:11.512027 30419 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.512708 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:11.513813 29292 leader_election.cc:336] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.144s (SENT)
I20260709 12:18:11.515726 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.516760 30419 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.517481 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:11.518407 29292 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.161s (SENT)
I20260709 12:18:11.519002 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.519003 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.521206 28604 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:11.514362 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:11.522012 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 108114us
I20260709 12:18:11.515096 29323 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:11.481042 30573 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:11.528187 28678 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
W20260709 12:18:11.532024 28647 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:11.532665 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:11.532732 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.535996 28604 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:18:11.535493 30544 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:11.550173 28604 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:11.533703 28648 leader_election.cc:336] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.756s (SENT)
W20260709 12:18:11.557580 29292 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.185s (SENT)
I20260709 12:18:11.558230 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.558425 28604 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:11.565560 28599 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:11.565725 30418 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:11.567330 28599 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:11.570264 30355 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:11.570811 30355 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:11.563526 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.572978 30424 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:11.573303 30471 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:11.573514 30424 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:11.573755 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.574975 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:11.533329 30592 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.579272 30573 raft_consensus.cc:2764] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:11.579344 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.580555 30573 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:11.561973 30584 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:11.574725 30424 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:11.581481 30584 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:11.581521 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 47869us
I20260709 12:18:11.582082 30584 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:11.583037 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44399us
I20260709 12:18:11.544008 28748 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:11.583434 30419 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.586627 28604 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:11.587230 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:11.587797 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1543) took 1083 ms. Trace:
I20260709 12:18:11.593551 28602 rpcz_store.cc:276] 0709 12:18:10.501337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.502107 (+   770us) service_pool.cc:224] Handling call
0709 12:18:10.502461 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:11.158215 (+655754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.584035 (+425820us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b5400216454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:11.584209 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466274688}
I20260709 12:18:11.577287 30471 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.607954 30580 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:18:11.612834 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 55302.8us
I20260709 12:18:11.624672 28682 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:11.625083 29292 leader_election.cc:336] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.210s (SENT)
I20260709 12:18:11.618709 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:11.605028 28648 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.001s (SENT)
W20260709 12:18:11.628075 28572 leader_election.cc:336] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.912s (SENT)
I20260709 12:18:11.626546 30580 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:11.560076 30346 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:18:11.630180 30580 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.634410 28681 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:11.635428 28648 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.571931 30355 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.639336 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:11.642021 29292 leader_election.cc:336] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.249s (SENT)
I20260709 12:18:11.647703 29326 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:11.648088 29326 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:11.647583 30471 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:11.650915 30471 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:11.651302 30471 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:11.654124 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.654686 28605 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:11.651237 29326 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.657837 28747 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:11.657826 29326 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.658684 30460 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:11.668567 30518 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.669608 30419 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.669925 28605 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:11.645277 30463 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.676275 28722 leader_election.cc:400] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4.
I20260709 12:18:11.676803 28722 leader_election.cc:403] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:11.638492 30457 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:11.682052 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77044.3us
I20260709 12:18:11.685207 29326 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:11.682726 30355 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:11.757279 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.759357 30326 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:11.790690 28603 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:11.793131 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 118435us
I20260709 12:18:11.792552 30326 tablet_bootstrap.cc:492] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
W20260709 12:18:11.793917 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.795192 30588 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.795764 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:11.796563 30463 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.797013 30463 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:11.799019 30463 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:11.799533 30463 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:11.799849 30463 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:11.800185 30463 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.705132 30573 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4.
I20260709 12:18:11.793951 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:11.820271 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 146007us
W20260709 12:18:11.820878 29292 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 3.089s (SENT)
I20260709 12:18:11.813176 30351 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:11.826696 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.820098 30588 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.829304 28505 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:11.830637 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.831112 28505 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 4, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:11.831821 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:11.832166 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.834251 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:11.829351 28503 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 331) took 9044 ms. Trace:
I20260709 12:18:11.821247 30571 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:11.839762 30571 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:11.832561 30479 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.837869 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:11.838208 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.832573 30346 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.845793 28572 leader_election.cc:400] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
I20260709 12:18:11.852648 28505 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 2, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 2 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:11.872768 28572 leader_election.cc:403] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:18:11.837786 30568 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:11.844853 30571 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:11.844350 30555 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.877928 30295 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:11.862978 30573 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.848838 30409 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:18:11.891844 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:11.898816 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77126.1us
I20260709 12:18:11.845129 30351 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:11.878756 30584 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:11.906719 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 79425.3us
I20260709 12:18:11.900220 30460 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4.
W20260709 12:18:11.908701 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 66758.7us
I20260709 12:18:11.896761 30544 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:11.886135 30555 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.836181 28503 rpcz_store.cc:276] 0709 12:18:02.777023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.777146 (+   123us) service_pool.cc:224] Handling call
0709 12:18:11.821180 (+9044034us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:10.193293 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:10.214540 (+ 21247us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:10.214592 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:18:10.214629 (+    37us) tablet.cc:662] Decoding operations
0709 12:18:10.215447 (+   818us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:10.215529 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:10.215554 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:18:10.216268 (+   714us) tablet.cc:701] Row locks acquired
0709 12:18:10.216300 (+    32us) write_op.cc:260] PREPARE: finished
0709 12:18:10.257020 (+ 40720us) write_op.cc:270] Start()
0709 12:18:10.297564 (+ 40544us) write_op.cc:276] Timestamp: P: 1783599490216425 usec, L: 0
0709 12:18:10.297607 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:18:10.298311 (+   704us) log.cc:844] Serialized 2154 byte log entry
0709 12:18:10.617663 (+319352us) op_driver.cc:464] REPLICATION: finished
0709 12:18:10.723676 (+106013us) write_op.cc:301] APPLY: starting
0709 12:18:10.723778 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:10.723968 (+   190us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:10.724110 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:10.821866 (+ 97756us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:10.872271 (+ 50405us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:18:10.884771 (+ 12500us) write_op.cc:312] APPLY: finished
0709 12:18:10.892692 (+  7921us) log.cc:844] Serialized 47 byte log entry
0709 12:18:10.892904 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:10.893019 (+   115us) write_op.cc:454] Released schema lock
0709 12:18:10.893081 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:10.893529 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:10.893562 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":105690,"apply.run_cpu_time_us":5964,"apply.run_wall_time_us":169815,"num_ops":5,"prepare.queue_time_us":94022,"prepare.run_cpu_time_us":33620,"prepare.run_wall_time_us":179287,"raft.queue_time_us":115466,"raft.run_cpu_time_us":35167,"raft.run_wall_time_us":96015,"replication_time_us":319868,"thread_start_us":266663,"threads_started":4,"wal-append.queue_time_us":171548,"wal-append.run_cpu_time_us":20997,"wal-append.run_wall_time_us":1433155}]]}
I20260709 12:18:11.915282 28722 leader_election.cc:400] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
I20260709 12:18:11.915560 28722 leader_election.cc:403] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:11.918372 30584 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:11.919646 28673 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:11.891423 30573 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:11.911087 30457 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:11.923974 30467 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
I20260709 12:18:11.925261 30471 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:11.932605 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:11.933127 30576 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:11.936750 30471 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:11.941968 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.946235 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.948596 28680 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:11.890538 30568 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:11.951996 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:11.950184 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:11.954370 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.955476 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:11.920825 30355 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:18:11.958288 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:11.959591 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:11.960198 28755 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:11.944849 30493 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:11.961673 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.948028 30409 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:18:11.966143 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:11.951808 30584 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.956429 30518 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.969695 30355 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:11.964991 30419 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:11.957319 30592 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.927448 30580 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:11.947012 30581 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.982000 30581 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:11.982391 30458 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:11.991683 30458 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.988695 28754 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:11.995023 30409 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:11.995927 30621 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:11.996317 30621 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:11.988938 30617 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:18:11.971993 30318 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:12.004964 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:12.005412 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60384.2us
I20260709 12:18:11.991118 30459 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:11.986253 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.006290 29327 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3. Re-sending same reply.
I20260709 12:18:11.971593 30555 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:12.008718 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.008738 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.009708 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.009912 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.010144 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.010535 28600 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:12.000473 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.008114 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.012244 28602 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:11.976404 30457 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:12.005185 30364 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:18:12.008379 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.009428 30621 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:11.969081 30471 raft_consensus.cc:2764] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:18:12.008106 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.008244 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.014467 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:11.977443 30355 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:12.022502 28599 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:12.021238 29326 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:11.971050 30618 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:18:12.018460 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.011154 28603 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:12.020126 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.022235 28679 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:12.014067 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:12.025748 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.047147 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.027170 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.048660 29326 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:12.049639 30568 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.050768 30460 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:12.050980 30580 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:12.051060 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.051900 28679 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:12.032722 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.052778 28604 raft_consensus.cc:2376] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5. Re-sending same reply.
I20260709 12:18:12.053046 28602 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:12.053671 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.054214 28604 raft_consensus.cc:2376] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4. Re-sending same reply.
I20260709 12:18:12.054280 28602 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:12.055202 28604 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:12.056095 30568 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.056581 30568 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.017659 30623 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:18:12.058295 30532 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:12.029913 30571 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.039798 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 244) took 1319 ms. Trace:
I20260709 12:18:12.032899 29317 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:12.059350 28598 rpcz_store.cc:276] 0709 12:18:10.720680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.720821 (+   141us) service_pool.cc:224] Handling call
0709 12:18:12.039581 (+1318760us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54002c0e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:12.039717 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469955328}
I20260709 12:18:12.040561 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 544) took 1158 ms. Trace:
I20260709 12:18:12.027951 30409 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:12.015208 30457 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:12.042007 30573 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:12.042986 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:11.996842 30584 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:12.036316 29323 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:12.080473 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.032812 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.051820 30460 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:12.058879 30532 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:18:12.061175 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48943.5us
W20260709 12:18:12.058324 30619 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:18:12.039297 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.040961 30621 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:11.996312 30458 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.062485 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:12.062844 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48860.8us
I20260709 12:18:12.041635 30525 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:12.066390 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.068262 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.014803 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.016855 30486 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:18:12.024375 30351 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.035465 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.109612 30479 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:18:12.110093 30622 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:18:12.070504 30457 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:12.109853 30355 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.111006 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.129223 29323 raft_consensus.cc:2376] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4. Re-sending same reply.
I20260709 12:18:12.105414 30525 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:12.070222 30346 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:12.067353 30581 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.120663 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.110242 30318 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:12.090378 30566 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:12.095693 30467 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.095525 30590 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.131088 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.142030 29327 raft_consensus.cc:2376] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3. Re-sending same reply.
I20260709 12:18:12.070242 30409 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.095263 30460 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:12.136336 29318 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:12.132696 30571 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:12.145180 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.130803 30618 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:12.144230 29322 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:12.150048 29323 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:12.127300 30364 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:18:12.152262 30624 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:18:12.145262 30590 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.160885 30525 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.160286 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.162330 30525 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.162343 29323 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:12.163718 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.168978 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1502) took 1459 ms. Trace:
I20260709 12:18:12.169374 28677 rpcz_store.cc:276] 0709 12:18:10.709279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.709416 (+   137us) service_pool.cc:224] Handling call
0709 12:18:11.482180 (+772764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:11.482736 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.168757 (+686021us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b540001f4d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:12.168889 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750515968}
I20260709 12:18:12.170771 28748 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:12.172607 28605 raft_consensus.cc:2410] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:12.141914 30566 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:12.175112 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.176805 30409 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.176707 30618 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.153065 30584 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:18:12.179221 30618 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:12.164870 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.186750 29320 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:12.186621 30532 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.151736 30568 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.188098 30577 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:12.188509 30577 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:12.189179 30590 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:12.149838 30573 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.189371 30577 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.191962 30577 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.143342 30467 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.175114 30566 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:12.193989 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 484) took 1031 ms. Trace:
I20260709 12:18:12.194587 30467 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:12.195429 29326 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:12.195966 29317 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:12.165798 30326 ts_tablet_manager.cc:1403] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 2.150s	user 0.042s	sys 0.030s
I20260709 12:18:12.194631 29325 rpcz_store.cc:276] 0709 12:18:11.162719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.406945 (+244226us) service_pool.cc:224] Handling call
0709 12:18:12.193209 (+786264us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:12.193403 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.193650 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.193675 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:12.193736 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:12.193771 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.193825 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.193923 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3895040}
I20260709 12:18:12.185792 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:12.199549 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49212us
I20260709 12:18:12.137265 30351 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:18:12.212355 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.215623 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.207700 30351 consensus_queue.cc:1243] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:18:12.218215 30460 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.219101 30458 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.219617 30460 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:12.220264 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:12.220772 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.221342 29318 raft_consensus.cc:2376] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3. Re-sending same reply.
I20260709 12:18:12.221414 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.223132 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.224305 30424 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:12.224692 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.225592 29326 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3. Re-sending same reply.
W20260709 12:18:12.227695 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.228922 30567 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:18:12.250017 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:12.250851 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.224799 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.227169 29326 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:12.254007 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 43691.3us
W20260709 12:18:12.253949 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46850.3us
I20260709 12:18:12.256263 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.252089 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:12.060463 29319 rpcz_store.cc:276] 0709 12:18:10.881882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.889644 (+  7762us) service_pool.cc:224] Handling call
0709 12:18:10.894024 (+  4380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:10.983661 (+ 89637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:10.986308 (+  2647us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:11.042150 (+ 55842us) log.cc:844] Serialized 26 byte log entry
0709 12:18:11.329701 (+287551us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:11.332371 (+  2670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.358980 (+ 26609us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.037162 (+678182us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b5400784220. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f4dbe 00007f6fe39ff930 00007f6fe39ff8d8 00007f6fe39ff858 00007f6fe39ff813 00007f6fe39fea9c 00007f6fe98ea2f6 00007f6fe98e4aa8 00007f6fe3a3b7cb 00007f6fe3a3e2c0
0709 12:18:12.040111 (+  2949us) raft_consensus.cc:1685] finished
0709 12:18:12.040138 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.040355 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78845,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":6004992,"thread_start_us":341163,"threads_started":2,"wal-append.queue_time_us":277450}
I20260709 12:18:12.257288 30534 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.260468 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:12.258307 30628 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:12.262571 29317 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:12.262485 30458 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:12.229123 30621 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:12.267511 29322 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:12.282200 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.283393 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.283783 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.302352 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.290470 28573 leader_election.cc:400] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
W20260709 12:18:12.290274 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 152191us
I20260709 12:18:12.292713 29325 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:12.293131 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.296036 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.297394 30572 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:12.268424 30566 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:12.298286 30621 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.317915 30621 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:12.288153 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.320073 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.303215 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.322961 29326 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:12.304387 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:12.304121 28678 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:12.278491 30567 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.314911 30572 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:12.325516 28678 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:12.342161 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.345175 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.345175 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.297442 29320 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:12.356320 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51986.8us
I20260709 12:18:12.359412 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:12.355569 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:12.364331 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 73978.4us
I20260709 12:18:12.364687 30355 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:12.365262 30355 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:12.366119 29319 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEARNER]: Advancing to term 6
I20260709 12:18:12.366266 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.304009 30486 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:18:12.369241 28681 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:12.369407 30572 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.370080 29326 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:12.370931 30572 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:12.371174 30479 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:12.376384 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:12.313449 30579 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.381448 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.387763 30551 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.390089 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:12.345708 30592 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.300359 30624 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:18:12.414808 30471 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.415091 29321 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:12.415539 30471 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:12.416550 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.417085 30364 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:12.418023 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.418654 29327 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:12.419497 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.405200 30459 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:12.420675 30459 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:12.422830 30463 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.621s	user 0.007s	sys 0.005s
W20260709 12:18:12.423611 30627 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:18:12.423367 30459 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.379887 30566 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.378230 30573 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.395780 30590 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:12.425299 30573 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.410192 30633 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:12.429214 30573 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:12.409631 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 68513.4us
I20260709 12:18:12.430243 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.432544 28748 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:12.432314 30631 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.433089 28754 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:12.311288 30457 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.372857 30424 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 12:18:12.417452 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.429287 30633 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:12.434527 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.435014 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:12.437594 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.378767 30618 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.385244 30486 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:12.392896 30346 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:12.444839 30346 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:12.445957 30457 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:12.445822 30346 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.444080 28601 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:12.395196 29318 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:12.392352 30568 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:12.450711 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60697.4us
I20260709 12:18:12.458709 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:12.456979 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.451583 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:12.456506 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 114454us
I20260709 12:18:12.389118 30544 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:18:12.468842 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:12.442914 30633 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:12.366114 30355 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.456562 30566 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:12.471629 28752 pending_rounds.cc:85] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 2
I20260709 12:18:12.478762 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:12.388877 30326 raft_consensus.cc:359] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:12.457630 30592 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.423341 30463 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.501870 28674 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:12.502869 30463 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:12.491128 28750 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:12.503491 30525 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:12.457667 30590 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:12.388288 30551 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.461077 30534 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:12.450098 30618 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.507171 28752 pending_rounds.cc:107] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:18:12.538508 28752 raft_consensus.cc:2889] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.497800 30566 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:12.505901 30621 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:12.489462 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:12.508407 30457 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.505570 30641 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:12.505970 30326 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:18:12.470314 30568 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:12.501173 30592 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.537861 30590 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:12.537240 30569 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:12.546727 30566 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:12.545845 30621 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:12.521363 30458 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:18:12.538136 30555 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:12.547899 30493 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.537968 30459 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 12:18:12.591089 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.592408 30419 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.593983 30621 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:12.595055 30629 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.540086 30534 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.594321 30569 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.618175 30590 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.642313 30618 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.601699 30493 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.656261 30625 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.629361 30419 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.663010 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.665573 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.667306 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.668807 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.672883 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.600653 30326 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:12.675239 28599 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:12.675532 28680 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:12.676843 28606 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:12.655969 30471 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:12.674044 28748 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:12.681259 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.681318 30629 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:12.683542 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.683717 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.684231 28600 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.689404 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.689673 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:12.694429 28607 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:12.716537 30326 ts_tablet_manager.cc:1434] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.510s	user 0.010s	sys 0.013s
W20260709 12:18:12.716981 30326 ts_tablet_manager.cc:1467] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Tablet startup took 512ms
W20260709 12:18:12.717334 30326 ts_tablet_manager.cc:1469] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Trace:
0709 12:18:00.569790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.578683 (+  8893us) service_pool.cc:224] Handling call
0709 12:18:00.829282 (+250599us) ts_tablet_manager.cc:934] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
0709 12:18:01.879676 (+1050394us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:02.149145 (+269469us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:02.159519 (+ 10374us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:02.352122 (+192603us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:02.361915 (+  9793us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:02.362268 (+   353us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:02.362333 (+    65us) inbound_call.cc:177] Queueing success response
0709 12:18:02.996863 (+634530us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4c004ed500. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe1d4ba20 00007f6fe1d5ca29 00007f6fe1d015e6 00007f6fe1d16b13 00007f6fe1d16945 00007f6fe1d897ad 00007f6fe8a5d198 00007f6fe8a5d137 00007f6fe8a5d09c 00007f6fe8a5d038 00007f6fe8a5c300
0709 12:18:10.015770 (+7018907us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:18:12.229666 (+2213896us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:18:12.309786 (+ 80120us) tablet_replica.cc:261] Starting instrumentation
0709 12:18:12.310523 (+   737us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":313,"spinlock_wait_cycles":49048832,"tablet-copy.queue_time_us":117827,"tablet-download-pool.queue_time_us":15838,"tablet-download-pool.run_cpu_time_us":5389,"tablet-download-pool.run_wall_time_us":6584323,"thread_start_us":135217,"threads_started":3}
I20260709 12:18:12.724014 28605 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:12.656870 30625 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.727718 28605 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:12.728598 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 337308us
I20260709 12:18:12.694883 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.735311 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.742908 28600 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:12.697211 30551 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.745188 28600 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:12.751379 30662 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:12.752645 28603 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:12.754668 30623 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:12.758724 30653 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:18:12.762472 30493 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.761417 30419 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:12.778802 28648 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.199s (SENT)
I20260709 12:18:12.792629 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.756745 30629 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.744129 30568 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.761471 30569 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.782824 29319 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:18:12.829077 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50333.6us
W20260709 12:18:12.818466 30577 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.004s
I20260709 12:18:12.801800 30551 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.834457 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:12.844673 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 396057us
W20260709 12:18:12.846041 28648 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.426s (SENT)
I20260709 12:18:12.846489 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:12.848156 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 81805.5us
I20260709 12:18:12.848943 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.845649 28674 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:12.853108 30463 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:12.792899 30623 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.860239 29326 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:12.861974 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-3be2bcd2a3b04c82bbf14413a7011c12 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:18:12.862643 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-3be2bcd2a3b04c82bbf14413a7011c12 on tablet 3be2bcd2a3b04c82bbf14413a7011c12 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:12.778623 30662 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:12.866474 30666 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:18:12.867283 30573 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:12.868028 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.855239 30544 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.871006 30534 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:12.873026 30638 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.463s	user 0.003s	sys 0.000s
I20260709 12:18:12.873123 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:12.891120 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:12.879822 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.891937 28678 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:12.868372 30629 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:18:12.884747 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44842.6us
I20260709 12:18:12.892787 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:12.867340 30667 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:18:12.887037 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:12.889353 30674 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.897486 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.898128 29327 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:12.898087 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:12.899151 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.900264 29327 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:12.900651 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:12.901202 28755 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:12.901856 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:12.905836 29327 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:12.893000 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:12.907426 28756 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:12.908144 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.894132 30590 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.913584 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:12.913631 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.894147 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:12.920972 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:12.924955 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.888803 30633 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.928531 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.923645 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:12.929546 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:12.933544 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:12.930013 30654 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:12.934798 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:12.923650 30644 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:18:12.936652 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:12.932688 30648 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.941361 28755 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:12.942593 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:12.928114 30364 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.930661 30486 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:12.947947 30658 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:12.928263 30625 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.948989 30645 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:12.949515 30645 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:12.949949 30645 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:12.949163 30681 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:12.947091 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:12.954643 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:12.953991 30662 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:12.943795 30654 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:12.955935 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:12.956192 30654 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:12.957628 28749 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:12.943190 30318 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:18:12.953161 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:12.954738 30631 consensus_meta.cc:287] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
I20260709 12:18:12.951702 28756 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:12.935940 30479 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:12.992975 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:12.994293 30631 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:12.995090 28750 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:12.954927 28755 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:18:12.979245 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.941804 30674 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:12.977382 30621 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:12.996129 28752 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:12.998361 28753 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:12.998574 28749 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:18:13.001130 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.997531 30581 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:13.001926 28755 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:12.991544 29319 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEARNER]: Advancing to term 7
I20260709 12:18:13.003425 30581 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.013355 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.014699 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.015262 28752 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:13.016100 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.016660 28752 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:13.016997 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:13.018983 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.019016 28599 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
W20260709 12:18:13.016639 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 81742.6us
I20260709 12:18:13.021303 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:13.022419 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.022882 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:13.023085 30364 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:18:13.024116 30364 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:13.024580 30364 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:13.024936 30658 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:13.018523 30623 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:13.025401 30364 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:13.028713 30486 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:13.029330 30364 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.030216 30486 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:12.989637 30566 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.031812 30486 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:18:13.037593 30621 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:13.037149 30592 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:13.038818 28602 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:13.039603 30566 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:13.040968 30532 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.040987 30633 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:13.046597 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:13.047677 30635 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.627s	user 0.003s	sys 0.000s
I20260709 12:18:13.049803 30566 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:13.050374 30566 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:13.051393 30675 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:13.051789 30675 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:13.048147 30640 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.450s	user 0.002s	sys 0.000s
W20260709 12:18:13.056263 30639 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.643s	user 0.002s	sys 0.000s
I20260709 12:18:13.052495 30566 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:13.063292 30642 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:18:13.070531 30573 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:13.067024 30675 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.073065 30675 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.044564 30544 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:18:13.081230 30584 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:13.081619 30584 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:13.082448 30584 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:13.085536 30643 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.462s	user 0.000s	sys 0.002s
I20260709 12:18:13.088543 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.090337 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.092780 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.093953 30645 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.094305 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.095227 28678 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:13.095683 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1548) took 1094 ms. Trace:
I20260709 12:18:13.096448 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.096019 28601 rpcz_store.cc:276] 0709 12:18:12.001240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.009483 (+  8243us) service_pool.cc:224] Handling call
0709 12:18:13.095510 (+1086027us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400217354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:13.095620 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770717056}
I20260709 12:18:13.101756 30576 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:18:13.106876 30645 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:13.107131 30576 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:13.107546 30555 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:13.108475 30295 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:13.108935 30295 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:13.109488 30647 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:13.107575 30576 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:13.109947 30295 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:13.110592 30647 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:18:13.153404 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.141713 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:13.154033 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.119249 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.176806 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.177006 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:13.112989 28606 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:13.154814 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.134208 30592 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.138290 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:13.186872 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48716us
I20260709 12:18:13.172127 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.192600 30669 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:13.193225 30669 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.195611 30669 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:13.195771 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.196877 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.197594 28748 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:13.109997 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:13.203734 28756 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:13.207224 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.209301 28755 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:13.206408 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:13.213487 30645 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.214004 30645 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.165902 30647 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:13.228897 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.228463 30647 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.229533 28751 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:13.203444 30592 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.230378 30647 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.232636 30573 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.233136 30573 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.235201 30573 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:13.220515 30569 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.186429 30534 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:13.232161 30592 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:13.203143 30567 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:13.224196 29323 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:13.224953 30576 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.198485 30674 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.221678 30656 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.562s	user 0.004s	sys 0.000s
I20260709 12:18:13.236598 30534 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.249536 30569 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:13.255856 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 581) took 2094 ms. Trace:
I20260709 12:18:13.256394 30424 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:13.258582 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:13.278561 28606 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:13.261667 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.272383 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.272997 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:13.280985 28756 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:13.269105 29321 rpcz_store.cc:276] 0709 12:18:11.161524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.406160 (+244636us) service_pool.cc:224] Handling call
0709 12:18:12.190352 (+784192us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:12.190548 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.415530 (+224982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.255600 (+840070us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54004b9454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:13.255791 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521097728}
I20260709 12:18:13.281947 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:13.283090 28505 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 335) took 7909 ms. Trace:
I20260709 12:18:13.260273 30567 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.279996 28682 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:13.284197 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:13.284197 28598 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:13.308495 28750 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:13.309620 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.309778 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:13.310822 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:13.312686 28601 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
W20260709 12:18:13.314838 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.310822 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:13.317828 29321 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:13.319461 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:13.283478 28505 rpcz_store.cc:276] 0709 12:18:05.360578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.382788 (+ 22210us) service_pool.cc:224] Handling call
0709 12:18:13.269924 (+7887136us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:11.961449 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:11.961837 (+   388us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:11.961858 (+    21us) write_op.cc:435] Acquired schema lock
0709 12:18:11.961869 (+    11us) tablet.cc:662] Decoding operations
0709 12:18:11.962428 (+   559us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:11.962525 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:11.962568 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:18:11.962836 (+   268us) tablet.cc:701] Row locks acquired
0709 12:18:11.962848 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:18:11.962960 (+   112us) write_op.cc:270] Start()
0709 12:18:11.963041 (+    81us) write_op.cc:276] Timestamp: P: 1783599491962924 usec, L: 0
0709 12:18:11.963054 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 12:18:11.963540 (+   486us) log.cc:844] Serialized 1326 byte log entry
0709 12:18:12.394979 (+431439us) op_driver.cc:464] REPLICATION: finished
0709 12:18:12.466855 (+ 71876us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe74b5ef0
0709 12:18:12.618648 (+151793us) write_op.cc:301] APPLY: starting
0709 12:18:12.618736 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:12.618888 (+   152us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:12.618912 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:12.641925 (+ 23013us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:12.642093 (+   168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:18:12.642145 (+    52us) write_op.cc:312] APPLY: finished
0709 12:18:12.642351 (+   206us) log.cc:844] Serialized 35 byte log entry
0709 12:18:12.644077 (+  1726us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:12.645665 (+  1588us) write_op.cc:454] Released schema lock
0709 12:18:12.647380 (+  1715us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:12.647808 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:12.647840 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1029965,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":204297,"apply.run_cpu_time_us":2221,"apply.run_wall_time_us":29143,"num_ops":3,"prepare.queue_time_us":35688,"prepare.run_cpu_time_us":35354,"prepare.run_wall_time_us":49071,"raft.queue_time_us":172729,"raft.run_cpu_time_us":20347,"raft.run_wall_time_us":208865,"replication_time_us":415738,"spinlock_wait_cycles":64608512,"thread_start_us":329434,"threads_started":4,"wal-append.queue_time_us":75258}]]}
I20260709 12:18:13.323402 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:13.324370 28602 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:13.261902 30532 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:18:13.269052 30569 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:13.309003 30567 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.305147 30572 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.262768 30566 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:18:13.323417 30346 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:18:13.305601 30592 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:13.327214 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:13.335938 28751 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:13.324311 30669 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:13.361479 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52032.4us
I20260709 12:18:13.372964 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:13.373456 30704 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.329015 30631 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:13.308738 30555 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:18:13.332772 30569 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:13.331542 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:13.334896 30576 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:13.401108 30707 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:13.373968 30704 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.305431 30674 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.408880 30674 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:13.410211 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.350531 30669 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.383754 30577 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.421366 28747 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:13.384055 30631 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:13.412223 30641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.014s	sys 0.000s
I20260709 12:18:13.414567 30669 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:13.453423 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 427668us
W20260709 12:18:13.442430 30641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.014s	sys 0.000s
I20260709 12:18:13.460173 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.458130 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:13.432714 30631 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.411804 30664 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 12:18:13.452231 30525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.012s	sys 0.019s
I20260709 12:18:13.513790 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:13.528820 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:13.530076 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.545069 28677 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:13.530128 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:13.526295 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:13.530620 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 76517.8us
I20260709 12:18:13.434099 30592 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:18:13.546109 28674 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:13.530226 30674 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.514149 30641 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:13.557801 28599 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:13.562141 30704 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:13.562913 30642 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:13.564203 30351 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:13.564610 30351 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:13.553767 30346 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:18:13.565526 30351 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:13.567092 30351 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.589000 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:13.589727 28606 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
W20260709 12:18:13.593844 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 143771us
W20260709 12:18:13.543733 30525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.012s	sys 0.019s
I20260709 12:18:13.598409 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.599910 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:13.601089 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.601850 29327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.025s	sys 0.063s
W20260709 12:18:13.602197 29327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.025s	sys 0.063s
I20260709 12:18:13.611886 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:13.612521 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.611883 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:13.615195 28747 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:13.598413 30534 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:13.613722 30295 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:13.627697 30641 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.636457 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:13.591311 30674 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.608901 30704 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.646384 30713 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.606878 30351 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:13.646541 30569 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.649696 30674 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:13.653429 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:13.709888 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93779.6us
I20260709 12:18:13.711632 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:13.712397 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:13.617966 30346 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 12:18:13.692653 30692 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:18:13.724895 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:13.727439 28572 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.723s (SENT)
I20260709 12:18:13.733194 30714 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.733731 30714 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.697034 30534 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.692996 30710 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.699766 30555 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:13.681311 30689 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:18:13.658387 30704 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.696156 30567 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:13.666638 30713 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:13.927524 29323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 521) took 1654 ms (client timeout 1723 ms). Trace:
I20260709 12:18:13.769555 28750 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:13.766772 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:13.927811 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.200407 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 383) took 1912 ms. Trace:
W20260709 12:18:14.201508 29326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 552) took 1822 ms (client timeout 2244 ms). Trace:
W20260709 12:18:13.913218 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.202663 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.200424 28747 raft_consensus.cc:2410] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:18:14.198343 29323 rpcz_store.cc:269] 0709 12:18:12.147785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.163448 (+ 15663us) service_pool.cc:224] Handling call
0709 12:18:13.801454 (+1638006us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006801d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:13.801596 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430799616}
W20260709 12:18:14.202010 29326 rpcz_store.cc:269] 0709 12:18:12.379027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.381206 (+  2179us) service_pool.cc:224] Handling call
0709 12:18:14.201350 (+1820144us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54007a0154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:14.201455 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045897984}
I20260709 12:18:14.201241 28680 rpcz_store.cc:276] 0709 12:18:12.287895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.361192 (+ 73297us) service_pool.cc:224] Handling call
0709 12:18:12.675349 (+314157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.675912 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.200174 (+1524262us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400251050. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:14.200327 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721602944}
W20260709 12:18:13.740893 30640 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:18:14.208478 30295 consensus_meta.cc:287] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.009s
I20260709 12:18:13.802384 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:14.021732 30676 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:13.924309 30674 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.243762 30674 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:13.951972 30722 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:13.926080 30648 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.201128 30714 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:13.933738 30642 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:14.015280 30693 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:14.227941 30631 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.000s
I20260709 12:18:13.767391 30712 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.101950 30663 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:14.253142 28747 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:14.231189 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:13.802138 30534 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.252142 30295 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.225219 30555 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:14.293561 30721 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:18:14.257969 30689 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:18:14.351198 30569 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.349795 30645 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.220736 30710 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:14.294564 30713 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.355170 30631 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.370484 28606 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:14.374747 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 345) took 1103 ms. Trace:
I20260709 12:18:14.380545 30577 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:14.363828 30569 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:14.361405 30576 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.948s	user 0.008s	sys 0.003s
I20260709 12:18:14.386786 28747 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:14.382676 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.367954 30645 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.420176 30713 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:14.427784 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.427627 30713 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:14.362239 30663 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:14.390355 30471 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:14.384114 30295 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:14.429375 30471 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:14.373178 30555 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:14.399616 28751 rpcz_store.cc:276] 0709 12:18:13.271126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.271267 (+   141us) service_pool.cc:224] Handling call
0709 12:18:14.374534 (+1103267us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b5400338954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:14.374654 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58757888}
W20260709 12:18:14.375900 30572 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.038s	user 0.010s	sys 0.000s
I20260709 12:18:14.432636 30572 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:14.433205 30534 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:14.356997 30712 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.433822 28603 raft_consensus.cc:2376] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5. Re-sending same reply.
I20260709 12:18:14.435714 30712 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.266582 30722 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.427493 30645 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:14.437866 30722 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.439201 30645 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:14.423585 30577 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.441380 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:14.442795 30351 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.443106 28680 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.443447 28680 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:14.443352 30351 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.444296 28680 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:14.445559 30351 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.430536 30631 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.364607 30567 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:14.430562 30663 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:14.448665 30295 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:14.428717 28504 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 226) took 8990 ms. Trace:
I20260709 12:18:14.449273 28504 rpcz_store.cc:276] 0709 12:18:05.438019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.448582 (+ 10563us) service_pool.cc:224] Handling call
0709 12:18:14.428539 (+8979957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":960213,"reported_tablets":1}
I20260709 12:18:14.430989 30569 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.395766 30674 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:14.396871 30704 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:14.432732 30713 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:14.431365 30471 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:14.367630 30669 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.841s	user 0.008s	sys 0.000s
W20260709 12:18:14.477901 30684 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 1.469s	user 0.005s	sys 0.009s
I20260709 12:18:14.478330 30669 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.479161 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 596) took 2013 ms. Trace:
I20260709 12:18:14.480717 30669 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:14.479568 29322 rpcz_store.cc:276] 0709 12:18:12.466152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.505308 (+ 39156us) service_pool.cc:224] Handling call
0709 12:18:12.563599 (+ 58291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.828532 (+264933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.828590 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.858734 (+ 30144us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.954119 (+ 95385us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:12.979164 (+ 25045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.982880 (+  3716us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.477312 (+1494432us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:14.478824 (+  1512us) raft_consensus.cc:1685] finished
0709 12:18:14.478856 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.479091 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151079,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":14016768,"thread_start_us":247695,"threads_started":2,"wal-append.queue_time_us":89244}
I20260709 12:18:14.481822 30702 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:14.482267 30702 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:14.483155 30702 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.486651 30651 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:14.487087 30651 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:14.490576 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 565) took 1041 ms. Trace:
I20260709 12:18:14.490960 29321 rpcz_store.cc:276] 0709 12:18:13.448678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.448807 (+   129us) service_pool.cc:224] Handling call
0709 12:18:14.490346 (+1041539us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54005df2d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:14.490494 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312169728}
I20260709 12:18:14.503686 29317 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:14.505519 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.509656 30569 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.521497 30584 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:14.273012 30648 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.526317 30581 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.541244 30648 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.487995 30651 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.542907 30651 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.326642 30642 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.555523 30642 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:14.484231 30702 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:14.573964 29317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 562) took 1335 ms (client timeout 1582 ms). Trace:
W20260709 12:18:14.574589 29317 rpcz_store.cc:269] 0709 12:18:13.239108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.308491 (+ 69383us) service_pool.cc:224] Handling call
0709 12:18:14.573662 (+1265171us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400680e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:14.573868 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2544008960}
I20260709 12:18:14.579560 28756 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
W20260709 12:18:14.580776 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.598477 30576 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.599965 30576 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:14.601743 30719 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.370s	user 0.004s	sys 0.000s
I20260709 12:18:14.604393 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 290) took 1192 ms. Trace:
I20260709 12:18:14.604869 28598 rpcz_store.cc:276] 0709 12:18:13.411762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.411917 (+   155us) service_pool.cc:224] Handling call
0709 12:18:13.413472 (+  1555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.595243 (+181771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.595276 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.596536 (+  1260us) log.cc:844] Serialized 26 byte log entry
0709 12:18:13.701143 (+104607us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:13.701178 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.701262 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.601160 (+899898us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:14.603395 (+  2235us) raft_consensus.cc:1685] finished
0709 12:18:14.603420 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.604311 (+   891us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35754,"raft.run_cpu_time_us":9282,"raft.run_wall_time_us":75859,"spinlock_wait_cycles":3490176,"thread_start_us":263642,"threads_started":2,"wal-append.queue_time_us":363615}
I20260709 12:18:14.626085 30710 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:14.630940 30577 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:14.359573 30693 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:14.666008 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.015s	sys 0.055s
W20260709 12:18:14.690332 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.016s	sys 0.055s
W20260709 12:18:14.690497 28570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.009s	sys 0.006s
W20260709 12:18:14.691045 28570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.010s	sys 0.006s
I20260709 12:18:14.675813 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1536) took 1064 ms. Trace:
W20260709 12:18:14.676645 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 145499us
W20260709 12:18:14.677623 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 162152us
W20260709 12:18:14.682060 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.015s	sys 0.057s
W20260709 12:18:14.929522 28572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.024s	sys 0.128s
I20260709 12:18:14.962893 28756 rpcz_store.cc:276] 0709 12:18:13.611448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.611592 (+   144us) service_pool.cc:224] Handling call
0709 12:18:14.675570 (+1063978us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54001c4154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:14.675728 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986184576}
W20260709 12:18:14.974032 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.022s	sys 0.036s
W20260709 12:18:14.973486 28572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.026s	sys 0.137s
I20260709 12:18:14.974937 29321 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:18:14.810582 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 116349us
I20260709 12:18:14.970754 28503 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:14.963078 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.015s	sys 0.089s
W20260709 12:18:14.974949 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.022s	sys 0.036s
W20260709 12:18:14.992857 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.998855 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:14.679612 30525 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:14.935555 28607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.013s	sys 0.017s
W20260709 12:18:15.000694 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.940577 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.009s	sys 0.021s
W20260709 12:18:15.000751 28607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.015s	sys 0.019s
W20260709 12:18:14.694167 28605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.043s	sys 0.055s
W20260709 12:18:15.002454 28605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.052s	sys 0.064s
W20260709 12:18:14.936895 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.001s	sys 0.024s
I20260709 12:18:14.849444 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:15.001398 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.011s	sys 0.022s
I20260709 12:18:15.009255 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:15.007647 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.001s	sys 0.027s
W20260709 12:18:15.010226 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 786682us
I20260709 12:18:14.999612 28503 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 5, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:15.011693 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.012049 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.012305 28678 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:15.011993 28503 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:15.014086 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.013638 28503 catalog_manager.cc:5697] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 4, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 4 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.014731 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.015475 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.016052 28673 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:15.017132 28503 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:15.018993 28606 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:18:15.018909 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:15.019639 28606 pending_rounds.cc:85] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 4
I20260709 12:18:15.019968 28606 pending_rounds.cc:107] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:18:15.020246 28606 raft_consensus.cc:2889] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:15.029451 28503 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 3, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:15.030295 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 180969us
I20260709 12:18:15.030332 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:15.031104 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:14.682894 30718 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.892679 30662 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:14.975394 29320 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.022s	sys 0.065s
I20260709 12:18:15.032704 29321 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:14.895738 30707 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.821285 30663 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.031585 28503 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:15.034201 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:15.079618 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45494.6us
I20260709 12:18:14.679828 30703 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.330s
I20260709 12:18:14.787817 30576 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.080340 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:15.080894 28680 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.081046 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:15.056097 30646 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:15.081843 29322 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:15.074605 29320 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.022s	sys 0.071s
I20260709 12:18:14.894351 30716 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:14.912376 30355 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:14.928125 30544 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:14.737046 30734 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:14.693763 30696 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:15.097005 28748 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:15.096756 30696 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.098058 30544 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:14.895731 30723 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:15.099092 28681 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:15.049822 30718 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.099301 30723 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.021317 30525 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.101209 30718 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:14.848385 30647 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:15.049269 30631 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.061753 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:15.062276 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.062456 30569 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:15.096264 30734 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.063027 30706 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:15.063130 28755 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:15.051620 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:15.063429 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:15.063525 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:15.107515 29326 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:15.063131 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:14.848306 30728 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:15.108278 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46600us
I20260709 12:18:15.051692 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:15.100183 30544 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.113603 28756 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.087922 30699 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:14.821002 30736 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:15.032104 30714 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.072872 28599 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:18:15.039287 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:15.122357 28599 pending_rounds.cc:85] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 4
I20260709 12:18:15.122641 28599 pending_rounds.cc:107] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:18:15.122884 28599 raft_consensus.cc:2889] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:15.122972 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 83744.5us
I20260709 12:18:15.123270 28680 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:15.075330 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:15.016922 30642 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:15.080539 28719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.017s	sys 0.043s
I20260709 12:18:15.037554 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.080096 30707 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.082041 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:14.737751 30551 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.038499 30730 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.033265 30710 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:15.085582 28503 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 3, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:15.038010 30625 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:15.140769 30642 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.058703 30645 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.141803 30645 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:15.090365 28604 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:15.142998 30642 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.142699 30645 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.084545 30646 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.143537 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.144160 28604 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:15.144039 30646 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.102980 30716 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.056887 30648 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.146304 30646 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.146401 30716 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.146232 30648 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.038695 30722 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:18:15.071718 30702 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:15.064626 28602 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:18:15.148226 28602 pending_rounds.cc:85] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 2
I20260709 12:18:15.112061 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:15.093304 30726 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:18:15.115072 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:15.062369 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:15.112810 30577 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.092007 30568 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:15.060650 30662 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.124567 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:18:15.126024 28719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.018s	sys 0.043s
I20260709 12:18:15.105103 30693 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.126672 30736 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:14.963441 30685 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:15.110304 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:15.103734 30569 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.148572 28602 pending_rounds.cc:107] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:18:15.086972 30663 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.149986 28503 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 3, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:15.179898 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55443.6us
W20260709 12:18:15.182148 28600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.381s	user 0.036s	sys 0.038s
W20260709 12:18:15.182443 28600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.381s	user 0.036s	sys 0.038s
I20260709 12:18:15.182422 28503 catalog_manager.cc:5697] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:18:15.127985 30631 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.188419 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2024) took 1446 ms. Trace:
I20260709 12:18:15.102361 30355 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.147593 30551 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.188844 28754 rpcz_store.cc:276] 0709 12:18:13.711392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.711544 (+   152us) service_pool.cc:224] Handling call
0709 12:18:13.711840 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.712163 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.712190 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.712754 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 12:18:14.231764 (+519010us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:14.231820 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.231912 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.157471 (+925559us) raft_consensus.cc:1685] finished
0709 12:18:15.157500 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.157683 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1658,"raft.queue_time_us":9745,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"thread_start_us":326483,"threads_started":1,"wal-append.queue_time_us":1107213}
W20260709 12:18:15.128928 30346 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:18:15.123921 30732 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.112958 30647 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.179380 28602 raft_consensus.cc:2889] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:15.174309 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 92330.1us
I20260709 12:18:15.164291 28756 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:15.180284 29326 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:15.180552 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:15.184275 28503 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 4, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 4 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:15.193679 30685 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.114030 30706 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.116880 30737 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:15.130429 30651 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.002s
I20260709 12:18:15.191752 30631 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.191994 30646 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.140673 30525 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.263972 30693 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.133076 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.207099 30732 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.215719 29322 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:18:15.260799 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 80337.6us
I20260709 12:18:15.191960 30576 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.161221 30699 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.157177 30689 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.216915 30568 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:15.117439 30728 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.153518 30702 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.290490 28599 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 2.
I20260709 12:18:15.129122 30714 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.285892 29323 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:15.205662 30648 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.294318 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.327498 30714 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.296736 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.301122 30729 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:15.328769 30568 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.329048 30729 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.330402 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.331038 28599 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:15.331480 30729 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.331858 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.343830 28599 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:15.307888 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.265630 30744 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.287395 30525 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.349792 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.312906 30728 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.284680 30631 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:15.313329 30725 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:18:15.314640 30551 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.315037 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2027) took 1577 ms. Trace:
I20260709 12:18:15.315546 30740 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.316169 30355 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.299362 30699 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.380560 30699 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.382102 30707 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.317281 30663 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.299898 30723 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.318501 30569 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.319219 30702 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.300201 30576 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.387456 30576 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.319916 30647 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.287817 30737 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.353387 30744 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.321337 30685 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.322614 30662 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.325613 30706 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.284721 30731 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.154130 30730 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.315064 30734 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:18:15.305259 30736 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.388809 30744 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.255235 28503 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:15.287339 30693 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:15.285010 30646 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.290949 30732 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.310870 30696 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.352274 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.355824 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.418335 28682 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:15.269390 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:15.357448 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.362025 28750 rpcz_store.cc:276] 0709 12:18:13.738102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.218901 (+480799us) service_pool.cc:224] Handling call
0709 12:18:14.219427 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:14.672659 (+453232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:14.672705 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:14.673287 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:18:14.973833 (+300546us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:14.973873 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.973968 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.314733 (+340765us) raft_consensus.cc:1685] finished
0709 12:18:15.314763 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.314947 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":228528,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":752825,"threads_started":2,"wal-append.queue_time_us":614035}
I20260709 12:18:15.339541 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.361032 30525 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.424764 28681 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:15.414043 30693 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.414223 30646 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.434181 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.435105 28599 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:15.436493 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:15.396530 30731 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.438233 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.440155 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:15.442114 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1979) took 1723 ms. Trace:
I20260709 12:18:15.442319 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.441582 30714 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:15.444427 30714 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.444792 30714 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.450629 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1977) took 1734 ms. Trace:
I20260709 12:18:15.432252 30735 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.442593 28605 rpcz_store.cc:276] 0709 12:18:13.718346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.718477 (+   131us) service_pool.cc:224] Handling call
0709 12:18:13.718776 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.723251 (+  4475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.723281 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.736696 (+ 13415us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.002997 (+1266301us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:15.003053 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.003158 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.441858 (+438700us) raft_consensus.cc:1685] finished
0709 12:18:15.441881 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.442033 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4128,"raft.queue_time_us":17403,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"thread_start_us":1265895,"threads_started":1,"wal-append.queue_time_us":1466126}
I20260709 12:18:15.451094 28600 rpcz_store.cc:276] 0709 12:18:13.716532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.716762 (+   230us) service_pool.cc:224] Handling call
0709 12:18:13.737028 (+ 20266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.737451 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:18:13.737495 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.769226 (+ 31731us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.182952 (+1413726us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:15.182992 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.183057 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.450404 (+267347us) raft_consensus.cc:1685] finished
0709 12:18:15.450429 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.450554 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":158912,"thread_start_us":1381743,"threads_started":1,"wal-append.queue_time_us":1638765}
W20260709 12:18:15.429198 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 159917us
I20260709 12:18:15.450732 30731 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.454391 28605 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:15.452114 30625 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.465211 28600 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:15.460605 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:15.467785 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:15.469059 28602 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:15.478446 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:15.463934 30625 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:15.469769 30710 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:15.465832 30741 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:15.476883 30696 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:15.508878 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 495600us
W20260709 12:18:15.474169 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 443869us
I20260709 12:18:15.477870 30737 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.501705 30717 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:15.527593 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:15.528337 30737 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:15.475291 30569 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:18:15.508169 30625 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.537351 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:15.519539 30733 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:15.546512 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 494953us
I20260709 12:18:15.548650 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:15.549652 28750 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:15.550524 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:15.552286 30525 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:15.554040 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 371926us
I20260709 12:18:15.560386 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:15.561002 28750 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:15.556947 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 358556us
I20260709 12:18:15.564509 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:15.564826 30745 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:18:15.565276 30663 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:15.566529 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:15.567255 30663 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:15.567627 30663 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.567960 30663 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.568732 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.537299 30459 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:18:15.574489 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.575260 28600 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:15.542240 30722 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:18:15.577821 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:15.582953 30685 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.583223 30689 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.583415 30685 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.583644 30689 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:15.584057 30689 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.575989 30663 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.589829 30663 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.538158 30710 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:18:15.547791 30717 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.596213 28750 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:15.526747 30696 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.521552 30741 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.583820 30685 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.604362 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:15.605084 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.610203 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.605454 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:15.605084 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:15.612720 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:15.607316 28598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.013s	sys 0.040s
W20260709 12:18:15.613732 28598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.014s	sys 0.040s
I20260709 12:18:15.614178 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:15.615123 28752 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:15.615940 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.616412 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.613543 28754 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:15.619398 28602 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:15.619863 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:15.622473 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:15.623301 29292 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.762s (SENT) [suppressed 27 similar messages]
I20260709 12:18:15.607244 30525 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:15.612416 30696 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.615896 30734 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.637655 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.629631 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:15.638834 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 61090us
I20260709 12:18:15.639307 29323 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:15.630949 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:15.632252 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:15.601676 30699 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.625388 30744 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.628376 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 541) took 2360 ms. Trace:
I20260709 12:18:15.593436 30631 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.620901 30651 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:15.638435 28600 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:15.557626 30730 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:15.662623 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 58330.1us
I20260709 12:18:15.664413 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:15.649081 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.600807 30693 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:15.621061 29317 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.009s	sys 0.013s
I20260709 12:18:15.667711 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:15.687264 28750 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:15.668377 28602 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
W20260709 12:18:15.653261 30645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.014s	sys 0.023s
I20260709 12:18:15.669054 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:15.643013 30736 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.675359 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:15.695820 28752 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:15.696696 28751 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:15.675853 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.654111 29319 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
W20260709 12:18:15.689428 29317 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.009s	sys 0.013s
I20260709 12:18:15.636637 30525 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:15.693416 30645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.014s	sys 0.024s
I20260709 12:18:15.655069 29322 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:15.676877 30730 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.717344 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.643502 30734 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.724066 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.724896 28602 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:15.697088 30647 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.696753 30736 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:15.698625 30663 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.676375 30740 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:18:15.704792 30696 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:15.705171 30756 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:15.670446 30651 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.743335 28604 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
W20260709 12:18:15.734006 30703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.016s	sys 0.016s
I20260709 12:18:15.727036 30730 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.738538 30736 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.719679 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 566) took 2255 ms. Trace:
I20260709 12:18:15.734594 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:15.720129 30728 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:15.749940 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 222414us
I20260709 12:18:15.767819 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:15.751040 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:15.756361 30703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.017s	sys 0.017s
I20260709 12:18:15.732749 30647 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.777119 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:15.764577 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 214144us
I20260709 12:18:15.771073 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:15.741961 30751 raft_consensus.cc:1064] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:18:15.783114 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.763868 30730 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.781281 28678 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:15.780391 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.787882 28680 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:15.746747 30663 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:15.774362 30729 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.759214 30731 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:18:15.774804 28573 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:15.794486 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:15.795120 28676 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.792335 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:15.793072 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 238455us
I20260709 12:18:15.780256 30647 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.795872 28679 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:15.779659 30710 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.796082 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:15.752327 30696 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.929322 28677 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.789237 30645 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:15.814604 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:15.914880 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:15.794299 30729 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.939997 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.942572 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.943054 28602 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:15.824580 30577 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:15.828176 30584 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:15.752135 30766 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:18:15.928975 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 133483us
I20260709 12:18:15.947702 28573 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:15.775226 30728 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:15.914938 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:15.915807 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:15.760252 30756 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:15.960953 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 164754us
I20260709 12:18:15.818022 30651 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.933095 30742 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:15.935406 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.934692 30645 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:15.813864 30699 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.959338 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.914155 30710 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.933347 30568 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:18:15.945767 30729 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.941751 30576 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:15.975723 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.802265 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.978000 28677 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:15.947813 30747 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.962507 30631 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:15.949654 30584 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:15.953814 30744 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:15.915041 30717 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:15.960268 28675 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:15.791812 30751 raft_consensus.cc:1068] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Unable to promote non-voter 5b3b2f4041a24b05983f30878f16db9d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:18:15.995312 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.987103 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:15.998692 28678 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:15.946453 30577 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:15.974682 30645 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:15.980315 30710 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.020555 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:15.980609 30551 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:16.000154 30646 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
W20260709 12:18:15.999961 30714 consensus_meta.cc:287] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.002s
I20260709 12:18:16.035425 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:16.013970 30749 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:18:15.998359 30699 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:15.998819 30693 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:16.048749 28602 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:16.050905 30763 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:18:16.051594 30754 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:18:16.017270 30747 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:16.057687 28673 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:16.020325 30717 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.064879 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.068115 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1978) took 2337 ms. Trace:
I20260709 12:18:16.078876 28607 rpcz_store.cc:276] 0709 12:18:13.717484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.717624 (+   140us) service_pool.cc:224] Handling call
0709 12:18:14.202993 (+485369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.001806 (+798813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.001850 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.047538 (+ 45688us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.478264 (+430726us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:15.478321 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.478410 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.054254 (+575844us) raft_consensus.cc:1685] finished
0709 12:18:16.054282 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.054454 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":230194,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":1212457,"threads_started":2,"wal-append.queue_time_us":599569}
I20260709 12:18:16.080857 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:16.081378 28607 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.027974 30525 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:16.076223 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:16.076627 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.002866 30737 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:18:16.039255 30631 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:18:16.077980 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 454650us
W20260709 12:18:16.054224 30765 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:18:15.763993 29318 rpcz_store.cc:276] 0709 12:18:13.456354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.105564 (+649210us) service_pool.cc:224] Handling call
0709 12:18:14.105970 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.182392 (+ 76422us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:14.672364 (+489972us) log.cc:844] Serialized 14 byte log entry
0709 12:18:15.644887 (+972523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:15.655006 (+ 10119us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:15.660361 (+  5355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.672777 (+ 12416us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.711945 (+ 39168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1380,"prepare.queue_time_us":260000,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":225929,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":1394466,"threads_started":3,"wal-append.queue_time_us":761633}
I20260709 12:18:16.001502 30576 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:16.112912 30753 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:18:16.069162 30706 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:16.113539 30706 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.097985 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:16.103111 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 124918us
I20260709 12:18:16.115676 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 353) took 1045 ms. Trace:
I20260709 12:18:16.047019 30551 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:16.095788 30631 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:16.111806 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1982) took 1104 ms. Trace:
I20260709 12:18:16.100255 30577 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.033711 30751 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:18:16.092283 28607 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:16.094373 30717 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:16.102525 29290 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:16.116659 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 169090us
I20260709 12:18:16.116027 28753 rpcz_store.cc:276] 0709 12:18:15.070233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.070369 (+   136us) service_pool.cc:224] Handling call
0709 12:18:15.070739 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.078192 (+  7453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.078239 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.080713 (+  2474us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.513096 (+432383us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:15.513171 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.513274 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.115451 (+602177us) raft_consensus.cc:1685] finished
0709 12:18:16.115485 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.115616 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":148,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":11121,"thread_start_us":431980,"threads_started":1,"wal-append.queue_time_us":677900}
I20260709 12:18:16.140017 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.141559 28573 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.143013 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.068212 30734 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:15.654832 29320 rpcz_store.cc:276] 0709 12:18:13.268019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.650135 (+382116us) service_pool.cc:224] Handling call
0709 12:18:13.650476 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.650834 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.650861 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.651331 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:18:14.207549 (+556218us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:15.082555 (+875006us) log.cc:844] Serialized 14 byte log entry
0709 12:18:15.620429 (+537874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.623155 (+  2726us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.628084 (+  4929us) raft_consensus.cc:1685] finished
0709 12:18:15.628119 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.628302 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17788,"prepare.queue_time_us":255502,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":176242,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":43131,"thread_start_us":1776188,"threads_started":3,"wal-append.queue_time_us":588824}
I20260709 12:18:16.068465 30651 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:16.097069 30760 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:18:16.127875 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:16.145031 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.146669 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:16.160583 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:16.122218 30733 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.569s	user 0.000s	sys 0.011s
I20260709 12:18:16.154980 30703 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:16.056309 30714 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:16.162070 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:16.170847 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:16.055310 30646 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.158921 30459 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.114349 30525 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:18:16.150503 30699 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.162905 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:16.120577 30693 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:16.172654 30733 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.176067 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1987) took 1111 ms. Trace:
I20260709 12:18:16.170007 30703 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:16.239748 30785 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:18:16.180531 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.241636 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:16.278018 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 97599us
I20260709 12:18:16.149380 30771 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:16.242550 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1986) took 1204 ms. Trace:
I20260709 12:18:16.166986 28753 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:16.115578 30736 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.240561 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.243507 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.286289 28750 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:16.173486 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.249328 28600 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:16.249150 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.288637 28756 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:16.242852 30744 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:16.176149 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:16.281620 28606 rpcz_store.cc:276] 0709 12:18:15.038452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.059739 (+ 21287us) service_pool.cc:224] Handling call
0709 12:18:15.060127 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.066645 (+  6518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.066687 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.077653 (+ 10966us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.527481 (+449828us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:15.527539 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.527631 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.242354 (+714723us) raft_consensus.cc:1685] finished
0709 12:18:16.242375 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.242493 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6449,"raft.queue_time_us":6162,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13306,"thread_start_us":445263,"threads_started":1,"wal-append.queue_time_us":695432}
I20260709 12:18:16.165436 30651 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.276221 28601 rpcz_store.cc:276] 0709 12:18:15.064984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.065111 (+   127us) service_pool.cc:224] Handling call
0709 12:18:15.116758 (+ 51647us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800003398. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:15.116968 (+   210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.117184 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.117211 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.124807 (+  7596us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.655295 (+530488us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:15.655337 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.655407 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.175758 (+520351us) raft_consensus.cc:1685] finished
0709 12:18:16.175778 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.175996 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4523264,"thread_start_us":463905,"threads_started":1,"wal-append.queue_time_us":622241}
I20260709 12:18:16.281066 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.299062 28573 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:16.175717 30741 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:16.301129 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.169821 30734 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:16.285621 28751 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:16.278988 28752 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:16.242857 30758 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:16.306396 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:16.239800 30762 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 12:18:16.242738 30788 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:16.280843 29322 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:16.281836 30716 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:16.282625 30703 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.285948 30699 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.240396 30768 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:18:16.240574 30759 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:16.245266 30631 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.293694 30756 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:16.305744 30576 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:16.357586 28676 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 12:18:16.281093 30693 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:16.380762 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 205210us
I20260709 12:18:16.244779 30459 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.303788 30771 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.366477 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:16.370971 30779 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.322s	user 0.000s	sys 0.005s
I20260709 12:18:16.366705 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.367381 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:16.368795 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.296166 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.352965 30733 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:16.303216 30747 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:16.408921 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.411995 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.379058 28676 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:16.414624 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.415691 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.306839 30758 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.353325 30734 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:16.418363 28748 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:16.419369 30758 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.381884 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:16.304759 30744 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:16.312398 30735 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:16.309098 30741 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:18:16.425941 30782 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:16.410290 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:16.425911 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44061.9us
I20260709 12:18:16.426648 30782 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.410432 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.309365 30788 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:16.428005 30788 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.429073 30782 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:16.378769 30751 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:16.370857 30759 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.422273 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.424008 28681 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:18:16.431084 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:16.434473 30756 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:16.434876 30756 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.435245 30756 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:16.458657 30663 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:16.476625 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.477597 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.481189 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.481978 28676 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:16.488658 30631 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.392778 30772 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:16.407533 30569 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.493916 28747 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:16.494740 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 64141.6us
I20260709 12:18:16.495913 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.497507 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.502753 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.503922 28606 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:16.432075 30759 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.423310 30734 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:16.507335 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.515242 28677 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:16.510394 28600 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:16.393873 30728 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:16.512229 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:16.424342 30733 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:16.492336 30730 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.702s	user 0.005s	sys 0.001s
I20260709 12:18:16.545737 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:16.551944 29323 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:16.553557 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:16.498916 30795 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.499313 30798 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.498348 30735 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:16.494833 30782 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.124991 28603 rpcz_store.cc:276] 0709 12:18:15.007346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.017045 (+  9699us) service_pool.cc:224] Handling call
0709 12:18:15.073383 (+ 56338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.106409 (+ 33026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.114231 (+  7822us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.181871 (+ 67640us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.649294 (+467423us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:18:15.649892 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.650588 (+   696us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.101785 (+451197us) raft_consensus.cc:1685] finished
0709 12:18:16.111550 (+  9765us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.111733 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7451,"raft.queue_time_us":5380,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":4567,"thread_start_us":385090,"threads_started":1,"wal-append.queue_time_us":716555}
I20260709 12:18:16.562630 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:16.530405 30755 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 12:18:16.571756 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.572474 28607 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:16.573524 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.574168 28603 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:16.527419 30714 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:16.584164 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.585434 28603 raft_consensus.cc:2410] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:16.587517 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:16.587831 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.590508 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:16.563548 30786 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:18:16.591248 28747 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:16.599786 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.602094 28607 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:16.504447 30569 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:16.557235 30646 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:16.554601 30751 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:16.606845 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:16.608371 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.608722 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.629858 28681 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:16.608922 30793 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:18:16.567804 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:16.506418 30772 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:16.612151 30752 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.018s	sys 0.048s
I20260709 12:18:16.633076 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.591933 30730 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:16.637542 30732 consensus_meta.cc:287] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.210s	user 0.013s	sys 0.007s
I20260709 12:18:16.581521 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:16.604228 30736 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:16.566313 30802 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:18:16.585839 30782 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:16.570780 30795 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:16.651038 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 88498.4us
I20260709 12:18:16.670185 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:16.670501 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.648342 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:16.649201 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:16.635744 30525 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:16.660694 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:16.574937 30744 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:16.643575 30752 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.019s	sys 0.049s
I20260709 12:18:16.682822 28748 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:16.647615 30750 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.691673 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:16.647841 30459 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:16.694512 30794 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:18:16.642788 30803 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:16.669930 30732 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.702229 30569 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:16.704890 30804 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:18:16.645656 29318 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:16.693076 29322 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:16.570698 30798 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:16.727802 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 79518.5us
I20260709 12:18:16.729961 28751 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.815873 30764 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.816356 30764 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.817245 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:16.818222 30569 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.818593 30799 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.819259 30799 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.728956 28747 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:16.736925 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.004s	sys 0.002s
W20260709 12:18:16.728821 30820 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:18:16.848546 30799 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:16.776965 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:16.778131 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 86559.3us
I20260709 12:18:16.709615 30699 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:16.699470 30625 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.150s	user 0.008s	sys 0.003s
I20260709 12:18:16.794477 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.794673 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:16.794469 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.733695 30734 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:16.662433 30733 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.818671 30764 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:16.692744 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 605) took 1716 ms. Trace:
W20260709 12:18:16.831504 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.004s	sys 0.007s
I20260709 12:18:16.822909 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1981) took 1847 ms. Trace:
I20260709 12:18:16.849864 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:16.852399 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:16.897071 29327 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:16.848924 30584 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.871884 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:16.888310 28675 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.001s
I20260709 12:18:16.876123 28751 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:16.793562 30693 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:16.795045 30651 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:16.885524 28605 raft_consensus.cc:2368] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3.
W20260709 12:18:16.881822 30718 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.010s	sys 0.029s
I20260709 12:18:16.889762 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:16.673429 30735 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:16.892665 28752 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.008s	sys 0.003s
W20260709 12:18:16.881177 30645 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.000s
W20260709 12:18:16.880630 30717 consensus_meta.cc:287] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.717s	user 0.008s	sys 0.004s
I20260709 12:18:16.897655 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1592) took 1194 ms. Trace:
W20260709 12:18:16.880961 30689 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.296s	user 0.013s	sys 0.000s
I20260709 12:18:16.897989 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:16.874998 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 168616us
I20260709 12:18:16.897377 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:16.893013 28598 rpcz_store.cc:276] 0709 12:18:14.975372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.975496 (+   124us) service_pool.cc:224] Handling call
0709 12:18:15.033469 (+ 57973us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:15.038430 (+  4961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.038459 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:15.056570 (+ 18111us) log.cc:844] Serialized 52 byte log entry
0709 12:18:15.614141 (+557571us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:15.803916 (+189775us) log.cc:844] Serialized 14 byte log entry
0709 12:18:15.930917 (+127001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.931021 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.822698 (+891677us) raft_consensus.cc:1685] finished
0709 12:18:16.822718 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.822851 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158985,"prepare.queue_time_us":366469,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":138375,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":26078,"thread_start_us":700487,"threads_started":2,"wal-append.queue_time_us":977795}
I20260709 12:18:16.894855 28681 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
W20260709 12:18:16.893009 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 710175us
I20260709 12:18:16.874131 30762 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.871309 30802 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:16.886888 30710 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.000s
I20260709 12:18:16.975831 30730 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:16.887069 30805 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.251s	user 0.000s	sys 0.003s
I20260709 12:18:17.264353 30772 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:16.972632 28747 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:16.890268 30729 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.883s	user 0.008s	sys 0.003s
I20260709 12:18:17.266273 28755 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:17.266449 30729 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.265100 30782 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:17.268802 30729 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:16.892746 30576 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.269526 30576 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.892431 30736 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:17.275516 28753 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:18:17.009229 28752 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.008s	sys 0.003s
I20260709 12:18:16.789577 30750 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.779942 30751 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:16.897095 30734 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:16.811818 30758 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:16.991459 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 119651us
I20260709 12:18:16.885215 30625 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:16.901206 30740 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.193867 28602 rpcz_store.cc:276] 0709 12:18:15.703034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.086082 (+383048us) service_pool.cc:224] Handling call
0709 12:18:16.086390 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.086774 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.086803 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:16.087284 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:18:16.279878 (+192594us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:16.279935 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.280039 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.897473 (+617434us) raft_consensus.cc:1685] finished
0709 12:18:16.897491 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.897604 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1076,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":192153,"threads_started":1,"wal-append.queue_time_us":275321}
W20260709 12:18:17.160246 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.967661 28675 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:17.243515 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:16.972946 30788 consensus_meta.cc:287] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.003s
I20260709 12:18:16.903050 30799 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:17.247987 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.296671 28603 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:17.297622 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.970732 29322 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:17.250231 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:17.248783 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 352693us
I20260709 12:18:16.973120 30706 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:16.984649 30718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.010s	sys 0.029s
I20260709 12:18:17.255352 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:17.303936 28680 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.968458 28751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:18:17.257292 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:16.986021 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.243170 30766 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.259217 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:16.985432 30584 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.263300 30459 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.263868 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.169484 30651 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.287288 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:17.271226 30803 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:17.302683 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:17.247501 30645 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.252544 30689 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.271706 30710 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:17.244470 30717 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:17.280309 30764 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:17.309046 28676 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.553449 28678 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:17.569502 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 282480us
I20260709 12:18:17.571604 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:17.573338 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:17.573979 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:17.568112 28680 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
W20260709 12:18:17.465682 30631 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.003s
W20260709 12:18:17.455626 30809 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.568s	user 0.001s	sys 0.000s
I20260709 12:18:17.340191 28599 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:17.555043 28751 raft_consensus.cc:606] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:17.555564 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:17.584327 28751 raft_consensus.cc:614] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:17.555827 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:17.542814 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:17.351431 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:17.460175 30821 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:18:17.349892 30813 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
W20260709 12:18:17.349133 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.534379 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:17.568171 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.575943 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.284952 30736 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:17.579599 28604 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:17.349244 30827 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.622546 30756 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.187s	user 0.021s	sys 0.007s
I20260709 12:18:17.352782 30699 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.342978 30762 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:17.590322 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.638782 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.640208 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.582263 28682 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:17.592796 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.559501 30795 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.308218 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 398) took 1526 ms. Trace:
I20260709 12:18:17.459486 30824 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:17.560725 30764 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:17.610733 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:17.649633 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 587) took 1009 ms. Trace:
I20260709 12:18:17.650089 29325 rpcz_store.cc:276] 0709 12:18:16.640574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.610431 (+969857us) service_pool.cc:224] Handling call
0709 12:18:17.649555 (+ 39124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:17.569319 30647 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.637s	user 0.014s	sys 0.000s
I20260709 12:18:17.649367 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2048) took 1231 ms. Trace:
I20260709 12:18:17.651471 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.601431 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.389101 30706 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.205s
I20260709 12:18:17.303328 30788 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:17.579285 30750 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.352806 30734 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.576850 30693 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.303589 30740 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.576031 30798 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:17.671245 30823 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:18:17.672288 30577 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.673213 30651 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:17.673651 30651 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.577201 30835 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:17.675863 30758 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:17.676561 30758 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:17.676925 30758 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:17.677048 29318 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:17.677374 30758 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:17.677599 30826 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.478s	user 0.002s	sys 0.000s
I20260709 12:18:17.680085 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.680398 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 297) took 2555 ms. Trace:
I20260709 12:18:17.680974 28679 raft_consensus.cc:2410] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:17.681643 28679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:17.682148 28679 raft_consensus.cc:606] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:17.682488 28679 raft_consensus.cc:614] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:17.684163 30703 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.305s	user 0.007s	sys 0.004s
I20260709 12:18:17.684604 30703 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.644735 30699 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.688884 30699 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.684157 30732 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.660578 30647 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.689950 28602 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.690325 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.691560 30647 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.692193 28747 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:17.693823 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1549) took 1080 ms. Trace:
I20260709 12:18:17.665623 30625 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.680759 28599 rpcz_store.cc:276] 0709 12:18:15.125111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.444505 (+319394us) service_pool.cc:224] Handling call
0709 12:18:15.444843 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.583838 (+2138995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.680182 (+ 96344us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54000a7b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:17.680343 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4341356800}
I20260709 12:18:17.698189 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.698822 28599 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:17.699678 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:17.651489 30824 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.705832 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:17.707087 30824 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:17.666458 30816 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 12:18:17.708644 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:17.709137 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:17.709525 30703 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:17.725265 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.726850 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.569811 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:17.610949 30752 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.566069 30459 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.459097 30569 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:17.308369 30799 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:17.634277 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2040) took 1328 ms. Trace:
I20260709 12:18:17.565864 30803 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:17.632380 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 372822us
I20260709 12:18:17.643568 28680 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:17.618397 30828 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:17.574769 30766 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:17.634457 30741 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:17.625234 30576 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.653959 28603 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:17.654793 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 614) took 1559 ms. Trace:
I20260709 12:18:17.765220 29326 rpcz_store.cc:276] 0709 12:18:16.095615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.096374 (+   759us) service_pool.cc:224] Handling call
0709 12:18:16.452638 (+356264us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:16.452831 (+   193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.453191 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.453220 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:16.453718 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:18:16.618462 (+164744us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:16.618605 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.618794 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.650400 (+1031606us) raft_consensus.cc:1685] finished
0709 12:18:17.650419 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.654727 (+  4308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17570,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"spinlock_wait_cycles":2578304,"thread_start_us":161331,"threads_started":1,"wal-append.queue_time_us":328842}
I20260709 12:18:17.656188 28676 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:17.651239 30792 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:17.657758 30833 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:18:17.658471 30830 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:18:17.652259 28749 rpcz_store.cc:276] 0709 12:18:16.418201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.420527 (+  2326us) service_pool.cc:224] Handling call
0709 12:18:16.420827 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.494966 (+ 74139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.494997 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:16.511829 (+ 16832us) log.cc:844] Serialized 26 byte log entry
0709 12:18:16.707006 (+195177us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:16.707111 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.707294 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.649147 (+941853us) raft_consensus.cc:1685] finished
0709 12:18:17.649167 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.649310 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82827,"raft.queue_time_us":73876,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":16040,"thread_start_us":138106,"threads_started":1,"wal-append.queue_time_us":353140}
I20260709 12:18:17.773566 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.774297 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 553) took 1259 ms. Trace:
I20260709 12:18:17.740739 30693 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.669091 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 95857.6us
I20260709 12:18:17.710878 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:17.777619 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66800us
I20260709 12:18:17.777673 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:17.779526 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 402) took 1986 ms. Trace:
I20260709 12:18:17.711490 30716 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.779891 28682 rpcz_store.cc:276] 0709 12:18:15.793160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.793287 (+   127us) service_pool.cc:224] Handling call
0709 12:18:15.928663 (+135376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.641057 (+1712394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.779320 (+138263us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54003b7254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:17.779470 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3802429184}
I20260709 12:18:17.780397 30716 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:17.709352 28681 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.780893 30716 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:17.780838 30625 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:17.781908 30716 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:17.782570 30625 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:17.782954 30625 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:17.713537 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.784610 30703 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:17.784866 28750 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:17.785044 30703 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:17.785138 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1546) took 1191 ms. Trace:
I20260709 12:18:17.785441 30703 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:17.785815 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:17.787019 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:17.787599 28677 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.715169 30696 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:17.790971 30769 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 1.292s	user 0.003s	sys 0.000s
I20260709 12:18:17.791302 30835 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:17.792057 29325 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
I20260709 12:18:17.792769 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.637447 30827 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.793356 28749 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:17.793732 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.794327 29325 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:17.794337 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.795235 28749 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:17.721043 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:17.795912 28599 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:17.723544 28602 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:17.518169 30761 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.815544 30761 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.817909 30761 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:17.628957 28598 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:17.732803 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1550) took 1116 ms. Trace:
I20260709 12:18:17.694132 28747 rpcz_store.cc:276] 0709 12:18:16.613959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.265684 (+651725us) service_pool.cc:224] Handling call
0709 12:18:17.266069 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.692561 (+426492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.693595 (+  1034us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400337054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:17.693746 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979564416}
I20260709 12:18:17.734860 28751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42654
I20260709 12:18:17.821358 28751 raft_consensus.cc:606] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:17.821815 28751 raft_consensus.cc:614] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:17.735742 28754 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:17.736286 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:16.892793 29317 rpcz_store.cc:276] 0709 12:18:14.973779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.978743 (+  4964us) service_pool.cc:224] Handling call
0709 12:18:15.066767 (+ 88024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.723642 (+656875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.731129 (+  7487us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.779804 (+ 48675us) log.cc:844] Serialized 26 byte log entry
0709 12:18:16.036077 (+256273us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:16.046649 (+ 10572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.059931 (+ 13282us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.662116 (+602185us) raft_consensus.cc:1685] finished
0709 12:18:16.662147 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.690496 (+ 28349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101847,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6757,"thread_start_us":693464,"threads_started":2,"wal-append.queue_time_us":367628}
I20260709 12:18:17.643021 30756 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.745051 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:17.824149 28679 raft_consensus.cc:2376] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4. Re-sending same reply.
I20260709 12:18:17.827340 28680 raft_consensus.cc:2376] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4. Re-sending same reply.
I20260709 12:18:17.745875 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:17.748728 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 581) took 1245 ms. Trace:
I20260709 12:18:17.742525 28752 rpcz_store.cc:276] 0709 12:18:16.305963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.308841 (+  2878us) service_pool.cc:224] Handling call
0709 12:18:16.309166 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.309366 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:17.276659 (+967293us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.634020 (+357361us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:17.634059 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:17.634089 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.634141 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.634233 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":333310,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":134,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":1274355,"threads_started":2,"wal-append.queue_time_us":435862}
I20260709 12:18:17.829083 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.749374 30799 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:17.751713 30803 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.841080 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.773404 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 555) took 1257 ms. Trace:
I20260709 12:18:17.842182 30756 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:17.842352 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:17.843078 29327 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:17.843561 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.753855 30459 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.754508 30828 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:17.833271 29319 rpcz_store.cc:276] 0709 12:18:16.503254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.517375 (+ 14121us) service_pool.cc:224] Handling call
0709 12:18:17.747861 (+1230486us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:17.748095 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.748307 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.748344 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:17.748391 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:17.748445 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.748516 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.748655 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18029312}
I20260709 12:18:17.845319 30525 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:17.845590 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.845832 30525 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.845423 30828 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:17.846267 29319 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:17.847239 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.847811 29319 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:17.745126 30569 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.733623 30752 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:17.737450 30685 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 2.119s	user 0.013s	sys 0.000s
W20260709 12:18:17.758502 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.648488 28675 rpcz_store.cc:276] 0709 12:18:15.782281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.783621 (+  1340us) service_pool.cc:224] Handling call
0709 12:18:17.303489 (+1519868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:17.760711 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:17.768209 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.859578 28607 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:17.774595 29326 rpcz_store.cc:276] 0709 12:18:16.514783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.773315 (+1258532us) service_pool.cc:224] Handling call
0709 12:18:17.774245 (+   930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:17.860879 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:17.775171 30792 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.651438 30764 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.867633 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.801471 30710 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:17.796674 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:17.783746 30625 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.799944 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:17.876456 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 76571us
I20260709 12:18:17.794914 30827 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.785543 28753 rpcz_store.cc:276] 0709 12:18:16.593912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.145435 (+551523us) service_pool.cc:224] Handling call
0709 12:18:17.243654 (+ 98219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.276051 (+ 32397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.784875 (+508824us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b54001b3fd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:17.785068 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63931520}
I20260709 12:18:17.807291 28750 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:17.812232 28681 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:17.879045 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:17.879469 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.879935 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:17.880419 28751 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:17.880600 28681 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:17.814736 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.883291 28749 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:17.824836 28756 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:17.820505 28755 rpcz_store.cc:276] 0709 12:18:16.618301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.267113 (+648812us) service_pool.cc:224] Handling call
0709 12:18:17.267404 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.273711 (+  6307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.273745 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.274174 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.619310 (+345136us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:17.631423 (+ 12113us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.631692 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.631790 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.732510 (+100720us) raft_consensus.cc:1685] finished
0709 12:18:17.732537 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.732727 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5939,"prepare.queue_time_us":13364,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":38,"raft.queue_time_us":8314,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":32475,"spinlock_wait_cycles":13205888,"thread_start_us":310290,"threads_started":1,"wal-append.queue_time_us":422026}
I20260709 12:18:17.860898 30752 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.850797 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.851366 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:17.831219 28677 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:17.844201 28747 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:17.891263 28606 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:17.856509 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:17.857486 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 113210us
I20260709 12:18:17.891916 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:17.892278 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:17.876487 30802 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.002s
I20260709 12:18:17.866236 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.717523 30645 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:17.903067 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.904083 28607 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:17.872335 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:17.840551 30843 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.887462 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.842134 29322 rpcz_store.cc:276] 0709 12:18:16.515651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.307793 (+792142us) service_pool.cc:224] Handling call
0709 12:18:17.771723 (+463930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:17.888250 28755 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:17.887836 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.888836 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:17.865010 30803 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:17.893038 28606 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:17.860669 30744 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:17.865121 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:17.895689 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:17.891846 28598 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:17.896559 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:17.897154 28749 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:18:17.932578 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 139936us
I20260709 12:18:17.909941 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:17.933220 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 68183.9us
I20260709 12:18:17.933632 28607 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.936542 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:17.937222 28677 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:17.936820 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:17.937326 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:17.887804 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.943874 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:17.873335 30685 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.877271 30732 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:18:17.884227 30761 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:18:17.820787 30693 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:17.956221 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:17.916298 30577 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:17.936623 30759 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.405s	user 0.010s	sys 0.003s
I20260709 12:18:17.961218 28677 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:17.932096 30803 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.911814 30762 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:17.901361 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.973603 28607 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
W20260709 12:18:17.977649 28605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 306) took 2348 ms (client timeout 2037 ms). Trace:
I20260709 12:18:17.915854 30802 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:17.979916 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:17.932731 30736 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:17.990592 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:18.000929 28605 rpcz_store.cc:269] 0709 12:18:15.607028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.609910 (+  2882us) service_pool.cc:224] Handling call
0709 12:18:17.955659 (+2345749us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003db3d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:17.955825 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791676800}
I20260709 12:18:17.944252 30710 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:17.943253 30645 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:17.999264 28674 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:17.999786 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 136121us
I20260709 12:18:17.948650 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:17.986590 30647 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.997997 30648 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:17.979983 30576 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.977387 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:17.990787 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:17.945410 30744 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:17.962935 29319 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:18.015316 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:18.001863 30795 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:17.917208 30843 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.006074 30803 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:18.085987 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 106149us
I20260709 12:18:18.003005 30788 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.086887 28571 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.010433 30577 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:18.013844 30645 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.083706 30648 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.083055 30733 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:18.080642 30647 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.082644 30740 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.085098 30576 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.003852 30759 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.092689 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:18.113507 29326 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.014534 30762 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.087997 30736 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.015954 30710 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:18.090931 30795 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.104300 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:18.110493 30645 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.095774 29322 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:18.114873 30648 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.135219 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.112874 30788 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:18.114032 30733 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:18.116372 30792 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.119613 30647 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.231148 30710 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.159258 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:18.151430 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 136185us
I20260709 12:18:18.232801 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.190428 28603 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:18:18.233376 30846 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:18:18.133797 30814 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.471s	user 0.003s	sys 0.001s
W20260709 12:18:18.199445 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 95229.6us
W20260709 12:18:18.192415 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.121160 30576 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:18.191223 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 90499.7us
I20260709 12:18:18.217299 28677 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:18.209365 29325 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
W20260709 12:18:18.206688 28720 connection.cc:256] RPC call timeout handler was delayed by -1.5681339590000789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 12:18:18.219161 29321 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:18.123894 30766 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:18.200398 30761 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:18.139755 30827 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.219637 30736 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:18.224874 30569 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:18.225401 30847 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:18:18.154141 30693 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:18.227800 28754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1538) took 1640 ms (client timeout 2011 ms). Trace:
W20260709 12:18:18.258788 28754 rpcz_store.cc:269] 0709 12:18:16.587142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.587280 (+   138us) service_pool.cc:224] Handling call
0709 12:18:18.227585 (+1640305us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54003e8354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.227724 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283792128}
W20260709 12:18:18.153000 30845 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:18.157831 29323 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:18.201390 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.119839 30703 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.161954 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:18.251129 28720 connection.cc:256] RPC call timeout handler was delayed by -1.5447339590000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 12:18:18.251437 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:18.188397 30795 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.255192 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.276971 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.234448 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.266140 29326 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:18.262991 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:18.286067 28754 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.260064 30736 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.263864 30761 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.265333 30685 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.227136 30577 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.257201 30756 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:18.288501 28720 connection.cc:256] RPC call timeout handler was delayed by -1.1749432110000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 12:18:18.263387 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:18.312772 28720 connection.cc:256] RPC call timeout handler was delayed by -1.1650432110000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 12:18:18.313122 28720 connection.cc:256] RPC call timeout handler was delayed by -1.1497432110002137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 12:18:18.314563 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:18.317296 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53986.8us
I20260709 12:18:18.261112 30861 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.292752 30736 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.277423 29317 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 1.
I20260709 12:18:18.286306 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.317003 30782 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:18.291100 30744 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.278609 30788 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:18.331405 30862 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:18:18.332139 30859 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:18:18.332926 30858 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:18.337239 30752 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.393177 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.394202 30752 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.394320 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.322392 30867 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:18.395042 30867 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:18.395427 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.396003 29322 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.343710 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:18.349422 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.322208 30766 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.350633 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:18.411293 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 61980.9us
I20260709 12:18:18.361277 30551 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.414028 30577 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.362262 30645 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.416656 30625 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.418493 30645 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.352249 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.369568 30703 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.374882 30761 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:18.374958 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.376157 30843 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.312461 30733 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.378160 30762 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.379020 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.423241 29317 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 2.
W20260709 12:18:18.383922 30584 consensus_meta.cc:287] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.000s
I20260709 12:18:18.350416 30782 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:18.426679 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 74519us
I20260709 12:18:18.427711 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:18.386155 30856 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:18:18.386723 30525 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 12:18:18.317266 30716 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:18.388885 30689 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.340642 30861 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:18.396004 30867 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.396720 30759 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:18.395048 30758 consensus_meta.cc:287] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.000s
I20260709 12:18:18.398967 30835 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:18.400331 28678 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:18.339210 30651 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.001s
I20260709 12:18:18.401116 30788 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.341620 28754 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:18.408835 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.404326 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.351838 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.412642 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.420153 29325 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:18.460013 30835 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:18.444753 30525 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.460206 29326 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:18.461244 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.460986 30835 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.423781 30741 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.461846 29326 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:18.462042 30835 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.447506 29319 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:18.462666 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.463155 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.464304 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.429128 28673 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:18.465284 30772 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.465495 30758 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.465765 30772 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.431396 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:18.431185 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:18.458688 28604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1593) took 2755 ms (client timeout 1949 ms). Trace:
I20260709 12:18:18.445654 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:18.429916 30782 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.450503 30861 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.453477 30736 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.454294 30717 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:18.456120 30764 consensus_meta.cc:287] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.004s
W20260709 12:18:18.443027 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 187821us
I20260709 12:18:18.467702 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.487226 30764 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:18.487713 28676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1562) took 1658 ms (client timeout 1990 ms). Trace:
I20260709 12:18:18.472458 30758 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.472914 30799 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.473001 30728 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:18.490017 28681 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:18:18.490455 30728 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:18.490952 30827 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.443742 30742 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:18.491894 30742 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.491478 30827 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:18.492336 30742 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.441183 30568 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.469791 28601 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:18.470238 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 118464us
I20260709 12:18:18.493938 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.494691 30799 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:18.472494 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63784.7us
I20260709 12:18:18.494032 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:18.497475 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.497941 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:18.480255 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.501376 29317 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:18.501940 29321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 547) took 1988 ms (client timeout 2011 ms). Trace:
I20260709 12:18:18.502388 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:18.502319 29321 rpcz_store.cc:269] 0709 12:18:16.513366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.271351 (+757985us) service_pool.cc:224] Handling call
0709 12:18:18.501805 (+1230454us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400660154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.501891 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625175936}
I20260709 12:18:18.502560 30795 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.462154 30741 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:18.469453 28604 rpcz_store.cc:269] 0709 12:18:15.703273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.802004 (+ 98731us) service_pool.cc:224] Handling call
0709 12:18:18.458439 (+2656435us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003d2f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.458607 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644497152}
W20260709 12:18:18.448351 29318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 585) took 1812 ms (client timeout 1514 ms). Trace:
I20260709 12:18:18.480914 30734 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.457288 30648 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:18.483232 28752 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:18.503700 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.475980 30647 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.506309 30803 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.481241 30651 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:18.489434 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 399) took 2706 ms (client timeout 1861 ms). Trace:
I20260709 12:18:18.489629 30764 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:18.488087 28676 rpcz_store.cc:269] 0709 12:18:16.829286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.875904 (+ 46618us) service_pool.cc:224] Handling call
0709 12:18:18.487538 (+1611634us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b540001f4d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.487651 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745471744}
W20260709 12:18:18.478634 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66086.7us
I20260709 12:18:18.517699 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:18.456717 30848 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.369s	user 0.003s	sys 0.000s
I20260709 12:18:18.495095 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.496519 30871 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:18.526639 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.499156 30799 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:18.499812 30827 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.491425 30728 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.500515 30772 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.503062 29317 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.471666 29322 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:18.506619 28756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1553) took 1690 ms (client timeout 1938 ms). Trace:
W20260709 12:18:18.511463 28674 rpcz_store.cc:269] 0709 12:18:15.782651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.782789 (+   138us) service_pool.cc:224] Handling call
0709 12:18:18.489250 (+2706461us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b540016d354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.489364 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5068686208}
I20260709 12:18:18.513623 28601 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:18.484679 30736 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:18.572907 28648 connection.cc:256] RPC call timeout handler was delayed by -1.0899081499999284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 12:18:18.518841 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 414) took 1227 ms. Trace:
I20260709 12:18:18.528761 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.530710 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.573602 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.517376 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:18.573885 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45240.4us
I20260709 12:18:18.526029 30568 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:18.575351 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44751.6us
I20260709 12:18:18.509352 30756 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.565979 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.511869 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.568241 28600 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:18.568341 28756 rpcz_store.cc:269] 0709 12:18:16.816675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.897797 (+ 81122us) service_pool.cc:224] Handling call
0709 12:18:18.506426 (+1608629us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54001b49d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.506550 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215654016}
I20260709 12:18:18.564774 30764 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.529603 30871 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:18.572638 29327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 550) took 2058 ms (client timeout 1799 ms). Trace:
I20260709 12:18:18.462042 30525 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:18.576577 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.576822 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:18.566422 30841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.002s	sys 0.022s
I20260709 12:18:18.577479 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.529819 30696 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:18.577533 28676 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:18:18.577893 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 345080us
I20260709 12:18:18.578718 30568 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.581614 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:18.582003 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 64682us
I20260709 12:18:18.573391 28682 rpcz_store.cc:276] 0709 12:18:17.291077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.840626 (+549549us) service_pool.cc:224] Handling call
0709 12:18:17.841005 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.856367 (+ 15362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.856403 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.871555 (+ 15152us) log.cc:844] Serialized 26 byte log entry
0709 12:18:18.008110 (+136555us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:18.081123 (+ 73013us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.084582 (+  3459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.084690 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.406453 (+321763us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b1800046720. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:18:18.517771 (+111318us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b1800046720. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe795358f 00007f6fe0992571 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd
0709 12:18:18.518570 (+   799us) raft_consensus.cc:1685] finished
0709 12:18:18.518598 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.518767 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22306,"prepare.queue_time_us":73321,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":18394,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":17694,"spinlock_wait_cycles":23697152,"thread_start_us":100391,"threads_started":1,"wal-append.queue_time_us":209243}
I20260709 12:18:18.532955 30734 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:18.581542 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.578150 30758 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:18.511354 29318 rpcz_store.cc:269] 0709 12:18:16.635070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.889486 (+254416us) service_pool.cc:224] Handling call
0709 12:18:18.441112 (+1551626us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b5400611a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.447079 (+  5967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217575680}
W20260709 12:18:18.604873 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.634264 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:18.530330 30799 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.579557 30762 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:18:18.636535 29321 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:18.639238 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57797.5us
I20260709 12:18:18.616325 30577 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:18.640223 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63460.5us
I20260709 12:18:18.585878 30756 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.638733 30734 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.641489 30647 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.646778 29319 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:18.586158 29320 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:18.637188 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.646642 30799 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:18.585033 29327 rpcz_store.cc:269] 0709 12:18:16.514042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.897731 (+383689us) service_pool.cc:224] Handling call
0709 12:18:18.572414 (+1674683us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54007a0154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.572561 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379566848}
I20260709 12:18:18.647773 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:18.636516 30841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.003s	sys 0.023s
I20260709 12:18:18.584244 30853 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:18.651747 30875 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:18:18.653802 30852 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:18:18.653857 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 80340.4us
I20260709 12:18:18.585515 30576 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.655257 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.655795 30764 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:18.635727 30717 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.659114 30762 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:18.659669 30782 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:18.660673 30718 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:18.660699 29326 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:18.661718 30803 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:18.662418 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:18.662895 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.633324 30818 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.639662 30568 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.709740 29290 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:18.677923 30853 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:18.580906 30759 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:18:18.644213 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 545) took 2131 ms. Trace:
I20260709 12:18:18.643394 30863 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.714494 30863 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:18.716790 30863 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.717048 30782 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:18.711503 30718 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:18.718541 30718 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.645289 30631 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:18.720273 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.672749 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.580669 30736 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.646170 30525 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.648507 30696 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:18.675733 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.676636 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.667938 30734 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.682252 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.646843 30625 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:18:18.673234 30651 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.674942 30744 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:18.708225 30647 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.692719 29321 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
W20260709 12:18:18.699662 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44489.2us
I20260709 12:18:18.707429 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.678517 30577 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:18.666666 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:18.730815 28680 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.730938 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.730304 28681 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:18.722482 30835 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:18.739729 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:18.712684 29322 rpcz_store.cc:276] 0709 12:18:16.512879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.576929 (+2064050us) service_pool.cc:224] Handling call
0709 12:18:18.577182 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.577338 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:18.584682 (+  7344us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.643863 (+ 59181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:18.643931 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:18.643983 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.644052 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.644151 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2935,"prepare.queue_time_us":13657,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":11279,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":98,"thread_start_us":55805,"threads_started":1,"wal-append.queue_time_us":79201}
W20260709 12:18:18.721485 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48822.2us
I20260709 12:18:18.689499 30648 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:18.724515 29327 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:18.688867 30762 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:18.704524 30717 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:18.725458 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48880.9us
I20260709 12:18:18.748299 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:18.704463 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.675585 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.731582 30761 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:18.754499 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:18.743682 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.743917 28750 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:18.744218 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:18.744459 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:18.755920 28754 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:18.756022 28753 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:18.745133 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:18.757143 28747 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:18.723050 30853 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.746089 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:18.746450 28755 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:18.759719 28749 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:18.726238 30841 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:18.727591 30703 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:18.760625 30841 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.760660 30703 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:18.761204 30841 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.761749 30703 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.762957 30703 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.749318 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.764331 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.765566 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:18.726393 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44201.2us
I20260709 12:18:18.768186 30693 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.740319 30744 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:18.768901 30693 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:18.769203 30876 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:18:18.769297 30744 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:18.770730 30880 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:18:18.751314 30647 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:18.771533 30647 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:18.772424 30647 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.772897 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:18.773610 30842 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.875s	user 0.000s	sys 0.005s
I20260709 12:18:18.774111 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.775168 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:18.776700 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 485980us
I20260709 12:18:18.777856 30863 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:18.778092 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:18.779367 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1545) took 2185 ms. Trace:
I20260709 12:18:18.779429 30863 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:18.776135 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.729310 30866 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:18.709756 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.731446 30843 raft_consensus.cc:2764] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:18.784713 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.784410 28680 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:18.790143 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:18.790313 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.791078 28680 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:18.791577 28753 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:18:18.755502 28756 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:18.746506 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.758977 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.722294 30819 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:18:18.725401 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:18.776592 30879 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:18.740741 30818 raft_consensus.cc:2764] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:18:18.749406 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:18.733281 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.785722 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.793195 29318 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:18.779914 28748 rpcz_store.cc:276] 0709 12:18:16.593626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.858036 (+264410us) service_pool.cc:224] Handling call
0709 12:18:16.877319 (+ 19283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:16.976270 (+ 98951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.011316 (+ 35046us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.309475 (+298159us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.743649 (+434174us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:17.828748 (+ 85099us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.875402 (+ 46654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.875489 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.773104 (+897615us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:18.779031 (+  5927us) raft_consensus.cc:1685] finished
0709 12:18:18.779139 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.779301 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21367,"prepare.queue_time_us":37752,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":184793,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":8926,"spinlock_wait_cycles":8341248,"thread_start_us":271965,"threads_started":1,"wal-append.queue_time_us":457906}
I20260709 12:18:18.797158 30631 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:18:18.780405 30734 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.791985 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.798583 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.802243 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.753681 30835 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:18.807068 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:18.808961 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:18.887076 30835 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.887962 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:18.888547 28601 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:18.889128 30887 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:18.848803 30772 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:18:18.851096 30867 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.890988 30867 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.810704 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:18.812300 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:18.815951 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48469.3us
I20260709 12:18:18.846670 28675 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:18.759330 30761 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:18.820731 29323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 548) took 2307 ms (client timeout 1524 ms). Trace:
W20260709 12:18:18.908299 29323 rpcz_store.cc:269] 0709 12:18:16.513590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.552791 (+ 39201us) service_pool.cc:224] Handling call
0709 12:18:17.690172 (+1137381us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:18.820474 (+1130302us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54006275d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.820637 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090386560}
I20260709 12:18:18.825882 28598 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:18.759871 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:18.910120 29321 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:18.829392 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:18.830188 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:18.751098 30877 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:18.796790 30625 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.805267 30710 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:18.802243 30569 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:18.836338 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.803463 30871 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.844076 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:18.813572 30728 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:18.846258 29322 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:18.846688 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 113465us
I20260709 12:18:18.806453 30782 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:18.794137 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:18.796985 30803 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:18:18.849314 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63673.6us
I20260709 12:18:18.851497 28750 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:18.773761 30696 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:18.949532 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 119424us
I20260709 12:18:18.888684 30741 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:18.817164 28678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 412) took 1534 ms (client timeout 1997 ms). Trace:
I20260709 12:18:18.899893 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 314) took 1048 ms. Trace:
I20260709 12:18:18.954324 28603 rpcz_store.cc:276] 0709 12:18:17.851620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.917818 (+ 66198us) service_pool.cc:224] Handling call
0709 12:18:18.190201 (+272383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.233464 (+ 43263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.899694 (+666230us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54002c0e50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.899831 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559595264}
I20260709 12:18:18.887125 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:18.905650 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:18.955650 28600 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:18.848589 30736 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:18.912592 29321 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:18:18.913039 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:18.960359 28598 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.914040 28601 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:18.914794 28606 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:18.916577 30710 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.912210 30761 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.949111 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 554) took 2433 ms. Trace:
I20260709 12:18:18.952795 30569 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:18.852646 28680 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:18.993237 28680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:18.993974 28680 raft_consensus.cc:606] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.994899 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:18.954012 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.997131 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:18.903977 30819 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.953225 30584 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:18.960474 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 586) took 2322 ms. Trace:
I20260709 12:18:18.894402 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 584) took 2263 ms. Trace:
I20260709 12:18:18.990878 30803 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:19.006103 30803 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:19.005904 29319 rpcz_store.cc:276] 0709 12:18:16.631099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.831292 (+2200193us) service_pool.cc:224] Handling call
0709 12:18:18.877649 (+ 46357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.893888 (+ 16239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.893935 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:18.894005 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:18.894063 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.894151 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.894322 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:18.918972 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:18.892102 30717 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:18.953961 28678 rpcz_store.cc:269] 0709 12:18:17.283586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.592498 (+308912us) service_pool.cc:224] Handling call
0709 12:18:18.816887 (+1224389us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400251f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:18.817084 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744576896}
I20260709 12:18:18.919826 30625 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:18.916839 30770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.619s	user 0.007s	sys 0.023s
I20260709 12:18:19.009605 30885 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:18:19.009861 30770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.716s	user 0.008s	sys 0.023s
I20260709 12:18:19.010193 30885 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:19.010452 30625 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.916126 30576 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:19.011214 30885 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:19.017210 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 98314.2us
I20260709 12:18:19.018126 30646 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:19.019358 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:19.020130 30646 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:19.021689 30741 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:19.021821 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:19.023679 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:19.025902 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:19.027315 30736 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.027881 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:18.991540 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 193057us
I20260709 12:18:19.029158 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:18.999230 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:18.955823 30871 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:19.002069 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:18.911042 28599 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.003448 29321 rpcz_store.cc:276] 0709 12:18:16.637996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.910724 (+2272728us) service_pool.cc:224] Handling call
0709 12:18:18.912295 (+  1571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.960165 (+ 47870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.960397 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:18.982533 30710 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.007344 30803 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:18.951071 28674 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:19.028033 30736 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:19.030416 28605 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.918570 30734 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:18.983268 30877 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:19.074002 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.074446 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.029412 30735 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.083034 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:19.059895 30625 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:19.083395 30735 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.083775 28753 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:19.084064 30625 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:18.989804 30728 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:19.084555 30625 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.085682 30735 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.057754 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:19.085445 30728 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.087165 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:19.088447 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:19.075821 28752 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:19.061868 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:19.074930 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.094787 28756 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:18.919432 30766 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 12:18:18.955943 30782 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:19.126900 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 221365us
I20260709 12:18:19.031971 30879 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:19.043079 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48281.7us
W20260709 12:18:19.069180 30881 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:18:19.131201 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:19.134825 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:19.149369 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:19.149610 29321 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:19.135349 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:19.150079 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:19.150279 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 618) took 1568 ms. Trace:
I20260709 12:18:19.150751 28752 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:19.051091 28600 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:19.031170 30867 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:19.082044 30790 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:19.031625 30584 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:19.141860 28605 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:19.144850 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.146276 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.038604 30871 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:19.026567 30756 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.151116 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:19.150597 29321 rpcz_store.cc:276] 0709 12:18:17.581578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.114280 (+1532702us) service_pool.cc:224] Handling call
0709 12:18:19.149437 (+ 35157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.150050 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.150230 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:19.113148 30735 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:19.162189 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:19.161996 30735 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.162830 29321 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.112018 30741 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:19.164947 30741 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:19.166133 30735 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.151751 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:19.166977 28600 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:19.167930 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:19.128082 30693 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:19.154641 30742 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.001s
I20260709 12:18:19.070004 30841 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.154721 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:19.152420 30803 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:19.190135 28605 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:19.156476 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.158233 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:18.989845 29318 rpcz_store.cc:276] 0709 12:18:16.515375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.792659 (+2277284us) service_pool.cc:224] Handling call
0709 12:18:18.792970 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.851201 (+ 58231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.918760 (+ 67559us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:19.159287 28648 connection.cc:256] RPC call timeout handler was delayed by -1.4445241060000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:18:19.160318 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:19.169059 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:19.151139 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:19.125705 30646 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:19.124966 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 552) took 2610 ms. Trace:
I20260709 12:18:19.178032 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:19.153807 28599 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:19.192126 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:19.157492 30584 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.153573 30790 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.158788 30871 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.194317 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:19.221292 29321 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:19.228143 28598 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:19.218914 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 183561us
I20260709 12:18:19.226941 28600 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:19.226497 28678 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.228160 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:19.227047 29327 rpcz_store.cc:276] 0709 12:18:16.514543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.748072 (+2233529us) service_pool.cc:224] Handling call
0709 12:18:18.748337 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.748570 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:18.850720 (+102150us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.123888 (+273168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.124009 (+   121us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:19.124094 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.124270 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.124533 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3321,"prepare.queue_time_us":22787,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":149,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9805,"thread_start_us":368412,"threads_started":2}
W20260709 12:18:19.231388 28648 connection.cc:256] RPC call timeout handler was delayed by -1.4319241059999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 12:18:19.232537 28753 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.165871 30741 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.233202 30877 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.194804 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:19.240056 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:19.250764 28648 connection.cc:256] RPC call timeout handler was delayed by -1.3923241059999327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:18:19.255051 28604 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:19.062606 30569 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.332119 28747 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:19.359259 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 598) took 1605 ms. Trace:
I20260709 12:18:19.315671 28676 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: [2.4-5.5]
I20260709 12:18:19.581895 29327 rpcz_store.cc:276] 0709 12:18:17.753960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.358364 (+1604404us) service_pool.cc:224] Handling call
0709 12:18:19.358758 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.358938 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.358962 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.358999 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:19.359036 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.359093 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.359205 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:19.242964 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48777.9us
I20260709 12:18:19.584606 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:19.585433 28756 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:19.588994 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:19.589212 28753 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:19.595135 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:19.563253 28678 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:19.589982 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 616) took 2050 ms. Trace:
I20260709 12:18:19.592901 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:19.593024 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:19.249436 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.597446 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:19.597508 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:19.598285 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2609241059999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 12:18:19.598611 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2492241059999287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:18:19.598839 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2276241059998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 12:18:19.599591 28749 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:19.599895 28754 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:19.351294 30703 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260709 12:18:19.600832 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:19.606098 28752 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:19.600733 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:19.603858 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 409121us
I20260709 12:18:19.602166 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:19.346963 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.395514 29317 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.785s	user 0.006s	sys 0.005s
I20260709 12:18:19.603863 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.358075 30756 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.606029 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:19.607311 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:19.621575 28752 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:19.621629 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.610419 28603 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:19.359203 30881 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:18:19.282464 30758 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.000s
I20260709 12:18:19.234958 30893 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:19.568120 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 596) took 1825 ms. Trace:
I20260709 12:18:19.355667 30733 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.254886 30735 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.629128 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:19.621887 30576 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.614311 30799 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.934s	user 0.009s	sys 0.000s
I20260709 12:18:19.604312 30772 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:19.609268 30882 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:19.338488 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 579) took 2860 ms. Trace:
I20260709 12:18:19.617252 30631 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:19.194166 30742 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.578212 30879 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:19.618130 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:19.236452 30790 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.254068 30734 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:19.601334 30568 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.878s	user 0.014s	sys 0.002s
I20260709 12:18:19.619853 28754 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:19.300237 30888 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:18:19.620087 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.649001 30882 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:19.580821 30841 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.623100 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.686118 28756 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:19.603575 30740 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:19.611833 30874 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:19.631237 28752 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:19.618351 30732 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:19.634742 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:19.693506 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58870.9us
I20260709 12:18:19.649358 30799 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.619467 29317 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:19.646070 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 549) took 3132 ms. Trace:
I20260709 12:18:19.647140 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:19.647377 28603 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:19.618533 30801 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:18:19.627857 30758 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:19.252089 30646 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.629967 30782 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:19.626113 30893 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:19.630951 30685 raft_consensus.cc:2764] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:18:19.673292 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55226.1us
I20260709 12:18:19.649123 30772 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.620216 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.683823 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:19.705478 30764 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:19.692466 28752 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:19.703341 30459 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:19.695304 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:19.192919 30853 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.695405 28676 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:19.759223 28676 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:19.760309 28676 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.761791 28676 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.696545 29325 rpcz_store.cc:276] 0709 12:18:16.513820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.603824 (+2090004us) service_pool.cc:224] Handling call
0709 12:18:18.604284 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.634916 (+ 30632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.634950 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.639497 (+  4547us) log.cc:844] Serialized 26 byte log entry
0709 12:18:18.738246 (+ 98749us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:18.746463 (+  8217us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.746752 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.746839 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.645763 (+898924us) raft_consensus.cc:1685] finished
0709 12:18:19.645794 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.645987 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6304,"prepare.queue_time_us":7944,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":2486,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":8731,"thread_start_us":67408,"threads_started":1,"wal-append.queue_time_us":169634}
I20260709 12:18:19.688624 30882 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.684479 30728 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:19.697809 30732 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.626605 29318 rpcz_store.cc:276] 0709 12:18:17.738299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.298689 (+1560390us) service_pool.cc:224] Handling call
0709 12:18:19.478838 (+180149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.510465 (+ 31627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.512553 (+  2088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.521222 (+  8669us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:19.531177 (+  9955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.535160 (+  3983us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.563717 (+ 28557us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:19.696837 30625 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260709 12:18:19.712162 28751 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:19.692081 30874 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:19.716751 28754 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:19.645026 30735 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.700959 30852 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:19.686009 30584 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.684852 30568 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.713619 30871 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.720871 28753 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:19.687476 30879 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.705266 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 601) took 1208 ms. Trace:
I20260709 12:18:19.650722 29320 rpcz_store.cc:276] 0709 12:18:16.478368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.495280 (+ 16912us) service_pool.cc:224] Handling call
0709 12:18:17.697428 (+1202148us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aeee 000000000036eb39 00007f6fe89ce1e0 00007f6fe8a970c4 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:18.574765 (+877337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.678004 (+103239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.338208 (+660204us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54007a0150. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:19.338388 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035254400}
I20260709 12:18:19.733582 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 617) took 2158 ms. Trace:
I20260709 12:18:19.735656 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 570) took 1401 ms. Trace:
I20260709 12:18:19.779469 29326 rpcz_store.cc:276] 0709 12:18:18.333966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.469561 (+135595us) service_pool.cc:224] Handling call
0709 12:18:19.735436 (+1265875us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540042a9d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:19.735580 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373534592}
I20260709 12:18:19.731072 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 557) took 1853 ms. Trace:
I20260709 12:18:19.780618 29321 rpcz_store.cc:276] 0709 12:18:17.877967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.360195 (+1482228us) service_pool.cc:224] Handling call
0709 12:18:19.361331 (+  1136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.625824 (+264493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.625854 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.625892 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:19.625921 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.730756 (+104835us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54007a5b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:19.730842 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.730998 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607770368}
I20260709 12:18:19.732614 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1570) took 1024 ms. Trace:
I20260709 12:18:19.745074 28599 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:19.742229 28604 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:19.779322 29319 rpcz_store.cc:276] 0709 12:18:17.575351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.007412 (+1432061us) service_pool.cc:224] Handling call
0709 12:18:19.007747 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.360023 (+352276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.360056 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.360105 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:19.360138 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.733226 (+373088us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54007a67d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:19.733307 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.733473 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809617280}
I20260709 12:18:19.778891 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 624) took 1117 ms. Trace:
I20260709 12:18:19.729176 28601 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:19.713434 30893 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.716883 30772 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.772363 30728 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:19.704497 28756 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:19.767452 29325 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:19.797773 28603 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:19.798314 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 627) took 1084 ms. Trace:
I20260709 12:18:19.798697 29325 rpcz_store.cc:276] 0709 12:18:18.713902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.766835 (+1052933us) service_pool.cc:224] Handling call
0709 12:18:19.767223 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.798078 (+ 30855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.798256 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:19.799865 29325 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:19.722400 30459 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:19.774176 28681 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:19.647470 30576 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.784792 28676 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:18:19.786069 29320 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:19.777925 29317 rpcz_store.cc:276] 0709 12:18:18.497238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.502139 (+  4901us) service_pool.cc:224] Handling call
0709 12:18:19.701184 (+1199045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:19.771950 30874 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.786726 30568 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:19.757431 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62206.4us
I20260709 12:18:19.792709 28680 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:19.792515 29327 rpcz_store.cc:276] 0709 12:18:18.661392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.583199 (+921807us) service_pool.cc:224] Handling call
0709 12:18:19.583511 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.583778 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:19.695250 (+111472us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.778027 (+ 82777us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.778094 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:19.778152 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.778250 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.778416 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132438,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":949,"thread_start_us":193284,"threads_started":2}
I20260709 12:18:19.795433 28677 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:19.811616 29326 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:18:19.803663 28676 pending_rounds.cc:85] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 3
I20260709 12:18:19.797834 30912 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:19.812826 28676 pending_rounds.cc:107] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:18:19.815521 28676 raft_consensus.cc:2889] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:19.788014 28675 rpcz_store.cc:276] 0709 12:18:18.707707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.709525 (+  1818us) service_pool.cc:224] Handling call
0709 12:18:18.826057 (+116532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.912304 (+ 86247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.732304 (+820000us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400251f50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:19.732523 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244932480}
I20260709 12:18:19.771485 30625 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:19.820647 29327 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:19.826397 30909 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:18:19.827351 30906 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:19.828501 30911 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:18:19.829375 30584 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.832871 30799 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:19.833695 30576 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:19.833690 30728 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.834607 30735 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:19.837163 30905 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:18:19.822585 30801 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:18:19.838860 30870 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.839594 30801 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:19.839474 30870 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.840119 30801 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:19.841265 30801 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:19.842592 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.769449 30762 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:19.842780 30710 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.000s
W20260709 12:18:19.849990 28673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1564) took 2680 ms (client timeout 1514 ms). Trace:
W20260709 12:18:19.850733 28673 rpcz_store.cc:269] 0709 12:18:17.169227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.249970 (+ 80743us) service_pool.cc:224] Handling call
0709 12:18:19.849786 (+2599816us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001bd354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:19.849920 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2597557504}
I20260709 12:18:19.809301 30742 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:19.868100 29319 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:19.873843 30801 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.868477 30459 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.876783 30459 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.877310 30853 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:19.876847 30874 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:19.879587 30874 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.881287 30732 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.882709 30871 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.883597 29317 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:19.816721 29318 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:19.885671 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 628) took 1171 ms. Trace:
I20260709 12:18:19.886050 29318 rpcz_store.cc:276] 0709 12:18:18.714194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.775879 (+1061685us) service_pool.cc:224] Handling call
0709 12:18:19.799205 (+ 23326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.885317 (+ 86112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.885594 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:19.853392 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 629) took 1127 ms. Trace:
I20260709 12:18:19.887851 29320 rpcz_store.cc:276] 0709 12:18:18.723649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.785522 (+1061873us) service_pool.cc:224] Handling call
0709 12:18:19.785869 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.812515 (+ 26646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.850622 (+ 38107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:19.895402 30879 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:19.901958 30761 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.873s	user 0.008s	sys 0.005s
I20260709 12:18:19.859462 30710 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:19.921875 30897 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.688s	user 0.005s	sys 0.001s
I20260709 12:18:19.922168 30882 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:19.902196 30762 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:19.950555 30795 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:19.951722 30752 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:18:19.995440 30893 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:19.996686 30857 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.018s	sys 0.020s
W20260709 12:18:20.006126 30857 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.018s	sys 0.020s
W20260709 12:18:20.049847 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.056310 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.070429 28600 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:20.076398 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1575) took 1287 ms. Trace:
I20260709 12:18:20.084314 28682 rpcz_store.cc:276] 0709 12:18:18.788510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.886754 (+ 98244us) service_pool.cc:224] Handling call
0709 12:18:18.887109 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.906697 (+ 19588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.906730 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.907255 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.157411 (+250156us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:19.157471 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.157569 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.921227 (+763658us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:20.075267 (+154040us) raft_consensus.cc:1685] finished
0709 12:18:20.075367 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.076064 (+   697us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10946,"raft.queue_time_us":19574,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"spinlock_wait_cycles":81419648,"thread_start_us":249758,"threads_started":1,"wal-append.queue_time_us":326440}
I20260709 12:18:20.082691 28602 raft_consensus.cc:2410] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:18:20.089540 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.075111 28679 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:20.092909 30625 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.094722 30648 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:20.095885 30648 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.100069 30651 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:20.101171 30651 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.101598 30710 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:19.937175 30761 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.104684 30651 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:20.091851 28679 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.107543 28679 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.108179 30761 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.109694 28679 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.116968 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1566) took 1373 ms. Trace:
I20260709 12:18:20.126163 28751 rpcz_store.cc:276] 0709 12:18:18.743608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.745047 (+  1439us) service_pool.cc:224] Handling call
0709 12:18:18.745726 (+   679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.769458 (+1023732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.116206 (+346748us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54001c4b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:20.116694 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222080896}
W20260709 12:18:20.072463 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 256629us
I20260709 12:18:20.140971 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.141935 28682 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:20.149698 30685 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:20.150247 30685 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.151765 30685 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.177501 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2002) took 1061 ms. Trace:
I20260709 12:18:20.178073 28599 rpcz_store.cc:276] 0709 12:18:19.099119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.226857 (+127738us) service_pool.cc:224] Handling call
0709 12:18:19.744885 (+518028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.787246 (+ 42361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.159901 (+372655us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54003d3950. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:20.160177 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188447616}
I20260709 12:18:20.193450 30648 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:20.197355 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.198976 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.199285 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.151906 30772 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.210559 28679 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
W20260709 12:18:20.211750 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 125587us
W20260709 12:18:20.212939 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.214720 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.210981 28679 pending_rounds.cc:85] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 6
I20260709 12:18:20.218109 30718 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:20.219285 30718 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:20.219653 30718 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.219691 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.220762 30893 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:20.222946 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.224743 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.224838 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.225672 28678 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:20.225374 30718 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:20.226740 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.226862 30718 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.228586 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.215889 28679 pending_rounds.cc:107] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:18:20.230403 28679 raft_consensus.cc:2889] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:20.231634 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2005) took 1131 ms. Trace:
I20260709 12:18:20.177067 30790 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.232100 28600 rpcz_store.cc:276] 0709 12:18:19.100421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.238100 (+137679us) service_pool.cc:224] Handling call
0709 12:18:19.243564 (+  5464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:20.083496 (+839932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.231319 (+147823us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b540004bd54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:20.231564 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1900168448}
I20260709 12:18:20.236645 28673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:20.243324 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:20.248220 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 77060us
W20260709 12:18:20.251539 30918 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260709 12:18:20.251816 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.253597 28755 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:20.256603 30882 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:20.259262 28674 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:20.258139 30920 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:18:20.259635 30772 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:20.260840 28673 raft_consensus.cc:606] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:20.262995 28673 raft_consensus.cc:614] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:20.262046 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:20.273228 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.272614 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:20.276988 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.277895 28747 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:20.283638 30827 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:20.285202 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1568) took 1537 ms. Trace:
I20260709 12:18:20.284857 30827 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.285594 28750 rpcz_store.cc:276] 0709 12:18:18.747403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.755800 (+  8397us) service_pool.cc:224] Handling call
0709 12:18:18.756051 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.950284 (+194233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.284767 (+1334483us) spinlock_profiling.cc:243] Waited 95.1 ms on lock 0x7b54000e7c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:20.285043 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218727296}
W20260709 12:18:20.295951 28602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 323) took 1864 ms (client timeout 1731 ms). Trace:
W20260709 12:18:20.296584 28602 rpcz_store.cc:269] 0709 12:18:18.431053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.431174 (+   121us) service_pool.cc:224] Handling call
0709 12:18:20.295586 (+1864412us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54000bd954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:20.295749 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3683858688}
I20260709 12:18:20.299463 30867 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:20.300000 30867 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:20.302896 30924 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 12:18:20.305737 30827 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:20.305858 30867 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.310840 30870 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:20.312183 30867 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.596537 29322 rpcz_store.cc:276] 0709 12:18:17.540037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.953681 (+1413644us) service_pool.cc:224] Handling call
0709 12:18:18.981489 (+ 27808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.981747 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:18.987389 (+  5642us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.589630 (+602241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:19.589683 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:19.589733 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.589796 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.589922 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15913,"prepare.queue_time_us":6204,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":9995,"raft.queue_time_us":16037,"spinlock_wait_cycles":18998016,"thread_start_us":202076,"threads_started":1,"wal-append.queue_time_us":246009}
W20260709 12:18:20.306861 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1579) took 1275 ms (client timeout 1511 ms). Trace:
W20260709 12:18:20.318256 28674 rpcz_store.cc:269] 0709 12:18:19.031664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.082796 (+ 51132us) service_pool.cc:224] Handling call
0709 12:18:20.306603 (+1223807us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000c6a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:20.306785 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2689562880}
W20260709 12:18:20.319123 30916 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.490s	user 0.000s	sys 0.004s
I20260709 12:18:20.321943 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:20.290319 30685 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.324899 30893 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.325287 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:20.325605 30893 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.326704 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1571) took 1617 ms. Trace:
I20260709 12:18:20.327217 28604 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:20.327150 28681 rpcz_store.cc:276] 0709 12:18:18.708975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.827704 (+118729us) service_pool.cc:224] Handling call
0709 12:18:18.852729 (+ 25025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.802490 (+949761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.326193 (+523703us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54001bd854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:20.326520 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053237120}
I20260709 12:18:20.327987 30893 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.328610 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:20.329592 30893 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.330139 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:20.330524 30893 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.333992 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:20.334350 30893 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.334786 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:20.335830 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:20.335938 28598 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:20.338307 28601 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:20.338876 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:20.339937 30750 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:20.324939 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.339929 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:20.344259 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 329) took 1075 ms. Trace:
I20260709 12:18:20.344652 28605 rpcz_store.cc:276] 0709 12:18:19.268638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.339429 (+1070791us) service_pool.cc:224] Handling call
0709 12:18:20.344179 (+  4750us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:20.346213 30910 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.509s	user 0.000s	sys 0.001s
I20260709 12:18:20.350497 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:20.351676 28605 raft_consensus.cc:2368] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:20.353399 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:20.354216 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:20.357323 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:20.358356 28751 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.354956 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:20.360062 28598 raft_consensus.cc:2410] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:20.357372 28599 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
W20260709 12:18:20.360695 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.360594 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2008) took 1259 ms. Trace:
I20260709 12:18:20.362215 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:20.363022 28756 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.364001 30879 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:20.361831 28603 rpcz_store.cc:276] 0709 12:18:19.101267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.703152 (+601885us) service_pool.cc:224] Handling call
0709 12:18:19.717252 (+ 14100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.798326 (+ 81074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.360094 (+561768us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b5400216954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:20.360395 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184669952}
I20260709 12:18:20.366272 30885 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:20.367620 28600 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:20.354349 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:20.380856 28601 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:20.396231 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:20.391812 30874 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:20.407263 28600 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 12:18:20.401497 30874 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:20.406967 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 68348us
I20260709 12:18:20.409106 28750 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.410081 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.412755 28601 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:18:20.412704 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.413726 28601 pending_rounds.cc:85] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 5
I20260709 12:18:20.417006 28601 pending_rounds.cc:107] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:18:20.417343 28601 raft_consensus.cc:2889] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:20.419343 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:20.421592 29326 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.424772 30872 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.425537 30872 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:20.428683 30646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.005s	sys 0.015s
W20260709 12:18:20.429045 30646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.006s	sys 0.015s
I20260709 12:18:20.430197 28748 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:18:20.430351 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:20.405200 30893 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.431118 30646 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:20.431392 30893 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.432206 30790 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.433897 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:20.434281 29322 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:20.434930 29318 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:20.436487 29320 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:20.430390 30843 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:20.414740 30874 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:20.438787 28750 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:20.439495 30872 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.440644 29321 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:20.438390 30843 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.443661 30843 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:20.449448 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.452710 28751 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:20.452095 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57956.2us
I20260709 12:18:20.469305 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:20.457492 30872 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:18:20.470223 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.470453 30911 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.002s	sys 0.016s
W20260709 12:18:20.470829 30911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.002s	sys 0.016s
I20260709 12:18:20.471980 28680 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:20.459074 30827 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.475669 28573 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.470136 30889 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:18:20.499068 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:20.499223 30827 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.499835 29318 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.500753 30728 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:20.500993 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:20.502055 30728 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:20.502569 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:20.503337 29321 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:20.503810 30795 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:20.504329 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:20.505086 30795 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:20.505450 30795 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:20.505622 28606 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:20.505951 30718 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:20.506186 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:20.506542 30795 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.501091 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.509042 30893 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:18:20.509238 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:20.507457 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:20.511852 30863 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:20.512149 28601 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:20.512234 30863 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.513419 30863 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:20.514813 30863 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:20.516618 28747 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:20.517191 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:20.517824 28605 raft_consensus.cc:2376] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4. Re-sending same reply.
I20260709 12:18:20.519333 30827 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:20.520009 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.505654 30766 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:20.520810 30766 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:20.509048 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:20.524171 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2004) took 1423 ms. Trace:
W20260709 12:18:20.524389 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 59668.2us
I20260709 12:18:20.525935 30646 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:20.526652 30912 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:20.527091 30912 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.527259 30646 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:20.527650 30646 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:20.528939 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.529264 30646 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.530018 30569 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:20.530786 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 61494.3us
I20260709 12:18:20.531836 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.523178 30893 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:20.534430 30893 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:20.530884 30646 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.535550 30893 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.536087 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.537117 28677 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:20.539739 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:20.540562 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.541033 30795 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:20.541313 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.541639 30911 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:20.539628 30929 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:20.542568 30827 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:20.543501 30750 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:20.544330 28603 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:20.544179 30750 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:20.545596 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.545905 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:20.547174 30718 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:20.547556 30718 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.548396 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.549247 29320 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:20.528211 30912 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.550415 30885 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.551112 29325 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:20.550415 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:20.552248 29321 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:20.553710 30718 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.544519 30584 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:20.554873 30584 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.556047 30584 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.557207 30584 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:20.559554 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.560421 30827 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:20.542038 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.569108 30766 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.585976 29326 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:20.551129 30912 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.524863 28607 rpcz_store.cc:276] 0709 12:18:19.100144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.227708 (+127564us) service_pool.cc:224] Handling call
0709 12:18:20.227465 (+999757us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b5800003398. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:20.227819 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:20.228385 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:20.228416 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:20.229132 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 12:18:20.392850 (+163718us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:20.466057 (+ 73207us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.466548 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.466628 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.508603 (+ 41975us) raft_consensus.cc:1685] finished
0709 12:18:20.523820 (+ 15217us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.523961 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16274,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":218,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":314,"spinlock_wait_cycles":76186368,"thread_start_us":230757,"threads_started":2,"wal-append.queue_time_us":240716}
I20260709 12:18:20.593953 30827 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.594430 30827 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.594780 30827 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.597294 30766 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:20.598043 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.599378 30885 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.611225 30885 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.612895 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.613835 30911 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:20.614956 30911 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:20.616057 30911 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:20.616406 30911 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.616592 30929 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:20.617008 30929 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.618260 30790 raft_consensus.cc:1064] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:18:20.617900 30929 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.619130 30929 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:20.621070 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.624739 30911 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.626097 30911 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.626292 30874 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.627398 28598 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:18:20.623229 30790 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.641624 30885 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:20.642345 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 110592us
I20260709 12:18:20.643579 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.651281 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:20.652017 29326 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.653193 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:20.657070 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.657478 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:20.657809 28681 raft_consensus.cc:2368] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6.
I20260709 12:18:20.658062 29321 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:20.659799 28681 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: [2.4-5.5]
I20260709 12:18:20.659837 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:20.660152 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.660526 29321 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.668462 30874 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.670547 30827 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:20.677057 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 64314.4us
I20260709 12:18:20.677850 30911 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:20.678071 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:20.678435 30911 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:20.678979 30911 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.679265 30923 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:20.680423 30889 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:20.680606 30569 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.683115 30569 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:20.683518 30569 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.684799 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.685525 28681 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:20.687433 29292 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.555s (SENT) [suppressed 24 similar messages]
I20260709 12:18:20.690333 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.691228 30889 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:20.693053 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.693881 30889 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:20.695362 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:20.696200 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 52732.6us
I20260709 12:18:20.696771 30889 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:20.696880 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.698489 28675 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:20.698966 28677 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:20.705616 28679 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:20.708990 28681 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:20.709587 29326 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
W20260709 12:18:20.709969 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 119814us
I20260709 12:18:20.590553 30718 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:20.733443 28674 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:18:20.727463 30889 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:20.748224 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:20.755489 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.756193 29321 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:20.757913 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.741693 30867 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.761773 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.762354 28681 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.762262 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.764369 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.765117 28679 raft_consensus.cc:2368] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:20.750705 30889 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.770364 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:20.770862 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.774120 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 78880.1us
I20260709 12:18:20.774231 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.776149 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.776463 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.778941 28756 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:20.781229 28747 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:20.781579 28747 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:20.785630 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.786433 30872 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:20.784178 28504 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 3, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.787113 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.787937 28754 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:20.789588 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.776217 30893 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:20.790666 30870 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:20.791162 30893 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.795836 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.775974 30861 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:20.796885 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.797737 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.781355 30827 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:20.799685 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.800760 28747 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.782807 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:20.801774 28747 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:20.802211 28748 raft_consensus.cc:2368] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:20.805914 28750 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:20.807049 29318 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:20.807221 30569 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.787138 30872 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:20.784636 30867 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.809710 30872 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.810971 30867 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:20.811861 28722 leader_election.cc:336] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.949s (SENT)
I20260709 12:18:20.812372 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:20.814900 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:20.815594 30795 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:20.816330 30795 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.823092 28681 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:20.817639 30893 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:20.820883 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.827391 28679 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:20.828250 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.829319 30870 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:20.831614 30750 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:20.835184 30827 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:20.836740 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:20.842535 28751 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:20.848313 28747 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:18:20.848814 28747 pending_rounds.cc:85] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 5
I20260709 12:18:20.849182 28747 pending_rounds.cc:107] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:18:20.849488 28747 raft_consensus.cc:2889] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:20.849612 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:20.841339 28675 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:20.856209 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.857034 28679 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:20.860806 30893 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:20.861500 30893 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:20.864780 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.866596 30646 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:20.866729 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.834014 30795 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.876410 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.868557 30827 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:20.867332 30646 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:20.880939 30827 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.881260 30861 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:20.881390 30827 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.882026 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:20.881757 30646 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.882923 30710 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:20.866577 30893 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:20.879773 30569 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:20.890404 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.901117 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.890718 28504 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.903409 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:20.904839 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:20.853406 30870 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:18:20.883401 30710 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:20.881778 30861 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:20.906888 28504 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 6, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 6 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:20.913070 30939 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 12:18:20.909950 30867 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:20.933059 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.916110 30889 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.934427 30827 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.935042 30889 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.906934 30893 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:20.935772 30893 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:20.916649 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45426.7us
I20260709 12:18:20.921056 28503 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 304) took 7741 ms. Trace:
I20260709 12:18:20.924361 29290 leader_election.cc:400] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:20.939301 28747 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:20.924600 30885 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:20.925951 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.929108 28504 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 4, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 4 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:20.939559 29290 leader_election.cc:403] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:18:20.924881 28720 leader_election.cc:400] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6.
I20260709 12:18:20.942138 28720 leader_election.cc:403] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:20.950158 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.950960 28751 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:20.932175 30911 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.952736 28504 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 4, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.954504 28504 catalog_manager.cc:5697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 4, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.905680 30569 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:18:20.956137 28504 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:18:20.929862 30861 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:20.959043 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 86696.1us
I20260709 12:18:20.959568 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:20.961799 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:20.962747 30867 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:20.962891 30710 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:20.963752 30867 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:20.964123 30867 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:20.965284 30893 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:20.965111 30867 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:20.959064 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:20.936343 30827 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:20.970280 30867 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:20.970810 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46103.9us
I20260709 12:18:20.971274 30947 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:20.979521 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:20.973307 28504 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:20.979619 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.985384 28673 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:20.985833 30911 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:20.987241 30718 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:20.987799 30718 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:20.988071 30795 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:20.965899 30893 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:20.961084 30766 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.018467 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:21.025931 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 76571.7us
I20260709 12:18:21.027781 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:21.027629 30648 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:20.988790 30718 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.027452 30646 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:21.053954 28504 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:20.956873 30889 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:18:21.064054 30889 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:21.064522 30889 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:21.065412 30889 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.066601 30889 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.068537 30569 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:21.070698 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63317.5us
I20260709 12:18:21.012423 30728 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:21.075661 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.056249 28504 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 3, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:21.082139 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 158066us
I20260709 12:18:21.108067 28504 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.107728 30911 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.136832 30945 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:18:21.142493 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.149410 30943 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:18:20.938807 28503 rpcz_store.cc:276] 0709 12:18:13.231589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.236560 (+  4971us) service_pool.cc:224] Handling call
0709 12:18:20.920855 (+7684295us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:15.956165 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:16.101134 (+144969us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:16.104831 (+  3697us) write_op.cc:435] Acquired schema lock
0709 12:18:16.104855 (+    24us) tablet.cc:662] Decoding operations
0709 12:18:16.314817 (+209962us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:16.354468 (+ 39651us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:16.361242 (+  6774us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:18:16.728760 (+367518us) tablet.cc:701] Row locks acquired
0709 12:18:16.728778 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:18:16.789487 (+ 60709us) write_op.cc:270] Start()
0709 12:18:16.806086 (+ 16599us) write_op.cc:276] Timestamp: P: 1783599496785730 usec, L: 0
0709 12:18:16.806115 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:18:17.251565 (+445450us) log.cc:844] Serialized 4806 byte log entry
0709 12:18:18.782983 (+1531418us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b
0709 12:18:19.918581 (+1135598us) op_driver.cc:464] REPLICATION: finished
0709 12:18:20.255866 (+337285us) write_op.cc:301] APPLY: starting
0709 12:18:20.256341 (+   475us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:20.258010 (+  1669us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:20.258226 (+   216us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:20.278871 (+ 20645us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:20.280512 (+  1641us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:18:20.287570 (+  7058us) write_op.cc:312] APPLY: finished
0709 12:18:20.340323 (+ 52753us) log.cc:844] Serialized 89 byte log entry
0709 12:18:20.340599 (+   276us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:20.340983 (+   384us) write_op.cc:454] Released schema lock
0709 12:18:20.341090 (+   107us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:20.398833 (+ 57743us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:20.399605 (+   772us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1145101,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":336461,"apply.run_cpu_time_us":5551,"apply.run_wall_time_us":122835,"num_ops":12,"prepare.queue_time_us":406494,"prepare.run_cpu_time_us":42135,"prepare.run_wall_time_us":3069971,"raft.queue_time_us":185371,"raft.run_cpu_time_us":15297,"raft.run_wall_time_us":85925,"replication_time_us":3107786,"spinlock_wait_cycles":9929472,"thread_start_us":2056966,"threads_started":4,"wal-append.queue_time_us":1872921}]]}
I20260709 12:18:21.084509 30648 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:21.151101 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:21.177757 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 81294.2us
W20260709 12:18:21.151247 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55452.4us
I20260709 12:18:21.155586 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:21.156139 30827 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:21.161799 28504 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:21.176419 29292 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.037s (SENT)
I20260709 12:18:21.184871 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:21.196691 30795 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:18:21.199873 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:21.207926 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52446.3us
I20260709 12:18:21.177279 30648 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:21.186975 30893 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:21.208930 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43822.3us
I20260709 12:18:21.191277 30718 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.160400 30861 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:21.164793 30911 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:21.244648 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.190737 30728 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:18:21.212790 30893 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:21.248307 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.249526 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:21.256937 30954 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:18:21.257484 30867 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:21.258157 30867 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:21.258414 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 82055.2us
W20260709 12:18:21.251955 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.212131 30569 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:21.263149 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 235465us
I20260709 12:18:21.213032 30648 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:21.222327 28504 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 3, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.204907 30885 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:21.262118 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 71614.8us
I20260709 12:18:21.259768 30893 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:21.270051 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.209245 30843 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.271313 30843 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.273101 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:21.274540 28504 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.275090 28721 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:21.276656 28504 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.278525 28504 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.281924 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:21.284751 28504 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:21.296821 28747 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:21.301076 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:21.305226 30728 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:21.306085 30728 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:21.308676 30961 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.267346 30569 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:21.213773 30827 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:21.309257 30961 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:21.334117 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.335899 30911 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:21.337674 30843 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:21.339062 29318 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:21.285328 30957 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:21.340015 30957 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:21.313766 30885 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:21.346412 30885 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.346910 30885 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.324777 30646 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:21.324506 28504 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 6, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 6 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:21.325562 30923 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:21.325671 30867 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:21.327311 28756 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:21.328121 28750 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:21.329027 30861 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.329442 28748 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:21.330432 28754 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:21.331218 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:21.332403 28752 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:21.359567 28504 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:21.360328 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 113679us
W20260709 12:18:21.379612 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.384141 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 107281us
I20260709 12:18:21.386297 28673 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 12:18:21.386577 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46908.3us
I20260709 12:18:21.412590 28747 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:21.401894 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:21.414006 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:21.402308 28673 pending_rounds.cc:85] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 2
I20260709 12:18:21.415194 28673 pending_rounds.cc:107] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:18:21.415525 28673 raft_consensus.cc:2889] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:21.416833 30795 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.417327 30843 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.417501 30795 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:21.402734 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:21.418741 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:21.412952 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:21.402683 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:21.358661 30646 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.417963 30843 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.379745 30923 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:21.432176 28721 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:21.427654 28680 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:21.429556 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:21.397023 30960 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.309346 30728 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.449342 30965 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:21.456943 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 54281us
I20260709 12:18:21.449400 30911 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:21.467257 30766 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6.
I20260709 12:18:21.426812 30646 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:21.470944 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.476552 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.478348 30957 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:21.483716 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 200113us
W20260709 12:18:21.485900 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 54307.7us
I20260709 12:18:21.485107 30965 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.490952 30965 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.491484 30965 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:21.491585 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.496598 30718 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:21.497339 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:21.503324 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 168101us
I20260709 12:18:21.496256 30648 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.511379 30648 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:21.486512 30960 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.508486 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:21.521000 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 91546.2us
I20260709 12:18:21.523322 30870 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:21.523376 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:21.523609 30766 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:21.526321 30870 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:21.527429 30870 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:21.527755 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:21.515173 30874 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:21.570695 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:21.571952 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:21.576098 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54158.8us
W20260709 12:18:21.616858 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45027.6us
I20260709 12:18:21.529909 30959 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:21.530915 30795 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:21.634123 30929 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:21.637152 30961 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:21.638257 30569 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.641255 30950 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:21.642515 30827 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.574019 30874 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:21.578656 30766 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:21.623737 30710 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:21.529042 30923 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.623914 30893 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.678037 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:21.669376 30718 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:18:21.687042 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.668319 30710 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:21.686197 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 105435us
I20260709 12:18:21.669947 30959 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:21.683398 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 195057us
I20260709 12:18:21.703040 28678 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:21.704640 30744 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:21.705199 30744 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:21.705667 30744 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:21.673206 30646 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.710345 28753 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:21.710649 30646 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:21.716562 30953 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:18:21.717907 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.719178 30766 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.736763 30960 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.737434 30960 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:21.737982 30960 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.683825 30964 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.745311 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:21.746227 28682 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:21.684464 30843 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.759591 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:21.756258 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:21.761111 28673 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:21.740161 30960 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:21.695583 30923 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:21.684052 30911 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:18:21.770402 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 240576us
W20260709 12:18:21.776226 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.782667 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.791293 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 263604us
I20260709 12:18:21.801515 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:21.802508 28673 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:21.806440 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:21.809175 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:21.809496 28607 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:21.817756 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 312858us
I20260709 12:18:21.819725 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:21.820902 30980 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:21.821940 30980 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:21.823621 30980 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:21.824050 30980 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:21.825145 30980 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.826565 30980 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.834829 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:21.835619 29325 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:21.835791 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:21.837216 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:21.843832 29292 leader_election.cc:400] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:21.847249 30950 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:21.860615 30889 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:21.764655 30874 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:21.853624 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:21.860693 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:21.851279 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:21.865770 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:21.873500 28603 raft_consensus.cc:2368] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:21.814404 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:21.878618 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.887738 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.891558 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:21.891440 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:21.892385 28598 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:21.880836 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:21.881292 30952 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:21.897092 30952 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.897485 30952 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.897694 30960 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:21.898018 30982 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:21.897092 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:21.901878 30718 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.905982 30952 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:21.908340 30893 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.909718 30952 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.861856 30710 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:21.922535 28601 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:21.930240 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:21.891702 30943 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:18:21.921628 28600 raft_consensus.cc:2376] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7. Re-sending same reply.
I20260709 12:18:21.931578 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:21.935403 28607 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 2: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:21.913955 30976 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:21.941638 30744 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:21.942257 30976 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:21.943310 30976 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:21.932284 30969 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:18:21.944478 30744 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.935472 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:21.946038 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.945772 28601 raft_consensus.cc:2376] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6. Re-sending same reply.
I20260709 12:18:21.948518 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:21.949173 30976 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.872843 30959 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.926662 30929 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:18:21.958045 30885 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.002s
I20260709 12:18:21.958683 30885 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:21.960749 30885 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:21.958144 28605 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:22.025175 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:22.029368 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 218231us
W20260709 12:18:22.029850 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 239226us
I20260709 12:18:22.071633 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:21.979059 30911 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.088022 30982 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:22.088460 30982 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:22.089296 30982 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.063609 30893 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:22.097472 29320 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
W20260709 12:18:22.098603 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 217879us
I20260709 12:18:22.099392 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:22.109192 30843 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:22.109743 30843 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:22.110129 30843 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.110383 30979 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:22.111788 30977 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:22.113284 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.114048 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.114197 30994 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:22.114693 28603 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:22.114804 30994 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.115566 28601 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:18:22.115617 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:22.116045 28601 pending_rounds.cc:85] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 4
I20260709 12:18:22.116326 28601 pending_rounds.cc:107] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:18:22.116575 28601 raft_consensus.cc:2889] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:22.116761 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:22.117201 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 243746us
I20260709 12:18:22.114705 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:22.120419 28607 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:22.125775 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:22.130354 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 289715us
I20260709 12:18:22.127283 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:22.136021 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.137540 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:22.131556 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:22.138265 28678 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:22.142606 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.144269 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.147270 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:22.147571 28598 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:22.104305 30976 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:22.155351 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:22.155992 28603 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:22.155395 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.158351 28605 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:22.129961 30744 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:22.161985 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:22.163612 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:22.164319 28676 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:22.165145 30744 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.167366 30744 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:22.168984 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:22.169546 28752 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.172055 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.173290 28754 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:22.175590 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44100.6us
I20260709 12:18:22.181272 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.182080 28682 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:22.184600 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.186602 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.187582 28673 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:22.188534 29321 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:22.189472 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.190630 28605 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 2. Current term is 4. Ops: []
I20260709 12:18:22.190645 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:22.190471 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.195560 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:22.192466 29322 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:22.215752 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.215921 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:22.216748 29321 raft_consensus.cc:2410] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:22.216713 28606 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:22.221204 28747 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:22.222254 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.224936 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.233067 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.233528 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:22.237601 28599 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:22.239738 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.242468 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:22.243040 29325 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.244500 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:22.244728 28605 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:22.246646 28756 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:18:22.249188 28607 raft_consensus.cc:2368] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5.
I20260709 12:18:22.180768 30976 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.250725 29322 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:22.255185 28750 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:22.255447 30976 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:22.244522 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:22.256050 30976 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:22.241540 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:22.256560 30976 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:22.256678 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:22.257061 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:22.257615 28673 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.257510 30976 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.260974 30718 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.261467 31001 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:22.261883 31001 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:22.262435 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:22.263032 28750 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:22.262709 31001 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.263953 31001 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.263923 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:22.297478 28750 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:22.266803 29317 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:18:22.250846 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:22.313486 29321 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.314337 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:22.268807 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:22.269766 29326 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:22.269894 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.318037 29322 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:22.271765 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.272059 30923 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.272539 30827 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.273016 30952 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:22.328944 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.329777 28605 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:18:22.274513 28673 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:22.272540 30995 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:22.261488 30718 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.280267 30744 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.281149 29292 leader_election.cc:400] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:22.256711 28603 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.281785 30980 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.283458 28681 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:22.284924 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.286243 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.223614 30994 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:22.352463 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66296.7us
I20260709 12:18:22.353168 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.236743 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:22.293660 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 220374us
I20260709 12:18:22.294173 28678 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:22.300613 28601 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:22.301142 28752 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:22.297415 28754 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:22.317041 28751 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.320225 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:22.315802 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:22.321051 28755 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:22.321393 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.326241 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:22.328161 29321 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:22.358117 28607 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.333738 29322 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:22.335196 29326 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:22.348824 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 67793.6us
I20260709 12:18:22.325537 30979 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.362715 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.363125 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:22.360162 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.319396 30923 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.361783 29321 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:18:22.363953 29321 pending_rounds.cc:85] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 6
I20260709 12:18:22.363873 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:22.364291 29321 pending_rounds.cc:107] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:18:22.364565 29321 raft_consensus.cc:2889] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:22.365118 28747 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:22.346400 30995 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:22.370823 28674 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:22.372357 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:22.373837 30893 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:22.377040 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.361136 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.331115 30827 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.381315 30945 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:18:22.382076 30994 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:18:22.361132 30744 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.365950 30947 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:22.384770 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:22.361240 31003 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:22.384300 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:22.392903 29292 leader_election.cc:336] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.555s (SENT)
I20260709 12:18:22.391932 29323 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:22.384852 31014 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.378648 30569 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:22.393735 30872 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:22.414207 28751 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:22.394636 28755 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:18:22.396661 28603 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:22.414740 29325 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:22.397639 30744 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:22.397730 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:22.398015 30945 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:22.398186 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.379513 30889 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.404510 29318 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:22.367615 30874 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:22.406694 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.406720 28750 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.382509 30960 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:22.378932 30950 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.419010 30945 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:22.442776 30945 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.443389 28607 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:22.444737 29319 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.419119 31003 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.447417 31003 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:22.448840 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50751.7us
I20260709 12:18:22.449668 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.452809 28600 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:22.454670 31001 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:22.415347 31014 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.455394 31001 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:22.399035 28754 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:18:22.456790 31001 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:22.457197 31001 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:22.433159 30889 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:22.457638 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.458456 29320 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:22.353035 30980 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.459332 30889 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:22.432564 31000 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:22.460754 30980 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:22.437675 30923 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:22.440551 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.458473 31001 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.463186 30982 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.463949 31001 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.436123 30718 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:22.464983 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:22.466998 30980 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:22.467545 30980 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:22.468465 30980 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.457144 31014 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:22.472301 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.444093 30945 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.474466 29317 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:18:22.478245 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 687204us
I20260709 12:18:22.478986 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:22.484813 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.485461 28682 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:22.485543 30957 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.485999 30957 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.487299 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:22.487970 30957 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:22.488233 30966 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:22.488793 30966 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.489204 30966 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.491290 30867 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:22.491698 30867 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.492023 30867 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.433355 30995 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.412684 28599 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:22.506326 28676 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:22.500104 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.507185 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.420531 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:22.509315 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.509668 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.510247 28673 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:22.512391 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 345193us
I20260709 12:18:22.427871 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:22.514331 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.515170 30995 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.500661 30960 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.516201 30961 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:22.517503 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.516848 30960 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.526383 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.419849 30843 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.528152 31001 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:22.528862 30965 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:22.529160 31001 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:22.534109 28750 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:22.433718 30827 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:22.540333 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 147441us
I20260709 12:18:22.543041 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.545836 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.547533 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:22.548775 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 128324us
I20260709 12:18:22.524690 30885 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.550590 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:22.522969 30728 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:22.562253 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44819.4us
I20260709 12:18:22.551352 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:22.565798 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.569924 30893 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:22.542722 30971 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.532994 31001 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:22.571667 30971 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.573171 31001 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.574517 31001 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.575469 30971 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:22.540004 30959 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:18:22.577862 30962 raft_consensus.cc:2764] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:18:22.579113 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:22.580235 30889 raft_consensus.cc:2764] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:22.580940 28675 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:22.581126 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:22.581462 30889 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:22.582641 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49372.3us
I20260709 12:18:22.566608 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:22.522727 30648 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:18:22.588737 28648 leader_election.cc:400] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5.
W20260709 12:18:22.598228 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.600931 28648 leader_election.cc:403] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:18:22.605791 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 235679us
I20260709 12:18:22.611809 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:22.612649 28676 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:22.535904 30979 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:18:22.567448 30827 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:22.634202 30827 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.634712 30827 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.556535 30950 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:22.556185 30795 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:22.628549 30986 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.624208 31000 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5.
I20260709 12:18:22.632103 30981 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:22.633052 30728 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:22.637454 30889 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:22.638724 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:22.664453 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.665239 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.566968 29319 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:22.638217 30795 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.620762 30870 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:22.628227 30970 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.625039 30923 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:22.638931 30843 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:22.638520 30569 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:18:22.683259 30981 consensus_queue.cc:1243] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:22.608947 30929 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:18:22.620594 31003 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 12:18:22.681876 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 93319.5us
W20260709 12:18:22.683506 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58891.4us
I20260709 12:18:22.683718 30870 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.556615 30985 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:18:22.684487 30952 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.624576 30991 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:22.681586 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71175.5us
W20260709 12:18:22.734453 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 187002us
W20260709 12:18:22.681164 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 99261.9us
I20260709 12:18:22.693516 30766 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:22.697333 31031 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:18:22.705642 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.705628 30987 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:18:22.709684 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:22.735556 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:22.733763 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 146550us
I20260709 12:18:22.742904 29325 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:22.639513 30962 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:18:22.738451 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:22.670322 30966 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.694577 30959 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:18:22.750448 28648 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:22.717317 30870 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.749006 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.752374 29317 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:22.752897 31032 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.756654 31010 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.757002 30981 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:22.756937 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.718401 30744 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:18:22.761554 30952 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:22.732838 31000 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:22.736572 30766 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:22.769062 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67674.2us
I20260709 12:18:22.771541 29322 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:22.748222 30971 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.666517 30986 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:22.762786 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:22.765594 28571 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:22.767758 30980 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:22.779394 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.777074 29319 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:22.773886 30923 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:18:22.785367 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.785714 31034 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.786158 29323 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:18:22.786504 31024 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:18:22.787339 30982 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:22.776988 30795 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:22.798133 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.777135 30929 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:22.802975 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.768579 30867 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:22.772984 31010 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.800926 31032 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:22.817086 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.823271 30978 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.774791 30889 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.788197 30971 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.821884 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.800719 30982 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:22.693638 30970 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.836597 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.814270 30929 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:22.839706 30978 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.843008 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:22.816754 30950 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.736791 30991 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:22.862907 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 47475.8us
W20260709 12:18:22.856566 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.782850 31000 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.859925 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:22.864073 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:22.838042 30987 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:22.843888 31032 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:22.870464 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.855604 30923 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:22.842140 30959 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:22.865670 28677 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.833706 30976 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:18:22.866314 30965 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:22.861024 30843 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:22.816267 30766 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:22.866256 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 100697us
I20260709 12:18:22.858556 30962 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.854146 30893 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.887239 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.888407 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.874670 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:22.854529 30953 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.801656 31034 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.890244 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:22.890724 30952 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:22.892663 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:22.899809 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.902807 30766 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.903980 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:22.904587 28602 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.904182 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.905632 28603 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4. Re-sending same reply.
I20260709 12:18:22.899809 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:22.907087 28676 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:18:22.907557 28676 pending_rounds.cc:85] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 7
I20260709 12:18:22.907872 28676 pending_rounds.cc:107] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.8
I20260709 12:18:22.908128 28676 raft_consensus.cc:2917] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Aborting config change with OpId 7.8: Aborted: Op aborted by new leader
I20260709 12:18:22.908558 28676 raft_consensus.cc:2889] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:22.917949 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:22.924194 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 160113us
I20260709 12:18:22.925526 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:22.892765 30965 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.894582 30966 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:22.901711 30953 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:22.971325 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53486.2us
I20260709 12:18:22.972148 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:22.915206 30987 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.976632 28673 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:22.906988 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:22.981788 31041 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:18:22.969750 30965 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:22.971088 30795 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:22.974334 30953 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.895221 31042 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 12:18:22.893347 30982 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:22.982115 31046 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:22.907290 30893 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.984289 30966 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:23.007663 31012 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.612s	user 0.001s	sys 0.002s
I20260709 12:18:23.008003 31056 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:23.008399 31035 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.072736 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.073453 28752 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:22.989769 29319 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:23.035840 30986 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:23.037925 30893 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.038045 30970 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:23.038554 30971 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:23.040006 31034 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:23.000347 29317 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:23.045215 30978 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:23.049208 31040 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
W20260709 12:18:23.052878 31038 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 12:18:23.052986 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 127546us
I20260709 12:18:22.999068 31032 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:22.994446 30960 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.055998 31050 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:22.996948 31036 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:23.032002 30867 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:23.009505 30923 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.057708 30744 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:23.057961 31010 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:23.124418 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.009341 30569 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.988732 30929 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.001683 31046 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:23.066079 28677 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:22.987910 30987 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.073520 28750 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:23.133011 29327 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:23.077687 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 105616us
I20260709 12:18:23.110131 30893 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.133389 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:23.080760 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:23.082669 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:23.137859 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44778.2us
I20260709 12:18:23.083076 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.086042 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:23.087410 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 156541us
I20260709 12:18:23.042536 30980 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:23.086514 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:23.099545 28602 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
W20260709 12:18:23.100044 31053 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:18:23.143965 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:23.101657 31064 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.085019 31041 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:23.083868 30986 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.052301 30827 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.080982 31056 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:23.123432 28676 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:23.125095 28673 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:23.128101 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:23.085196 30981 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:23.035979 31000 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:23.028335 30952 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:23.091234 31001 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.003s
I20260709 12:18:23.120363 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.146010 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:23.147691 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:23.149729 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.150939 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.154037 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:23.160490 28601 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.087167 31035 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.162199 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.162920 28676 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:23.160490 28680 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:23.146636 30843 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:23.157845 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.170295 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:23.170862 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.166280 31055 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:18:23.166947 28602 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:23.173413 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:23.145908 30744 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:18:23.143520 30893 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.173986 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:23.173986 28673 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.156759 30980 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.180636 28598 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:23.182787 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.164757 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:23.153358 30986 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:22.517288 30977 consensus_queue.cc:1175] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:23.194519 28754 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:23.176340 29317 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:23.196870 31055 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:23.196689 30965 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.197322 31055 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:23.198259 31055 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.198794 30965 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.199468 31055 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:23.187702 30980 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.200611 31051 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:23.200896 30843 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.201499 31051 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:23.201843 31051 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:23.202175 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 115767us
I20260709 12:18:23.202420 30980 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.202759 31051 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.204397 30867 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:23.204628 31042 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:23.204962 30867 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:23.205268 31054 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:23.205633 29317 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:23.204157 31051 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.205854 30867 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.206413 31054 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:23.206843 31054 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:23.206949 31048 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.207178 30870 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.207552 31048 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.208488 31057 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:23.209053 31057 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:23.209414 30870 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:23.210346 29321 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:23.210152 30870 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:23.209945 31057 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.211594 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1588) took 1085 ms. Trace:
I20260709 12:18:23.176363 30978 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:23.211932 28749 rpcz_store.cc:276] 0709 12:18:22.125710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.125816 (+   106us) service_pool.cc:224] Handling call
0709 12:18:22.126122 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:22.494304 (+368182us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:18:22.656595 (+162291us) log.cc:844] Serialized 14 byte log entry
0709 12:18:22.866822 (+210227us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:22.887595 (+ 20773us) log.cc:844] Serialized 26 byte log entry
0709 12:18:22.887745 (+   150us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:22.887994 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 12:18:22.970877 (+ 82883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.970954 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:23.211405 (+240451us) raft_consensus.cc:1685] finished
0709 12:18:23.211424 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:23.211540 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":461868,"prepare.queue_time_us":268884,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2564,"raft.queue_time_us":577793,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":25544,"spinlock_wait_cycles":920832,"thread_start_us":310018,"threads_started":4,"wal-append.queue_time_us":130796}
I20260709 12:18:23.213423 30978 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.214924 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:23.215530 30978 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:23.215941 30977 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:23.216068 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:23.216280 31049 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:18:23.209496 31044 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:23.187431 31046 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.220757 28673 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:23.224033 28752 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:23.225144 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.226372 28753 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:23.227309 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.227859 28756 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:23.236339 28601 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:23.207774 31054 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.250211 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:23.251827 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:23.224807 30966 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:23.250801 30981 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.226595 31044 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:23.151223 31064 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.192725 31052 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:23.199491 31058 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:23.252805 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.265237 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49227.2us
I20260709 12:18:23.261606 28601 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
W20260709 12:18:23.294379 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.233635 30977 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:23.313868 31058 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.297433 31046 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.317849 30979 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:23.318275 30979 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:23.319156 30979 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.320219 30979 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:23.306999 28747 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:23.276932 29319 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:23.314019 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:23.339583 28601 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:23.340868 28601 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 12:18:23.342134 28601 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:18:23.296847 28752 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:23.311627 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:23.330808 31050 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:23.332135 31044 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.333869 30982 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.334939 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 622) took 1003 ms. Trace:
I20260709 12:18:23.347690 30987 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:23.347893 29327 rpcz_store.cc:276] 0709 12:18:22.331449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.366161 (+ 34712us) service_pool.cc:224] Handling call
0709 12:18:23.334675 (+968514us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b5400660154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:23.334846 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418290944}
I20260709 12:18:23.261667 28675 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.337715 29323 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:23.292630 30978 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.345865 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 108214us
I20260709 12:18:23.346979 30766 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:23.351873 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.352945 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.353577 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:23.368988 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:23.358035 28721 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:23.349361 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:23.298719 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:23.321395 31035 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.374053 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:23.376928 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:23.274366 31000 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:23.360188 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:23.263952 31056 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.412736 31058 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:23.337563 31003 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.276738 30971 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:18:23.345489 28748 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:23.350445 31042 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.344153 30960 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:18:23.336115 31052 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.373523 30977 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:23.414752 31010 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:23.412822 30827 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:23.418907 30976 raft_consensus.cc:2764] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:23.424811 31054 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.452340 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:23.441547 31060 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:18:23.433380 31058 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:23.430222 31052 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.375732 30978 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.427698 30893 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.438547 30986 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:23.451846 30962 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:18:23.439659 31010 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:23.420682 31000 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.425742 31003 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.462677 30987 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:23.460341 31051 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:23.461491 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:23.502354 29319 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:23.503118 31047 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:18:23.503981 29319 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:23.435683 31042 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.475301 31010 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.474534 30962 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:23.471655 31048 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:23.504210 30953 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:23.498371 30987 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.571023 30991 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:23.572302 30950 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.005s
I20260709 12:18:23.572877 30950 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:23.573071 30953 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.573817 28606 raft_consensus.cc:2368] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:23.579885 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:23.580731 28606 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:23.579993 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.014s	sys 0.023s
W20260709 12:18:23.583112 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.014s	sys 0.023s
W20260709 12:18:23.585206 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 710587us
I20260709 12:18:23.586338 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:23.592758 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.595844 31062 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:23.589365 30893 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:23.596405 31062 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:23.597687 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.575673 30987 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.602720 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:23.600772 30960 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.604699 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.604954 30960 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.605430 28676 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:23.607187 30960 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.615603 29321 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:23.590238 31064 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.625627 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.628589 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:23.624147 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 481820us
I20260709 12:18:23.641582 30843 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.633694 31063 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:18:23.647109 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:23.652077 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.623176 29317 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:23.653263 30945 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.613694 31047 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:18:23.670087 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:23.670910 28676 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.622437 30960 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:18:23.644711 30950 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:23.625464 30718 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:18:23.675592 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:23.657881 30980 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:23.676445 28755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.020s	sys 0.025s
I20260709 12:18:23.687868 28678 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:23.625689 31052 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.730051 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:23.772744 28680 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.681294 30978 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:23.658075 30945 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.676659 30976 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:23.680212 31064 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.653786 30843 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:23.675946 30923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.014s	sys 0.031s
I20260709 12:18:23.753755 31070 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 12:18:23.767335 28751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.043s	sys 0.021s
W20260709 12:18:23.782846 28751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.043s	sys 0.021s
I20260709 12:18:23.769831 28676 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:23.730180 31000 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:23.768421 30744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.016s	sys 0.020s
W20260709 12:18:23.770305 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 410184us
W20260709 12:18:23.770478 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.032s
W20260709 12:18:23.784789 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.015s	sys 0.032s
W20260709 12:18:23.654808 31039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.050s
I20260709 12:18:23.681327 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:23.770974 28755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.020s	sys 0.034s
W20260709 12:18:23.775944 30929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.045s
W20260709 12:18:23.785394 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 559028us
I20260709 12:18:23.812896 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:23.787254 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:23.816320 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:23.782612 30923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.014s	sys 0.032s
W20260709 12:18:23.825296 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 144062us
W20260709 12:18:23.826166 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.784301 30744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.017s	sys 0.020s
W20260709 12:18:23.822568 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 464596us
I20260709 12:18:23.887405 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:23.812037 30929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.000s	sys 0.046s
W20260709 12:18:23.887567 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 60716.3us
W20260709 12:18:23.896023 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.896449 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.896668 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.896795 28605 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:23.812252 31062 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:23.900411 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:23.903203 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60273us
I20260709 12:18:23.841008 30961 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:23.810519 31039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.006s	sys 0.055s
I20260709 12:18:23.823405 31055 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:23.912176 31055 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.912714 31055 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.915575 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:23.783351 30976 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:23.922467 28749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.010s	sys 0.024s
W20260709 12:18:23.922878 28749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.010s	sys 0.024s
I20260709 12:18:23.922049 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:23.908422 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:23.911337 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:23.924571 28753 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:23.911195 31046 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:23.916534 28755 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:23.784888 31064 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:23.917969 30995 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.938678 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:23.942631 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:23.954468 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:23.954807 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46481.6us
I20260709 12:18:23.919243 31057 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:23.962841 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.919807 30961 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.897446 30889 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:18:23.905258 30872 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:23.995488 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.997054 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:24.002462 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.922731 30744 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:18:23.958443 30646 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:24.017781 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 596) took 1136 ms. Trace:
I20260709 12:18:23.962179 30991 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:24.011781 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.010s	sys 0.016s
W20260709 12:18:24.020219 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.011s	sys 0.016s
W20260709 12:18:24.020865 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 646821us
I20260709 12:18:24.028152 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:24.014132 30766 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.014s	sys 0.020s
I20260709 12:18:24.030707 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:23.993173 31057 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:23.953105 30995 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:24.044412 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:24.045365 30995 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:24.046030 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:24.046623 30994 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:24.047115 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:24.047263 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:24.048509 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:24.049005 29326 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:24.003749 30961 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.010931 31062 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.036543 31064 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:24.036757 30843 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:23.967916 30971 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:18:24.038489 31075 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:24.039795 31079 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:18:24.040563 31078 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:18:24.042887 31057 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.061616 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:24.031994 30766 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.015s	sys 0.020s
I20260709 12:18:24.073446 28752 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:18:24.089651 31076 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:24.077989 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:24.079296 31042 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:24.080921 31023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.020s
I20260709 12:18:24.018535 29325 rpcz_store.cc:276] 0709 12:18:22.868704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.868841 (+   137us) service_pool.cc:224] Handling call
0709 12:18:22.869223 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.086763 (+217540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.086828 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.091790 (+  4962us) log.cc:844] Serialized 26 byte log entry
0709 12:18:23.591849 (+500059us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:24.004281 (+412432us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.004676 (+   395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.004768 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:24.004812 (+    44us) raft_consensus.cc:1685] finished
0709 12:18:24.004829 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.004970 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62825,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6227,"thread_start_us":1115119,"threads_started":3,"wal-append.queue_time_us":687546}
I20260709 12:18:24.132022 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:24.132259 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.134323 28571 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:24.141196 28755 raft_consensus.cc:2410] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:24.076728 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 594) took 1209 ms. Trace:
I20260709 12:18:24.153666 29323 rpcz_store.cc:276] 0709 12:18:22.866892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.884190 (+ 17298us) service_pool.cc:224] Handling call
0709 12:18:23.335492 (+451302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:23.350626 (+ 15134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.076452 (+725826us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b5400660150. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:24.076646 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000909824}
I20260709 12:18:24.145231 28600 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:24.151448 28753 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:24.159017 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:24.170406 28606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.017s
W20260709 12:18:24.171558 28606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.012s	sys 0.017s
W20260709 12:18:24.163288 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.157655 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:24.175362 29323 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:24.179661 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.145051 30945 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:24.144392 30766 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:24.155608 31023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.007s	sys 0.021s
I20260709 12:18:24.090029 31062 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:24.160386 30979 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.821s	user 0.007s	sys 0.006s
W20260709 12:18:24.159425 28675 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.002s
W20260709 12:18:24.162971 30982 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.001s
I20260709 12:18:24.293468 28679 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:24.214541 28676 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:24.213559 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:24.176301 30965 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.024s
I20260709 12:18:24.157472 30957 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:24.134644 31075 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.160156 30995 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:24.273896 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:24.273856 29326 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:24.179167 30953 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:24.219434 30945 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:24.277236 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:24.322435 30965 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.005s	sys 0.024s
I20260709 12:18:24.155361 30795 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:18:24.285502 30744 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:24.290982 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:24.277227 30976 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:24.367975 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:24.324911 30971 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:24.383947 31074 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:18:24.370478 30945 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.385816 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 406) took 1314 ms. Trace:
I20260709 12:18:24.386547 30945 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:24.386242 28751 rpcz_store.cc:276] 0709 12:18:23.071212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.071339 (+   127us) service_pool.cc:224] Handling call
0709 12:18:23.071711 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.122104 (+ 50393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.122155 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.130811 (+  8656us) log.cc:844] Serialized 26 byte log entry
0709 12:18:23.783328 (+652517us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:23.823292 (+ 39964us) log.cc:844] Serialized 14 byte log entry
0709 12:18:23.889148 (+ 65856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.889237 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:24.385588 (+496351us) raft_consensus.cc:1685] finished
0709 12:18:24.385610 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.385754 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49820,"prepare.queue_time_us":39502,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":102263,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":19827,"thread_start_us":627854,"threads_started":1,"wal-append.queue_time_us":880451}
W20260709 12:18:24.387914 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.391634 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 639) took 1090 ms. Trace:
I20260709 12:18:24.393352 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.394147 28603 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:24.395231 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.365229 28675 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:24.366500 30744 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.397265 30979 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:24.396414 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.392158 29327 rpcz_store.cc:276] 0709 12:18:23.301444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.461968 (+160524us) service_pool.cc:224] Handling call
0709 12:18:24.390730 (+928762us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:24.390990 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.391217 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.391254 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:24.391306 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:24.391366 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.391438 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.391561 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40749312}
I20260709 12:18:24.406844 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.407830 31091 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.357681 30995 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.375784 28748 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:24.435524 28603 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
W20260709 12:18:24.424188 28680 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.003s
I20260709 12:18:24.448827 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:24.409006 30982 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.409688 30744 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:24.459790 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.460688 28600 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:24.378415 30971 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:24.448295 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 641) took 1146 ms. Trace:
I20260709 12:18:24.449899 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1624) took 1272 ms. Trace:
I20260709 12:18:24.428138 30979 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:24.504590 28647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.022s	sys 0.039s
W20260709 12:18:24.506179 28647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.022s	sys 0.040s
W20260709 12:18:24.500237 31056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.029s	sys 0.055s
W20260709 12:18:24.470762 30710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.026s	sys 0.031s
I20260709 12:18:24.468844 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.469993 29327 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: Advancing to term 8
I20260709 12:18:24.456867 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.372454 31055 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:24.517788 28601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.026s	sys 0.060s
W20260709 12:18:24.518098 28747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 404) took 1438 ms (client timeout 1719 ms). Trace:
I20260709 12:18:24.520635 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.453675 31091 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.440312 30766 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:24.553371 28747 rpcz_store.cc:269] 0709 12:18:23.070309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.070429 (+   120us) service_pool.cc:224] Handling call
0709 12:18:24.508863 (+1438434us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002d5fd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:24.508985 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382144256}
W20260709 12:18:24.563522 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.021s	sys 0.040s
W20260709 12:18:24.564355 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.022s	sys 0.040s
I20260709 12:18:24.539384 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 634) took 1317 ms. Trace:
I20260709 12:18:24.463526 30982 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:24.548684 30710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.026s	sys 0.032s
W20260709 12:18:24.515805 31010 consensus_meta.cc:287] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.966s	user 0.007s	sys 0.004s
I20260709 12:18:24.550544 28603 raft_consensus.cc:2410] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:24.491658 28675 rpcz_store.cc:276] 0709 12:18:23.161932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.171612 (+  9680us) service_pool.cc:224] Handling call
0709 12:18:23.232966 (+ 61354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.403635 (+1170669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.434244 (+ 30609us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:24.499128 30569 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.367s	user 0.012s	sys 0.002s
I20260709 12:18:24.549230 28600 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
W20260709 12:18:24.553308 28601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.027s	sys 0.060s
W20260709 12:18:24.556465 29322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.045s
I20260709 12:18:24.553965 28599 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:24.535494 29321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.015s	sys 0.033s
W20260709 12:18:24.570792 29322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.012s	sys 0.045s
W20260709 12:18:24.552423 31095 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:18:24.548355 31098 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:24.570917 29321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.015s	sys 0.033s
I20260709 12:18:24.575531 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:24.574331 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:24.581717 28603 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:24.581909 28599 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:18:24.582599 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1668) took 1362 ms. Trace:
I20260709 12:18:24.582702 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2027) took 1392 ms. Trace:
W20260709 12:18:24.551637 30960 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.016s	sys 0.036s
W20260709 12:18:24.550804 31056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.030s	sys 0.055s
I20260709 12:18:24.578027 28600 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:18:24.589520 30947 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.583067 28603 rpcz_store.cc:276] 0709 12:18:23.220224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.581089 (+1360865us) service_pool.cc:224] Handling call
0709 12:18:24.581489 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.582307 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.582531 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:24.584607 28599 rpcz_store.cc:276] 0709 12:18:23.190330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.576120 (+1385790us) service_pool.cc:224] Handling call
0709 12:18:24.576495 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.582431 (+  5936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.582640 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:24.585342 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 453306us
I20260709 12:18:24.633635 31033 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.589120 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:24.633165 28676 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:24.571597 30569 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:24.568852 31102 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:24.571571 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:24.564350 31099 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.573442 30976 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:24.642320 28600 pending_rounds.cc:85] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 4
I20260709 12:18:24.669970 28600 pending_rounds.cc:107] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:18:24.670315 28600 raft_consensus.cc:2889] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:24.578158 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:24.671752 28680 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:24.672891 28604 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:24.634220 31085 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.268s	user 0.001s	sys 0.001s
I20260709 12:18:24.587958 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:24.647739 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:24.631407 31075 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:24.651997 28602 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:24.590355 31098 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.573046 31010 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.639197 31048 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:24.654707 31061 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.649897 30947 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.566579 29317 rpcz_store.cc:276] 0709 12:18:23.218861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.463827 (+244966us) service_pool.cc:224] Handling call
0709 12:18:23.599365 (+135538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.664681 (+ 65316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.532192 (+867511us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54002f58d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:24.535990 (+  3798us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243405184}
I20260709 12:18:24.662110 28748 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:18:24.665287 31096 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 12:18:24.640166 30960 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.019s	sys 0.045s
W20260709 12:18:24.665809 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.015s
W20260709 12:18:24.707013 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.006s	sys 0.016s
W20260709 12:18:24.707408 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 573101us
I20260709 12:18:24.707988 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:24.639199 31062 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:24.669399 28570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.011s	sys 0.012s
W20260709 12:18:24.712652 28570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.011s	sys 0.012s
I20260709 12:18:24.671146 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1665) took 1517 ms. Trace:
I20260709 12:18:24.676354 28747 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:24.679517 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 91653.2us
I20260709 12:18:24.713784 28600 rpcz_store.cc:276] 0709 12:18:23.153666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.575259 (+1421593us) service_pool.cc:224] Handling call
0709 12:18:24.575615 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.670858 (+ 95243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.671068 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:24.715423 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:24.653414 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:24.688719 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:24.713485 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:24.654917 31032 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:24.717952 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 64652.3us
I20260709 12:18:24.654706 31070 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:24.671331 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:24.705845 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1654) took 1571 ms. Trace:
I20260709 12:18:24.723841 28605 rpcz_store.cc:276] 0709 12:18:23.134104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.134233 (+   129us) service_pool.cc:224] Handling call
0709 12:18:23.146576 (+ 12343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:23.897191 (+750615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.705521 (+808330us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b5400233a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:24.705758 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724824960}
I20260709 12:18:24.656077 31033 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:24.682176 30987 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.068s	user 0.013s	sys 0.000s
I20260709 12:18:24.677707 29318 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:24.718851 28603 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:24.716723 28676 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:24.687180 30995 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:24.670002 31102 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:24.726624 28600 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:24.737073 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:24.795282 28680 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:24.708002 31003 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:24.705612 30971 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:24.685407 30569 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:24.471474 29319 rpcz_store.cc:276] 0709 12:18:23.302070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.504857 (+202787us) service_pool.cc:224] Handling call
0709 12:18:23.573378 (+ 68521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.573816 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.573845 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.574403 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.138308 (+563905us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:24.144775 (+  6467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.154836 (+ 10061us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:24.447987 (+293151us) raft_consensus.cc:1685] finished
0709 12:18:24.448018 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.448221 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2207,"raft.queue_time_us":6109,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9073,"thread_start_us":492885,"threads_started":1,"wal-append.queue_time_us":871398}
I20260709 12:18:24.712419 30952 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.799485 28747 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:24.704957 31061 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.725580 31075 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:24.727758 30945 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.678416 31099 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.729509 31046 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:24.689566 30976 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.793668 31064 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.824807 28678 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:24.847311 31064 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.791059 30874 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:24.852831 30874 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:24.853786 30982 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:24.839680 31100 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 12:18:24.840422 31105 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 12:18:24.841502 31110 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:18:24.842303 31104 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 12:18:24.842940 31106 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:18:24.843721 31103 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:18:24.846011 30872 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:18:24.910720 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 190776us
I20260709 12:18:24.790567 30987 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.863716 31091 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:24.725759 31032 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.896212 29323 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:24.727451 31070 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:24.846681 31102 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:24.974159 28747 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:24.875064 31085 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:24.838503 31055 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:24.981766 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 357) took 1144 ms. Trace:
I20260709 12:18:24.812469 30952 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:25.095989 31099 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:24.981737 31107 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:18:24.895452 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:24.980878 30982 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.981122 30569 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.856122 30945 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:25.184350 29327 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:25.186142 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 599) took 1282 ms. Trace:
I20260709 12:18:25.188331 29327 rpcz_store.cc:276] 0709 12:18:23.904080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.454931 (+550851us) service_pool.cc:224] Handling call
0709 12:18:24.469826 (+ 14895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.185795 (+715969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.186071 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:25.087980 28599 rpcz_store.cc:276] 0709 12:18:23.837189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.649025 (+811836us) service_pool.cc:224] Handling call
0709 12:18:24.649343 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.649777 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:24.665243 (+ 15466us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.981396 (+316153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:24.981456 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:24.981520 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.981592 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.981709 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55350,"prepare.queue_time_us":14962,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":260340,"threads_started":1}
I20260709 12:18:25.116382 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 646) took 2010 ms. Trace:
I20260709 12:18:24.898396 31075 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.223s
I20260709 12:18:24.994153 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:25.106158 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 303522us
I20260709 12:18:25.080542 30995 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.232353 28571 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:25.106787 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 195214us
I20260709 12:18:25.229614 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:25.118428 30953 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.761s	user 0.012s	sys 0.001s
I20260709 12:18:25.197342 29322 rpcz_store.cc:276] 0709 12:18:23.106200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.106335 (+   135us) service_pool.cc:224] Handling call
0709 12:18:23.106651 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.113000 (+  6349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.113035 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:24.050927 (+937892us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b2c000eb598. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:18:24.051403 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.571990 (+520587us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:24.572032 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.572103 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.098393 (+526290us) raft_consensus.cc:1685] finished
0709 12:18:25.098422 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.116287 (+ 17865us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253,"raft.queue_time_us":18027,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3459,"spinlock_wait_cycles":4586880,"thread_start_us":520107,"threads_started":1,"wal-append.queue_time_us":592671}
W20260709 12:18:25.135133 31103 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 12:18:25.509745 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 277503us
I20260709 12:18:25.234506 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1664) took 2093 ms. Trace:
I20260709 12:18:25.118121 31099 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.356268 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 642) took 1467 ms. Trace:
I20260709 12:18:25.355895 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2086) took 1458 ms. Trace:
I20260709 12:18:25.549419 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:25.570277 29321 rpcz_store.cc:276] 0709 12:18:23.888892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.889353 (+   461us) service_pool.cc:224] Handling call
0709 12:18:23.907770 (+ 18417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.908157 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.908197 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.908740 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.584222 (+675482us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:24.584281 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.584377 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.356025 (+771648us) raft_consensus.cc:1685] finished
0709 12:18:25.356051 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.356202 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1573,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":16438,"thread_start_us":630080,"threads_started":1,"wal-append.queue_time_us":706611}
W20260709 12:18:25.558185 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 216491us
W20260709 12:18:25.605029 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55784.3us
I20260709 12:18:25.562590 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 645) took 1602 ms. Trace:
W20260709 12:18:25.364509 30960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.037s
I20260709 12:18:25.620746 29322 rpcz_store.cc:276] 0709 12:18:23.960456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.547734 (+1587278us) service_pool.cc:224] Handling call
0709 12:18:25.561822 (+ 14088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.562112 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.562149 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:25.562203 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:25.562245 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.562324 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.562501 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:25.350857 31119 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:18:25.250558 31085 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:18:25.354452 29318 raft_consensus.cc:2410] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:18:25.578972 31054 consensus_meta.cc:287] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 2.128s	user 0.008s	sys 0.008s
I20260709 12:18:25.603994 28754 rpcz_store.cc:276] 0709 12:18:23.897191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.897361 (+   170us) service_pool.cc:224] Handling call
0709 12:18:23.907566 (+ 10205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.909813 (+  2247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.909856 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.910385 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.398178 (+487793us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:24.398218 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.398288 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.355624 (+957336us) raft_consensus.cc:1685] finished
0709 12:18:25.355650 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.355821 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1848,"raft.queue_time_us":2900,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":15851,"thread_start_us":487488,"threads_started":1,"wal-append.queue_time_us":661852}
W20260709 12:18:25.507009 30744 consensus_meta.cc:287] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.016s	user 0.012s	sys 0.000s
I20260709 12:18:25.550068 28606 rpcz_store.cc:276] 0709 12:18:23.141515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.621545 (+480030us) service_pool.cc:224] Handling call
0709 12:18:23.634787 (+ 13242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.635229 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.635269 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.639774 (+  4505us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.173747 (+533973us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:24.173802 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.173902 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.234298 (+1060396us) raft_consensus.cc:1685] finished
0709 12:18:25.234317 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.234444 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3088,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5425,"thread_start_us":507486,"threads_started":1,"wal-append.queue_time_us":914815}
I20260709 12:18:25.503369 31073 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:25.179077 30982 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:25.208709 30569 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:25.353905 31061 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:25.359339 30952 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.350081 31010 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.346417 31032 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:25.638912 29327 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:25.179414 30874 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:25.361222 31098 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.344935 31070 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:25.358038 30987 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.351894 30976 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.527149 31064 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.349857 30953 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:25.355000 30947 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.358618 31033 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.370105 30945 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:25.637915 30960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.013s	sys 0.045s
I20260709 12:18:25.676221 30569 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.632853 31125 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:25.696348 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1661) took 2557 ms. Trace:
W20260709 12:18:25.688657 30766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.009s	sys 0.056s
I20260709 12:18:25.682801 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1633) took 1094 ms. Trace:
I20260709 12:18:25.708931 28754 rpcz_store.cc:276] 0709 12:18:24.587891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.667418 (+1079527us) service_pool.cc:224] Handling call
0709 12:18:25.682332 (+ 14914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.682491 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.682516 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:25.682557 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:25.682585 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.682640 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.682737 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:25.421247 30995 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:25.677515 28646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.019s	sys 0.066s
W20260709 12:18:25.723199 28646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.019s	sys 0.066s
W20260709 12:18:25.692452 31129 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:25.672264 31073 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:25.677739 31089 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.640262 31128 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.697930 28601 rpcz_store.cc:276] 0709 12:18:23.135977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.342773 (+206796us) service_pool.cc:224] Handling call
0709 12:18:23.343038 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.343396 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:23.780773 (+437377us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.569881 (+789108us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:24.578488 (+  8607us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.579112 (+   624us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:24.628660 (+ 49548us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.636576 (+  7916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.636671 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.693235 (+1056564us) raft_consensus.cc:1685] finished
0709 12:18:25.693255 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.693383 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18379,"prepare.queue_time_us":152852,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3137,"raft.queue_time_us":27670,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":50621,"spinlock_wait_cycles":4672128,"thread_start_us":1113084,"threads_started":2,"wal-append.queue_time_us":806391}
I20260709 12:18:25.635099 31099 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:25.683218 30952 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.722219 28754 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:25.667685 30744 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:25.726322 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1620) took 1720 ms. Trace:
I20260709 12:18:25.695643 31010 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:25.769464 28751 rpcz_store.cc:276] 0709 12:18:24.006283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.388640 (+382357us) service_pool.cc:224] Handling call
0709 12:18:24.389074 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:24.390015 (+   941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.390059 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:24.390659 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.791923 (+401264us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:25.121998 (+330075us) log.cc:844] Serialized 14 byte log entry
0709 12:18:25.128857 (+  6859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.128964 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.726045 (+597081us) raft_consensus.cc:1685] finished
0709 12:18:25.726074 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.726249 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8107,"prepare.queue_time_us":31518,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":6840,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":69554,"thread_start_us":711339,"threads_started":2,"wal-append.queue_time_us":694561}
W20260709 12:18:25.710443 30766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.009s	sys 0.056s
I20260709 12:18:25.741796 31128 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:25.708480 31125 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:25.732963 31089 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:25.737208 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1634) took 1149 ms. Trace:
W20260709 12:18:26.054148 28679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1626) took 2376 ms (client timeout 2228 ms). Trace:
I20260709 12:18:25.969707 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1614) took 2612 ms. Trace:
W20260709 12:18:26.054728 28679 rpcz_store.cc:269] 0709 12:18:23.594133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.597417 (+  3284us) service_pool.cc:224] Handling call
0709 12:18:25.970300 (+2372883us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400252954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:25.970463 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598308736}
W20260709 12:18:25.809392 29292 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.985s (SENT) [suppressed 9 similar messages]
I20260709 12:18:25.799319 28754 rpcz_store.cc:276] 0709 12:18:24.588165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.710178 (+1122013us) service_pool.cc:224] Handling call
0709 12:18:25.721728 (+ 11550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.736882 (+ 15154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.737142 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:25.735718 30952 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:25.771519 28748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.018s	sys 0.025s
W20260709 12:18:25.776254 31122 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:18:25.776751 31124 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:18:25.929733 31099 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:25.795476 30961 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.663s	user 0.011s	sys 0.004s
I20260709 12:18:25.789955 31052 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:25.789162 30982 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:25.775640 30744 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:25.789866 31125 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:26.280736 29322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.009s	sys 0.023s
I20260709 12:18:25.797004 31010 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:26.203888 28748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.019s	sys 0.026s
I20260709 12:18:25.790596 31073 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:25.789332 31130 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:26.373562 31128 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:25.791016 31060 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:26.376188 31130 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.376596 31060 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.378347 31130 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.378487 31060 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.340744 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.380885 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 647) took 2019 ms. Trace:
I20260709 12:18:26.381669 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.382345 28679 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:26.383220 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.383759 28679 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:26.390743 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:26.391495 31039 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:26.391866 31039 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.392184 31039 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:26.354629 30961 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.394996 30978 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:26.395536 30978 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:26.396735 28755 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:26.399293 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1626) took 1814 ms. Trace:
I20260709 12:18:26.402017 31010 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.381286 29321 rpcz_store.cc:276] 0709 12:18:24.361136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.633926 (+1272790us) service_pool.cc:224] Handling call
0709 12:18:25.659717 (+ 25791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.662444 (+  2727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.662485 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.663095 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.133480 (+470385us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:26.133536 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.133607 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.380637 (+247030us) raft_consensus.cc:1685] finished
0709 12:18:26.380658 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.380820 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2169,"raft.queue_time_us":7356,"spinlock_wait_cycles":5413120,"thread_start_us":431072,"threads_started":1,"wal-append.queue_time_us":705213}
I20260709 12:18:26.404920 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.056499 28749 rpcz_store.cc:276] 0709 12:18:23.222758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.222914 (+   156us) service_pool.cc:224] Handling call
0709 12:18:23.223338 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:23.223779 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.223832 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:23.252928 (+ 29096us) log.cc:844] Serialized 52 byte log entry
0709 12:18:23.923294 (+670366us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:23.961753 (+ 38459us) log.cc:844] Serialized 14 byte log entry
0709 12:18:23.963029 (+  1276us) log.cc:844] Serialized 14 byte log entry
0709 12:18:23.974824 (+ 11795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.974926 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.834562 (+1859636us) raft_consensus.cc:1685] finished
0709 12:18:25.834593 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.834815 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":847,"prepare.queue_time_us":105139,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":4786,"raft.queue_time_us":93727,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":18945,"spinlock_wait_cycles":53495936,"thread_start_us":602543,"threads_started":1,"wal-append.queue_time_us":891678}
I20260709 12:18:26.343583 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1673) took 1632 ms. Trace:
I20260709 12:18:26.406380 28681 rpcz_store.cc:276] 0709 12:18:24.711535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.668077 (+956542us) service_pool.cc:224] Handling call
0709 12:18:25.668469 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.668733 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:26.077919 (+409186us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.341150 (+263231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:26.342594 (+  1444us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:26.342940 (+   346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.343114 (+   174us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.343396 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45703,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":23059,"thread_start_us":626891,"threads_started":2}
W20260709 12:18:26.355186 29322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.009s	sys 0.024s
I20260709 12:18:26.369657 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1655) took 3235 ms. Trace:
I20260709 12:18:26.405491 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:26.399708 28755 rpcz_store.cc:276] 0709 12:18:24.584918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.585282 (+   364us) service_pool.cc:224] Handling call
0709 12:18:24.585609 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.397217 (+1811608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.398982 (+  1765us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54003e9754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:26.399217 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4164364160}
I20260709 12:18:25.790499 31132 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:26.426209 31132 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.408322 28598 rpcz_store.cc:276] 0709 12:18:23.134421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.134543 (+   122us) service_pool.cc:224] Handling call
0709 12:18:23.134838 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:23.182685 (+ 47847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.369361 (+3186676us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b54002c0454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:26.369591 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101322624}
I20260709 12:18:26.413506 31128 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:26.412272 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:26.417522 30872 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.418025 30964 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:26.394991 30961 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:26.419359 31089 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.363787 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.422008 30978 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.427184 31123 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:26.412647 30952 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.406201 28679 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:26.428515 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 619098us
I20260709 12:18:26.429306 28681 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:26.403172 30995 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.422067 31044 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:26.430150 31128 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:26.472597 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 65855us
I20260709 12:18:26.476609 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:26.434453 30964 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.470310 30978 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:26.471225 31128 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:26.436010 30872 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.429996 31039 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.486361 30952 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:26.490080 30952 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.490214 31059 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:26.490470 30952 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:26.490617 31059 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:26.491478 31059 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.493171 28682 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:26.493862 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.494858 28679 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:18:26.467671 31123 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.487764 30957 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.514480 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.493729 30718 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.495963 31052 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.500686 31059 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:26.500236 31034 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:26.523964 31052 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.522318 30718 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.520236 30957 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.529404 28681 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
W20260709 12:18:26.519603 28722 connection.cc:256] RPC call timeout handler was delayed by -1.8806579399999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 12:18:26.534363 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.542780 28679 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:26.544840 28571 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:26.522886 30977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.790s	user 0.023s	sys 0.035s
I20260709 12:18:26.575403 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1674) took 1863 ms. Trace:
I20260709 12:18:26.579064 28681 rpcz_store.cc:276] 0709 12:18:24.711858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.574305 (+1862447us) service_pool.cc:224] Handling call
0709 12:18:26.574705 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.574952 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.574985 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:26.575042 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:26.575100 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.575171 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.575307 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:26.581954 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 341305us
I20260709 12:18:26.528667 30961 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:26.577343 30977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.848s	user 0.023s	sys 0.035s
I20260709 12:18:26.575127 30710 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:26.592953 30710 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:26.593572 30872 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.593868 30710 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.594923 30957 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:26.605680 28749 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:26.536511 31034 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.601588 30957 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:26.613855 30957 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.593627 31052 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.617668 28750 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:26.583920 30961 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.621541 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:26.622524 28750 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:26.622721 30961 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.590010 31125 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.623669 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:26.625038 31123 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.625412 31125 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.669240 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 356) took 3779 ms. Trace:
W20260709 12:18:26.759160 28678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1632) took 2183 ms (client timeout 1644 ms). Trace:
I20260709 12:18:26.626488 28755 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:18:26.786989 28678 rpcz_store.cc:269] 0709 12:18:24.575500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.588807 (+ 13307us) service_pool.cc:224] Handling call
0709 12:18:26.758912 (+2170105us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540016c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:26.759067 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399486848}
I20260709 12:18:26.788411 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:26.786667 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 654) took 2261 ms. Trace:
I20260709 12:18:26.627503 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1668) took 1918 ms. Trace:
I20260709 12:18:26.789597 28678 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:26.629782 28750 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:26.664633 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:26.789215 29327 rpcz_store.cc:276] 0709 12:18:24.525541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.689993 (+1164452us) service_pool.cc:224] Handling call
0709 12:18:25.694291 (+  4298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.850154 (+155863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.850208 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.048306 (+198098us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.500136 (+451830us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:26.500176 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.500245 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.627636 (+127391us) raft_consensus.cc:1685] finished
0709 12:18:26.627659 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.786603 (+158944us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14130,"raft.queue_time_us":275631,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":84550,"thread_start_us":278169,"threads_started":1,"wal-append.queue_time_us":454434}
I20260709 12:18:26.793921 29292 leader_election.cc:400] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:26.794275 29292 leader_election.cc:403] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:26.791867 28749 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:26.626219 31039 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.796353 31052 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.796993 31052 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.797744 30980 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:26.798354 31149 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:26.799038 31052 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:26.733894 31153 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.800401 31153 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.742256 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 600) took 2837 ms. Trace:
I20260709 12:18:26.802943 29317 rpcz_store.cc:276] 0709 12:18:23.904368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.720626 (+816258us) service_pool.cc:224] Handling call
0709 12:18:24.727067 (+  6441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.227422 (+500355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.250088 (+ 22666us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:25.342437 (+ 92349us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:25.342539 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.741933 (+1399394us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54006c02d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:26.741986 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.742171 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913355648}
I20260709 12:18:26.733443 31132 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.804555 31073 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.805101 31073 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.807117 31073 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.786092 29320 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:26.809679 29320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 628) took 4068 ms (client timeout 1978 ms). Trace:
W20260709 12:18:26.810093 29320 rpcz_store.cc:269] 0709 12:18:22.741539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.744758 (+  3219us) service_pool.cc:224] Handling call
0709 12:18:26.353883 (+3609125us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aeee 000000000036eb39 00007f6fe89ce1e0 00007f6fe8a970c4 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:26.809437 (+455554us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400587354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:26.809566 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740707456}
I20260709 12:18:26.774272 30964 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:26.785386 31034 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.689849 30965 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:26.813099 30965 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.789827 28680 rpcz_store.cc:276] 0709 12:18:24.709155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.474208 (+765053us) service_pool.cc:224] Handling call
0709 12:18:25.499231 (+ 25023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.965366 (+466135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.965410 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.966057 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.448600 (+482543us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:26.448676 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.448775 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.627243 (+178468us) raft_consensus.cc:1685] finished
0709 12:18:26.627271 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.627430 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2790,"raft.queue_time_us":226234,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":59460,"thread_start_us":652957,"threads_started":2,"wal-append.queue_time_us":389775}
I20260709 12:18:26.786850 28607 rpcz_store.cc:276] 0709 12:18:22.889951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.890069 (+   118us) service_pool.cc:224] Handling call
0709 12:18:22.890414 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:22.890763 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.890787 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:22.891390 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 12:18:26.500242 (+3608852us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b18003ee2a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1
0709 12:18:26.504201 (+  3959us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:26.585645 (+ 81444us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.668695 (+ 83050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.668805 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.668861 (+    56us) raft_consensus.cc:1685] finished
0709 12:18:26.668962 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.669159 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11396,"prepare.queue_time_us":229409,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":36701,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":47125,"spinlock_wait_cycles":12613888,"thread_start_us":226065,"threads_started":3,"wal-append.queue_time_us":109568,"wal-append.run_cpu_time_us":3918,"wal-append.run_wall_time_us":1209386}
I20260709 12:18:26.737221 30945 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.667840 31123 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.828147 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:26.708120 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 602) took 2803 ms. Trace:
I20260709 12:18:26.841048 29319 rpcz_store.cc:276] 0709 12:18:23.904941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.487967 (+1583026us) service_pool.cc:224] Handling call
0709 12:18:25.553881 (+ 65914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.668427 (+114546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.670900 (+  2473us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.732755 (+ 61855us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.137510 (+404755us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:26.613229 (+475719us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.707628 (+ 94399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.707748 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.707825 (+    77us) raft_consensus.cc:1685] finished
0709 12:18:26.707843 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.708037 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22279,"prepare.queue_time_us":538478,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":47964,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":4483,"thread_start_us":522705,"threads_started":2,"wal-append.queue_time_us":627842}
I20260709 12:18:26.842891 31128 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.845597 31128 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.846225 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:26.824811 30952 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.846863 28680 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:26.848706 30952 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.849174 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.849519 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.849884 29319 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:26.850936 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.849048 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1632) took 2261 ms. Trace:
I20260709 12:18:26.852699 28747 rpcz_store.cc:276] 0709 12:18:24.587623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.830863 (+243240us) service_pool.cc:224] Handling call
0709 12:18:24.875016 (+ 44153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.080757 (+205741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.848829 (+1768072us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b54003fff54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:26.848992 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227471616}
I20260709 12:18:26.616412 30957 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:26.831828 30718 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:26.832520 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.854147 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:26.854605 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.851663 29320 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:26.831012 28678 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:26.833580 31089 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.857730 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:26.858088 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:26.857873 31089 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.834359 30979 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.835523 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1647) took 4298 ms. Trace:
I20260709 12:18:26.858984 28682 rpcz_store.cc:276] 0709 12:18:22.537192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.537346 (+   154us) service_pool.cc:224] Handling call
0709 12:18:22.565004 (+ 27658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.492832 (+3927828us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540030ee20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f6dc0 00007f6fe3a811c0 00007f6fe3a82231 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c
0709 12:18:26.493535 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.835318 (+341783us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540024f9d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:26.835449 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463982208}
I20260709 12:18:26.829412 31065 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:26.837472 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.860231 31065 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.860737 28679 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:26.862375 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1631) took 2275 ms. Trace:
I20260709 12:18:26.862497 31065 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.862776 28752 rpcz_store.cc:276] 0709 12:18:24.587351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.861630 (+2274279us) service_pool.cc:224] Handling call
0709 12:18:26.861900 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.862074 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.862096 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:26.862133 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:26.862165 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.862220 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.862317 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:26.863585 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.864507 29320 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:26.865427 31089 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.865658 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.865870 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1658) took 3730 ms. Trace:
I20260709 12:18:26.856236 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 653) took 2341 ms. Trace:
I20260709 12:18:26.867822 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2028) took 3556 ms. Trace:
I20260709 12:18:26.858623 28678 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:26.868177 28603 rpcz_store.cc:276] 0709 12:18:23.311897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.645255 (+1333358us) service_pool.cc:224] Handling call
0709 12:18:24.645541 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.741747 (+ 96206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.867604 (+2125857us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b5400233554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:26.867767 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168119680}
I20260709 12:18:26.866982 28602 rpcz_store.cc:276] 0709 12:18:23.135238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.186026 (+ 50788us) service_pool.cc:224] Handling call
0709 12:18:23.227242 (+ 41216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.679556 (+1452314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.865657 (+2186101us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002c1354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:26.865811 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3275914112}
I20260709 12:18:26.867206 29322 rpcz_store.cc:276] 0709 12:18:24.514628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.644758 (+1130130us) service_pool.cc:224] Handling call
0709 12:18:25.681266 (+ 36508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.681709 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.681742 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.690376 (+  8634us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.408420 (+718044us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:26.408476 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.408545 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.420808 (+ 12263us) raft_consensus.cc:1685] finished
0709 12:18:26.420828 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.855995 (+435167us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b540042a9d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:26.856179 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141280,"raft.queue_time_us":2575,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":9027,"spinlock_wait_cycles":82898304,"thread_start_us":683625,"threads_started":1,"wal-append.queue_time_us":694507}
I20260709 12:18:26.879583 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.868556 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.886896 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:26.886976 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.852407 30945 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.896605 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.899889 30945 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.869361 31123 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.902429 31123 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.905382 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.906957 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.907599 31099 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:26.907614 28673 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:26.908288 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:26.892174 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.910435 28678 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:26.911435 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:26.921784 28679 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:26.934810 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.893164 30718 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:26.943163 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:26.894492 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 473) took 2264 ms. Trace:
I20260709 12:18:26.894671 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:26.893210 29317 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:26.951993 28679 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:26.961138 28680 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:26.893703 30965 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:26.908010 30977 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:26.920348 31014 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.920601 31132 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:26.934408 30995 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:26.947981 30718 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:27.031546 30718 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:27.038015 31014 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:26.920972 31099 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:27.042982 31099 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:26.937553 31146 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.950403 28675 rpcz_store.cc:276] 0709 12:18:24.629697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.874259 (+244562us) service_pool.cc:224] Handling call
0709 12:18:24.897504 (+ 23245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.637724 (+740220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.660500 (+ 22776us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.683599 (+ 23099us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.230446 (+546847us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:26.253830 (+ 23384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.868228 (+614398us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54000c6f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:26.868288 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.868344 (+    56us) raft_consensus.cc:1685] finished
0709 12:18:26.868357 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.893280 (+ 24923us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16200,"raft.queue_time_us":601729,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":2190,"spinlock_wait_cycles":37902080,"thread_start_us":883550,"threads_started":2,"wal-append.queue_time_us":752459}
W20260709 12:18:27.047030 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.046765 31132 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:26.963352 31149 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:26.942677 31153 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:27.055439 30977 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.058079 30977 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:26.965865 30960 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.059046 30960 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.224445 31149 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.030023 29320 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:27.167004 30977 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:27.166788 31153 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:27.194883 30962 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.225193 31149 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:27.341557 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.469424 28648 connection.cc:256] RPC call timeout handler was delayed by -2.4878584519999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 12:18:27.349817 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.470923 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2890853940000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 12:18:27.471330 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.471493 28648 connection.cc:256] RPC call timeout handler was delayed by -1.1650830479998149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 12:18:27.473158 29290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.005s	sys 0.023s
W20260709 12:18:27.473831 29290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.023s
I20260709 12:18:27.469403 28673 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:27.270068 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:27.505384 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:27.517738 29322 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:27.490294 28648 leader_election.cc:400] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:27.365167 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:27.518392 28648 leader_election.cc:403] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:27.522590 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50157.9us
I20260709 12:18:27.521668 29327 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:27.524034 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:27.524961 29322 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:27.269349 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:27.456602 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:27.531697 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:27.475616 31099 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:27.521704 30995 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.514757 31060 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:27.259522 30977 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:27.466135 31146 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:27.475796 31014 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:27.532966 28755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.006s	sys 0.012s
W20260709 12:18:27.556900 28755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.007s	sys 0.012s
I20260709 12:18:27.537129 29327 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:27.249894 30965 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:27.503978 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:27.539093 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.544930 29326 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:27.549194 30979 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:27.458187 29320 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:18:27.284091 31153 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:27.299669 30718 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.522174 30962 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.547300 31099 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:27.570611 30977 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:27.614967 28756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.010s	sys 0.026s
W20260709 12:18:27.787390 28756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.013s	sys 0.039s
I20260709 12:18:27.689276 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1685) took 1252 ms. Trace:
I20260709 12:18:27.614796 28682 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:27.546944 29318 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:27.538582 29317 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:27.754412 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 421) took 1152 ms. Trace:
I20260709 12:18:27.788309 28676 rpcz_store.cc:276] 0709 12:18:26.436585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.842917 (+406332us) service_pool.cc:224] Handling call
0709 12:18:26.843287 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.843690 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.843719 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.844198 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.252795 (+408597us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:27.252854 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.252948 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.688953 (+436005us) raft_consensus.cc:1685] finished
0709 12:18:27.688987 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.689197 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10150,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":408188,"threads_started":1,"wal-append.queue_time_us":842773}
I20260709 12:18:27.795068 28751 rpcz_store.cc:276] 0709 12:18:26.602191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.602326 (+   135us) service_pool.cc:224] Handling call
0709 12:18:26.616820 (+ 14494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.815773 (+198953us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:26.829805 (+ 14032us) log.cc:844] Serialized 14 byte log entry
0709 12:18:27.186850 (+357045us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.237540 (+ 50690us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.237751 (+   211us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:27.238048 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 12:18:27.238300 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.238402 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.754079 (+515677us) raft_consensus.cc:1685] finished
0709 12:18:27.754110 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.754329 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50495,"prepare.queue_time_us":16933,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":10553,"raft.queue_time_us":182011,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":50268,"thread_start_us":343193,"threads_started":1,"wal-append.queue_time_us":717979}
W20260709 12:18:27.813110 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 187961us
I20260709 12:18:27.563239 31166 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:27.690682 31081 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.610819 31168 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:27.736104 30979 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.771202 31174 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.686663 31170 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:27.572940 31132 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:27.572362 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1630) took 2985 ms. Trace:
I20260709 12:18:27.559546 31060 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:27.794437 30795 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:27.820384 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:27.553026 30995 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:27.572856 29319 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:27.820983 29290 connection.cc:256] RPC call timeout handler was delayed by -1.0882331279999562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20260709 12:18:27.795954 31164 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.561007 31146 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.831103 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:27.566465 30965 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:27.827843 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 302737us
I20260709 12:18:27.819891 31149 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:27.840387 31180 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:27.884428 31178 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:27.885103 31178 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:27.885651 31171 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:18:27.816143 31030 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:18:27.887406 31178 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:27.840929 30718 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:27.892323 30962 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:27.826144 31170 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.893730 31099 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:27.893981 31146 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:27.819023 31081 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:27.895318 30965 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:27.821004 31166 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:27.879096 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58943.4us
W20260709 12:18:27.907882 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.822319 30979 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.917449 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2087) took 4019 ms. Trace:
W20260709 12:18:27.861263 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.878710 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63345.7us
I20260709 12:18:27.825980 31174 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.880656 31153 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:27.929785 28756 rpcz_store.cc:276] 0709 12:18:23.897700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.897824 (+   124us) service_pool.cc:224] Handling call
0709 12:18:23.898176 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.906004 (+  7828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.906048 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.910804 (+  4756us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.534646 (+623842us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b180033ac00. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:18:26.901141 (+2366495us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b180033ac00. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:18:27.787784 (+886643us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:27.787830 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.787916 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.917216 (+129300us) raft_consensus.cc:1685] finished
0709 12:18:27.917236 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.917386 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7375,"raft.queue_time_us":10071,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3246,"spinlock_wait_cycles":52953856,"thread_start_us":886419,"threads_started":1,"wal-append.queue_time_us":3855826}
I20260709 12:18:27.824362 31168 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.917047 31132 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:27.929716 31149 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.957387 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 156033us
W20260709 12:18:28.012470 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49432.6us
W20260709 12:18:28.017233 28572 connection.cc:256] RPC call timeout handler was delayed by -2.8390588419999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 12:18:28.017927 28572 connection.cc:256] RPC call timeout handler was delayed by -2.4939772509999329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260709 12:18:27.927822 30962 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:18:27.934628 31175 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:27.998726 31132 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:28.020944 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71791.5us
I20260709 12:18:27.906387 31180 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:27.841895 31164 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:28.032009 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 200964us
I20260709 12:18:27.972635 31177 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.940578 31099 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
W20260709 12:18:28.042061 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.944070 31146 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:18:28.045181 30962 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:28.038733 31175 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:28.048928 28604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1656) took 4908 ms (client timeout 1978 ms). Trace:
W20260709 12:18:28.051371 28604 rpcz_store.cc:269] 0709 12:18:23.134692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.137409 (+  2717us) service_pool.cc:224] Handling call
0709 12:18:28.042949 (+4905540us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54000a8054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:28.043078 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3479355776}
I20260709 12:18:27.973155 31186 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:28.061235 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:28.088754 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.117326 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:28.108012 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:28.126348 29326 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:28.022114 31149 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:28.050922 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:28.128791 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:28.129987 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 195018us
I20260709 12:18:28.060087 31186 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.137355 29322 raft_consensus.cc:2410] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:28.152639 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:28.154074 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:28.128888 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:28.205757 28572 connection.cc:256] RPC call timeout handler was delayed by -1.8566939770000772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:18:28.206266 28572 connection.cc:256] RPC call timeout handler was delayed by -1.5209939769999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 12:18:28.206919 28572 connection.cc:256] RPC call timeout handler was delayed by -1.3508939769999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23900000000000002s for a response
I20260709 12:18:28.145437 31186 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:28.052873 31177 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:28.194097 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:28.209350 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.254282 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.254741 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.288305 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:28.411823 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 255550us
I20260709 12:18:28.496600 28603 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:28.285943 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:28.497784 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51248.6us
I20260709 12:18:28.280598 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.272923 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.151667 29320 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 2.
I20260709 12:18:28.288717 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.204208 31197 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:28.507021 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:28.503342 28601 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:28.293107 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.505039 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.508042 28605 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:27.825196 28748 rpcz_store.cc:276] 0709 12:18:24.587055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.802153 (+215098us) service_pool.cc:224] Handling call
0709 12:18:24.854650 (+ 52497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:24.855111 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.855156 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.096525 (+241369us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.571508 (+2474983us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b1800469a20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1
0709 12:18:27.571734 (+   226us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:27.571793 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.571898 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.571965 (+    67us) raft_consensus.cc:1685] finished
0709 12:18:27.571987 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.572278 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4077,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":91,"spinlock_wait_cycles":15903104,"thread_start_us":1271320,"threads_started":1,"wal-append.queue_time_us":1268039,"wal-append.run_cpu_time_us":2112,"wal-append.run_wall_time_us":1048426}
I20260709 12:18:28.285444 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:28.401172 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 377590us
I20260709 12:18:28.500041 29322 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:28.513089 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:28.513582 29322 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:28.257884 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.515183 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.339058 31192 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.521627 28602 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:28.419339 31190 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:18:28.518505 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.530608 28680 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:28.208042 31183 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:18:28.209998 31172 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 12:18:28.427127 31164 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:28.522650 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.399221 30718 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:28.514453 28573 connection.cc:256] RPC call timeout handler was delayed by -2.2817909979999058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 12:18:28.547261 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:28.547801 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:28.525480 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 388112us
I20260709 12:18:28.527043 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.527235 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:28.526664 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 205468us
I20260709 12:18:28.527712 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.320231 29317 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:28.423053 31150 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 1.684s	user 0.027s	sys 0.010s
I20260709 12:18:28.407454 31030 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:28.534029 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.534370 28676 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:28.349678 30979 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:28.357369 31166 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:28.358289 31168 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:28.405227 31132 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:28.515913 28599 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:28.344977 31099 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:28.533736 31192 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:28.539611 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.542125 30960 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:28.523406 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.425446 31175 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:28.350420 31081 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:28.546233 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1655) took 4898 ms. Trace:
I20260709 12:18:28.209208 30965 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.324s
I20260709 12:18:28.549031 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:28.549744 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.549829 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.550122 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.528317 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.551894 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.520659 31062 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:28.290117 30893 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.246s
I20260709 12:18:28.349385 31174 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:28.555899 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 644) took 4651 ms. Trace:
I20260709 12:18:28.556442 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.558290 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.531898 31189 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.532029 31184 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.527168 31197 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:28.642771 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.546680 29318 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:28.779009 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50087.9us
I20260709 12:18:28.535385 31183 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:28.684124 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.847388 28601 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:28.836750 29323 rpcz_store.cc:276] 0709 12:18:23.898947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.275553 (+376606us) service_pool.cc:224] Handling call
0709 12:18:24.328301 (+ 52748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.981989 (+653688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.550551 (+3568562us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540036abd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:28.550719 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305502080}
I20260709 12:18:28.840459 28604 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:28.838079 28681 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
W20260709 12:18:28.735416 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.836977 28677 rpcz_store.cc:276] 0709 12:18:23.648236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.504228 (+2855992us) service_pool.cc:224] Handling call
0709 12:18:26.759382 (+255154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.759611 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.759645 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:26.759697 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:26.759748 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.759819 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.546065 (+1786246us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540016c450. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:28.546177 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585876352}
I20260709 12:18:28.843212 28673 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:28.843469 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.844280 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:28.594743 31118 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 2.926s	user 0.020s	sys 0.031s
I20260709 12:18:28.852910 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:28.653609 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 98042us
I20260709 12:18:28.855211 28599 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:28.613382 29322 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:28.845221 28679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:28.858527 28679 raft_consensus.cc:606] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:28.838488 28603 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:28.848536 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.537056 31177 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:18:28.545269 30911 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.558424 31149 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:28.934860 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:28.559408 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.930378 30965 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:28.930745 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:28.931042 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:28.931305 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:28.648228 31164 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:28.930745 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:28.827426 31015 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:28.553697 31186 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:28.999943 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.948773 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:28.985821 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.953616 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.005648 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:29.004798 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 157076us
I20260709 12:18:28.846027 31132 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.593994 31113 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.444s
I20260709 12:18:29.011431 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:28.557462 30718 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.016932 29327 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:28.863785 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.554035 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:28.856460 28605 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:28.859050 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 310059us
I20260709 12:18:28.938961 28598 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:28.596606 31185 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:28.939359 29322 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 2.
I20260709 12:18:28.936842 28607 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
W20260709 12:18:29.012652 28722 leader_election.cc:336] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.723s (SENT)
I20260709 12:18:28.854899 31099 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:28.914464 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.032466 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:29.028005 28722 leader_election.cc:336] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.978s (SENT)
I20260709 12:18:28.936481 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.914489 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.039029 28676 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:28.800369 31180 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:28.557307 31170 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:29.045567 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 643) took 5146 ms. Trace:
I20260709 12:18:29.045706 29326 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:28.687096 31179 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.252s
I20260709 12:18:28.947152 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:28.594920 31206 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.000083 31112 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:18:29.008215 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 59548.5us
I20260709 12:18:28.980623 31166 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:18:28.935250 31081 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:28.846851 31030 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:28.932935 29292 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.906s (SENT)
I20260709 12:18:28.941625 30911 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.020076 28600 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:28.842908 31189 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:28.938256 30965 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:28.999982 31164 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:29.036252 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:28.936755 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.033980 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:28.931067 31204 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:18:29.047109 29322 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:29.045982 29325 rpcz_store.cc:276] 0709 12:18:23.898689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.179673 (+280984us) service_pool.cc:224] Handling call
0709 12:18:24.180085 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:24.327887 (+147802us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:24.327919 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:24.328500 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.721719 (+393219us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:24.721765 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.721838 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.549380 (+3827542us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:29.045280 (+495900us) raft_consensus.cc:1685] finished
0709 12:18:29.045301 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.045507 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":35414,"spinlock_wait_cycles":6254336,"thread_start_us":383444,"threads_started":1,"wal-append.queue_time_us":1004966}
I20260709 12:18:29.048097 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:29.042486 28607 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 12:18:29.048861 28673 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 3.
I20260709 12:18:29.032037 28599 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:29.050765 28604 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:28.859131 28679 raft_consensus.cc:614] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:29.054216 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 107168us
I20260709 12:18:28.836750 31062 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:29.014946 31015 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:29.087393 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 154486us
W20260709 12:18:29.142670 29292 leader_election.cc:336] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.985s (SENT)
I20260709 12:18:29.024647 31201 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:18:28.858877 31184 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:29.026259 31216 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:29.026418 31185 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:29.039923 31047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.002s	user 0.014s	sys 0.057s
I20260709 12:18:29.108883 28605 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:18:29.163219 31047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.125s	user 0.014s	sys 0.057s
I20260709 12:18:29.109707 29323 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:29.118759 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:29.164017 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:29.164300 31212 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:18:29.164714 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46083.2us
I20260709 12:18:29.114692 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:29.166605 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51991.2us
I20260709 12:18:29.167027 31015 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.167143 31184 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:29.169394 31216 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:29.116572 31062 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:29.170492 31216 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.173997 31192 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.174860 31166 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:29.175387 31166 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:29.175781 31166 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:29.178328 31185 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:29.140906 28607 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:29.023265 31132 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:29.143249 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:29.003141 28681 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 3: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:29.108847 31164 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:29.149293 28600 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:29.086966 31174 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:29.040211 31050 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:18:29.033116 31196 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:18:29.159049 28604 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:29.160176 28602 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:29.169430 30911 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:29.288699 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57689.9us
I20260709 12:18:29.115592 28601 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:29.289816 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 147181us
W20260709 12:18:29.290509 29292 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.112s (SENT)
I20260709 12:18:29.290880 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:29.292279 29292 leader_election.cc:336] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.373s (SENT)
I20260709 12:18:29.292800 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:29.184021 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:29.190016 28679 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:18:29.009181 31183 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:29.305438 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:29.306272 29323 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:29.159727 28675 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:29.142819 31221 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:29.322322 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 615) took 1261 ms. Trace:
I20260709 12:18:29.346728 29327 rpcz_store.cc:276] 0709 12:18:28.060805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.061004 (+   199us) service_pool.cc:224] Handling call
0709 12:18:29.322115 (+1261111us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54007a5b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:29.322261 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195757312}
W20260709 12:18:29.347221 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 313287us
I20260709 12:18:29.323395 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2037) took 1069 ms. Trace:
I20260709 12:18:29.348097 28598 rpcz_store.cc:276] 0709 12:18:28.254261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.254404 (+   143us) service_pool.cc:224] Handling call
0709 12:18:29.323221 (+1068817us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002c1854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:29.323334 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011946880}
I20260709 12:18:29.348317 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:29.287986 31081 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:29.079759 31206 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:29.339846 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.341504 29326 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:18:29.229708 31174 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:29.315199 31168 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:29.520144 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 171886us
I20260709 12:18:29.520498 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.525673 28681 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:29.539408 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.312398 31149 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:29.312626 31175 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:29.230559 31015 raft_consensus.cc:2764] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:18:29.553894 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 389936us
I20260709 12:18:29.338418 31205 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:29.547060 29326 pending_rounds.cc:85] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 5
I20260709 12:18:29.571677 29326 pending_rounds.cc:107] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
W20260709 12:18:29.566573 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.567540 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44283.3us
I20260709 12:18:29.570209 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.345906 31183 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:29.572813 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:29.572822 28681 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:29.346182 31113 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:29.547695 31174 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:29.346585 31221 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:29.586858 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:29.594527 28681 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:29.572049 29326 raft_consensus.cc:2917] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 12:18:29.577320 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 668) took 1051 ms. Trace:
I20260709 12:18:29.597790 29326 raft_consensus.cc:2889] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:29.598201 29326 pending_rounds.cc:107] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:18:29.598671 29326 raft_consensus.cc:2889] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:29.604481 31219 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:18:29.605511 31062 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.607623 31062 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.614038 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 425) took 3008 ms. Trace:
I20260709 12:18:29.614445 28755 rpcz_store.cc:276] 0709 12:18:26.606809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.788096 (+181287us) service_pool.cc:224] Handling call
0709 12:18:26.788487 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.826478 (+ 37991us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:26.826507 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.830757 (+  4250us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.557418 (+726661us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:27.557499 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.613557 (+2056058us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b54002d5ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:29.613616 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.613670 (+    54us) raft_consensus.cc:1685] finished
0709 12:18:29.613705 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.613969 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6119,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1915,"spinlock_wait_cycles":62242688,"thread_start_us":640555,"threads_started":1,"wal-append.queue_time_us":926521}
I20260709 12:18:29.548254 31225 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:29.593000 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:29.617221 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.644897 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.587711 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45840us
I20260709 12:18:29.626581 31081 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.623924 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.625795 31223 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:29.626768 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.597859 29325 rpcz_store.cc:276] 0709 12:18:28.510913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.140050 (+629137us) service_pool.cc:224] Handling call
0709 12:18:29.140464 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.140684 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:29.180896 (+ 40212us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.562233 (+381337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.562285 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:29.562337 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.562403 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.562518 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30847,"prepare.queue_time_us":79037,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2025,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12458,"thread_start_us":380957,"threads_started":1}
I20260709 12:18:29.571046 31205 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.665640 28677 raft_consensus.cc:2410] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:18:29.675845 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 82921.9us
I20260709 12:18:29.315969 30965 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.678675 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:29.681865 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:29.647836 30962 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:29.685020 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:29.687036 28677 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:29.595880 31197 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.580125 31201 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:18:29.649017 31175 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:29.652727 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:29.698266 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.674680 31225 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:29.703312 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.679489 31205 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:29.587864 30889 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:18:29.681244 31224 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.710872 28679 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:29.713152 28681 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:29.652421 31166 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.700212 30965 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:29.686245 31223 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:29.719698 29292 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.239s (SENT)
I20260709 12:18:29.684116 31226 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:29.695910 31186 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:29.741015 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:29.752839 31162 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 2.198s	user 0.000s	sys 0.013s
I20260709 12:18:29.753333 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.754288 28681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:29.754763 28681 raft_consensus.cc:606] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:29.755070 28681 raft_consensus.cc:614] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:29.756770 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1657) took 6107 ms. Trace:
I20260709 12:18:29.725404 31099 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.742779 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:29.745026 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:29.698310 30962 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.760638 31186 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:29.761601 31206 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.762061 30962 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.743150 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.763203 28679 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:29.763607 29319 raft_consensus.cc:2410] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:18:29.765291 29319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 611) took 1724 ms (client timeout 1985 ms). Trace:
I20260709 12:18:29.765523 28679 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:29.765697 29319 rpcz_store.cc:269] 0709 12:18:28.040876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.041543 (+   667us) service_pool.cc:224] Handling call
0709 12:18:29.652556 (+1611013us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:29.765056 (+112500us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b54006531d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:29.765231 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117784064}
I20260709 12:18:29.747143 31223 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:29.770370 29292 leader_election.cc:336] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.993s (SENT)
I20260709 12:18:29.770803 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:29.771785 31189 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:29.772274 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:29.772545 31189 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:29.773136 31050 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:29.774609 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:29.775372 31050 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:29.775738 31050 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.776062 31050 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:29.776311 31113 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:29.776899 30965 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:29.777906 31225 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:29.780786 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.782447 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:29.783463 28677 raft_consensus.cc:2410] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:29.783581 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.783993 31050 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.785089 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.785405 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.706789 30718 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.742671 31224 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.757169 28674 rpcz_store.cc:276] 0709 12:18:23.649210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.649366 (+   156us) service_pool.cc:224] Handling call
0709 12:18:23.649709 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.650116 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.650143 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.650695 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.743555 (+3092860us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b1800304f60. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:18:26.967098 (+223543us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:26.967131 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.967233 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.649159 (+2681926us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:29.756560 (+107401us) raft_consensus.cc:1685] finished
0709 12:18:29.756578 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.756707 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7190,"spinlock_wait_cycles":10875008,"thread_start_us":223345,"threads_started":1,"wal-append.queue_time_us":3903947}
I20260709 12:18:29.784365 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.745131 31226 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:29.748811 31163 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 2.195s	user 0.014s	sys 0.014s
I20260709 12:18:29.801884 28677 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:29.800540 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.794404 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.811661 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.745440 31149 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.724365 31112 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:29.800176 28570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.067s	sys 0.078s
W20260709 12:18:29.819387 28570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.069s	sys 0.078s
I20260709 12:18:29.773113 31189 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.713815 31175 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.822362 28600 raft_consensus.cc:2410] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:29.751928 31221 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:29.824684 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.827716 28604 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:29.811267 31226 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:29.830543 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.823809 31030 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:29.833791 31206 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:29.834594 31206 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:29.835472 31153 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:29.835841 31153 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:29.836648 31153 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.840879 31153 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:29.839937 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 486) took 1330 ms. Trace:
I20260709 12:18:29.843678 28675 rpcz_store.cc:276] 0709 12:18:28.509099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.515510 (+  6411us) service_pool.cc:224] Handling call
0709 12:18:29.839756 (+1324246us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540016d354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:29.839873 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268530048}
I20260709 12:18:29.832195 30962 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:29.850435 30962 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:29.864277 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 572665us
I20260709 12:18:29.871930 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.873549 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.874217 28601 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:29.872767 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.872905 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.849201 31174 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:29.832602 28720 connection.cc:256] RPC call timeout handler was delayed by -3.9186180500000773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 12:18:29.877435 28599 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:29.865144 29322 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.017s	sys 0.013s
W20260709 12:18:29.879211 29322 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.017s	sys 0.013s
I20260709 12:18:29.879144 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:29.880119 28720 connection.cc:256] RPC call timeout handler was delayed by -3.8622277239999221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:18:29.880661 28720 connection.cc:256] RPC call timeout handler was delayed by -3.8475180499999624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 12:18:29.881709 28720 connection.cc:256] RPC call timeout handler was delayed by -3.7008180499999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 12:18:29.822477 31149 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:29.884035 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.882627 28720 connection.cc:256] RPC call timeout handler was delayed by -3.1473424969999542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
W20260709 12:18:29.886547 28720 connection.cc:256] RPC call timeout handler was delayed by -2.6496180500000719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3054s for a response
I20260709 12:18:29.886711 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:29.873632 31164 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.002s
I20260709 12:18:29.822695 31189 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:29.890776 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.895974 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:29.896827 28749 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:29.898116 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:29.898865 29325 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:29.902689 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:29.903494 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:29.883502 31030 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.889138 31185 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
I20260709 12:18:29.907514 29290 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:29.883987 31153 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.906315 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:29.908748 29327 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:29.887590 30962 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:29.910156 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:29.934368 28676 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
W20260709 12:18:29.925902 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.927073 30980 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:29.957790 30980 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.957949 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:29.958209 30980 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:29.958578 29319 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:29.960549 31149 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:29.960721 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:29.961422 28755 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:29.968753 31166 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:29.968204 31132 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:29.969195 30980 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.970099 31205 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.971457 28607 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:29.970851 31198 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 1.375s	user 0.007s	sys 0.002s
I20260709 12:18:29.973434 30980 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:29.973359 31175 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:29.956135 31206 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:29.975092 28603 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:30.015448 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1689) took 1319 ms. Trace:
W20260709 12:18:29.983747 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.979946 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1690) took 1283 ms. Trace:
I20260709 12:18:30.016048 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:30.016469 28602 rpcz_store.cc:276] 0709 12:18:28.733308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.843871 (+110563us) service_pool.cc:224] Handling call
0709 12:18:29.979746 (+1135875us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540004b854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:29.979873 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356497792}
I20260709 12:18:30.015823 28603 rpcz_store.cc:276] 0709 12:18:28.696219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.039099 (+342880us) service_pool.cc:224] Handling call
0709 12:18:29.039478 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.974945 (+935467us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b54003b45a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f6dc0 00007f6fe3a811c0 00007f6fe3a82231 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c
0709 12:18:30.015190 (+ 40245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.015386 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10696576}
W20260709 12:18:30.017495 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.987178 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:30.007071 28679 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:30.018576 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.019731 28679 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:29.976214 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 620) took 1767 ms. Trace:
I20260709 12:18:30.019446 28749 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:30.027086 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:30.027912 28674 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:30.020954 29326 rpcz_store.cc:276] 0709 12:18:28.208519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.208653 (+   134us) service_pool.cc:224] Handling call
0709 12:18:29.045521 (+836868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.599494 (+553973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.976019 (+376525us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400587fd0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:29.976141 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743788800}
I20260709 12:18:30.029891 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.030471 28677 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:30.032119 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.034937 28753 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:29.978513 31222 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.456s	user 0.001s	sys 0.000s
I20260709 12:18:30.039240 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:29.980288 30960 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:29.930060 31185 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:29.900321 31164 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:30.043053 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.043228 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.044868 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.045691 28752 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.044325 28756 raft_consensus.cc:2410] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:29.976311 31174 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:30.047868 28648 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.780s (SENT)
I20260709 12:18:30.049424 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:30.052541 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:29.979121 30795 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:30.055991 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:30.057142 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:29.981598 31050 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:30.023859 31132 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.060117 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:30.060957 28753 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:30.041648 30960 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:30.067935 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.068842 28755 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:30.069489 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.070113 28751 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:30.071265 28601 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:30.071480 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 671) took 1559 ms. Trace:
I20260709 12:18:29.941068 31153 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:29.927837 31030 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.055452 31000 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:30.088966 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.059128 30795 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:30.091295 28753 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:30.092635 28747 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:30.092984 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 667) took 1582 ms. Trace:
I20260709 12:18:30.095566 28755 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:30.096006 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.100863 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.101583 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.102272 28751 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:30.102418 28753 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:30.104475 28749 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:30.108963 28598 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:30.134327 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1679) took 1441 ms. Trace:
I20260709 12:18:30.134816 28606 rpcz_store.cc:276] 0709 12:18:28.693047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.037425 (+344378us) service_pool.cc:224] Handling call
0709 12:18:29.053041 (+ 15616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.228993 (+175952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.229023 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.288452 (+ 59429us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.906125 (+617673us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:29.906170 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.906250 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.134079 (+227829us) raft_consensus.cc:1685] finished
0709 12:18:30.134103 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.134259 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165710,"raft.queue_time_us":67518,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":15774,"thread_start_us":518991,"threads_started":2,"wal-append.queue_time_us":747251}
I20260709 12:18:30.136803 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.137593 28753 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:30.138484 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.139086 28754 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:30.139958 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:30.141119 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.141736 28750 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:30.144047 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:30.144948 29320 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:30.146209 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:30.147037 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:30.149151 29323 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:30.150725 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:30.152621 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.153038 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.153647 28751 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:30.132000 31164 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:30.156018 29327 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEARNER]: Advancing to term 8
I20260709 12:18:30.158356 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:30.166237 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.176764 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.186142 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:30.098433 31224 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:30.270634 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:30.143276 31060 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:30.268898 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 94834us
W20260709 12:18:30.200161 28721 connection.cc:256] RPC call timeout handler was delayed by -2.2042949770000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 12:18:30.283924 28721 connection.cc:256] RPC call timeout handler was delayed by -2.0998949770000763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 12:18:30.285737 28721 connection.cc:256] RPC call timeout handler was delayed by -2.0231505900001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:18:30.286129 28721 connection.cc:256] RPC call timeout handler was delayed by -1.8674472049999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 12:18:30.286522 28721 connection.cc:256] RPC call timeout handler was delayed by -1.8649949769999239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 12:18:30.286890 28721 connection.cc:256] RPC call timeout handler was delayed by -1.6784505900000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 12:18:30.287263 28721 connection.cc:256] RPC call timeout handler was delayed by -1.562347205000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 12:18:30.298514 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.299408 29327 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:30.299427 28755 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:30.301687 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.302048 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.070128 31132 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:30.282011 28722 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 3.054s (SENT)
I20260709 12:18:30.308657 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:30.309535 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:30.319892 28755 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:30.320778 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:30.320945 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.321712 28606 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:30.321856 28751 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:30.307763 28648 leader_election.cc:336] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.152s (SENT)
I20260709 12:18:30.326488 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.330180 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.330711 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.331305 28751 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
I20260709 12:18:30.346596 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.346709 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.347433 28755 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:30.348008 28754 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:30.345577 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:30.357213 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:30.357800 28753 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:30.361641 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:30.368717 28755 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:30.369176 28755 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:30.345485 31174 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:30.270617 30960 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.384071 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:30.388844 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.369896 28755 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:30.389559 28751 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:30.385671 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:30.389922 28755 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.387434 28753 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:30.380673 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.392386 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.393083 28750 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.394837 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 665) took 3526 ms. Trace:
I20260709 12:18:30.395190 29321 rpcz_store.cc:276] 0709 12:18:26.868177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.868733 (+   556us) service_pool.cc:224] Handling call
0709 12:18:29.725489 (+2856756us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:29.725683 (+   194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.725973 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.726011 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.726562 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.059775 (+333213us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:30.059811 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.059879 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.394519 (+334640us) raft_consensus.cc:1685] finished
0709 12:18:30.394542 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.394763 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7948672,"thread_start_us":313054,"threads_started":1,"wal-append.queue_time_us":406054}
W20260709 12:18:30.396896 31238 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:18:30.398805 28606 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:30.371834 31149 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:30.371026 31153 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:30.383245 31174 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:30.407039 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.391126 31205 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:30.400499 31149 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:30.412729 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.413319 28755 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:18:30.413365 28750 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:30.413774 28755 pending_rounds.cc:85] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 4
I20260709 12:18:30.413862 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.414147 28755 pending_rounds.cc:107] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:18:30.414465 28755 raft_consensus.cc:2889] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:30.414553 28753 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:30.406467 31189 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.504s	user 0.004s	sys 0.007s
I20260709 12:18:30.416779 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:30.418215 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 108734us
I20260709 12:18:30.418728 28755 raft_consensus.cc:2410] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:30.419242 31187 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:30.420511 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.420657 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:30.421422 31187 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:30.421568 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:30.421900 31187 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.422315 31187 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:30.422503 28674 raft_consensus.cc:606] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:30.422896 28674 raft_consensus.cc:614] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:30.425733 28682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 482) took 3532 ms (client timeout 1722 ms). Trace:
I20260709 12:18:30.407086 31174 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:30.410269 31226 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.006s
I20260709 12:18:30.433877 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.434636 28749 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:30.409955 31185 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:30.427575 31189 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.432112 29319 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.424808 31164 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:30.401525 30795 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.411809 31149 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.424885 30995 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:30.427281 31030 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:30.441232 30795 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:30.436934 31226 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.453384 31226 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:30.454028 31189 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:30.382580 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.482448 28605 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:30.484766 28604 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:30.484599 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:30.485785 28599 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:30.486020 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:30.486697 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:30.487046 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:30.488008 28604 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:30.487263 28602 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:30.500905 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:30.501953 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:30.503177 28674 raft_consensus.cc:606] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:30.503798 28674 raft_consensus.cc:614] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:30.426143 28682 rpcz_store.cc:269] 0709 12:18:26.893836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.897611 (+  3775us) service_pool.cc:224] Handling call
0709 12:18:30.425537 (+3527926us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b5400299854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:30.425667 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536607488}
W20260709 12:18:30.508401 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.509322 28682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:30.509955 28682 raft_consensus.cc:606] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:30.510370 28682 raft_consensus.cc:614] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:30.511870 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:30.514644 28749 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:30.517832 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.519487 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.520999 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.522327 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.523265 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.524156 28754 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:30.524741 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.523368 28749 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:30.527767 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.528631 28753 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:30.528973 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:30.527031 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.530050 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.530709 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.534279 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.535476 28756 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.535925 31200 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.548692 28751 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.549645 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:30.549911 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.551033 28754 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.537108 31200 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.556758 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.557826 31187 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.560055 29327 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:30.567577 28753 raft_consensus.cc:2410] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:30.578267 30995 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.579272 30995 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.583472 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:30.590768 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.594758 28673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 494) took 1656 ms (client timeout 2130 ms). Trace:
I20260709 12:18:30.597153 31187 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:18:30.597482 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 480) took 3704 ms. Trace:
I20260709 12:18:30.596817 31174 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:30.595551 28673 rpcz_store.cc:269] 0709 12:18:28.938310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.938452 (+   142us) service_pool.cc:224] Handling call
0709 12:18:30.594193 (+1655741us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b540016c954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:30.594450 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109956864}
I20260709 12:18:30.594472 30995 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:30.603005 28682 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:30.603003 29319 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:30.598112 28678 rpcz_store.cc:276] 0709 12:18:26.892588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.911343 (+ 18755us) service_pool.cc:224] Handling call
0709 12:18:26.911670 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.061697 (+150027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.061744 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.061802 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:27.061865 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.596820 (+3534955us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000c7954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:30.596925 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.597214 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344162688}
I20260709 12:18:30.072165 29322 rpcz_store.cc:276] 0709 12:18:28.511492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.142382 (+630890us) service_pool.cc:224] Handling call
0709 12:18:29.183889 (+ 41507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.184150 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:29.879748 (+695598us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.070895 (+191147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.070971 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:30.071043 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.071135 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.071401 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42355,"prepare.queue_time_us":336890,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":7400,"raft.queue_time_us":4203,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6670,"thread_start_us":757405,"threads_started":2}
I20260709 12:18:30.609084 28753 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.617226 30795 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:30.619184 30795 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:30.619650 30795 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:30.620815 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:30.621923 30795 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.623894 30795 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:30.627275 30960 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:30.630553 31179 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:30.630988 31179 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:30.615495 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:30.638080 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.641281 28674 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:30.636695 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.671171 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.655629 31200 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:30.632290 31179 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:30.679062 31179 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.693914 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:30.694113 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:30.694321 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:30.697615 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:30.698431 28677 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.708858 31229 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:30.710966 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.715761 28747 raft_consensus.cc:2410] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:18:30.719511 29317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 613) took 2665 ms (client timeout 1775 ms). Trace:
W20260709 12:18:30.720191 29317 rpcz_store.cc:269] 0709 12:18:28.053543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.054865 (+  1322us) service_pool.cc:224] Handling call
0709 12:18:30.717198 (+2662333us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b5400660154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:30.719285 (+  2087us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193332608}
I20260709 12:18:30.722419 28681 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:30.725664 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.729192 31244 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.290s	user 0.000s	sys 0.005s
I20260709 12:18:30.093727 29318 rpcz_store.cc:276] 0709 12:18:28.510663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.043706 (+533043us) service_pool.cc:224] Handling call
0709 12:18:29.120405 (+ 76699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.184888 (+ 64483us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:29.820846 (+635958us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.080575 (+259729us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.080661 (+    86us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:30.092627 (+ 11966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.092744 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.092901 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19358,"prepare.queue_time_us":288953,"prepare.run_cpu_time_us":1993,"prepare.run_wall_time_us":23038,"raft.queue_time_us":3258,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11671,"thread_start_us":534705,"threads_started":2,"wal-append.queue_time_us":253253}
I20260709 12:18:30.732920 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:30.738059 28674 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
W20260709 12:18:30.739995 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.739967 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:30.741657 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:30.742568 31250 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:18:30.742750 28752 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:30.743782 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:30.744603 28748 raft_consensus.cc:2376] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5. Re-sending same reply.
W20260709 12:18:30.747479 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.749713 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.749745 28678 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:30.757936 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:30.765340 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:30.829066 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.885392 28676 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:30.866647 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1649) took 1184 ms. Trace:
I20260709 12:18:30.861184 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 370) took 1079 ms. Trace:
I20260709 12:18:30.764963 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:30.869691 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:30.893901 28681 rpcz_store.cc:276] 0709 12:18:29.682537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.759590 (+ 77053us) service_pool.cc:224] Handling call
0709 12:18:30.425665 (+666075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.722913 (+297248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.865252 (+142339us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400299854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:30.866291 (+  1039us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400299850. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:30.866523 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192620288}
I20260709 12:18:30.897588 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.898236 28753 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.887060 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.920070 28682 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:30.766139 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:30.922281 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.923333 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.855959 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:30.928660 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.894906 28600 rpcz_store.cc:276] 0709 12:18:29.782118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.782231 (+   113us) service_pool.cc:224] Handling call
0709 12:18:30.860718 (+1078487us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b5400233f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:30.861004 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89992960}
I20260709 12:18:30.935099 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:30.784693 31174 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:30.828697 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:30.940287 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:30.826526 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47958.3us
W20260709 12:18:30.945299 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 250856us
W20260709 12:18:30.930740 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 166055us
I20260709 12:18:30.949831 28674 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:18:30.951213 28755 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:30.951617 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:30.952479 28722 leader_election.cc:336] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.594s (SENT)
I20260709 12:18:30.957906 31060 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:30.940177 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.805765 31149 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:30.960084 28749 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:30.788816 30744 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 12:18:30.958461 31060 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:30.980813 31179 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:30.984262 31179 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:30.986780 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.986861 31179 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:30.987701 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.993410 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 209560us
I20260709 12:18:30.996781 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:30.997835 28750 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:31.006633 31132 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:31.007829 28682 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:31.008158 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:31.022770 31149 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:31.021211 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:30.981740 31060 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:31.034801 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 179194us
W20260709 12:18:31.037472 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.988237 31258 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.042822 28677 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:31.043678 31192 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:18:31.045102 31153 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:31.045843 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 63086.1us
I20260709 12:18:31.046288 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:31.046758 28722 leader_election.cc:336] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.670s (SENT)
I20260709 12:18:31.047228 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:31.047519 30962 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:31.048197 31030 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:31.048628 29325 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:31.048683 31030 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:31.049197 30962 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.049316 31030 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.051642 28751 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:31.055723 28573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.564s (SENT) [suppressed 78 similar messages]
I20260709 12:18:31.058835 31030 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:31.069582 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:31.075474 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.077842 31030 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:31.071616 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:31.087359 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 52775us
W20260709 12:18:31.084699 28722 leader_election.cc:336] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.695s (SENT)
W20260709 12:18:31.089257 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 54569.4us
W20260709 12:18:31.092849 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46761.3us
I20260709 12:18:31.096536 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:31.103184 31000 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:31.105057 31000 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:31.105906 31000 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:31.103884 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:31.070992 31179 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:31.128273 31265 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:31.128914 31258 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:31.129616 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:31.129654 31258 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:31.131469 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:31.132712 28675 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:31.132912 30795 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:31.133432 30795 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.133579 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 366) took 1354 ms. Trace:
I20260709 12:18:31.133919 30795 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.134011 28598 rpcz_store.cc:276] 0709 12:18:29.779433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.779568 (+   135us) service_pool.cc:224] Handling call
0709 12:18:29.779855 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.109483 (+329628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.133074 (+1023591us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54003d3454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:31.133384 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739537152}
I20260709 12:18:31.136943 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:31.137769 29319 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:31.138603 31267 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:18:31.120659 31030 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:31.139195 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:31.139580 31030 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:31.139791 30962 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:31.140226 30962 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.140645 30962 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.140828 31030 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.131556 31258 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.143867 28505 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:31.145473 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 55641.7us
I20260709 12:18:31.145680 31216 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:31.138618 31221 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.146744 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:31.146773 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:31.146217 31216 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:31.152027 31263 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:18:31.155735 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:31.150945 31216 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.150913 31132 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:31.146261 31153 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:31.158215 28722 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.723s (SENT)
W20260709 12:18:31.161279 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.168041 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:31.168825 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.166857 31153 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.171062 31265 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:31.183621 31265 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.192708 31265 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:31.196991 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 93014.8us
I20260709 12:18:31.198829 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:31.215930 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:31.219766 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 65027.6us
W20260709 12:18:31.235109 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:31.245549 28504 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 336) took 15165 ms (client timeout 15000 ms). Trace:
I20260709 12:18:31.251436 31000 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.254472 31000 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.236717 30795 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.264542 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 387) took 1103 ms. Trace:
I20260709 12:18:31.266630 30795 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.265120 28603 rpcz_store.cc:276] 0709 12:18:30.104902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.105156 (+   254us) service_pool.cc:224] Handling call
0709 12:18:30.105555 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.105820 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:30.323952 (+218132us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.079471 (+755519us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b1800472fc0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a 00007f6fe3a89a2a
0709 12:18:31.160258 (+ 80787us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.160408 (+   150us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:31.170093 (+  9685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.178699 (+  8606us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.207084 (+ 28385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2684,"prepare.queue_time_us":164205,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":23469,"raft.queue_time_us":14534,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4329,"spinlock_wait_cycles":35337984,"thread_start_us":264125,"threads_started":2,"wal-append.queue_time_us":884647}
W20260709 12:18:31.255862 31268 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:18:31.257527 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:31.260453 29325 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:18:31.260812 31183 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.261848 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:31.269769 28505 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 3, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:31.262796 30960 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:31.271858 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:31.272722 30960 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:31.272902 31030 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:31.273237 30960 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.276889 30960 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.277045 30795 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:31.273932 31183 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:18:31.283454 31060 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.285944 29325 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:31.287032 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:31.287720 31271 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.004s
I20260709 12:18:31.288059 31030 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.288708 31223 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:31.290693 31153 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:31.292732 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 54105.8us
W20260709 12:18:31.294049 31273 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:31.303231 31179 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:31.227185 31258 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:31.303617 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:31.304747 31149 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:31.307494 30962 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.308648 30795 raft_consensus.cc:2764] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:31.324877 29317 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.323647 31030 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:31.331835 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 118176us
I20260709 12:18:31.304797 31183 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:18:31.332382 31258 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:31.369107 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 170411us
I20260709 12:18:31.377199 31102 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.377977 31102 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.381232 31102 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:31.376178 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 228462us
I20260709 12:18:31.383502 31132 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:31.368796 31258 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:31.390779 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:31.398387 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 94881.5us
I20260709 12:18:31.399127 28673 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:31.400499 31175 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:31.404593 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:31.405499 28675 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:31.405891 31280 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:31.406394 31280 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:31.406829 31280 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.406862 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:31.409245 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:31.410262 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.408134 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:31.368887 31149 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.373049 31179 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:31.413496 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.419757 28682 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.393644 31283 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:31.421357 28505 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 5, now has a pending config: VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129), VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130), VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131), VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 5 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:31.385725 31192 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:31.384770 31132 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:31.246042 28504 rpcz_store.cc:269] 0709 12:18:16.080301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.080508 (+   207us) service_pool.cc:224] Handling call
0709 12:18:31.245231 (+15164723us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:21.747926 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:21.748904 (+   978us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:21.748983 (+    79us) write_op.cc:435] Acquired schema lock
0709 12:18:21.749014 (+    31us) tablet.cc:662] Decoding operations
0709 12:18:21.751098 (+  2084us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:21.751206 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:21.751236 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:18:21.862475 (+111239us) tablet.cc:701] Row locks acquired
0709 12:18:21.862522 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:18:21.862707 (+   185us) write_op.cc:270] Start()
0709 12:18:21.862870 (+   163us) write_op.cc:276] Timestamp: P: 1783599501862635 usec, L: 0
0709 12:18:21.862891 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:18:21.863871 (+   980us) log.cc:844] Serialized 7656 byte log entry
0709 12:18:22.397079 (+533208us) op_driver.cc:464] REPLICATION: finished
0709 12:18:22.593110 (+196031us) write_op.cc:301] APPLY: starting
0709 12:18:22.593192 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:22.593577 (+   385us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:22.593689 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:23.478000 (+884311us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5c000b6a8c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe9c71331 00007f6fe9c71221 00007f6fe9c6bf6c 00007f6fe73cc30b 00007f6fe73cbfd3 00007f6fe74cae34 00007f6fe74b697c 00007f6fe74bad61 00007f6fe74bad19 00007f6fe74baca9 00007f6fe74bac71
0709 12:18:23.478972 (+   972us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:23.479330 (+   358us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:18:23.479383 (+    53us) write_op.cc:312] APPLY: finished
0709 12:18:23.479808 (+   425us) log.cc:844] Serialized 132 byte log entry
0709 12:18:24.322212 (+842404us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:24.367097 (+ 44885us) write_op.cc:454] Released schema lock
0709 12:18:24.372597 (+  5500us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:24.386934 (+ 14337us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:24.386972 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":203050,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":195779,"apply.run_cpu_time_us":53217,"apply.run_wall_time_us":1793533,"num_ops":19,"prepare.queue_time_us":336388,"prepare.run_cpu_time_us":19806,"prepare.run_wall_time_us":406888,"raft.queue_time_us":127423,"raft.run_cpu_time_us":24608,"raft.run_wall_time_us":223354,"replication_time_us":534031,"spinlock_wait_cycles":3535232,"thread_start_us":1520550,"threads_started":5,"wal-append.queue_time_us":1098892,"wal-append.run_cpu_time_us":19669,"wal-append.run_wall_time_us":2216850}]]}
I20260709 12:18:31.414373 30795 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.439472 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:31.439636 30980 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.440366 30980 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.441733 31174 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:31.442546 31174 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:31.442888 30980 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:31.443629 30980 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:31.444046 30980 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:31.444593 31192 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:31.445292 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:31.448645 31179 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.438493 30795 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.452347 30795 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:31.455675 28572 connection.cc:256] RPC call timeout handler was delayed by -1.0988734000000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 12:18:31.426370 31283 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:31.463841 28600 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:18:31.472566 28682 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:31.476238 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.479949 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.482476 28603 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:31.475924 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.504096 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.506167 28600 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:31.506456 31060 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.502046 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.508747 30980 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.509506 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.502480 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:31.513145 28605 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:31.508803 29290 leader_election.cc:336] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.722s (SENT)
I20260709 12:18:31.492859 31183 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:31.515131 31183 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:31.515760 29325 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:31.514019 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:31.493911 31153 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.534153 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.535348 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.536134 28605 raft_consensus.cc:2368] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5.
I20260709 12:18:31.474116 30960 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.537004 31175 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:31.538200 30960 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:31.538746 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.539171 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.539584 28604 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:31.539175 31265 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.539777 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.540418 28601 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:31.540583 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.541415 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.541867 31216 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.542692 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.516392 29317 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:31.544015 31216 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.548750 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:31.549541 29319 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.552619 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.487114 30962 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.530334 31149 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:31.515946 31183 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.555680 31265 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:31.521093 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 108749us
W20260709 12:18:31.568620 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 127221us
I20260709 12:18:31.571851 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:31.570044 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 194276us
I20260709 12:18:31.573463 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.585742 28674 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:31.579517 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.620656 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.625916 28673 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:18:31.587692 31149 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:31.628775 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 220727us
I20260709 12:18:31.624398 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:31.632046 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 123296us
I20260709 12:18:31.632987 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.640801 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.646764 30960 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:31.647840 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:31.649370 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:31.650075 29321 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.656735 31216 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:31.657495 31216 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.658397 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:31.659296 31221 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:31.659838 31216 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.660072 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.662081 31297 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:31.662264 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:31.662628 31297 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:31.662921 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:31.663306 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:31.663731 28755 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:31.664086 28749 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:31.667197 31280 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:31.669523 31030 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.663612 31297 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:31.646893 31292 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.662927 28750 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.633008 29317 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:31.634474 31060 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:31.681991 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 62635.6us
I20260709 12:18:31.681772 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:31.683357 28755 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:31.687546 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:31.690538 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.692643 28747 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:18:31.688377 28754 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:31.722231 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.678426 31179 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.678779 31030 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:31.739279 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:31.747016 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.749047 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:31.749313 29319 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:31.747646 28602 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:31.754031 28754 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:31.754953 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 96639.6us
I20260709 12:18:31.744819 30744 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.756801 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:31.757686 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:31.758320 28707 heartbeater.cc:646] Failed to heartbeat to 127.26.205.190:43093 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.205.190:43093 timed out after 15.000s (SENT)
I20260709 12:18:31.759002 28755 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:31.759081 29326 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:31.691998 30795 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:31.739001 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:31.761044 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:31.761688 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.762352 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:31.718708 31192 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:31.659850 31289 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
W20260709 12:18:31.760936 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.646764 31283 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.737704 31060 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:31.698172 31292 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:31.770743 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:31.812455 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:31.837278 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.964272 28750 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:31.958595 28747 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:31.837947 28605 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:31.965698 29319 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 3.
W20260709 12:18:31.815104 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48973.3us
I20260709 12:18:31.837275 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:31.959158 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 239680us
W20260709 12:18:31.970388 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.780460 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:31.915009 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.974992 28678 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:31.978186 28753 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:31.780839 30962 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:31.982692 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:31.965121 30980 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.982131 28755 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:31.990527 31183 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:31.993304 31183 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:31.993422 31298 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:18:31.978102 31280 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:31.993870 29323 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:31.994207 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:32.004190 28680 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.997459 29290 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:31.997870 31294 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:18:31.999110 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.007498 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:32.008131 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.002067 29321 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:32.002662 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:32.006223 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:32.005453 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:31.939271 30744 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:32.034296 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 389593us
I20260709 12:18:32.038499 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.040618 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.042815 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.044370 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.045499 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.024535 31229 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.048385 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.049777 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.049789 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.047627 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:32.064294 28755 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:32.047832 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.065070 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:32.067811 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.134171 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:32.132721 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:32.129954 28722 leader_election.cc:336] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.787s (SENT)
I20260709 12:18:32.116417 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.137472 28601 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:32.106999 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:32.111054 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 59548.2us
I20260709 12:18:32.116531 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:32.106433 29327 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:32.052832 31296 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:18:32.141073 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:32.085268 28602 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:32.133420 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:32.142485 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 116261us
W20260709 12:18:32.074299 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76959.4us
I20260709 12:18:32.201228 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:32.197783 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.164989 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:32.164068 28722 leader_election.cc:336] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.841s (SENT)
I20260709 12:18:32.207494 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:32.191030 28674 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:32.205801 29326 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:32.209479 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:32.150115 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 101663us
I20260709 12:18:32.048089 31175 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:32.205520 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.225852 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.167037 28681 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
W20260709 12:18:32.084268 30960 raft_consensus.cc:670] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:32.247293 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44480us
I20260709 12:18:32.249986 28755 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:18:32.253408 28755 pending_rounds.cc:85] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 5
W20260709 12:18:32.256101 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 92074.7us
W20260709 12:18:32.250005 28648 leader_election.cc:336] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.515s (SENT)
I20260709 12:18:32.198101 31280 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:32.084630 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:32.064888 31174 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:32.267598 28598 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:18:32.268427 29327 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:32.067126 31229 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.272547 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.274052 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:32.275722 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:32.277532 28678 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:32.275838 29321 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:32.282367 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.283178 29325 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:32.283339 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.285107 29320 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:32.286499 30744 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:32.260421 31280 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:32.256938 31287 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:32.287171 31280 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:32.287284 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.287765 31287 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.289539 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.289966 31287 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:32.290592 28607 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:18:32.291554 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.293164 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.293853 28599 raft_consensus.cc:2376] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5. Re-sending same reply.
I20260709 12:18:32.284125 28605 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:32.300457 31283 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:32.253664 28755 pending_rounds.cc:107] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 12:18:32.301182 28755 raft_consensus.cc:2917] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 12:18:32.301841 28755 raft_consensus.cc:2889] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:32.302275 28755 pending_rounds.cc:107] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:18:32.302564 28755 raft_consensus.cc:2889] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:32.303287 31313 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:18:32.305320 28602 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:32.305424 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.307524 31175 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:32.308048 31175 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.308514 31175 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.308650 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.309051 31292 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:32.309329 28606 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
W20260709 12:18:32.309865 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 302507us
I20260709 12:18:32.310539 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.311548 31192 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:32.285132 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 244081us
I20260709 12:18:32.313687 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:32.314405 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.314700 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:32.315205 28607 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:32.316080 29319 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:32.316812 28753 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:32.257253 31060 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:32.257611 30962 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:32.320750 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 71014.3us
I20260709 12:18:32.277417 28573 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:32.133457 31311 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 12:18:32.287207 31282 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:32.334185 28604 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:32.353976 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.354112 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.355175 29321 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:32.356084 28601 raft_consensus.cc:2410] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:32.358641 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:32.322500 31301 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:32.318662 31295 raft_consensus.cc:2764] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:32.317304 30795 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:32.319154 31183 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.361830 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:32.367712 28678 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:32.369189 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:32.353111 28748 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:32.351687 30960 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:32.319499 31296 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:18:32.349995 31282 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:32.375095 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:32.387248 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 113309us
I20260709 12:18:32.388358 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.372851 31301 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:32.372249 31287 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:32.399881 28682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.020s
W20260709 12:18:32.401417 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 195352us
W20260709 12:18:32.407995 28682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.005s	sys 0.020s
I20260709 12:18:32.383857 31221 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:32.410094 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:32.411973 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:32.365931 31306 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:32.395795 30962 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:32.385967 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.389035 30960 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:32.408527 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 97058.6us
I20260709 12:18:32.374552 31183 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.426064 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:32.407320 31301 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.406703 30980 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:32.435904 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:32.436383 31302 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:18:32.414535 31221 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:32.439404 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:32.444607 28648 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.533s (SENT)
I20260709 12:18:32.574245 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:32.542465 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.585532 28607 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:32.574193 29323 consensus_meta.cc:287] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
W20260709 12:18:32.544790 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.586238 29323 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:32.527135 29321 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:32.586702 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.536149 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 186686us
I20260709 12:18:32.431187 30960 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:32.586321 28680 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.559s	user 0.005s	sys 0.005s
I20260709 12:18:32.574813 31221 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.593535 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:32.558430 29320 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:32.593976 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 168018us
I20260709 12:18:32.595844 28606 raft_consensus.cc:1217] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Deduplicated request from leader. Original: 4.5->[4.6-6.7]   Dedup: 4.6->[6.7-6.7]
I20260709 12:18:32.596351 28606 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:18:32.597303 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:32.603938 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 234841us
I20260709 12:18:32.447331 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:32.428010 30744 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:32.588665 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:32.606199 28680 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
W20260709 12:18:32.606772 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 176453us
W20260709 12:18:32.607271 28648 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.534s (SENT)
I20260709 12:18:32.453262 30795 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.603307 31149 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:32.626289 30795 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:32.575615 31322 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:18:32.626358 31149 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.428303 31328 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:32.450754 31308 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.324s	user 0.001s	sys 0.001s
W20260709 12:18:32.631068 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 312185us
I20260709 12:18:32.432672 30962 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:32.539386 30980 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:32.588461 31174 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:32.634292 31321 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:18:32.634707 31282 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.635102 31175 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.539501 31297 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:32.638434 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 323839us
W20260709 12:18:32.632579 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 221682us
I20260709 12:18:32.612727 30744 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:32.707150 28722 leader_election.cc:336] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.053s (SENT)
W20260709 12:18:32.717374 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 111871us
I20260709 12:18:32.716837 30795 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:32.718988 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.706151 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:32.631083 31292 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:18:32.747990 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:32.563365 31280 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:32.607712 28648 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.534s (SENT)
I20260709 12:18:32.447964 31289 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.259s
I20260709 12:18:32.666678 31229 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:32.717289 30744 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:32.767674 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 320409us
I20260709 12:18:32.759842 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:32.757249 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:32.761593 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:32.759219 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:32.768558 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 131919us
I20260709 12:18:32.775471 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:32.776885 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 69794.7us
I20260709 12:18:32.748929 31328 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:32.791281 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 183552us
W20260709 12:18:32.792001 28648 leader_election.cc:336] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.615s (SENT)
W20260709 12:18:32.799129 28648 leader_election.cc:336] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.615s (SENT)
I20260709 12:18:32.799654 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:32.785938 31229 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:32.776723 31060 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:32.820420 28722 leader_election.cc:336] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.063s (SENT)
I20260709 12:18:32.821842 29321 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:32.806994 31229 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.833204 31060 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:32.858908 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:32.818344 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 670) took 1009 ms. Trace:
I20260709 12:18:32.826874 31292 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:32.827180 31328 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:32.849972 31319 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
W20260709 12:18:32.872952 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52579.6us
I20260709 12:18:32.844523 31229 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:32.870030 31292 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:32.881225 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 88684.6us
I20260709 12:18:32.881950 31292 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:32.882457 31327 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:18:32.882671 28648 leader_election.cc:336] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.669s (SENT)
I20260709 12:18:32.883152 31292 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:32.883112 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:32.885279 31341 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:32.886978 31280 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:32.887724 31338 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 12:18:32.888948 31338 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:32.889415 31338 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:32.890595 31338 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.892999 31284 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:32.893567 31284 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:32.894811 31284 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:32.897106 31330 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:18:32.868387 29318 rpcz_store.cc:276] 0709 12:18:31.626960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.632754 (+  5794us) service_pool.cc:224] Handling call
0709 12:18:31.644884 (+ 12130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.762279 (+117395us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:32.128573 (+366294us) log.cc:844] Serialized 14 byte log entry
0709 12:18:32.553530 (+424957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:32.579020 (+ 25490us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:32.586069 (+  7049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.603262 (+ 17193us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.635812 (+ 32550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86659,"prepare.queue_time_us":363647,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":8167,"raft.queue_time_us":157432,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":3092,"thread_start_us":643917,"threads_started":3,"wal-append.queue_time_us":250698}
I20260709 12:18:32.795832 30980 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.848982 31311 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:18:32.870191 31333 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:32.884300 31334 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.819263 30962 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:32.954725 31060 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:32.913436 31301 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:32.923134 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:32.942162 31326 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.366s	user 0.002s	sys 0.000s
W20260709 12:18:32.949229 31325 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.373s	user 0.010s	sys 0.001s
I20260709 12:18:32.859010 31287 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:32.973272 29327 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.001s
W20260709 12:18:32.997341 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 241102us
I20260709 12:18:33.000499 29321 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:32.892191 31338 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:32.938133 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:32.946691 31334 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:33.008024 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 84947.1us
W20260709 12:18:32.954759 31331 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:18:33.012558 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 129887us
W20260709 12:18:32.994118 28722 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.072s (SENT)
W20260709 12:18:32.987291 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 182117us
I20260709 12:18:32.972275 31284 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:33.017050 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 79031.2us
I20260709 12:18:33.025841 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:32.907819 31311 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:33.014021 29327 raft_consensus.cc:2410] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:18:33.019536 28648 leader_election.cc:336] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.716s (SENT)
I20260709 12:18:33.060773 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:33.061554 28678 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:33.013852 31258 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.585s	user 0.014s	sys 0.001s
W20260709 12:18:33.033456 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.033907 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:33.065349 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:33.063755 28674 raft_consensus.cc:2376] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6. Re-sending same reply.
I20260709 12:18:32.952950 31335 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.017609 31280 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:33.017336 29320 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:33.021615 31149 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:33.079396 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:33.080118 31280 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:33.081087 31280 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.081537 31060 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:33.081949 31060 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:33.082340 31060 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:33.084175 31349 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:32.913143 31333 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:33.020701 31175 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:33.062438 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 635) took 1094 ms. Trace:
I20260709 12:18:33.064087 29326 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:33.022864 28604 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:33.040817 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.013510 31179 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:32.991299 31282 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:33.018402 31334 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:32.994194 31174 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:18:33.021267 31183 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:33.062186 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 68115.4us
I20260709 12:18:33.086067 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:33.088847 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 303105us
I20260709 12:18:33.088088 29327 rpcz_store.cc:276] 0709 12:18:31.967700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.187293 (+219593us) service_pool.cc:224] Handling call
0709 12:18:33.062373 (+875080us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:33.101816 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.102082 28674 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.022404 31301 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:33.078049 31341 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:18:33.099715 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:33.105759 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 357814us
I20260709 12:18:33.108199 29327 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:32.909574 31328 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.086305 31311 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:33.116981 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 97496.6us
W20260709 12:18:33.117725 28648 leader_election.cc:336] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.727s (SENT)
W20260709 12:18:33.118396 28648 leader_election.cc:336] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.727s (SENT)
I20260709 12:18:33.118786 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.116132 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:33.119993 28722 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.418s (SENT)
I20260709 12:18:33.120570 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.090507 31179 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.086838 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:33.072289 31258 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:33.133313 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.107316 31183 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:33.146474 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:33.121358 31306 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:33.125958 31179 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.078112 31335 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.128378 31345 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:33.154910 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 77496.7us
I20260709 12:18:33.155383 28750 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:33.135249 30980 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.169188 31336 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:33.170387 31341 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:33.157562 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.174362 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1709) took 1132 ms. Trace:
I20260709 12:18:33.174757 28604 rpcz_store.cc:276] 0709 12:18:32.042399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.462548 (+420149us) service_pool.cc:224] Handling call
0709 12:18:32.566340 (+103792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.089149 (+522809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.174135 (+ 84986us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54000bed54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:33.174303 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049408256}
W20260709 12:18:33.150872 31283 consensus_meta.cc:287] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.850s	user 0.013s	sys 0.000s
W20260709 12:18:33.182562 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.117177 31334 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:18:33.183849 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 73603us
I20260709 12:18:33.193507 28678 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:33.195135 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:33.198383 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51880.9us
I20260709 12:18:33.213200 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:33.196260 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:33.218859 28674 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:33.088241 31333 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:33.223542 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 103591us
I20260709 12:18:33.139050 29318 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:33.226668 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:33.238270 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 151896us
W20260709 12:18:33.239547 28722 connection.cc:256] RPC call timeout handler was delayed by -1.0829125899999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2717s for a response
I20260709 12:18:33.231333 31229 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:33.247696 31343 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 12:18:33.231128 31302 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:33.249272 31360 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:18:33.241750 31149 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:33.181874 31183 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:33.256727 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.272836 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:33.180383 30744 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.273463 28674 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:18:33.274775 31354 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:33.277235 31149 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:33.278297 31149 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:33.287169 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.287274 28674 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:33.264814 28607 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
W20260709 12:18:33.251200 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 55020.3us
I20260709 12:18:33.297240 28607 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:33.297150 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:33.194078 31345 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.297770 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1721) took 1003 ms. Trace:
I20260709 12:18:33.298911 31363 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:33.301592 29292 connection.cc:256] RPC call timeout handler was delayed by -1.1634288949999245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 12:18:33.302203 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 183807us
I20260709 12:18:33.304368 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1723) took 1009 ms. Trace:
I20260709 12:18:33.312232 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:33.313709 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:33.321761 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:33.322934 28607 rpcz_store.cc:276] 0709 12:18:32.294043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.437857 (+143814us) service_pool.cc:224] Handling call
0709 12:18:33.297717 (+859860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:33.327387 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.332544 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.333357 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.371407 28598 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:33.334112 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:33.372141 28604 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:33.336006 31348 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.336408 31351 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.337510 29327 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:33.337978 31349 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:33.339007 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:33.377796 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:33.335814 31060 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.341542 31345 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:33.343935 31335 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:33.348894 31353 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:18:33.283378 31302 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:33.363590 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 66516.2us
I20260709 12:18:33.282294 31301 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:33.335597 31347 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.366004 28605 rpcz_store.cc:276] 0709 12:18:32.294585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.015419 (+720834us) service_pool.cc:224] Handling call
0709 12:18:33.015780 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:33.063295 (+ 47515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.063340 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:33.077011 (+ 13671us) log.cc:844] Serialized 52 byte log entry
0709 12:18:33.237295 (+160284us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:33.237333 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.237398 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.304041 (+ 66643us) raft_consensus.cc:1685] finished
0709 12:18:33.304069 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.304267 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34605,"raft.queue_time_us":60633,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":5363,"thread_start_us":109915,"threads_started":1,"wal-append.queue_time_us":195162}
W20260709 12:18:33.374616 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 77980.5us
W20260709 12:18:33.378149 28648 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.733s (SENT)
W20260709 12:18:33.373252 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 178916us
I20260709 12:18:33.384407 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.388919 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.389971 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.390769 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:33.392851 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.393868 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:33.398056 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 59144.6us
I20260709 12:18:33.405906 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:33.406240 28674 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:33.407416 28599 raft_consensus.cc:2368] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5.
I20260709 12:18:33.382854 31362 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:33.354835 31283 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:18:33.397022 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 112381us
I20260709 12:18:33.400372 31341 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:33.375718 31179 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.398875 31301 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:33.408341 31360 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:18:33.432116 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 66261.4us
I20260709 12:18:33.409054 31258 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:33.430049 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51737.7us
I20260709 12:18:33.438567 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:33.439210 28606 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
W20260709 12:18:33.442657 28722 leader_election.cc:336] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.695s (SENT)
I20260709 12:18:33.443236 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.402956 31351 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:33.448849 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.448971 28648 leader_election.cc:336] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.760s (SENT)
I20260709 12:18:33.449245 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:33.450675 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:33.451141 28677 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:33.456732 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.457777 28680 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:33.439502 31301 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:33.434873 31175 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:33.439729 31360 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:33.334843 31311 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.468166 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.468951 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1720) took 1175 ms. Trace:
I20260709 12:18:33.476569 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:33.485210 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45130us
I20260709 12:18:33.485265 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:33.486123 28605 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.486444 29290 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:33.470299 29327 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:33.447067 31192 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:18:33.458916 30962 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.452162 31362 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:33.490676 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.444944 31349 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:18:33.487612 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:33.415959 31347 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:33.484799 28601 rpcz_store.cc:276] 0709 12:18:32.293740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.587468 (+293728us) service_pool.cc:224] Handling call
0709 12:18:32.598346 (+ 10878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.751668 (+153322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.751711 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:32.770650 (+ 18939us) log.cc:844] Serialized 26 byte log entry
0709 12:18:32.936063 (+165413us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18002975e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:18:33.115486 (+179423us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:33.115542 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.115649 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.465258 (+349609us) raft_consensus.cc:1685] finished
0709 12:18:33.465276 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.468886 (+  3610us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152928,"raft.queue_time_us":174149,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":15769,"spinlock_wait_cycles":2984320,"thread_start_us":179215,"threads_started":1,"wal-append.queue_time_us":417795}
W20260709 12:18:33.492506 28648 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.797s (SENT)
I20260709 12:18:33.493649 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.489365 28722 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:33.513291 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 60365.7us
I20260709 12:18:33.535784 28598 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
W20260709 12:18:33.537056 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49176.7us
I20260709 12:18:33.547070 31309 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:33.614279 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:33.544178 28607 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:33.469105 31175 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.538398 31368 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:33.540884 31359 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:18:33.546280 31292 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:33.536710 31341 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:33.539390 31366 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:33.538982 31346 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:33.613749 31282 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:33.539994 31328 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:33.543938 30960 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.000s
I20260709 12:18:33.623225 31368 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:33.538666 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 52490.3us
W20260709 12:18:33.655653 28648 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.797s (SENT)
I20260709 12:18:33.656423 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.625046 31292 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:33.600862 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46408.9us
I20260709 12:18:33.520169 31149 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:33.632139 31346 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:33.541786 31362 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:33.484172 31258 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.601961 29317 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:18:33.639679 31366 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:33.602945 28682 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:18:33.614399 28603 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:33.615360 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:33.615931 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.544862 31060 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:33.597044 31183 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:33.623375 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 155842us
I20260709 12:18:33.552556 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:33.680864 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:33.633646 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:33.681681 28679 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.635445 31179 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:33.635694 31339 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:33.636081 31367 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:33.685873 31373 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:18:33.686466 29318 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:33.611334 31360 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.687538 31360 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.674484 31349 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:33.658540 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 172150us
I20260709 12:18:33.669881 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.493955 30744 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:33.672511 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:33.701211 28605 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
W20260709 12:18:33.674929 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76201.5us
I20260709 12:18:33.612617 28600 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:33.486917 31302 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:33.679210 28648 leader_election.cc:336] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.860s (SENT)
I20260709 12:18:33.613351 31309 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:33.670737 31149 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.713902 31149 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:33.715052 31379 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:18:33.658113 31368 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:33.715407 31258 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:33.683706 28601 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:33.674342 31346 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:33.717362 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.717473 31351 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:33.718493 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.719532 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:33.721203 31355 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:18:33.725322 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:33.726008 28677 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
W20260709 12:18:33.540834 31380 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:18:33.676731 29317 pending_rounds.cc:85] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 5
I20260709 12:18:33.702234 28573 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:33.703825 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:33.737417 29319 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:33.639814 31341 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:33.706072 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:33.671316 31328 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:18:33.662808 30960 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.707194 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.709403 31183 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:33.710232 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.710398 31347 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:33.711067 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:33.713088 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.712981 31309 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.728914 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.749882 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:33.729722 28571 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:33.706100 28648 leader_election.cc:336] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.860s (SENT)
I20260709 12:18:33.685909 31367 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:18:33.757169 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.739940 28679 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:33.741011 29322 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:18:33.728708 31179 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:33.742336 31351 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.739583 29317 pending_rounds.cc:107] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:18:33.743520 28682 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:33.699514 31339 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:33.708927 31306 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:33.751142 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.738199 30962 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:33.762669 29323 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:18:33.764832 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62667.2us
I20260709 12:18:33.768128 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:33.767557 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 54922.7us
I20260709 12:18:33.771780 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:33.758683 31284 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:33.749061 31328 consensus_queue.cc:1243] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:18:33.780352 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 74281.9us
W20260709 12:18:33.781574 28648 leader_election.cc:336] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.890s (SENT)
W20260709 12:18:33.782104 28648 leader_election.cc:336] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.890s (SENT)
I20260709 12:18:33.782435 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.784802 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:33.785035 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:33.785666 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:18:33.786036 28573 connection.cc:256] RPC call timeout handler was delayed by -1.1595708419999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 12:18:33.768767 29317 raft_consensus.cc:2889] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.789315 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:33.772743 30962 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:33.772653 31306 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:33.774060 31309 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:33.791699 31390 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:33.779901 31349 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:33.787156 31183 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:33.792932 31368 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.781498 31284 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.792256 31328 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:33.769995 31301 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:33.787521 30744 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.826022 30744 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:33.827137 31301 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:33.827986 30744 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:33.796831 31385 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:18:33.829684 31338 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:33.830152 31338 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:33.797053 31344 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:18:33.831049 31338 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.800567 31346 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:33.833654 31338 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:33.834038 28603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2067) took 2296 ms (client timeout 2056 ms). Trace:
W20260709 12:18:33.834443 28603 rpcz_store.cc:269] 0709 12:18:31.537373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.566467 (+ 29094us) service_pool.cc:224] Handling call
0709 12:18:33.833830 (+2267363us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540004b354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:33.833935 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3702443392}
I20260709 12:18:33.835124 31346 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:33.804692 31183 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:33.841456 31345 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:33.842311 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 686) took 1901 ms. Trace:
I20260709 12:18:33.842608 31328 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:33.842733 29326 rpcz_store.cc:276] 0709 12:18:31.941161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.208977 (+267816us) service_pool.cc:224] Handling call
0709 12:18:33.062348 (+853371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.088460 (+ 26112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.842071 (+753611us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b540042a9d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:33.842214 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848450816}
I20260709 12:18:33.804999 30962 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:33.840521 31149 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.845417 30962 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.846104 29327 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:33.794318 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:33.795729 31341 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:33.818240 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.796032 31367 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.820591 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:33.820890 31368 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:33.767778 31366 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:33.821506 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:33.823338 31390 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:33.824617 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.794337 31339 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:33.849785 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44833.1us
I20260709 12:18:33.851234 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:33.794381 31387 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:33.836144 31183 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:33.795917 31374 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:18:33.852177 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:33.879537 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 55005.8us
W20260709 12:18:33.871955 28648 leader_election.cc:336] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.903s (SENT)
I20260709 12:18:33.817569 31284 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.886600 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:33.882644 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.800658 31388 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:33.805465 31060 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.886605 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.869405 31149 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:33.892956 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.893620 31060 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:33.883657 31174 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.793447 31392 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:33.893914 28648 leader_election.cc:336] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.947s (SENT)
I20260709 12:18:33.843700 31328 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:33.900193 28648 leader_election.cc:336] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.947s (SENT)
I20260709 12:18:33.900668 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:33.891359 31402 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.896512 31345 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:33.898972 31392 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:33.910542 31332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.007s	sys 0.015s
I20260709 12:18:33.935491 31392 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:33.964615 30960 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:33.910333 31149 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:33.891433 31388 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:33.976764 28648 leader_election.cc:336] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.952s (SENT)
I20260709 12:18:34.036811 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.037658 31360 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:34.038707 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 61984us
W20260709 12:18:34.039475 28648 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.963s (SENT)
W20260709 12:18:34.040086 28648 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.963s (SENT)
I20260709 12:18:34.040506 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:33.977250 28573 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.564s (SENT)
I20260709 12:18:33.907171 31060 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:34.010134 31332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.012s	sys 0.018s
W20260709 12:18:34.030547 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 137626us
I20260709 12:18:34.035646 29319 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.035182 31284 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:33.990444 31390 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.042819 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.044482 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:34.047739 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 70513.5us
W20260709 12:18:34.063619 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.070573 31175 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:34.076861 31357 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:34.077467 28648 leader_election.cc:336] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.971s (SENT)
I20260709 12:18:34.077946 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:34.079093 28648 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.002s (SENT)
I20260709 12:18:34.079488 31229 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:34.079468 28648 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.047302 31149 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:34.087931 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.066458 31360 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:34.047108 31295 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:34.096624 31360 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:34.097122 31360 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:34.098233 31388 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:34.090215 31349 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:34.099174 31360 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:34.090786 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:34.100046 29325 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.092674 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.104985 28751 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:34.092900 29319 raft_consensus.cc:2410] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:34.092770 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.093248 31332 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:34.105938 31284 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:34.106392 28748 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:34.106310 31332 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:34.062064 31306 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.108667 31332 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:34.109146 31306 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:34.109901 31332 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:34.110932 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.110597 31332 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:34.113870 31332 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:34.115051 31280 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.115880 31332 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.115572 31280 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.118718 31280 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:34.119076 28753 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:34.121704 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.094277 31183 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.141994 29325 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:34.146857 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.147038 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:34.147517 28756 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:34.147722 28752 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:18:34.151180 28750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1668) took 2140 ms (client timeout 1564 ms). Trace:
I20260709 12:18:34.151708 28749 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:34.151924 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.089824 31060 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:34.151660 28750 rpcz_store.cc:269] 0709 12:18:32.002285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.002422 (+   137us) service_pool.cc:224] Handling call
0709 12:18:34.142841 (+2140419us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400110b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:34.142942 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2620525312}
I20260709 12:18:34.153620 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.154093 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:34.154302 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.155019 28747 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:34.157894 31183 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:34.140854 31175 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:34.159531 28755 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:34.160596 28747 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.161026 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.168010 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:34.169063 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.169934 28750 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:34.169966 28747 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:18:34.171376 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.172153 28747 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:34.172060 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.174929 28756 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:18:34.175850 31405 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:18:34.144299 31332 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:34.196229 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.206826 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 73763.5us
I20260709 12:18:34.219344 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.219659 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:34.220577 28678 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:34.061802 31392 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.216153 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.122463 28748 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:34.221666 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.213244 28756 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:34.230913 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.231755 28754 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:34.232002 28747 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:34.120111 31292 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.233630 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.239099 28750 raft_consensus.cc:2410] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:34.221469 31371 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:34.249063 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.249945 28751 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 6. Ops: []
I20260709 12:18:34.253686 28754 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:34.256397 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.257229 28678 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:18:34.260414 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.269484 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 53405.4us
I20260709 12:18:34.251506 31292 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.270385 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.273697 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.251322 31366 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:34.277098 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:34.253415 31371 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:34.277966 28754 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:34.279750 28747 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:34.243383 31390 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:18:34.292991 31390 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:34.293409 31390 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:34.294263 31390 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.295493 31390 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:34.300962 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.301450 30980 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:34.301559 28747 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:34.301905 30980 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:18:34.302544 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.302870 30980 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.303933 30980 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:34.304730 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.306736 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:18:34.307366 31392 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:34.308816 31371 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.319731 28678 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:34.313999 31060 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:18:34.327407 31060 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:34.327878 31060 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:34.328872 28756 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:34.328810 31060 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.330060 31060 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.330104 30960 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:34.290632 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:34.311407 31371 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.332320 28748 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.333055 31301 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:34.334025 31306 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:34.334383 31306 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:34.335006 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.335224 31306 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:33.885587 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:34.331657 31383 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:34.345856 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:34.350899 28681 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:18:34.336215 31389 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.607s	user 0.002s	sys 0.000s
I20260709 12:18:34.350993 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:34.355445 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:34.356174 28747 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.336390 31306 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.367775 28677 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:34.310379 31408 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:18:34.355391 31348 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:34.357825 31357 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.375487 28571 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:34.379014 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:34.355136 31342 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:18:34.387173 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:34.372609 31301 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:34.374356 31348 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.389245 28749 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:34.390012 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:34.394685 28505 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 332) took 18028 ms (client timeout 15000 ms). Trace:
I20260709 12:18:34.394951 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.380908 31333 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:34.371472 31289 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:18:34.417264 28747 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:34.417168 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:34.421511 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:34.422200 28747 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.400853 31360 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:34.381718 31357 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.391331 31368 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:34.402194 31363 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:34.402503 31332 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:34.439800 28648 leader_election.cc:400] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5.
I20260709 12:18:34.440161 28648 leader_election.cc:403] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:34.446640 31360 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5.
W20260709 12:18:34.449195 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2567108880000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 12:18:34.449306 28607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2091) took 1157 ms (client timeout 1529 ms). Trace:
W20260709 12:18:34.449802 28648 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.032s (SENT)
W20260709 12:18:34.449831 28607 rpcz_store.cc:269] 0709 12:18:33.292140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.378026 (+ 85886us) service_pool.cc:224] Handling call
0709 12:18:34.449119 (+1071093us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54003db3d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:34.449245 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317044992}
I20260709 12:18:34.450344 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.451699 31360 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:34.452816 28648 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.042s (SENT)
I20260709 12:18:34.453179 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.453855 31360 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:34.454828 28648 leader_election.cc:336] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.093s (SENT)
I20260709 12:18:34.455194 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.391331 31408 raft_consensus.cc:2764] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:18:34.395095 28505 rpcz_store.cc:269] 0709 12:18:16.360892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.361089 (+   197us) service_pool.cc:224] Handling call
0709 12:18:34.388711 (+18027622us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:31.669173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:31.669905 (+   732us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:31.669955 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:18:31.669973 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:31.670594 (+   621us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:31.670664 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:31.670691 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:18:31.671151 (+   460us) tablet.cc:701] Row locks acquired
0709 12:18:31.671194 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:18:31.671347 (+   153us) write_op.cc:270] Start()
0709 12:18:31.671496 (+   149us) write_op.cc:276] Timestamp: P: 1783599511671285 usec, L: 0
0709 12:18:31.671519 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:31.746396 (+ 74877us) log.cc:844] Serialized 1635 byte log entry
0709 12:18:33.181580 (+1435184us) op_driver.cc:464] REPLICATION: finished
0709 12:18:33.305800 (+124220us) write_op.cc:301] APPLY: starting
0709 12:18:33.305958 (+   158us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:33.306147 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:33.306326 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:33.306994 (+   668us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:33.309682 (+  2688us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:18:33.309752 (+    70us) write_op.cc:312] APPLY: finished
0709 12:18:33.310092 (+   340us) log.cc:844] Serialized 35 byte log entry
0709 12:18:33.311621 (+  1529us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:33.311722 (+   101us) write_op.cc:454] Released schema lock
0709 12:18:33.311774 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:33.349206 (+ 37432us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:33.349253 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57172,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":123731,"apply.run_cpu_time_us":2745,"apply.run_wall_time_us":8235,"num_ops":3,"prepare.queue_time_us":164819,"prepare.run_cpu_time_us":26740,"prepare.run_wall_time_us":759564,"raft.queue_time_us":270357,"raft.run_cpu_time_us":27345,"raft.run_wall_time_us":168613,"replication_time_us":1509881,"spinlock_wait_cycles":2816,"thread_start_us":914151,"threads_started":4,"wal-append.queue_time_us":790678,"wal-append.run_cpu_time_us":23490,"wal-append.run_wall_time_us":1686127}]]}
I20260709 12:18:34.393818 31348 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.392204 31301 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.458714 28749 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
W20260709 12:18:34.466321 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.457226 28747 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:34.423928 31333 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.484681 31360 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:34.507879 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:34.504944 28648 leader_election.cc:336] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.115s (SENT)
I20260709 12:18:34.508653 28747 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:34.509042 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:34.509497 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:34.510128 28648 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.121s (SENT)
I20260709 12:18:34.510074 28747 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:34.510535 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.511230 31060 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:34.511906 31360 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:34.511230 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:34.513010 28648 leader_election.cc:336] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.145s (SENT)
W20260709 12:18:34.513098 31416 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:18:34.513433 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:34.513586 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:34.514504 28648 leader_election.cc:336] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.152s (SENT)
I20260709 12:18:34.515779 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.514600 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:34.517009 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.517114 28747 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:18:34.517802 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.519137 28747 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:18:34.519858 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.520762 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:34.521576 30960 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.521863 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.522070 30960 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:34.522936 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.523523 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.524130 30960 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:34.515158 30795 raft_consensus.cc:1064] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:18:34.549543 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:34.549712 28748 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:34.551936 31357 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:34.553785 29317 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:34.555409 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:34.559844 31392 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:34.560642 31392 consensus_queue.cc:1243] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:34.561209 31334 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:34.561540 31334 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:34.562408 31334 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:34.563246 31411 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.258s	user 0.000s	sys 0.002s
I20260709 12:18:34.564064 31334 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.566651 28673 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:34.567282 28750 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:34.501076 28753 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:34.514931 31360 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:34.524231 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:34.578083 28677 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:34.525022 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:34.525295 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.525729 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:34.578116 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.526368 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:34.580320 28673 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:34.580657 28682 raft_consensus.cc:2410] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:34.527666 28680 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:18:34.527724 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:34.528380 28676 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:34.530113 29327 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:34.531837 28747 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:34.532115 29325 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:34.534675 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:34.585155 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.585986 28676 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.534873 31221 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:34.536118 29320 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:34.536752 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:34.543741 28751 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:34.545650 29322 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:34.546557 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:34.592118 29321 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:34.477254 31301 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.456569 31368 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:34.507911 31414 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:34.599689 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:34.593416 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:34.600762 29322 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:34.582537 29323 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:34.584095 31060 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:34.596769 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 82269.4us
I20260709 12:18:34.599570 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:34.602478 28599 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:34.602173 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:34.586454 29317 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.608526 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:34.609310 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:34.614177 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:34.616083 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.630134 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.633878 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.645498 31183 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:34.651314 28675 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:34.619437 29318 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:34.652689 29317 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:34.606140 31357 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:18:34.661062 31357 consensus_queue.cc:1243] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:34.615762 31362 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 12:18:34.674437 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.675330 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:34.676014 28673 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.681478 28676 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
W20260709 12:18:34.683956 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.684652 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 81006.2us
W20260709 12:18:34.687338 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 136833us
I20260709 12:18:34.599363 31342 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:18:34.679719 31411 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:18:34.691911 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 87335.6us
I20260709 12:18:34.694209 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:34.682474 31388 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:34.614583 30962 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:18:34.608204 31311 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:18:34.698520 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:34.700592 28606 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:34.704361 28673 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:34.684481 31382 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:34.712607 28648 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.353s (SENT)
I20260709 12:18:34.713732 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:34.715448 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.716583 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.718302 28648 leader_election.cc:336] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.802s (SENT)
I20260709 12:18:34.718878 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:34.725397 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 95342.7us
I20260709 12:18:34.735077 31425 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:34.735909 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:34.736673 28677 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:34.738173 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.718478 31371 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:34.830421 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.714823 31388 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:34.939396 31060 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:34.953140 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.853765 31425 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:34.956457 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:34.956748 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.957576 28753 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 12:18:34.963277 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 248496us
I20260709 12:18:34.964522 28753 pending_rounds.cc:85] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 6
I20260709 12:18:34.715946 31368 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:34.957446 31398 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.222s	user 0.005s	sys 0.005s
I20260709 12:18:34.967008 28753 pending_rounds.cc:107] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:18:34.970072 28753 raft_consensus.cc:2889] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:34.971378 31060 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:34.978430 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 279966us
I20260709 12:18:34.979473 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:34.958375 31333 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:34.981040 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:34.982023 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 265571us
I20260709 12:18:34.982834 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:34.987378 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.988361 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:34.989943 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:34.992921 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:34.994874 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:34.993826 31382 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:34.983556 31431 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:34.999945 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:35.002902 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:34.993943 30980 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.995399 31371 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:35.008613 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.996364 31349 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:34.996469 31360 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.030057 28676 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:35.007110 30960 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:35.031456 30960 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.033867 31284 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.034232 30960 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:35.034413 31284 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.036748 31221 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:35.019027 30980 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:35.040030 31306 consensus_meta.cc:287] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.000s
I20260709 12:18:35.040758 30980 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:35.041193 31388 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:34.998131 31408 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:35.041981 31408 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:35.042492 31408 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:35.043048 28501 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 3 to 4, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 4 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.045488 31432 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:35.046023 31432 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:35.046569 31284 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:35.046993 31432 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:35.015101 31431 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:35.049932 31431 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.060344 28677 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:35.061730 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.063361 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:35.065060 28680 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:35.066349 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.067791 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.015389 31425 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:35.060182 28501 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 3 to 4, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 4 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:35.023981 31423 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:35.024189 28750 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:35.026525 31060 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.076984 28682 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:18:35.078653 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.082530 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.074589 28501 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:35.090131 31424 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 12:18:35.093273 28750 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:35.091446 28501 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.006666 31333 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.099944 28676 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:35.100865 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.123386 28680 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:35.028151 31309 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:18:35.017442 31371 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:35.126219 28501 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:35.127779 28572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.018s	sys 0.034s
W20260709 12:18:35.131628 28572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.019s	sys 0.034s
I20260709 12:18:35.140805 28682 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:35.101788 31432 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:35.132382 31348 consensus_meta.cc:287] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.648s	user 0.020s	sys 0.000s
W20260709 12:18:35.135622 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 533507us
I20260709 12:18:35.148912 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.150301 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:35.153167 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:35.157363 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:35.099040 31060 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:18:35.133879 31371 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:35.170341 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 167508us
I20260709 12:18:35.171705 31426 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.173616 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:35.174729 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:35.175019 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.175560 28682 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:35.176944 31306 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:35.142318 31363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.019s
W20260709 12:18:35.177598 31363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.007s	sys 0.019s
I20260709 12:18:35.159741 31343 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.179828 31183 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.183506 31183 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:35.183943 31183 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:35.184799 31183 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:35.132643 31333 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.194197 31333 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:35.196118 31301 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 12:18:35.199235 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.174232 31302 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:35.216655 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.222997 28648 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.529s (SENT)
I20260709 12:18:35.162388 31348 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.236721 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:35.239341 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.200062 31388 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:35.243952 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.245594 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70667.2us
I20260709 12:18:35.241525 31363 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.251387 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.221670 31301 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:35.252700 31302 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.254612 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2089) took 1963 ms. Trace:
I20260709 12:18:35.256059 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.256594 31183 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.258320 28682 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:35.275429 31311 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:35.277316 31443 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.279968 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:35.268146 28604 rpcz_store.cc:276] 0709 12:18:33.291597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.415477 (+123880us) service_pool.cc:224] Handling call
0709 12:18:33.840519 (+425042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.840878 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.840913 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:33.840957 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:33.840996 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:33.841056 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.254437 (+1413381us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540004b350. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:35.254553 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":949364480}
I20260709 12:18:35.287278 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:35.289242 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.297228 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.297122 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.298033 28675 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:35.244834 31388 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.298688 28676 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:35.303283 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.303931 28677 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:35.305438 28678 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:35.306391 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.307760 28678 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:35.308832 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.309549 28681 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:35.311272 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2143) took 1079 ms. Trace:
I20260709 12:18:35.289633 31183 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.313145 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.316756 31348 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:35.318382 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:35.318992 28754 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:35.319196 31388 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:35.321197 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.321976 31183 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.322314 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.311781 28756 rpcz_store.cc:276] 0709 12:18:34.231825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.242861 (+ 11036us) service_pool.cc:224] Handling call
0709 12:18:34.256041 (+ 13180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.329290 (+ 73249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.310941 (+981651us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54003e8854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:35.311160 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166289792}
I20260709 12:18:35.323602 31183 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.270040 31363 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:35.292549 31334 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.000s
I20260709 12:18:35.326164 31363 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:35.326754 31409 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 1.020s	user 0.007s	sys 0.006s
I20260709 12:18:35.326359 31408 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:35.327579 28753 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:35.328415 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.324286 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:18:35.331050 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 43867.5us
I20260709 12:18:35.334157 28720 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.336167 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.351786 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.333256 31289 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.449991 29319 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:35.457389 28750 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:35.471414 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.472782 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 121041us
W20260709 12:18:35.476593 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 123563us
I20260709 12:18:35.477561 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:35.480967 29325 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:35.486730 28754 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:35.477694 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:35.495148 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 155051us
I20260709 12:18:35.495980 28676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:35.496403 28676 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.353099 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.496846 28676 raft_consensus.cc:614] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:35.498600 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.479023 31334 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.505312 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.507579 29318 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:35.456883 31363 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.508868 31363 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:35.510962 31363 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:35.512079 31408 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:35.511905 31440 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:18:35.513909 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.516590 31432 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:35.516677 31302 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:35.517184 31432 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.517522 31302 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.519358 31432 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:35.520915 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.522101 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:35.523171 31280 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.523248 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.524067 28607 raft_consensus.cc:2368] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:35.524601 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:35.526479 31302 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:35.527287 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:35.527807 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:35.528738 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.529610 28607 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:35.530498 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.531237 28599 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:35.532428 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.533293 28599 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:35.534190 31341 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:35.535638 31341 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:35.536011 31341 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.503958 31388 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:18:35.541054 28606 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:35.542151 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.542655 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.543193 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.543782 28606 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:35.543428 28602 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:35.544489 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.544662 28676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:35.545037 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.545192 28676 raft_consensus.cc:606] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:35.545655 28676 raft_consensus.cc:614] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:35.545818 28607 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:18:35.546200 28607 pending_rounds.cc:85] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 5
I20260709 12:18:35.546433 28607 pending_rounds.cc:107] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:18:35.546602 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.542750 28604 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:35.549448 28754 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:35.550740 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.551086 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:35.552407 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:35.552911 28600 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:35.553123 31301 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:35.554118 31371 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:35.456005 31328 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:35.456414 31392 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:35.556140 28676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:35.576642 28676 raft_consensus.cc:606] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:35.577128 28676 raft_consensus.cc:614] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:35.523947 31280 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.569034 28606 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:35.569866 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:35.546656 28607 raft_consensus.cc:2889] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:35.579595 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.495167 31183 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.583323 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.494980 31258 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.495452 31431 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.496277 31333 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.585280 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:35.592831 28750 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:35.502074 31443 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:35.594807 28598 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:35.536345 31341 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:35.590045 28648 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:35.596390 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.597003 28602 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:35.597729 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.591229 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.600934 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.610658 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.613554 28601 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:35.613777 29292 leader_election.cc:400] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6.
I20260709 12:18:35.501472 31311 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:18:35.623467 29325 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:35.624970 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:35.627122 28750 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:35.595537 31437 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:35.617208 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.617452 28598 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:18:35.590567 31332 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:35.612587 31388 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:35.615913 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 110689us
W20260709 12:18:35.631181 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.644775 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.608300 31357 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.607831 31383 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.647406 31383 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.598959 31392 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:35.649541 31392 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.614403 31360 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:35.619431 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.654556 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.593175 31363 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:18:35.616058 31283 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.656533 31283 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.616603 31258 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.658366 30980 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.659046 30980 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.659636 30980 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:35.662030 31383 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:35.663599 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.664523 28750 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:35.665380 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 62728.9us
I20260709 12:18:35.667060 28600 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:35.625128 31280 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:18:35.668653 28676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:35.671190 28676 raft_consensus.cc:606] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:35.671564 28676 raft_consensus.cc:614] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:35.672585 31442 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:18:35.608496 31333 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.608835 31431 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.675786 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.685113 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:35.599058 31183 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.670089 31332 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:35.693559 31456 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:35.694171 31456 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.696375 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1784) took 1445 ms. Trace:
I20260709 12:18:35.696767 28674 rpcz_store.cc:276] 0709 12:18:34.250872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.258588 (+  7716us) service_pool.cc:224] Handling call
0709 12:18:34.263636 (+  5048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.315637 (+ 52001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.315667 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.315707 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:34.315746 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.696153 (+1380407us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b5400251054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:35.696199 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.696316 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119061248}
I20260709 12:18:35.697481 31333 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:35.697990 31179 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:35.698243 31333 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:35.698400 31179 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:35.698760 31333 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:35.699180 31333 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:35.692679 31366 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:35.699899 31366 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:35.700706 31371 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:35.700839 31366 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.702487 31332 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.702929 30795 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.669343 31360 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:35.674880 31390 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:35.706277 28603 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:35.709319 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.696166 31456 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:35.688741 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 188306us
I20260709 12:18:35.712527 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:35.714883 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.716100 28674 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:35.682253 31453 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:35.718645 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.725186 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.707151 31366 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:35.696175 31283 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:35.708775 31390 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:35.709826 31371 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.711694 31334 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.737152 28679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
W20260709 12:18:35.740680 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52773.3us
I20260709 12:18:35.719046 31280 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:35.732049 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 135667us
I20260709 12:18:35.724555 31258 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:35.741272 28679 raft_consensus.cc:606] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:35.753204 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 469) took 1630 ms. Trace:
I20260709 12:18:35.753149 28679 raft_consensus.cc:614] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:35.755086 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:35.757457 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:35.759641 28600 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:35.753716 28755 rpcz_store.cc:276] 0709 12:18:34.123065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.123200 (+   135us) service_pool.cc:224] Handling call
0709 12:18:34.123464 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.159959 (+ 36495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.752973 (+1593014us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400307354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:35.753144 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82481024}
W20260709 12:18:35.753661 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.720305 31328 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:18:35.724324 31456 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:18:35.751085 31258 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.785990 28749 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:35.784804 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.775589 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:35.787109 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.778468 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.834740 28754 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 12:18:35.780864 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.786408 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.792318 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:35.836954 28755 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:35.837319 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69531.9us
I20260709 12:18:35.837096 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:35.839018 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:35.785439 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.801515 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.840968 28747 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:35.818742 29322 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:35.843546 28751 raft_consensus.cc:2368] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8.
W20260709 12:18:35.768802 31413 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 1.472s	user 0.008s	sys 0.018s
I20260709 12:18:35.853348 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:35.865509 28679 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:35.790652 31437 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:35.775022 31458 raft_consensus.cc:2764] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:35.871838 29323 pending_rounds.cc:85] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 4
I20260709 12:18:35.750957 31371 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.777194 31183 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:35.877252 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:35.872231 29323 pending_rounds.cc:107] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 12:18:35.877863 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 120508us
I20260709 12:18:35.878211 29323 raft_consensus.cc:2889] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:35.837021 31258 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.797638 31431 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:35.881469 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:35.871830 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:35.765836 31363 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:18:35.886705 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:35.887342 29325 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:35.884282 28751 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:35.762166 31360 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.847496 31334 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 12:18:35.888695 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 86366.5us
I20260709 12:18:35.872182 31437 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:35.875276 31408 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:35.895404 28599 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:35.774682 31179 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.780203 31390 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:35.867376 31060 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:18:35.872627 31341 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:35.894143 31223 raft_consensus.cc:1064] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:18:35.913300 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:18:35.941464 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.952346 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:35.953096 29325 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:35.953152 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:35.892527 31328 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:35.960728 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:35.975615 29326 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:35.917052 31466 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:35.911818 31408 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:35.976797 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:35.982048 28603 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:35.957895 31390 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:35.911095 31229 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:18:35.977653 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:35.889870 31459 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:18:35.979013 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:35.981328 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:35.944990 31301 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:35.905830 31463 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:18:35.961935 31464 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.978690 31287 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:35.996457 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:35.960197 31342 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:18:36.006520 31344 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:35.979013 31466 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:35.992530 31179 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:36.012974 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:36.016901 28749 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:35.981012 31302 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:36.007536 31461 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.007970 31287 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.021080 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:36.022591 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 183635us
I20260709 12:18:36.025986 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:36.012761 31301 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:36.030336 31301 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.033607 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:36.034471 31334 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:36.034911 31334 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.013662 31466 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:36.035359 31455 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:18:36.009276 31464 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:36.037228 31472 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:36.037719 31464 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:36.010902 31467 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:36.041428 31465 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:18:36.041522 31341 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:36.042368 31371 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:36.046144 31408 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:36.046586 31287 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:36.019526 31440 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:18:36.019224 31283 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:36.048458 31283 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.048847 31283 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:36.018939 31344 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:36.051218 31344 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:36.052704 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:36.053117 31280 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:36.034965 31444 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:36.064049 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:36.067476 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:36.068847 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:36.069934 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:36.070446 28749 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:36.053643 31280 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.035372 31334 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.079746 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:36.083437 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.085333 29325 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:36.061626 31302 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.064996 31408 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:36.093793 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 67897.3us
I20260709 12:18:36.105912 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:36.106545 28676 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:36.107168 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:36.107769 28677 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:36.100716 29325 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:36.114886 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:36.117739 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:36.122136 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:36.122685 29319 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:36.054129 31461 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.135386 29325 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:36.136673 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 161044us
W20260709 12:18:36.139375 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.098320 31479 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:36.152685 28676 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:36.094448 31302 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:36.109802 31371 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:18:36.141819 28748 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:36.159740 28678 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:36.159138 28682 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:36.185909 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:36.188575 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.120069 31333 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:36.206173 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53195.1us
I20260709 12:18:36.143834 31449 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:36.219491 28682 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:36.206740 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:36.221071 28680 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:36.227823 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 67699.8us
I20260709 12:18:36.228605 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:36.206660 31292 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.234781 31292 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.235464 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:36.236217 28681 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.225966 30960 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:18:36.238320 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:36.239550 31480 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:18:36.239813 28673 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:36.246284 31474 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.186s
I20260709 12:18:36.248175 31467 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:36.180878 31060 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:36.248759 31467 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:36.249040 31060 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:36.157496 31481 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:36.250500 31481 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.250851 31481 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.251299 31060 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:36.253247 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:36.261831 28673 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:36.265506 31482 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:36.273396 31060 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.274045 31060 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.276597 31408 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:36.277235 31408 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.280124 31060 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:36.281741 31060 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:36.282384 31060 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:36.285441 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 476) took 1324 ms. Trace:
I20260709 12:18:36.285913 28753 rpcz_store.cc:276] 0709 12:18:34.961322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.991081 (+ 29759us) service_pool.cc:224] Handling call
0709 12:18:35.002972 (+ 11891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:35.327963 (+324991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.259272 (+931309us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54002d55d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:36.285369 (+ 26097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745783040}
I20260709 12:18:36.223925 31453 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.228848 31464 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:36.259028 31478 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.285126 30960 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:36.294751 31363 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.340071 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:36.341012 29327 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:36.347150 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:36.303195 31482 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:36.308633 31463 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 12:18:36.354997 31484 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:18:36.355913 31366 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:36.356384 31366 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.356804 31366 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.344878 31363 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:36.361038 31363 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:36.338243 31371 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.363965 28681 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
W20260709 12:18:36.365694 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 209929us
I20260709 12:18:36.335790 31060 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:36.299238 31453 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.303593 31464 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:36.334450 31348 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:18:36.319893 31478 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.337909 31283 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:36.396230 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 380896us
I20260709 12:18:36.370541 31302 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:36.414762 31446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.012s	sys 0.004s
W20260709 12:18:36.422451 31446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.013s	sys 0.004s
I20260709 12:18:36.426889 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:36.379885 31280 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:36.371140 31371 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.379041 31431 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:18:36.369338 31467 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.417502 31461 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:36.392513 31296 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:18:36.479431 31449 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:36.486011 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 163524us
I20260709 12:18:36.392314 31368 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:18:36.449896 31482 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.505790 31287 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.455988 31384 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:36.507618 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:36.506685 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 113925us
I20260709 12:18:36.371321 31437 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:36.510996 31437 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:36.513830 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.513823 31444 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:36.514966 31444 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.516324 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:36.517093 31444 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:36.517697 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:36.517133 31348 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:36.518543 31348 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.518869 31348 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:36.519600 29323 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:36.521045 31468 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:36.521531 31468 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:36.522137 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:36.522356 31468 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.523445 29326 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEARNER]: Advancing to term 10
I20260709 12:18:36.523573 31468 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:36.524758 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:36.520984 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:36.525645 29323 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:36.526440 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:36.527213 28753 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:36.530923 31292 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:36.534385 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:36.534714 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:36.539288 31348 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.517622 31444 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:36.543874 29326 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:36.569963 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:36.571097 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:36.555570 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:36.556566 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44286.2us
I20260709 12:18:36.558727 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:36.573345 28605 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:36.574719 28605 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:36.572073 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:36.572718 29326 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:36.499802 31333 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:36.581734 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:36.426738 31466 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:36.581193 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 65339.7us
I20260709 12:18:36.599125 28603 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:36.630615 29319 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:36.630105 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 95836.3us
W20260709 12:18:36.631211 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 72600.8us
I20260709 12:18:36.586028 31229 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:36.546767 31384 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:36.630362 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 56883.1us
I20260709 12:18:36.545397 31461 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:18:36.599541 31355 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:18:36.723841 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1756) took 1055 ms. Trace:
W20260709 12:18:36.733270 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 100969us
W20260709 12:18:36.712721 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.787807 31179 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.770s	user 0.011s	sys 0.000s
W20260709 12:18:36.777279 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 140038us
I20260709 12:18:36.861464 28600 rpcz_store.cc:276] 0709 12:18:35.668496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.669650 (+  1154us) service_pool.cc:224] Handling call
0709 12:18:35.670052 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:35.760154 (+ 90102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.723579 (+963425us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b54003d2f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:36.723763 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205019392}
I20260709 12:18:36.865481 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:36.942893 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76033.4us
W20260709 12:18:36.945837 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 80450.2us
I20260709 12:18:36.637742 31360 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:36.714594 31485 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:18:36.751186 31258 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.863s	user 0.007s	sys 0.001s
W20260709 12:18:36.748193 31390 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.755s	user 0.007s	sys 0.002s
W20260709 12:18:36.683513 31500 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 12:18:36.684480 31491 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:18:36.828624 31349 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:36.686095 31309 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:18:36.751956 31334 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.000s
I20260709 12:18:36.648727 31344 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:36.753407 31283 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:36.638347 31468 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:36.787567 31348 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:36.977500 31366 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.001s
I20260709 12:18:36.644922 31481 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.736385 31478 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:36.683079 31509 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.285s
I20260709 12:18:36.870617 31060 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.017485 31349 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.017604 31334 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.961057 31302 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:37.026625 31469 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.918s	user 0.000s	sys 0.002s
I20260709 12:18:37.030359 31408 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.013217 31287 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:37.048486 31490 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.633s	user 0.001s	sys 0.000s
I20260709 12:18:37.058781 31458 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:36.977746 31371 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.053303 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 704) took 1208 ms. Trace:
I20260709 12:18:37.092815 29317 rpcz_store.cc:276] 0709 12:18:35.845248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.853064 (+  7816us) service_pool.cc:224] Handling call
0709 12:18:35.909378 (+ 56314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:35.957324 (+ 47946us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:35.957356 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.006767 (+ 49411us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.052666 (+1045899us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b1800425fe0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1
0709 12:18:37.052826 (+   160us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:37.052872 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.052963 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.053012 (+    49us) raft_consensus.cc:1685] finished
0709 12:18:37.053023 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.053235 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19926,"raft.queue_time_us":104166,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6039,"spinlock_wait_cycles":2802944,"thread_start_us":54385,"threads_started":1,"wal-append.queue_time_us":152523}
I20260709 12:18:36.941566 31431 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:18:36.787431 31493 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.095822 31493 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:36.735468 31504 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:18:36.973469 31360 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:36.976608 31463 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:37.015476 31179 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.065536 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:37.109200 28682 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:37.065907 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:37.007917 31464 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:37.016950 31309 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:36.701884 31449 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.084453 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:37.118965 31471 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:37.119422 28600 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:37.120041 31506 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.120579 31506 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:36.973313 31258 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.122725 31506 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:37.087375 29322 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:37.060137 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:37.123274 31258 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.123764 28604 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:37.124047 28752 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:37.123713 31492 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.162s
I20260709 12:18:36.685382 31384 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.061483 31366 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.067332 31453 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.103734 28749 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:37.110124 28605 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:37.113673 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:37.129526 28674 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:37.103288 31463 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.115646 31511 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.105664 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:37.139359 28606 raft_consensus.cc:2376] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6. Re-sending same reply.
I20260709 12:18:37.129802 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:37.088586 31408 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.133679 28600 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:37.084883 31060 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:37.105397 31440 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.001s	sys 0.010s
I20260709 12:18:37.140353 28604 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:37.177691 28682 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:18:37.165925 28603 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:37.109045 31493 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:37.139199 31463 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:37.176829 31440 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.001s	sys 0.011s
I20260709 12:18:37.202366 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 546) took 1087 ms. Trace:
I20260709 12:18:37.116580 31179 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.202961 28675 rpcz_store.cc:276] 0709 12:18:36.115219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.117584 (+  2365us) service_pool.cc:224] Handling call
0709 12:18:36.117881 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:36.137836 (+ 19955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.137867 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:36.141525 (+  3658us) log.cc:844] Serialized 52 byte log entry
0709 12:18:36.245792 (+104267us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4800002dd8. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe89a8aa1 00007f6fe899fb37 00007f6fe899f9ca 00007f6fe8a9726f 00007f6fe8a96f37 00007f6fe8aab55c 00007f6fe8aab508 00007f6fe8aab488 00007f6fe8aab443 00007f6fe8aaa6ec 00007f6fe79d4a96
0709 12:18:36.287467 (+ 41675us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:36.287515 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.287582 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.047766 (+760184us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:37.202052 (+154286us) raft_consensus.cc:1685] finished
0709 12:18:37.202086 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.202280 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11732,"raft.queue_time_us":14470,"raft.run_cpu_time_us":1601,"raft.run_wall_time_us":107668,"spinlock_wait_cycles":51293312,"thread_start_us":132427,"threads_started":1,"wal-append.queue_time_us":197396}
I20260709 12:18:37.127579 31368 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:18:37.173059 31489 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.186043 31453 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.192138 31384 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:37.217618 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:37.183178 31408 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.253144 31334 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:37.227818 31497 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 12:18:37.233414 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1801) took 1076 ms. Trace:
W20260709 12:18:37.255554 31515 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:18:37.254719 28676 rpcz_store.cc:276] 0709 12:18:36.157236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.160429 (+  3193us) service_pool.cc:224] Handling call
0709 12:18:36.161122 (+   693us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:36.161824 (+   702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.161852 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:36.254842 (+ 92990us) log.cc:844] Serialized 624 byte log entry
0709 12:18:36.427296 (+172454us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:36.427355 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.427449 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.233091 (+805642us) raft_consensus.cc:1685] finished
0709 12:18:37.233120 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.233333 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":27869,"thread_start_us":122459,"threads_started":1,"wal-append.queue_time_us":217695}
I20260709 12:18:37.215965 31517 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.257099 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:37.257194 31517 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.259882 31517 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:37.236701 31522 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:37.261250 28676 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:37.239002 31525 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:18:37.241109 31349 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.242537 31060 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.249492 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:37.251474 31366 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.263243 31481 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:37.264843 31449 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.265015 28676 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:37.265532 31449 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.187480 31511 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.267901 31449 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:37.268555 31511 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:37.198930 31309 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.270428 31309 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:37.237928 31523 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:18:37.254077 31408 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:37.277559 31437 consensus_meta.cc:287] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.000s
I20260709 12:18:37.278447 28679 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:37.281021 31528 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:37.281553 31528 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.281963 31528 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:37.284026 31458 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:37.284509 31458 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:37.286201 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 710) took 1130 ms. Trace:
I20260709 12:18:37.286619 29322 rpcz_store.cc:276] 0709 12:18:36.156089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.156235 (+   146us) service_pool.cc:224] Handling call
0709 12:18:36.156668 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.123519 (+966851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.285934 (+162415us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400611a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:37.286130 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139908352}
I20260709 12:18:37.288386 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1724) took 1232 ms. Trace:
I20260709 12:18:37.289003 28749 rpcz_store.cc:276] 0709 12:18:36.055499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.072561 (+ 17062us) service_pool.cc:224] Handling call
0709 12:18:36.072921 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.128692 (+1055771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.288123 (+159431us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400306954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:37.288324 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369828224}
I20260709 12:18:37.290323 31466 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:37.292419 31179 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:37.294770 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.233361 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:37.296039 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62784.4us
I20260709 12:18:37.260908 31522 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.301105 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:37.243587 31223 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.303642 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:37.304610 31467 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:37.304720 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:37.304744 31332 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:37.317415 29327 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:37.317442 31332 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:37.318961 31332 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:37.302361 31355 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.305641 31383 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:37.331346 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:37.305956 31509 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.306049 31522 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.306587 31501 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.309652 31458 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.313868 29322 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:37.316959 28676 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:37.326548 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.328106 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:37.314962 31342 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.332332 31383 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:37.333380 31355 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.335379 31332 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.219600 31489 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.324589 31511 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:37.222327 31453 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.738092 31456 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.738432 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:37.741087 31501 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.741492 31456 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:37.642515 29291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.003s	sys 0.002s
W20260709 12:18:37.742656 29291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.004s	sys 0.008s
I20260709 12:18:37.743831 31456 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:37.706533 28673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.067s	sys 0.111s
W20260709 12:18:37.744776 28673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.069s	sys 0.111s
W20260709 12:18:37.329998 31487 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.981s	user 0.000s	sys 0.004s
I20260709 12:18:37.561470 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:37.746327 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:37.746503 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:37.746758 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 658) took 1794 ms. Trace:
W20260709 12:18:37.554800 28756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 480) took 2226 ms (client timeout 2195 ms). Trace:
I20260709 12:18:37.625257 31541 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:37.566756 31280 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.749398 31541 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.747444 29320 rpcz_store.cc:276] 0709 12:18:35.951911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.958329 (+  6418us) service_pool.cc:224] Handling call
0709 12:18:35.985038 (+ 26709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.020833 (+ 35795us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:36.038656 (+ 17823us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.144020 (+105364us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.216210 (+ 72190us) log.cc:844] Serialized 26 byte log entry
0709 12:18:36.231790 (+ 15580us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:36.511725 (+279935us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.512993 (+  1268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.513095 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.323675 (+810580us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:37.746545 (+422870us) raft_consensus.cc:1685] finished
0709 12:18:37.746568 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.746702 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161929,"prepare.queue_time_us":109049,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":2274,"raft.queue_time_us":81144,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":31969,"spinlock_wait_cycles":5867264,"thread_start_us":246340,"threads_started":2,"wal-append.queue_time_us":247364}
I20260709 12:18:37.565918 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:37.492130 31334 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.336319 31468 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:37.542492 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:37.751390 31334 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.550487 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1729) took 1493 ms. Trace:
I20260709 12:18:37.752118 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:37.512740 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2103) took 1762 ms. Trace:
I20260709 12:18:37.752540 28754 rpcz_store.cc:276] 0709 12:18:36.056958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.628860 (+571902us) service_pool.cc:224] Handling call
0709 12:18:36.679781 (+ 50921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.761821 (+ 82040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.761852 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.773854 (+ 12002us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.539356 (+765502us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b18002da720. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1
0709 12:18:37.539513 (+   157us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:37.539559 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.539653 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.539695 (+    42us) raft_consensus.cc:1685] finished
0709 12:18:37.539707 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.550403 (+ 10696us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24968,"raft.queue_time_us":262526,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":20699,"spinlock_wait_cycles":64915712,"thread_start_us":36748,"threads_started":1,"wal-append.queue_time_us":253045}
I20260709 12:18:37.753366 31383 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.608831 31437 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:37.754356 30960 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.754806 31437 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.755092 30960 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:37.755892 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:37.573948 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:37.757728 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:37.524725 31522 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.758280 29326 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.758378 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:37.758642 31522 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.759030 29323 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:37.760411 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:37.760749 31522 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:37.542371 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:37.765199 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.765278 29326 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:37.757725 31437 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.768285 31437 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:37.392915 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:37.773089 31332 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.482508 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:37.747850 28756 rpcz_store.cc:269] 0709 12:18:35.328516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.328744 (+   228us) service_pool.cc:224] Handling call
0709 12:18:37.554529 (+2225785us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540003e654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:37.554708 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906979712}
I20260709 12:18:37.774075 28674 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:37.553593 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:37.336117 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:37.555519 31444 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.196s
I20260709 12:18:37.754814 31383 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:37.550889 31258 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.579456 31297 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.191s
I20260709 12:18:37.761055 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:37.780014 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:37.780848 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:37.753937 28599 rpcz_store.cc:276] 0709 12:18:35.750089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.750335 (+   246us) service_pool.cc:224] Handling call
0709 12:18:35.895084 (+144749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:35.905905 (+ 10821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.512538 (+1606633us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003db3d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:37.512677 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332017024}
I20260709 12:18:37.781620 28675 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:37.618791 31408 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.748265 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:37.828456 28676 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.749712 31280 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:37.780256 28677 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:37.785485 31342 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.568660 31360 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:37.423691 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.787264 31456 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.846181 29327 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:37.788237 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:37.788491 31541 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.747056 28673 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:37.743794 31501 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:37.866123 29319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 666) took 1324 ms (client timeout 1630 ms). Trace:
I20260709 12:18:37.790736 30960 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:37.839668 31463 consensus_meta.cc:287] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.001s
W20260709 12:18:37.385627 31488 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.922s	user 0.002s	sys 0.000s
I20260709 12:18:37.522907 30795 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:37.534891 31526 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.532879 31429 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.251s
I20260709 12:18:37.389392 31509 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:37.737699 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.844774 29317 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:37.803195 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:37.746922 28680 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
W20260709 12:18:37.808077 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:37.746906 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.818727 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:37.825525 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:37.917647 28748 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:37.918792 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:37.919687 28747 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:37.797035 31384 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.575s	user 0.001s	sys 0.009s
I20260709 12:18:37.829581 28756 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:37.794029 31468 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:37.836479 28678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.005s	sys 0.014s
I20260709 12:18:37.861012 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:37.929787 28678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.006s	sys 0.014s
I20260709 12:18:37.862294 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:37.930821 28604 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:37.862939 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:37.932302 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 69502.1us
I20260709 12:18:37.864125 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:37.865265 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:37.750777 31355 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:37.790768 31458 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:37.869947 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 81767.9us
I20260709 12:18:37.843153 31408 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.791569 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 484) took 1281 ms. Trace:
I20260709 12:18:37.890841 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:37.832732 29318 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:37.895293 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:37.848420 31466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.007s
W20260709 12:18:37.887086 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76297.4us
I20260709 12:18:37.898478 31463 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:37.899781 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.831856 31453 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:37.829514 31258 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.892648 31444 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.898707 31517 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:37.928030 28756 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:37.940248 28676 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:37.867965 31511 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 12:18:37.866796 29319 rpcz_store.cc:269] 0709 12:18:36.522359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.524531 (+  2172us) service_pool.cc:224] Handling call
0709 12:18:37.845725 (+1321194us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54006c0f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:37.847127 (+  1402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241727872}
I20260709 12:18:37.954445 28748 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:37.905575 31360 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:37.982108 31466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.011s	sys 0.007s
I20260709 12:18:37.957808 28747 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:37.960850 28752 rpcz_store.cc:276] 0709 12:18:36.510402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.725983 (+215581us) service_pool.cc:224] Handling call
0709 12:18:36.787986 (+ 62003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.124517 (+336531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.791297 (+666780us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003e8d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:37.791499 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772380416}
I20260709 12:18:37.909377 31179 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:37.908110 31545 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:37.868101 31522 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:18:37.916061 31505 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:37.874918 31456 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.962378 28754 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:37.978298 31509 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:37.980595 31280 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:38.019596 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:37.981374 31342 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:37.929080 31501 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.905015 30795 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:37.754185 31334 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:37.988140 31492 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:18:37.990068 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2157) took 2012 ms. Trace:
I20260709 12:18:38.032994 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:38.002972 28677 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:38.038511 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1822) took 1089 ms. Trace:
I20260709 12:18:37.876399 31292 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:18:38.001049 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:38.041751 28756 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:37.962788 31183 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:37.999830 31517 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:38.037472 31355 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.010471 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:37.924306 31526 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:38.023286 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:38.061000 31456 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:38.062633 31544 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:38.064381 31408 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:38.009378 31360 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:38.065954 30795 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:38.015345 31179 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:38.067104 31360 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:38.041961 31537 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:38.068534 31537 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:38.069187 31179 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:38.069790 31537 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:38.071507 31537 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:38.032160 31501 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:38.074004 31546 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:18:38.075066 31548 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:18:38.018437 31309 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:18:38.078555 31463 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:38.081411 31258 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:38.085186 31355 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:37.520732 29292 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.195s (SENT) [suppressed 30 similar messages]
I20260709 12:18:38.089408 28754 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:38.092172 28754 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:38.006960 31444 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:38.021242 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:38.007071 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.019228 31453 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:38.093020 31528 consensus_meta.cc:287] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.811s	user 0.012s	sys 0.000s
I20260709 12:18:38.099083 31526 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:38.038990 28677 rpcz_store.cc:276] 0709 12:18:36.949169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.036466 (+ 87297us) service_pool.cc:224] Handling call
0709 12:18:37.553380 (+516914us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:38.038428 (+485048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67360128}
I20260709 12:18:38.103070 28752 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:38.046005 31489 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:38.112376 31301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.002s	sys 0.020s
I20260709 12:18:38.017515 31545 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:38.101722 31517 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:38.033074 28751 rpcz_store.cc:276] 0709 12:18:35.978044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.980851 (+  2807us) service_pool.cc:224] Handling call
0709 12:18:35.981168 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:35.981514 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.981546 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:35.982169 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 12:18:36.217937 (+235768us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:36.378795 (+160858us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.381580 (+  2785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.381655 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.336775 (+955120us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:37.982987 (+646212us) raft_consensus.cc:1685] finished
0709 12:18:37.989783 (+  6796us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.989984 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":376180,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":40445,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":24124,"spinlock_wait_cycles":17622912,"thread_start_us":328367,"threads_started":2,"wal-append.queue_time_us":338889}
I20260709 12:18:38.194095 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.177469 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.175427 31360 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:38.180769 31301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.002s	sys 0.020s
I20260709 12:18:38.112773 31522 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:38.204684 31522 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:38.206925 31522 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:38.180593 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 415883us
I20260709 12:18:38.186981 31355 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:38.190927 31432 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:18:38.211671 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.209913 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:38.235348 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.235728 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:38.235956 28676 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:38.173908 31528 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:38.174443 31453 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:38.237506 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.277477 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:38.238709 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.197108 31489 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:38.192251 31449 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.043s	sys 0.086s
W20260709 12:18:38.271073 28648 connection.cc:256] RPC call timeout handler was delayed by -1.0256759510000393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 12:18:38.300563 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:38.284381 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48712.5us
I20260709 12:18:38.275002 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:38.305991 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.306993 28674 raft_consensus.cc:2410] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:38.225410 31408 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:38.310061 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:38.329099 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.311157 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.228704 31432 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:38.336061 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.392226 28601 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:38.276232 31526 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:38.304214 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:38.455550 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 151392us
I20260709 12:18:38.211128 31360 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:38.386922 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 86442.2us
I20260709 12:18:38.466626 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:38.391745 28676 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:38.388427 28677 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:38.303390 31449 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.043s	sys 0.087s
I20260709 12:18:38.298692 31530 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:38.447504 28674 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:18:38.393080 28599 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.007s	sys 0.032s
W20260709 12:18:38.468557 31479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.048s	sys 0.066s
W20260709 12:18:38.474799 28678 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.007s	sys 0.016s
W20260709 12:18:38.546430 28678 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.008s	sys 0.016s
W20260709 12:18:38.483880 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.004s	sys 0.050s
I20260709 12:18:38.301901 31522 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
W20260709 12:18:38.537497 28673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.031s	sys 0.049s
I20260709 12:18:38.539158 28680 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
W20260709 12:18:38.548207 28673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.031s	sys 0.050s
W20260709 12:18:38.548861 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.009s	sys 0.050s
W20260709 12:18:38.542773 28599 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.019s	sys 0.032s
I20260709 12:18:38.300189 31489 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:38.522925 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.011s	sys 0.024s
W20260709 12:18:38.555995 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.012s	sys 0.025s
I20260709 12:18:38.547325 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1696) took 1737 ms. Trace:
W20260709 12:18:38.549322 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 635388us
I20260709 12:18:38.557164 28678 rpcz_store.cc:276] 0709 12:18:36.810357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.810478 (+   121us) service_pool.cc:224] Handling call
0709 12:18:36.828706 (+ 18228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.828972 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:37.226449 (+397477us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.546850 (+1320401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.546934 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:38.547001 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.547088 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.547222 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128017,"prepare.queue_time_us":300695,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":83294,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2853,"thread_start_us":1566095,"threads_started":3,"wal-append.queue_time_us":963576}
I20260709 12:18:38.394315 31408 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:38.579852 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.551398 31479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.049s	sys 0.066s
I20260709 12:18:38.455183 31526 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:38.622421 28570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.028s	sys 0.019s
W20260709 12:18:38.657333 28570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.028s	sys 0.019s
W20260709 12:18:38.527854 28682 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.019s
W20260709 12:18:38.658349 28682 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.010s	sys 0.019s
W20260709 12:18:38.659318 28753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.012s	sys 0.021s
W20260709 12:18:38.659906 28753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.013s	sys 0.022s
W20260709 12:18:38.539191 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 55528us
I20260709 12:18:38.660790 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 487) took 1121 ms. Trace:
I20260709 12:18:38.660892 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:38.632936 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.000s	sys 0.047s
W20260709 12:18:38.662912 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.001s	sys 0.047s
W20260709 12:18:38.663352 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 755619us
I20260709 12:18:38.551898 31530 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:38.576375 31432 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:38.896309 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 557) took 1598 ms. Trace:
I20260709 12:18:39.029489 29319 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:39.024294 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:39.038689 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.718801 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.028609 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 1.04399e+06us
W20260709 12:18:38.686589 28679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.000s	sys 0.043s
W20260709 12:18:38.666414 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.039907 28679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.002s	sys 0.075s
I20260709 12:18:39.023114 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:39.028527 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:38.778177 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:38.661181 28753 rpcz_store.cc:276] 0709 12:18:37.539128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.540217 (+  1089us) service_pool.cc:224] Handling call
0709 12:18:37.556476 (+ 16259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.556736 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:38.046903 (+490167us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.660414 (+613511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.660485 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:38.660549 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.660622 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.660738 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1104779,"raft.queue_time_us":72,"thread_start_us":1102917,"threads_started":2}
I20260709 12:18:39.044023 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:38.483750 31383 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.010s
W20260709 12:18:38.635164 31543 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.515s	user 0.000s	sys 0.001s
I20260709 12:18:39.037746 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:39.027213 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:38.590677 31537 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:39.091262 28674 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:39.031164 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:38.626916 31444 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:39.302917 29292 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.016s	sys 0.074s
I20260709 12:18:38.634716 31460 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:39.315761 29292 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.016s	sys 0.075s
W20260709 12:18:38.859922 31468 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.001s
W20260709 12:18:39.106101 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.250910 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:39.316732 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 285664us
W20260709 12:18:39.319042 28572 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.411s	user 0.018s	sys 0.068s
W20260709 12:18:39.230873 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 452768us
W20260709 12:18:38.686971 31549 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:18:38.668227 31384 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.014s	sys 0.037s
W20260709 12:18:38.687036 31552 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 12:18:38.900199 31559 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
W20260709 12:18:38.687096 31558 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:39.319816 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:39.020176 29318 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:38.889350 31563 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:39.073303 31509 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.305s
I20260709 12:18:38.801271 31536 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:39.322518 31460 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:39.316360 28754 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.039s	sys 0.046s
I20260709 12:18:38.834228 31328 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:39.258867 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:38.905700 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1773) took 1045 ms. Trace:
I20260709 12:18:39.321529 31537 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.021757 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:39.037756 28681 rpcz_store.cc:276] 0709 12:18:37.297974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.757270 (+459296us) service_pool.cc:224] Handling call
0709 12:18:37.757528 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.792325 (+ 34797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.792367 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:37.792416 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:37.802364 (+  9948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.896013 (+1093649us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b54003e21d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:38.896071 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.896231 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79289600}
W20260709 12:18:39.197804 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.658705 31301 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:39.280853 31342 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.043s	sys 0.058s
I20260709 12:18:38.682780 31526 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:38.804939 31561 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:18:38.839576 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1730) took 1204 ms. Trace:
I20260709 12:18:39.257812 31333 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:39.311326 30980 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:38.775563 31437 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:39.019157 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 717) took 1104 ms. Trace:
W20260709 12:18:39.373090 31384 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.360s	user 0.040s	sys 0.067s
W20260709 12:18:39.388975 28572 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.021s	sys 0.071s
W20260709 12:18:39.128144 31443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.028s	sys 0.063s
I20260709 12:18:39.383013 28750 rpcz_store.cc:276] 0709 12:18:37.631926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.632120 (+   194us) service_pool.cc:224] Handling call
0709 12:18:37.838205 (+206085us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:37.838415 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.041027 (+202612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:38.041057 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.041100 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:38.041130 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.836245 (+795115us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54001b35d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:38.836292 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.836415 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533234688}
I20260709 12:18:38.836863 31528 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:38.861256 31408 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:38.689324 31562 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.686499 31355 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.073660 31296 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.322337 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 1.80143e+06us
I20260709 12:18:39.098191 31440 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.396111 31443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.037s	sys 0.073s
I20260709 12:18:39.046439 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:39.263435 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.389308 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 1.48134e+06us
I20260709 12:18:39.377523 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 489) took 1837 ms. Trace:
W20260709 12:18:39.380628 28754 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.039s	sys 0.047s
I20260709 12:18:39.440711 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.381043 28678 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:38.834633 31360 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:38.686898 31223 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:39.393752 31489 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:39.458920 31536 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:39.459455 31489 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:39.459606 31536 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:39.459985 31489 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.460676 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.461231 28605 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:39.462056 31489 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.462159 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.462805 28605 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:39.463636 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.463984 31223 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:38.867506 31541 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:39.400759 31453 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:39.380894 28601 rpcz_store.cc:276] 0709 12:18:37.860197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.860342 (+   145us) service_pool.cc:224] Handling call
0709 12:18:38.905499 (+1045157us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400217354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:38.905640 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042115328}
I20260709 12:18:39.310931 31388 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.473287 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.474651 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.475299 28601 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:39.339272 30962 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:39.083432 31545 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:39.382586 31342 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.321s	user 0.043s	sys 0.062s
I20260709 12:18:39.476658 30962 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.773109 31392 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.622s
W20260709 12:18:39.432061 29292 connection.cc:256] RPC call timeout handler was delayed by -1.2636894269999175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 12:18:39.477751 29292 connection.cc:256] RPC call timeout handler was delayed by -1.0760367509999469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
I20260709 12:18:39.479070 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:39.251529 31332 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.450467 31477 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.371948 31444 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.441955 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.439356 28755 rpcz_store.cc:276] 0709 12:18:37.539717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.541320 (+  1603us) service_pool.cc:224] Handling call
0709 12:18:37.541737 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.567053 (+ 25316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.567098 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:37.567639 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.909239 (+341600us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:37.909281 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.910444 (+  1163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.377320 (+1466876us) raft_consensus.cc:1685] finished
0709 12:18:39.377347 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.377467 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24833,"raft.queue_time_us":26400,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":341159,"threads_started":1,"wal-append.queue_time_us":745709}
I20260709 12:18:39.449430 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.441437 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1764) took 2329 ms. Trace:
I20260709 12:18:39.380684 31571 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:39.076615 31258 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:39.435847 31501 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:39.452384 31574 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:39.382766 31301 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.381126 31328 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:39.384686 29320 rpcz_store.cc:276] 0709 12:18:37.914858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.018171 (+1103313us) service_pool.cc:224] Handling call
0709 12:18:39.018538 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:39.018752 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.018781 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:39.018833 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:39.018873 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.018946 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.019066 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:39.452852 31360 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:39.399560 30980 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.453445 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.484117 31528 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:39.383410 31333 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:39.449249 31549 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:39.373786 31468 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.455432 31526 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.456957 28600 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:39.458551 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.383780 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 665) took 2861 ms. Trace:
I20260709 12:18:39.464151 28605 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:38.903644 31517 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.435472 31532 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.471037 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 424633us
I20260709 12:18:39.477173 30962 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:39.515643 31574 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:39.451644 31562 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.437638 31296 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:39.558758 31296 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:39.388664 31460 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:39.484306 29323 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:39.377740 31563 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.561404 31563 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.476250 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.506284 31489 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.562729 31489 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.508896 31477 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.509158 31444 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:39.512576 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1828) took 1604 ms. Trace:
I20260709 12:18:39.484567 28602 rpcz_store.cc:276] 0709 12:18:37.104949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.105619 (+   670us) service_pool.cc:224] Handling call
0709 12:18:37.106038 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:37.106458 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.106498 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:37.115266 (+  8768us) log.cc:844] Serialized 52 byte log entry
0709 12:18:37.638660 (+523394us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:37.638716 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.638813 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.618804 (+979991us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:39.417110 (+798306us) raft_consensus.cc:1685] finished
0709 12:18:39.417131 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.434617 (+ 17486us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54923,"raft.queue_time_us":1590,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":13323,"spinlock_wait_cycles":2819968,"thread_start_us":465552,"threads_started":1,"wal-append.queue_time_us":974855}
W20260709 12:18:39.513965 28675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.015s	sys 0.046s
I20260709 12:18:39.513378 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:39.435235 31355 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.512580 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:39.442772 31408 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:39.570871 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:39.517933 31501 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:18:39.506769 31571 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.525388 28607 raft_consensus.cc:2368] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:39.441756 31440 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.524606 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:39.481613 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:39.530876 29325 rpcz_store.cc:276] 0709 12:18:36.522071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.528537 (+  6466us) service_pool.cc:224] Handling call
0709 12:18:36.528862 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:36.617616 (+ 88754us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:36.617666 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:36.829665 (+211999us) log.cc:844] Serialized 52 byte log entry
0709 12:18:37.579742 (+750077us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b1800264ac0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:18:37.905515 (+325773us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:37.905557 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.905621 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.383471 (+1477850us) raft_consensus.cc:1685] finished
0709 12:18:39.383497 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.383699 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9798,"raft.queue_time_us":437154,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":41133,"spinlock_wait_cycles":3959040,"thread_start_us":413784,"threads_started":2,"wal-append.queue_time_us":1448376}
I20260709 12:18:39.537050 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.538262 30980 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:39.538870 31328 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.540620 31574 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.542112 31526 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.546025 31333 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:39.526567 31360 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.550649 31530 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.551903 28603 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:39.552470 31532 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.554847 31223 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.602166 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:39.618741 31296 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:39.483899 31388 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.568495 31562 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:39.624603 30980 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:39.573264 28599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.007s	sys 0.008s
W20260709 12:18:39.571522 28749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.013s	sys 0.042s
I20260709 12:18:39.610229 31408 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:39.571522 28673 rpcz_store.cc:276] 0709 12:18:37.907678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.907794 (+   116us) service_pool.cc:224] Handling call
0709 12:18:37.908111 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.908506 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:37.908532 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:37.915823 (+  7291us) log.cc:844] Serialized 26 byte log entry
0709 12:18:38.559419 (+643596us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:38.559470 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.559548 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.512345 (+952797us) raft_consensus.cc:1685] finished
0709 12:18:39.512366 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.512515 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74319,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":19556,"thread_start_us":587579,"threads_started":1,"wal-append.queue_time_us":1580173}
W20260709 12:18:39.575611 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 63113.4us
W20260709 12:18:39.577093 28675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.016s	sys 0.046s
I20260709 12:18:39.512756 31258 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.620230 28598 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:39.564743 31489 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.625727 28605 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
W20260709 12:18:39.629801 29289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.005s	sys 0.013s
I20260709 12:18:39.647687 31574 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.580714 31578 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:39.530745 31528 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:39.600955 31571 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:39.620404 29317 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:39.653399 28749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.013s	sys 0.042s
I20260709 12:18:39.679733 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1731) took 2047 ms. Trace:
I20260709 12:18:39.680226 28749 rpcz_store.cc:276] 0709 12:18:37.632302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.752224 (+119922us) service_pool.cc:224] Handling call
0709 12:18:38.113511 (+361287us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:38.113756 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.114017 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:38.468988 (+354971us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.679300 (+1210312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:39.679369 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:39.679435 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.679515 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.679664 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":577126,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":122633088,"thread_start_us":1524814,"threads_started":2}
I20260709 12:18:39.529742 31576 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.653770 28599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.008s	sys 0.008s
I20260709 12:18:39.642033 31526 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:39.656231 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 563) took 1892 ms. Trace:
I20260709 12:18:39.683466 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1770) took 1841 ms. Trace:
I20260709 12:18:39.644062 31296 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.704079 31296 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:39.704409 31440 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.644852 31328 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:39.664602 29321 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
W20260709 12:18:39.665637 29289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.005s	sys 0.013s
W20260709 12:18:39.629094 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.669925 31258 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.673537 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:39.708993 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.709517 31360 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.709574 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:39.710697 31545 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:39.710932 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:39.711097 31545 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.711545 31545 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:39.711635 31301 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.711817 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:39.709581 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.678407 28682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.006s	sys 0.013s
W20260709 12:18:39.714958 28682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.006s	sys 0.013s
I20260709 12:18:39.715714 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1827) took 1808 ms. Trace:
I20260709 12:18:39.716040 28682 rpcz_store.cc:276] 0709 12:18:37.907387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.918658 (+ 11271us) service_pool.cc:224] Handling call
0709 12:18:37.919024 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.919263 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:38.659433 (+740170us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.715399 (+1055966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:39.715450 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:39.715501 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.715565 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.715666 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":87869,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2113,"thread_start_us":1759394,"threads_started":2}
W20260709 12:18:39.682485 31449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.005s	sys 0.010s
W20260709 12:18:39.694877 31580 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:18:39.695205 31444 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:39.696395 31477 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:39.679647 31578 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.690090 31569 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:39.700783 31560 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:18:39.701501 31388 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:39.747421 31388 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:39.747936 31388 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:39.701628 31355 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.702822 31532 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:39.690382 31511 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:39.703260 31526 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:39.750340 31296 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:39.751159 31511 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:39.751029 31526 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.751639 31511 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.754628 31537 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.702843 31536 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.725720 31517 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:39.756929 31517 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.757990 31536 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.759522 31388 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:39.691424 28675 rpcz_store.cc:276] 0709 12:18:37.763833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.832706 (+ 68873us) service_pool.cc:224] Handling call
0709 12:18:37.833068 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.833563 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:38.323940 (+490377us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.655893 (+1331953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:39.655943 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:39.655991 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.656064 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.656174 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6961,"prepare.queue_time_us":69867,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":6899,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9032,"thread_start_us":1706659,"threads_started":2}
I20260709 12:18:39.684109 29320 raft_consensus.cc:2410] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:18:39.730137 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.692502 28599 rpcz_store.cc:276] 0709 12:18:37.842345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.857921 (+ 15576us) service_pool.cc:224] Handling call
0709 12:18:37.858320 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.858597 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:38.549982 (+691385us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.683025 (+1133043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:39.683095 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:39.683155 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.683262 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.683400 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":976463,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":1033,"thread_start_us":1823595,"threads_started":2}
I20260709 12:18:39.711273 31562 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:39.713294 31576 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:40.086531 28572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.013s
W20260709 12:18:39.995214 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.922595 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.257s	user 0.012s	sys 0.017s
W20260709 12:18:40.508008 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.843s	user 0.021s	sys 0.033s
W20260709 12:18:40.508246 28606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.009s	sys 0.031s
W20260709 12:18:40.087813 28680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.007s	sys 0.025s
W20260709 12:18:40.013634 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.081336 28719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.002s	sys 0.020s
W20260709 12:18:39.972949 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.728454 31333 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.726063 31384 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:40.381131 31571 consensus_meta.cc:287] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.002s
W20260709 12:18:40.064977 29291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.013s	sys 0.032s
I20260709 12:18:39.729069 30980 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:39.736646 31449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.005s	sys 0.010s
W20260709 12:18:40.109440 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.010s	sys 0.013s
W20260709 12:18:40.185371 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.010s	sys 0.014s
W20260709 12:18:39.943430 28677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.016s	sys 0.013s
W20260709 12:18:39.946313 29290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.011s	sys 0.018s
W20260709 12:18:40.512521 28572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.014s	sys 0.031s
W20260709 12:18:40.070040 28754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.006s	sys 0.034s
W20260709 12:18:40.509114 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.000s	sys 0.020s
W20260709 12:18:40.549059 28754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.016s	sys 0.046s
W20260709 12:18:40.549196 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.000s	sys 0.020s
W20260709 12:18:39.872164 31183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.094s	user 0.014s	sys 0.013s
W20260709 12:18:40.493896 28676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.006s	sys 0.013s
I20260709 12:18:39.799412 31477 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:40.513432 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.769343 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:39.872349 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.389s	user 0.011s	sys 0.014s
W20260709 12:18:40.557550 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.074s	user 0.027s	sys 0.026s
W20260709 12:18:40.510484 28606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.009s	sys 0.031s
W20260709 12:18:40.511593 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.906380 28679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.000s	sys 0.027s
W20260709 12:18:40.224866 29326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.000s	sys 0.013s
I20260709 12:18:39.822122 28604 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:39.905990 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:40.508538 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 1.84342e+06us
W20260709 12:18:40.510174 28680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.009s	sys 0.040s
W20260709 12:18:39.872514 28645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.010s	sys 0.015s
W20260709 12:18:40.247849 31588 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 12:18:40.226706 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.175534 31584 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:18:39.967783 31521 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.796s	user 0.007s	sys 0.026s
W20260709 12:18:40.113768 30962 consensus_meta.cc:287] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
W20260709 12:18:40.437268 31589 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:18:40.008069 31437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.004s	sys 0.036s
W20260709 12:18:40.511279 28719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.005s	sys 0.028s
W20260709 12:18:40.549582 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.011s	sys 0.023s
W20260709 12:18:40.550021 29290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.476s	user 0.024s	sys 0.030s
W20260709 12:18:40.549656 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.012s	sys 0.022s
W20260709 12:18:40.549503 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 824328us
W20260709 12:18:40.549039 28677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.513s	user 0.030s	sys 0.024s
W20260709 12:18:40.169597 31342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.004s	sys 0.017s
W20260709 12:18:40.166313 31443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.013s	sys 0.007s
W20260709 12:18:39.945103 28647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.004s	sys 0.024s
W20260709 12:18:40.543381 29291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.022s	sys 0.038s
W20260709 12:18:40.551214 28676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.007s	sys 0.013s
I20260709 12:18:40.552367 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.553719 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.625088 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 564) took 2384 ms. Trace:
I20260709 12:18:40.554347 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:40.623428 28647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.294s	user 0.016s	sys 0.036s
W20260709 12:18:40.510793 29317 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.786s	user 0.013s	sys 0.001s
I20260709 12:18:39.847743 31578 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:39.761543 31517 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.556072 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.099130 31432 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:40.556988 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1744) took 2721 ms. Trace:
W20260709 12:18:40.617707 31342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.009s	sys 0.026s
I20260709 12:18:39.827426 31528 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.635864 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:39.774977 31408 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:40.562000 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.549917 31333 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:40.591361 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.591682 28645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.039s	sys 0.023s
W20260709 12:18:40.544466 31388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.004s	sys 0.008s
I20260709 12:18:39.827176 31468 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:40.592835 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:40.596659 28607 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:40.640936 28607 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:40.641525 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.641650 28607 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.642549 28607 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:40.642697 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.643748 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:40.597210 29326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.009s	sys 0.020s
I20260709 12:18:40.598341 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.543519 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 677) took 1030 ms. Trace:
I20260709 12:18:40.644891 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.546635 31296 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:40.555909 31183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.773s	user 0.016s	sys 0.039s
I20260709 12:18:39.773569 31569 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:40.554730 31574 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.766682 31511 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:40.554914 31440 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:40.612885 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 1.21176e+06us
I20260709 12:18:40.620148 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:40.621236 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:40.556543 30980 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:40.656858 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:39.945293 31460 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:40.602423 31545 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.886s	user 0.004s	sys 0.011s
W20260709 12:18:40.646716 31388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.005s	sys 0.008s
I20260709 12:18:40.625900 28598 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:39.937623 31555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.010s	sys 0.020s
W20260709 12:18:40.658711 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.557008 31477 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:40.630471 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.544126 31384 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:40.617882 31437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.234s	user 0.008s	sys 0.045s
I20260709 12:18:40.687575 28674 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:40.623356 31443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.018s	sys 0.020s
W20260709 12:18:40.561081 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 2.09428e+06us
W20260709 12:18:40.668658 31555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.831s	user 0.013s	sys 0.045s
I20260709 12:18:40.557590 29319 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:40.563148 28679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.001s	sys 0.053s
I20260709 12:18:40.645215 29320 rpcz_store.cc:276] 0709 12:18:39.511955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.535273 (+ 23318us) service_pool.cc:224] Handling call
0709 12:18:40.541834 (+1006561us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:40.611496 31592 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.670389 29327 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:18:40.618733 30962 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:40.633891 31596 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:40.629992 29317 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
W20260709 12:18:40.607128 31521 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.453s	user 0.013s	sys 0.047s
I20260709 12:18:40.549710 31571 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.634143 28754 rpcz_store.cc:276] 0709 12:18:37.830236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.151730 (+321494us) service_pool.cc:224] Handling call
0709 12:18:38.175830 (+ 24100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.176031 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:39.440928 (+1264897us) log.cc:844] Serialized 14 byte log entry
0709 12:18:40.551174 (+1110246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:40.551227 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:40.551284 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.551350 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.551484 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3125,"prepare.queue_time_us":659728,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":11580,"spinlock_wait_cycles":13385600,"thread_start_us":2359537,"threads_started":2,"wal-append.queue_time_us":1159367}
I20260709 12:18:40.691767 31443 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:40.692453 31600 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.690258 31437 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:40.695482 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 674) took 1215 ms. Trace:
I20260709 12:18:40.688342 31612 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:40.638477 31562 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:18:40.678498 31296 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.670172 31599 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:40.685523 31477 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:40.681656 30980 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.814677 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 675) took 1333 ms. Trace:
I20260709 12:18:40.815977 31460 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.696075 31292 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.689810 31408 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:40.823074 30962 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:40.823243 31408 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:40.713358 31443 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.814692 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 673) took 1334 ms. Trace:
I20260709 12:18:40.826045 29322 rpcz_store.cc:276] 0709 12:18:39.479980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.480159 (+   179us) service_pool.cc:224] Handling call
0709 12:18:39.481579 (+  1420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:39.506640 (+ 25061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.506669 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:39.519247 (+ 12578us) log.cc:844] Serialized 52 byte log entry
0709 12:18:40.055325 (+536078us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:40.055371 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.055442 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.813902 (+758460us) raft_consensus.cc:1685] finished
0709 12:18:40.813946 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.814336 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25208,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5684,"thread_start_us":481611,"threads_started":1,"wal-append.queue_time_us":1224290}
W20260709 12:18:40.793138 28572 connection.cc:256] RPC call timeout handler was delayed by -1.1515652789998967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 12:18:40.645473 28605 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:40.624913 28599 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:40.830345 31333 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:40.700806 31449 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:40.831394 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.794903 28603 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:40.797518 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1722) took 1758 ms. Trace:
I20260709 12:18:40.636531 28600 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 4.
I20260709 12:18:40.764384 31511 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:40.690116 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:40.832834 28680 rpcz_store.cc:276] 0709 12:18:39.038422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.390111 (+351689us) service_pool.cc:224] Handling call
0709 12:18:39.433336 (+ 43225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:39.433785 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.433821 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.457872 (+ 24051us) log.cc:844] Serialized 572 byte log entry
0709 12:18:40.592032 (+1134160us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:40.592075 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.592145 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.796650 (+204505us) raft_consensus.cc:1685] finished
0709 12:18:40.796695 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.797179 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1133857,"threads_started":1,"wal-append.queue_time_us":1302860}
I20260709 12:18:40.834097 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.834901 28678 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:40.835830 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:40.688716 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:40.836803 28680 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:40.837139 28674 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:40.837574 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2121) took 1391 ms. Trace:
I20260709 12:18:40.837987 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:40.838038 28604 rpcz_store.cc:276] 0709 12:18:39.445777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.513077 (+ 67300us) service_pool.cc:224] Handling call
0709 12:18:40.837113 (+1324036us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400092754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:40.837354 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570638720}
I20260709 12:18:40.839119 28680 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:40.694344 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 566) took 2420 ms. Trace:
I20260709 12:18:40.840276 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:40.841223 28680 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:40.842458 31526 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:40.840680 28677 rpcz_store.cc:276] 0709 12:18:38.274298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.468972 (+194674us) service_pool.cc:224] Handling call
0709 12:18:38.542851 (+ 73879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.701143 (+158292us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:39.036149 (+335006us) log.cc:844] Serialized 14 byte log entry
0709 12:18:40.613546 (+1577397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:40.613599 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:40.613644 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.694118 (+ 80474us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54003b7254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:40.694162 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.694288 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":612757,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1451,"raft.queue_time_us":4080,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5322,"spinlock_wait_cycles":363284352,"thread_start_us":1577031,"threads_started":1,"wal-append.queue_time_us":1174287}
I20260709 12:18:40.842875 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:40.843850 28680 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:40.763136 31571 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.678323 31574 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.696168 29325 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:18:40.713733 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 670) took 1232 ms. Trace:
I20260709 12:18:40.830651 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:40.690194 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:40.683557 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:40.625499 28676 rpcz_store.cc:276] 0709 12:18:38.240683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.467732 (+227049us) service_pool.cc:224] Handling call
0709 12:18:38.468094 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.483626 (+ 15532us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:38.665247 (+181621us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.729818 (+1064571us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b18003d5760. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a 00007f6fe3a89a2a
0709 12:18:39.748341 (+ 18523us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b18003d5760. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:18:39.755501 (+  7160us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b18003d5760. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992557 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:18:40.624748 (+869247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:40.624801 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:40.624852 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.624915 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.625022 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142108,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":369548,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":152221,"spinlock_wait_cycles":210054400,"thread_start_us":894729,"threads_started":1,"wal-append.queue_time_us":1727742}
I20260709 12:18:40.685143 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:40.894069 31408 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:40.714118 29319 rpcz_store.cc:276] 0709 12:18:39.480314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.480520 (+   206us) service_pool.cc:224] Handling call
0709 12:18:39.769158 (+288638us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:40.695411 (+926253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2725760}
I20260709 12:18:40.689769 31578 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.897873 31578 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.831897 31449 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:40.658308 31545 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.671767 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:40.766244 31585 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:40.911863 31545 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:40.912263 31585 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:40.701758 31596 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.716594 31600 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.765357 31601 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:40.712797 31604 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:18:40.753376 31606 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:40.937345 31606 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:40.938057 31578 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.938884 29320 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:40.939854 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:40.917117 31574 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.940874 29322 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:40.942530 31384 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:40.943430 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 266925us
I20260709 12:18:40.754118 31599 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:40.947161 31599 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:40.758291 31612 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:40.756158 31609 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:18:40.678095 31440 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.695698 31597 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.949293 31597 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.949844 31585 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.950659 31440 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.951179 31585 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:40.819303 31292 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:40.851625 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:40.952984 28678 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:40.954300 31292 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:40.954373 31600 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.952195 31597 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.955140 31612 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:40.828222 31443 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:40.858289 28605 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:40.956897 31596 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:40.957643 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:40.939882 31606 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:40.857848 29317 rpcz_store.cc:276] 0709 12:18:39.478984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.483385 (+  4401us) service_pool.cc:224] Handling call
0709 12:18:40.711652 (+1228267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:40.767275 31576 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:40.815369 29326 rpcz_store.cc:276] 0709 12:18:39.480938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.481103 (+   165us) service_pool.cc:224] Handling call
0709 12:18:39.482112 (+  1009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:39.507562 (+ 25450us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:39.507607 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.508138 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:18:40.644705 (+1136567us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:40.644744 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.644809 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.813903 (+169094us) raft_consensus.cc:1685] finished
0709 12:18:40.813962 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.814345 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24934,"raft.queue_time_us":41349,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3407,"spinlock_wait_cycles":1521920,"thread_start_us":1136249,"threads_started":1,"wal-append.queue_time_us":1254181}
I20260709 12:18:40.883898 28675 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:40.757513 31296 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:40.893347 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 203103us
W20260709 12:18:40.905815 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 76668.7us
I20260709 12:18:40.911159 28598 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:40.696983 31592 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.016727 29322 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:40.906224 31388 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.928681 28674 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:40.906399 31449 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:40.880878 31437 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:40.931849 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:40.932116 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 280696us
I20260709 12:18:40.934427 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 672) took 1454 ms. Trace:
I20260709 12:18:40.934801 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:40.959712 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:40.959457 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:40.975584 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:40.957662 31601 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.008463 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:40.973809 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 240469us
W20260709 12:18:41.016250 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.978226 31296 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.021876 29327 rpcz_store.cc:276] 0709 12:18:39.479606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.479731 (+   125us) service_pool.cc:224] Handling call
0709 12:18:39.759448 (+279717us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:39.759651 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:40.695853 (+936202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.933754 (+237901us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54004a92d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:40.934163 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080735360}
I20260709 12:18:41.015481 28598 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:40.973124 31595 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:41.033836 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69812.8us
I20260709 12:18:41.039235 28678 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:41.030279 31601 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:41.065148 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.073014 31571 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:41.046919 31388 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:41.102388 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 476960us
I20260709 12:18:41.105178 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:41.108597 28721 connection.cc:256] RPC call timeout handler was delayed by -1.3144398369997816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 12:18:41.109164 28721 connection.cc:256] RPC call timeout handler was delayed by -1.1110398369999075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 12:18:41.109541 28721 connection.cc:256] RPC call timeout handler was delayed by -1.1083398369999031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:18:41.112939 31592 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.113107 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:41.113727 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 179351us
W20260709 12:18:41.114277 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 138934us
W20260709 12:18:41.097294 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 415085us
I20260709 12:18:41.076987 31595 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.120129 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:41.120400 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:41.108610 31526 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:41.097384 31477 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.138051 29321 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:18:41.139110 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.147013 31477 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:41.149519 31183 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:41.149660 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1826) took 3721 ms. Trace:
I20260709 12:18:41.150113 28679 rpcz_store.cc:276] 0709 12:18:37.427758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.770194 (+342436us) service_pool.cc:224] Handling call
0709 12:18:37.915272 (+145078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:39.040422 (+1125150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.040485 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.073224 (+ 32739us) log.cc:844] Serialized 26 byte log entry
0709 12:18:40.695576 (+1622352us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:41.051421 (+355845us) log.cc:844] Serialized 14 byte log entry
0709 12:18:41.112964 (+ 61543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.113076 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:41.113148 (+    72us) raft_consensus.cc:1685] finished
0709 12:18:41.113160 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:41.149274 (+ 36114us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54003e12d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:41.149436 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130170,"prepare.queue_time_us":266412,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":5060,"raft.queue_time_us":107645,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":16633,"spinlock_wait_cycles":332897152,"thread_start_us":2710581,"threads_started":3,"wal-append.queue_time_us":1407332}
I20260709 12:18:41.152544 28755 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:41.153931 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2113) took 1710 ms. Trace:
I20260709 12:18:41.154433 28606 rpcz_store.cc:276] 0709 12:18:39.443117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.443241 (+   124us) service_pool.cc:224] Handling call
0709 12:18:39.448929 (+  5688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:39.530099 (+ 81170us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:39.536521 (+  6422us) log.cc:844] Serialized 14 byte log entry
0709 12:18:40.831044 (+1294523us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b1800262f00. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:18:40.854224 (+ 23180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:40.863142 (+  8918us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:40.869457 (+  6315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.153408 (+283951us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b540004b354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:41.153473 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:41.153668 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2513,"prepare.queue_time_us":6436,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":72151,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":302,"spinlock_wait_cycles":190069760,"thread_start_us":1281133,"threads_started":2,"wal-append.queue_time_us":1096775}
W20260709 12:18:41.142181 31432 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.007s
I20260709 12:18:41.118703 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.091634 31600 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:41.144650 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.158731 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.159147 28754 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:41.161712 31388 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:41.140184 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.149690 31638 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:41.185240 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:41.201938 31638 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:41.203299 31627 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.203846 31627 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.204274 31627 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.185561 31526 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.150080 31183 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:41.208271 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.208500 31526 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.208657 31183 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:41.186048 31621 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:41.190814 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:41.192692 28607 consensus_meta.cc:287] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.550s	user 0.014s	sys 0.006s
W20260709 12:18:41.184280 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62010us
I20260709 12:18:41.210537 28607 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:18:41.210861 28607 pending_rounds.cc:85] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 6
I20260709 12:18:41.211122 28607 pending_rounds.cc:107] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:18:41.196727 31528 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:41.211390 28607 raft_consensus.cc:2889] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.211314 31342 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:18:41.211992 31528 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.213999 31569 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:41.214450 31528 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.186635 31595 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:41.216867 31595 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:41.219225 31596 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:41.219609 31596 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:41.197804 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.220625 31596 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.221845 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.222236 31596 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.222040 31601 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.222839 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.203204 31638 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.211328 28648 leader_election.cc:400] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8.
I20260709 12:18:41.199023 31517 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.226089 31611 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:41.226652 31611 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.227361 31611 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.226608 31517 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.211499 31477 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:41.229874 31569 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:41.230274 31569 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:41.230753 31569 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:41.230955 28601 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:18:41.232360 31296 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:41.233083 31296 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.235319 31296 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.238991 31602 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:41.239706 31602 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.241394 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.241863 31603 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.242352 31617 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.242693 31528 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.242954 31617 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.243175 31528 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.243410 31617 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.243580 31528 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.243698 31392 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:41.244529 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 207849us
I20260709 12:18:41.245182 31392 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:41.246260 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.247551 31392 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:41.248636 31621 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:41.249748 31511 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:41.242436 31603 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.248121 31392 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:41.249253 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 168580us
I20260709 12:18:41.246300 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.226127 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.256660 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:41.258455 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.259253 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.258387 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.260552 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.178146 31600 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:41.264508 31600 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.265480 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.266714 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.230218 31517 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.268404 31592 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:41.269337 31592 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:41.276959 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:41.279314 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 96155.9us
I20260709 12:18:41.254709 31601 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:41.287334 31576 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:41.287726 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:41.289041 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 63074.8us
I20260709 12:18:41.289366 31332 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:41.289783 31562 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:41.290022 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:41.290729 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.291496 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.291672 31562 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:41.292935 31562 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:41.294116 28501 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 227) took 20801 ms (client timeout 15000 ms). Trace:
I20260709 12:18:41.294776 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.295653 29325 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:41.289063 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.296469 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.296864 28753 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:41.297155 29321 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:41.297497 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.298362 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.299229 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.291519 28679 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:41.303932 31511 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.305383 31501 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.308619 31332 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:41.308917 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.305866 31511 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.309796 31511 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.310026 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.311518 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.315275 31449 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:41.315892 31449 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:41.307487 31501 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.316478 31501 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.316562 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.316958 31449 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.320044 31443 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:41.320407 31620 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.328784 31631 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 4 to 7, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:41.307662 31526 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:41.333480 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.324052 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:41.336570 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.338675 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.341339 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:41.294651 28501 rpcz_store.cc:269] 0709 12:18:20.496140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.496511 (+   371us) service_pool.cc:224] Handling call
0709 12:18:41.293754 (+20797243us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:35.251563 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:35.591765 (+340202us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:35.594917 (+  3152us) write_op.cc:435] Acquired schema lock
0709 12:18:35.598629 (+  3712us) tablet.cc:662] Decoding operations
0709 12:18:35.704561 (+105932us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:35.704627 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:35.704658 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:18:35.705231 (+   573us) tablet.cc:701] Row locks acquired
0709 12:18:35.705273 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:18:35.705432 (+   159us) write_op.cc:270] Start()
0709 12:18:35.705547 (+   115us) write_op.cc:276] Timestamp: P: 1783599515705382 usec, L: 0
0709 12:18:35.705569 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:35.748570 (+ 43001us) log.cc:844] Serialized 2080 byte log entry
0709 12:18:36.252509 (+503939us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b
0709 12:18:37.488425 (+1235916us) op_driver.cc:464] REPLICATION: finished
0709 12:18:38.198741 (+710316us) write_op.cc:301] APPLY: starting
0709 12:18:38.199972 (+  1231us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:38.296170 (+ 96198us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:38.300044 (+  3874us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:38.832872 (+532828us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:38.837294 (+  4422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:18:38.837346 (+    52us) write_op.cc:312] APPLY: finished
0709 12:18:38.837596 (+   250us) log.cc:844] Serialized 47 byte log entry
0709 12:18:40.702658 (+1865062us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:40.713843 (+ 11185us) write_op.cc:454] Released schema lock
0709 12:18:40.717100 (+  3257us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:40.847934 (+130834us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:40.848021 (+    87us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62443,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":692940,"apply.run_cpu_time_us":66476,"apply.run_wall_time_us":2568838,"num_ops":5,"prepare.queue_time_us":25279,"prepare.run_cpu_time_us":22667,"prepare.run_wall_time_us":1179777,"raft.queue_time_us":245473,"raft.run_cpu_time_us":7093,"raft.run_wall_time_us":403380,"replication_time_us":1782666,"spinlock_wait_cycles":65518336,"thread_start_us":2985665,"threads_started":5,"wal-append.queue_time_us":2579615,"wal-append.run_cpu_time_us":31531,"wal-append.run_wall_time_us":1764054}]]}
I20260709 12:18:41.342181 28754 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:41.313789 31562 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:41.348840 31585 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.349496 31585 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.303093 31392 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:41.354290 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46383.8us
I20260709 12:18:41.354831 31432 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:41.348017 28503 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 4, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 4 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.356145 31517 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:41.352675 31511 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:41.396036 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 72040us
I20260709 12:18:41.397119 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.384996 28753 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
W20260709 12:18:41.358886 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54139.6us
I20260709 12:18:41.400857 28601 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:41.395530 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:41.402036 28604 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.347891 31501 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.405467 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:41.335042 31526 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.403155 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.408274 28607 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:41.410650 31408 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:41.356354 31562 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:41.408368 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:41.412771 29325 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.356585 31603 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.356818 31576 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:41.360730 31602 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.416766 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.418946 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.419891 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.420225 28679 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:41.423888 31571 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:41.424583 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.427596 29321 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:41.406590 31526 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.416386 28503 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 6 to 8, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 8 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.411191 31408 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:41.378621 31183 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.374671 31600 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.437553 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.411791 31517 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:41.440501 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.441327 28679 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:41.445025 31511 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.447427 31569 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.442210 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.454344 28600 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 4.
I20260709 12:18:41.454758 31501 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:41.454908 31578 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:41.438320 31408 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.413470 31627 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.461846 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.461436 29325 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:41.457506 28682 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:41.463840 29321 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:41.467713 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.468317 29317 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:41.461357 28503 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 5 to 6, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 6 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.470963 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:41.471760 28755 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:41.472787 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.473595 28752 raft_consensus.cc:2368] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:41.478381 28750 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:41.479553 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.480310 28673 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:41.481287 31392 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:41.482036 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.490790 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.499491 28749 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:41.500927 31517 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.500213 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.502439 28750 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:41.504933 31183 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:41.508759 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.509505 29317 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:41.513183 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:41.513758 28750 raft_consensus.cc:2376] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6. Re-sending same reply.
I20260709 12:18:41.514791 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.515610 28756 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:41.516477 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.516846 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.517045 28754 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:41.518203 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:41.501446 29321 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:41.499588 28682 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:41.459791 31576 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:41.525168 28503 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 6, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 6 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.528054 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.539740 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.540647 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.540956 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.541175 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.541285 28675 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:41.541527 28681 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.541924 28680 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:41.480201 31617 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.546096 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.536991 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.569751 31611 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.572983 31600 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:41.576520 31501 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:41.577843 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 88819.5us
I20260709 12:18:41.578625 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:41.579849 31617 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:41.580550 31617 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:41.580618 31432 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.580976 31617 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.581411 31617 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.581521 31611 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:41.585083 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.586694 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.586979 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.587313 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.587646 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:41.587944 29322 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:41.588143 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.588239 29326 raft_consensus.cc:2376] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6. Re-sending same reply.
I20260709 12:18:41.588985 29327 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:41.587322 29317 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:41.589373 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:41.588997 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.590191 29320 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:41.590476 29318 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:41.591027 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.591732 29323 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:41.594116 31627 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:41.595182 31620 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:41.595904 28752 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:41.573040 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.604967 29321 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:41.605499 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.606053 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.608248 28680 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:41.603335 28503 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 6, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 6 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:18:41.615459 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.616628 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.617267 29320 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:41.618850 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.619340 28681 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:41.619467 29322 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:41.620537 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.621873 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.622526 28681 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:41.623257 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.623839 28681 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:41.624956 28681 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:41.625850 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.626185 28681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:41.626893 28681 raft_consensus.cc:606] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:41.627183 28681 raft_consensus.cc:614] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:41.629500 31569 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.630946 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.631366 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:41.637161 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.645102 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.654274 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.654873 28674 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:41.656678 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.646598 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.656312 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.661083 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:41.664314 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.669175 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.669925 30980 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.670374 30980 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:41.670892 30980 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.675139 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.675750 28680 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:41.628262 31528 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.684851 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.685200 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.652494 31578 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.688048 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:41.681948 31620 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:41.694820 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.695920 28682 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:41.697069 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:41.697925 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.682786 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.657033 31183 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:41.699874 28673 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:41.680716 28503 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 5, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:41.701365 29317 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:41.666764 31585 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.706900 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.709213 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.703826 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:41.712013 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:41.710918 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.717154 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.726478 28682 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:41.726927 28673 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:41.727023 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.727660 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:41.716135 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:41.721112 29325 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:41.731133 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.721483 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:41.733855 28681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:41.734427 28681 raft_consensus.cc:606] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.734760 28681 raft_consensus.cc:614] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:41.739934 28674 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:41.708104 31449 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:41.749765 28503 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.692345 31408 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.705582 31517 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:41.752413 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51688.1us
W20260709 12:18:41.759541 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46406.9us
I20260709 12:18:41.758987 31627 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.735648 31574 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:41.773699 28503 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 3 to 4, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 4 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.736788 31183 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:41.779649 28678 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:41.730742 31569 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:18:41.781955 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:41.753708 31517 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:41.793156 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106744us
I20260709 12:18:41.791443 31517 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.797878 31392 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.777416 31627 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.800163 28503 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:41.777164 31574 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:41.776537 31449 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:41.806479 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.753988 31578 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.706327 31576 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:41.828548 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.799428 28573 leader_election.cc:336] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.736s (SENT)
I20260709 12:18:41.786381 31511 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.831640 28676 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:41.786554 28674 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:41.840793 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:41.843154 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:41.807085 31587 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:41.823560 31627 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.858258 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:41.871045 31408 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:41.871694 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:41.838774 31443 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:18:41.828042 31574 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:41.875952 31532 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:41.877014 31648 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:18:41.878152 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.903647 28752 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:41.878720 31528 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:41.798691 31392 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.901177 28503 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 3, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:41.898697 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 168368us
I20260709 12:18:41.911273 28676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:41.911918 28676 raft_consensus.cc:606] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.912322 28676 raft_consensus.cc:614] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:41.823812 31526 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:41.930303 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.931049 28607 raft_consensus.cc:2368] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
I20260709 12:18:41.932809 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.935031 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.938813 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.939503 28599 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:41.941157 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:41.941900 28599 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:41.943773 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.948715 28602 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:41.898485 31585 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:41.899869 31532 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:41.904374 31611 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:41.973919 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.980903 28747 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:41.982189 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.982908 28753 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:41.844360 31511 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:41.987202 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:41.970709 31596 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.000s
I20260709 12:18:41.984268 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:41.927304 31620 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:41.994346 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:41.996493 28598 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:41.991528 28503 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 5, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.000176 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:42.000972 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 129356us
I20260709 12:18:42.001735 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:41.999831 29319 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:42.006012 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.006743 28751 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
W20260709 12:18:42.006932 31652 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:18:42.010142 31655 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:41.985455 31648 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:41.980544 31585 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:42.021524 31578 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:42.022512 31585 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.023535 31392 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:42.025504 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.028991 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:42.004396 28676 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.040361 31432 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:42.040858 31655 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:42.042125 31655 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.047936 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:41.976598 31532 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.049996 28503 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 3 to 4, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 4 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:42.052932 28503 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 7 to 8, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 8 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.057582 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.058341 28753 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:41.989225 31449 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.065371 31511 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:42.055438 28503 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.075771 28680 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:42.076447 28749 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:42.078127 28673 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:42.079262 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:41.977407 31611 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:42.081208 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.082402 28682 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:42.084867 28676 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:42.092393 28676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
W20260709 12:18:42.094929 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47082.7us
W20260709 12:18:42.095535 28573 leader_election.cc:336] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.139s (SENT)
I20260709 12:18:42.090691 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.097216 28751 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:42.075379 31620 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.086526 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 304628us
I20260709 12:18:42.099776 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:42.020104 31617 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.130527 31617 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:42.131609 28607 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:42.135769 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:42.101694 28503 catalog_manager.cc:5697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 5, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.083964 31562 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:42.103425 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:42.103929 31183 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.105521 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:42.108033 28604 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.704s	user 0.005s	sys 0.001s
I20260709 12:18:42.147035 28604 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:42.109740 30962 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:42.110764 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:42.111419 31526 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:42.116382 31611 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.119233 31620 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:42.123322 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.165585 28601 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.166653 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:42.167709 28648 connection.cc:256] RPC call timeout handler was delayed by -2.5278611069998078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 12:18:42.168151 28648 connection.cc:256] RPC call timeout handler was delayed by -2.4144611069998518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 12:18:42.168568 28648 connection.cc:256] RPC call timeout handler was delayed by -2.328961106999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 12:18:42.168942 28648 connection.cc:256] RPC call timeout handler was delayed by -2.2506611069998144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 12:18:42.169327 28648 connection.cc:256] RPC call timeout handler was delayed by -2.2344611069997882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 12:18:42.169648 28648 connection.cc:256] RPC call timeout handler was delayed by -2.1255611069998395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 12:18:42.170012 28648 connection.cc:256] RPC call timeout handler was delayed by -2.0580611069999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 12:18:42.170331 28648 connection.cc:256] RPC call timeout handler was delayed by -2.0301611069999126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 12:18:42.170697 28648 connection.cc:256] RPC call timeout handler was delayed by -1.8177611069997965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2392s for a response
W20260709 12:18:42.171061 28648 connection.cc:256] RPC call timeout handler was delayed by -1.1760611069998959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3105s for a response
W20260709 12:18:42.171442 28648 connection.cc:256] RPC call timeout handler was delayed by -1.1310611069998231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3155s for a response
W20260709 12:18:42.171797 28648 connection.cc:256] RPC call timeout handler was delayed by -1.1301611069998216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31560000000000005s for a response
I20260709 12:18:42.149506 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:42.150118 31392 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:42.150688 31443 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:42.150455 28503 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.153921 28681 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:18:42.154779 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.155006 31183 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:42.156677 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:42.150166 31440 raft_consensus.cc:1064] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:18:42.157612 31562 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.187837 31562 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.189980 31440 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.157881 31384 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:42.158088 31342 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:42.147643 28599 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:42.172179 28648 connection.cc:256] RPC call timeout handler was delayed by -1.1175611069998013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.317s for a response
W20260709 12:18:42.180713 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 79605.4us
I20260709 12:18:42.185159 28503 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 2 to 4, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 4 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.196357 28503 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.199477 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:42.199630 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:42.201445 31511 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:42.202088 31627 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.205156 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:42.200325 28678 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:42.213554 30962 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:42.215510 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:42.215574 30962 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:42.216985 30980 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 12:18:42.216771 30962 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.217433 30980 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.217988 30962 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.182464 31392 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:42.218917 31392 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:42.220657 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 64045.6us
I20260709 12:18:42.221875 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:42.225083 31517 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.225939 31443 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:42.226974 28675 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:42.227172 31517 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:42.227342 31501 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:42.227882 31501 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:42.228825 31501 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.229179 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.229851 28749 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:42.230780 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.231469 28753 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:42.228847 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.232478 28751 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:42.233228 28604 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:42.234201 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:42.211659 28573 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.243s (SENT)
W20260709 12:18:42.243834 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.261562 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.263103 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.263424 28602 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:42.263813 28752 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:42.233060 31576 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:18:42.265277 31576 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:42.265424 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:42.266713 31571 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:42.266923 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:42.267149 31571 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:42.265690 31576 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:42.269038 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 119588us
I20260709 12:18:42.267748 31571 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.273533 31662 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:18:42.274637 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:42.275347 28675 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:42.277091 31576 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.277422 31562 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.277877 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:42.278362 28682 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:42.278792 28602 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:42.281527 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:42.197322 31384 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:42.282651 28678 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:42.295459 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.207659 31342 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:42.219485 31532 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.268375 28503 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 7, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:42.308190 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:42.281795 31408 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:42.340445 31468 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:42.340837 28601 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:42.471328 29292 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.012s
W20260709 12:18:42.660310 29292 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.008s	sys 0.017s
W20260709 12:18:42.660709 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 781433us
I20260709 12:18:42.660851 31627 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:42.661859 28676 raft_consensus.cc:606] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:42.662184 28647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.672s (SENT) [suppressed 17 similar messages]
I20260709 12:18:42.662338 28676 raft_consensus.cc:614] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:42.663053 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1740) took 1028 ms. Trace:
W20260709 12:18:42.341691 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 144583us
I20260709 12:18:42.555601 31571 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.361245 30980 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:42.667030 31571 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:42.667536 28675 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:42.546857 31384 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.671273 31602 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:42.671711 31602 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:42.674428 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:42.675168 29319 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:42.678427 31602 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.679845 31602 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.549135 31392 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.684571 31392 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:42.674610 29320 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:42.340752 31408 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:42.367314 31388 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:42.644121 31443 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:42.687400 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.688550 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.716361 28751 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:18:42.689317 31611 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.719403 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:42.720021 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:42.340937 31468 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:42.722918 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:42.690632 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:42.724253 28675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:18:42.724742 28749 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.725327 28600 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:42.659775 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:42.663615 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 384004us
I20260709 12:18:42.693056 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:42.530427 31342 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.694880 28605 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:42.694926 31440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.012s
I20260709 12:18:42.695534 31562 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:42.700717 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.702241 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:42.586781 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.744596 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:42.745108 28682 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:42.745848 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:42.746300 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:42.745127 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:42.748718 29319 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:42.732699 31384 raft_consensus.cc:2764] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:18:42.708878 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 442022us
I20260709 12:18:42.663501 28674 rpcz_store.cc:276] 0709 12:18:41.634534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.752005 (+117471us) service_pool.cc:224] Handling call
0709 12:18:41.760805 (+  8800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.778870 (+ 18065us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:41.897964 (+119094us) log.cc:844] Serialized 14 byte log entry
0709 12:18:42.661643 (+763679us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:42.661699 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:42.661755 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.662845 (+  1090us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.662976 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6974,"raft.queue_time_us":56295,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":670811,"threads_started":2,"wal-append.queue_time_us":788757}
W20260709 12:18:42.710651 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.711158 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:42.708666 29289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.015s
W20260709 12:18:42.756225 29289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.003s	sys 0.015s
I20260709 12:18:42.756498 28677 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:18:42.714039 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:42.717684 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:42.663805 31576 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.361510 31574 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.718885 31443 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.689659 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.762049 28753 raft_consensus.cc:2410] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:18:42.551430 31532 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:42.763096 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:42.763540 29320 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:42.763717 29322 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.771073 31574 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:42.772091 31517 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:42.758903 31587 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:18:42.761375 31602 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:42.754674 31664 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:42.776389 31664 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.776769 31664 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.777302 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:42.778035 28749 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:42.778759 28648 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:42.779564 31585 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:42.780043 31585 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:42.735066 31388 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:42.781061 28605 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:42.721379 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 55004.9us
I20260709 12:18:42.557044 31620 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:42.724828 28675 raft_consensus.cc:606] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:42.691308 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:42.691991 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:42.726244 28679 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 12:18:42.726897 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.730011 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:42.730170 31468 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.730667 28747 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:42.735639 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:42.715831 31408 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:42.746340 31676 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:42.738440 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:42.704689 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.738956 31440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.011s	sys 0.012s
I20260709 12:18:42.844403 28599 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:42.844758 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:42.758757 30962 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.003s
I20260709 12:18:42.832449 29322 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
W20260709 12:18:42.833351 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51972.9us
I20260709 12:18:42.735522 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:42.757910 28601 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:42.845744 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:42.849277 28675 raft_consensus.cc:614] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:42.850843 28679 pending_rounds.cc:85] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 5
I20260709 12:18:42.851213 28679 pending_rounds.cc:107] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:18:42.851514 28679 raft_consensus.cc:2889] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:42.856864 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43878.3us
I20260709 12:18:42.857731 28606 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
W20260709 12:18:42.859589 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.861289 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:42.780539 31585 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:42.866497 28602 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:42.843624 31562 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:42.871069 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 92374.4us
I20260709 12:18:42.868621 30962 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:18:42.864794 31677 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:42.874071 31677 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.874413 31677 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.856498 31501 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:42.884379 31683 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:18:42.884398 31501 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.886287 31501 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:42.884684 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:42.761894 31600 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:18:42.864203 31392 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:18:42.893365 31388 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:42.909062 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:42.908399 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:42.918200 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 186554us
I20260709 12:18:42.918424 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:42.918658 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:42.918454 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:42.919895 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:42.907315 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:42.918166 29318 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:42.921427 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:42.921489 31596 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:42.920284 29323 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:42.907255 28599 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:42.928079 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:42.927533 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:42.933346 29319 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:42.939226 29318 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:42.942651 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.952157 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.933102 31656 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:42.939441 31562 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:42.956969 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:42.956962 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.971856 28752 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:18:42.968643 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 198532us
I20260709 12:18:42.960629 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:42.975139 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:42.955931 28602 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:42.977051 28601 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:42.978138 30962 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:42.978770 31532 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.978713 30962 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:42.979388 31532 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:42.980221 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 131567us
I20260709 12:18:42.981523 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.982646 28747 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:42.983043 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:42.982646 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:42.932262 31655 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:18:42.987953 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.988376 31655 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:42.988788 28755 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:42.932579 31477 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:18:42.989218 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:42.953645 31384 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:42.989315 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:42.996366 28751 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:42.985711 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:42.990013 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.021816 31685 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:18:43.020479 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 80760.2us
I20260709 12:18:43.024536 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1807) took 1063 ms. Trace:
W20260709 12:18:43.029201 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 65530.8us
I20260709 12:18:43.008737 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:42.988391 31680 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:42.971102 31562 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:43.046389 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71321.7us
I20260709 12:18:42.988866 31655 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:43.036785 28679 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:43.039860 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.042833 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.025061 28603 rpcz_store.cc:276] 0709 12:18:41.961689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.962082 (+   393us) service_pool.cc:224] Handling call
0709 12:18:41.962545 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.008147 (+ 45602us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:42.008188 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.009235 (+  1047us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.344233 (+334998us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:42.344291 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.344386 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.024249 (+679863us) raft_consensus.cc:1685] finished
0709 12:18:43.024280 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.024463 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31719,"raft.queue_time_us":45321,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"thread_start_us":334582,"threads_started":1,"wal-append.queue_time_us":773438}
I20260709 12:18:43.027856 31600 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:43.040674 31342 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:43.051272 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:43.059196 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:43.059707 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.060202 30962 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:43.061944 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:43.062657 28679 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:43.062565 31691 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:43.063140 31691 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:43.063536 31691 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:43.063524 31673 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:18:43.049084 31562 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.084769 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.086840 28756 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:43.112964 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.048151 29318 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:43.116552 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 159468us
W20260709 12:18:43.116146 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 68822.1us
W20260709 12:18:43.115243 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 129718us
I20260709 12:18:43.062265 31342 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:43.120682 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 61582us
I20260709 12:18:43.118991 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:43.119457 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.126667 28648 leader_election.cc:400] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:43.131809 28648 leader_election.cc:403] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:43.073350 31477 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:18:43.123148 31342 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.085055 31443 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:18:43.144620 31679 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:43.122673 31690 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.149016 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.134089 31694 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:43.132654 31687 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:43.157084 28679 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:43.126688 31685 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:18:43.134008 31408 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.178377 28678 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:43.154467 28756 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:43.162570 28679 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:43.167243 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:43.167659 28750 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:43.168318 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.180171 28751 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:43.172276 31602 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:43.172683 31449 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:43.174021 28607 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:43.175179 31684 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:18:43.135265 31655 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.197067 31655 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:43.197134 31384 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.149330 29323 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:43.198500 31408 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.175840 31677 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.155984 31694 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:43.184018 31602 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:43.209834 31694 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:43.211073 31694 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:43.152273 31532 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:43.186594 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.155814 31700 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:43.177580 31687 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:43.187069 31501 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.188488 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.188916 31392 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:43.189726 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.225065 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.225704 28756 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:43.226233 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.226527 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:43.222368 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 152348us
I20260709 12:18:43.227013 28749 raft_consensus.cc:2368] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9.
I20260709 12:18:43.227349 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.227600 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.190569 31449 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:43.229071 31562 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.230124 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:43.230664 28678 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.192849 31691 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.205492 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:43.232677 31596 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:43.225107 31501 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.236334 31691 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.205798 28754 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:43.184823 29327 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:18:43.239609 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.240078 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.224128 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.241351 28754 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:43.224502 31687 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:43.226289 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.200346 28677 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:43.231231 31562 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.227015 28748 raft_consensus.cc:2368] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:43.240192 28753 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:43.223213 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.249753 28751 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:43.202831 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:43.206631 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 158854us
I20260709 12:18:43.247815 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.251232 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.251579 28756 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:43.248548 28678 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:18:43.248673 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.179152 31664 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.253080 28751 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:43.253829 28748 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:43.254436 31664 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.255183 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.218675 31585 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.255710 28747 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:18:43.257122 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.257637 31585 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.220952 31700 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:43.258428 31700 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:43.263211 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.267536 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 64776.3us
I20260709 12:18:43.270715 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.269228 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:43.278644 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:43.279331 31443 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:43.281780 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 162897us
I20260709 12:18:43.281872 28753 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:43.281912 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:43.282795 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:43.285262 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:43.285941 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 140904us
W20260709 12:18:43.305133 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.295680 28677 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:43.298123 31664 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:43.249069 31704 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.302943 28678 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:18:43.297268 28747 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:43.331725 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:43.344019 29317 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.333066 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:43.344594 28747 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:43.344945 28673 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
W20260709 12:18:43.333369 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 206826us
I20260709 12:18:43.338656 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:43.340258 31689 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
I20260709 12:18:43.329455 31638 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:43.340680 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:43.341382 31696 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:18:43.294811 31611 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.298729 31687 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:18:43.348311 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:43.351759 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.376025 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:43.297895 31501 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:43.377635 28681 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:18:43.382357 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.335007 31443 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:43.386570 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:43.386940 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1813) took 1202 ms. Trace:
W20260709 12:18:43.391609 28573 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.546s (SENT)
W20260709 12:18:43.392114 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 43964.6us
I20260709 12:18:43.346554 31664 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:43.402187 31664 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.402832 31468 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:43.400156 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.406297 28678 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:43.395087 28572 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:43.400955 28573 leader_election.cc:336] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.549s (SENT)
I20260709 12:18:43.407333 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:43.407333 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:43.394232 28607 rpcz_store.cc:276] 0709 12:18:42.184133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.184289 (+   156us) service_pool.cc:224] Handling call
0709 12:18:43.386787 (+1202498us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54002c0454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:43.386884 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239601920}
I20260709 12:18:43.400472 30962 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.411538 29322 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:43.414367 28673 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:18:43.416347 28749 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:18:43.402695 31701 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.251s	user 0.000s	sys 0.002s
I20260709 12:18:43.423420 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.424023 28750 raft_consensus.cc:2376] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6. Re-sending same reply.
I20260709 12:18:43.425330 28756 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:43.426574 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.392323 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:43.375775 31638 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.433494 31602 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:43.434424 31638 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:43.375905 31477 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:18:43.427345 28756 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:43.438058 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.438201 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.438772 28756 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:43.394505 31501 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.429966 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:43.429246 29292 leader_election.cc:336] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.195s (SENT)
I20260709 12:18:43.435889 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.349190 31620 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:18:43.444003 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57502.4us
I20260709 12:18:43.445392 28749 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:43.434727 31602 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:43.447156 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46245.6us
I20260709 12:18:43.446030 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:43.448273 28679 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.447075 31501 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.424691 31443 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:43.426911 31392 raft_consensus.cc:2764] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:43.428619 31562 raft_consensus.cc:2764] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:18:43.472674 31708 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:18:43.474159 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.446906 31685 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:43.478557 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:43.483604 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 59964.1us
I20260709 12:18:43.485085 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:43.427191 31709 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:18:43.469451 31694 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.489588 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.493271 28756 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:43.487918 28679 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:43.500103 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:43.490388 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:43.505559 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.507390 28749 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:43.502070 31477 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.506198 31627 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:18:43.508886 31443 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.511418 31627 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:43.511834 31627 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:43.512185 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:43.512778 31627 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:43.513643 31713 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:18:43.515228 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43541.9us
I20260709 12:18:43.512791 29325 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.516893 29322 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:43.516181 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 86272.6us
I20260709 12:18:43.519006 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:43.473194 31714 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:43.484236 31685 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.494191 31620 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:43.506534 31638 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:43.504448 31693 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:43.507139 31677 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.514672 31384 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.488124 31576 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:18:43.561408 31720 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:43.546020 31685 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.558756 28675 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:43.552599 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:43.505244 31719 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.486892 31711 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:18:43.544658 31704 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.543828 31714 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:43.553114 31627 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:43.551476 31620 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:43.591405 29325 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:43.592645 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:43.570587 28673 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:43.597100 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 118601us
W20260709 12:18:43.597309 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44758.8us
I20260709 12:18:43.598201 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:43.559495 31693 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:43.600304 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.563120 31712 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:43.602852 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.552047 31468 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:18:43.608987 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.610862 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.611208 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.612758 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:43.592469 31638 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:43.617695 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.618028 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.610690 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.619513 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.617990 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.593938 31714 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:43.620682 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58330.4us
I20260709 12:18:43.620321 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.621711 28606 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:43.624881 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.633592 31700 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.636709 31718 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:18:43.638551 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.628628 31691 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.612089 31712 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.806793 31729 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.641552 29317 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:43.624894 30980 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:43.642683 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:18:43.643606 31703 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 12:18:43.645691 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.645985 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:43.814420 28750 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:43.799124 28751 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:43.724858 28675 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:43.730681 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.815734 28606 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:43.717067 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.736557 31693 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.738039 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:43.723050 31706 raft_consensus.cc:670] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 12:18:43.723755 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.817623 28752 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.727514 31521 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:43.617581 31695 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:43.784507 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 67463.8us
I20260709 12:18:43.619585 31719 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:43.810042 30980 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:43.730041 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.629437 31468 consensus_queue.cc:1243] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:18:43.783039 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.729197 28605 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:18:43.838626 28605 pending_rounds.cc:85] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 6
I20260709 12:18:43.833500 30980 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:43.837729 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.717944 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.844509 28599 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:43.716277 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:43.804798 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 280049us
I20260709 12:18:43.806131 28755 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:43.808897 28602 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:43.811908 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:43.809195 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:43.798880 31709 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.837736 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:43.807420 31729 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:43.835088 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 192528us
I20260709 12:18:43.628422 31342 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.851627 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:43.839074 28605 pending_rounds.cc:107] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:18:43.865842 28605 raft_consensus.cc:2889] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:43.733121 31638 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.840620 28749 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:43.839359 31408 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.846931 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.870790 28602 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:43.818893 31521 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:43.851823 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:43.852363 28573 leader_election.cc:400] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6.
I20260709 12:18:43.827221 31611 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:43.826350 31704 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:43.716799 31620 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:43.883394 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.883844 31620 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.884064 31468 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.884654 31468 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.885416 31721 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:43.885828 31721 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:43.886626 31721 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.863756 31709 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:43.890049 31587 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:43.890472 31587 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:43.891142 31501 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.891353 31587 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.891791 31709 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:43.895612 31517 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:43.896070 31517 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:43.896628 31726 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:18:43.897080 31517 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.898403 31517 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.851704 31449 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.899032 31449 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.901113 31449 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.875782 31477 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.903259 28750 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:43.837896 31719 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:43.903964 28601 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:43.843458 31576 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:18:43.869529 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:43.907272 28675 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:43.874116 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.875384 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.876368 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.882045 31408 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:18:43.913650 28598 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.917913 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.919067 28599 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:43.926329 31690 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:43.913028 28606 raft_consensus.cc:2376] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6. Re-sending same reply.
W20260709 12:18:43.935627 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.937319 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 125517us
I20260709 12:18:43.939604 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:43.939674 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:43.946058 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.947026 31729 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:43.947203 31408 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:43.947813 31477 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:43.948975 31521 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:43.950183 31521 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:43.874367 29320 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:43.953413 31627 raft_consensus.cc:2764] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:18:43.957240 31501 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:43.959527 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 107780us
I20260709 12:18:43.875449 31704 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:43.948184 28681 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:43.961747 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:43.969329 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.961805 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:43.895779 31714 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.972151 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:43.973161 28603 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:43.987119 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:43.994786 29325 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:43.995884 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 114259us
I20260709 12:18:43.996696 28573 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:43.998147 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:43.887814 31721 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:43.992069 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:44.004724 28677 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.999689 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:44.005025 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:44.005831 28682 raft_consensus.cc:2410] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:44.005831 29319 raft_consensus.cc:2410] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:44.002768 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:43.892422 31709 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:44.009963 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:44.040730 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 79053.6us
I20260709 12:18:43.992403 31704 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.041967 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:43.904567 31719 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:43.967971 31576 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:43.991954 30962 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:44.007848 31384 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:44.011812 31677 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.943936 31662 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
W20260709 12:18:44.055651 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 217981us
I20260709 12:18:44.073339 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:44.063010 29325 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
W20260709 12:18:44.073779 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 77161.3us
I20260709 12:18:44.071781 28598 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:44.076205 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:44.076181 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:44.085368 28603 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:44.086647 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.087989 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.089211 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:44.091331 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 146211us
I20260709 12:18:44.074653 31698 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:44.099974 31698 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.081293 31574 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:44.101413 31501 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:44.005182 31724 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:18:44.103008 28598 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:44.020018 31712 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:44.050554 31718 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:44.056550 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:44.055800 31695 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:44.102248 31698 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:44.137599 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 328442us
I20260709 12:18:44.139375 28598 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:44.119539 31477 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:44.105675 31384 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.066552 31720 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:18:44.081512 31576 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:44.083480 31677 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:44.175383 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 111081us
I20260709 12:18:44.178350 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:44.175432 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 102030us
I20260709 12:18:44.178957 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:44.154134 29320 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:44.161412 31477 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:18:44.172701 31701 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:44.188170 28606 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:44.203112 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 105704us
I20260709 12:18:44.181001 31664 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:44.180635 31709 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:44.187774 31392 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:44.214340 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.216071 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:44.210860 31664 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:44.217494 31664 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.220891 31477 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.222115 31477 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:44.224519 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.225685 31757 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:44.226837 31757 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:44.227073 29318 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:44.227603 29318 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:44.229166 31576 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:44.242156 28600 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:44.243528 31677 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:44.243530 28600 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:44.274469 28677 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:44.224014 31342 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:44.278239 28752 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
W20260709 12:18:44.345018 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.210978 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 169072us
I20260709 12:18:44.232172 31620 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:44.279547 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 75074.4us
I20260709 12:18:44.367128 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:44.380059 28601 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:44.382673 28600 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:44.214672 31392 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:44.392311 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 213429us
I20260709 12:18:44.400040 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:44.401078 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:44.385174 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 173818us
I20260709 12:18:44.402463 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:44.406069 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 516) took 1392 ms. Trace:
I20260709 12:18:44.406865 28751 rpcz_store.cc:276] 0709 12:18:42.992996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.254634 (+261638us) service_pool.cc:224] Handling call
0709 12:18:43.334533 (+ 79899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.815219 (+480686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.232241 (+417022us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540003e654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:44.385004 (+152763us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b540003e650. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:44.385207 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251007616}
W20260709 12:18:44.392634 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 313175us
I20260709 12:18:44.413206 28600 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:18:44.415848 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:44.377478 31740 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:44.421928 30980 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.001s
I20260709 12:18:44.422363 30980 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.424899 29327 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:44.379745 31714 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:44.385180 31743 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:44.433046 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:44.384186 29318 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.428645 31576 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:44.445354 31517 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 12:18:44.429391 31691 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:18:44.448884 31384 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:44.424379 30980 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:44.368820 31695 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.453440 30980 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:44.454329 31685 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.001s
I20260709 12:18:44.454825 28600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42084
I20260709 12:18:44.454787 31685 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.430390 31740 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:44.452899 28602 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:18:44.533456 31517 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:44.534178 31517 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.542732 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:44.382618 31756 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:18:44.545411 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:18:44.549374 28599 consensus_meta.cc:287] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.002s
I20260709 12:18:44.549837 28599 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:44.547006 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:44.553469 29317 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:18:44.554226 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 152296us
I20260709 12:18:44.563692 28600 raft_consensus.cc:606] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 12:18:44.564267 28600 raft_consensus.cc:614] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:44.568864 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:44.470388 31740 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:44.436690 31698 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
W20260709 12:18:44.581248 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 148260us
I20260709 12:18:44.583410 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:44.587007 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:44.587657 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:44.588204 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:44.588409 29319 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:44.545047 31576 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:44.589787 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:44.594542 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:44.595113 29325 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:44.554889 31748 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:44.572788 31602 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:44.608795 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:44.554355 30962 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:18:44.539773 31709 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.617338 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:44.616679 29325 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:44.624296 31755 raft_consensus.cc:2764] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:18:44.643683 28601 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:44.639279 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:44.641010 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:44.618263 29323 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:44.623670 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.647957 28599 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:44.609748 31748 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:44.650281 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:44.683267 31748 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.626260 31620 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:44.626353 31602 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:44.619796 31677 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:44.676690 31384 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:44.704309 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 54106.2us
I20260709 12:18:44.621299 31766 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:44.709586 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 122954us
W20260709 12:18:44.715217 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 136421us
W20260709 12:18:44.729146 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 88209.3us
I20260709 12:18:44.704844 31744 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:44.705909 31750 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:44.735762 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:44.731773 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.641393 31664 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:44.702911 31761 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:44.732983 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.712708 31517 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:44.733415 31477 consensus_meta.cc:287] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.000s
I20260709 12:18:44.746759 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.747537 28599 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:44.725925 31759 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:44.749820 28606 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.000s
I20260709 12:18:44.745843 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:44.734489 31753 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:44.751245 28606 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:44.753440 31777 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:44.714046 31756 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:44.738016 31655 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:44.709942 31576 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.751096 31759 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:44.758510 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:44.766958 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.759368 31691 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:44.773425 29292 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.511s (SENT)
W20260709 12:18:44.779690 29292 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.551s (SENT)
I20260709 12:18:44.780243 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:44.761806 31655 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:44.782406 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:44.783939 28599 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:44.772243 31759 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:44.777911 31517 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:44.783557 31690 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.003s
I20260709 12:18:44.795548 28599 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:18:44.718853 31766 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.761826 31777 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.800163 31685 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:44.785905 31655 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:44.711591 31764 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:18:44.801254 31770 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:44.776010 31750 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:18:44.774303 31602 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:44.855214 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.021s	sys 0.049s
W20260709 12:18:44.863343 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.021s	sys 0.049s
W20260709 12:18:44.846783 31521 consensus_meta.cc:287] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.896s	user 0.013s	sys 0.001s
I20260709 12:18:44.823570 31690 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:44.856689 31449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.004s	sys 0.030s
W20260709 12:18:44.859977 31704 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.003s
I20260709 12:18:44.873088 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:44.875204 28677 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:44.859444 31719 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:44.881304 28680 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
W20260709 12:18:44.882085 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.869316 31449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.005s	sys 0.030s
I20260709 12:18:44.888692 28674 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:18:44.886260 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 304199us
I20260709 12:18:44.897310 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:44.892571 31719 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:44.893065 31690 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:44.927114 29292 leader_election.cc:336] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.718s (SENT)
I20260709 12:18:44.880414 31704 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.927611 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:44.908229 31664 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:44.934492 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.935750 28607 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 5: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:44.936848 31784 raft_consensus.cc:2764] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:18:44.885623 31676 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:18:44.939978 31740 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:44.943189 31777 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:44.943980 31780 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:44.936199 28607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2136) took 1331 ms (client timeout 1723 ms). Trace:
W20260709 12:18:44.944664 28607 rpcz_store.cc:269] 0709 12:18:43.604994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.926505 (+1321511us) service_pool.cc:224] Handling call
0709 12:18:44.936144 (+  9639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:44.944662 31780 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:44.946166 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 741) took 1001 ms. Trace:
I20260709 12:18:44.883345 31772 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:18:44.948328 29327 rpcz_store.cc:276] 0709 12:18:43.944654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.945108 (+   454us) service_pool.cc:224] Handling call
0709 12:18:43.945358 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.425278 (+479920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.945813 (+520535us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400780354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:44.946081 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102334720}
W20260709 12:18:44.950695 31728 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.134s	user 0.012s	sys 0.009s
I20260709 12:18:44.950981 31780 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:44.952821 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 603) took 1665 ms. Trace:
I20260709 12:18:44.953647 31719 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:44.953154 28676 rpcz_store.cc:276] 0709 12:18:43.286969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.287066 (+    97us) service_pool.cc:224] Handling call
0709 12:18:43.287354 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:43.296057 (+  8703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.296083 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:43.296854 (+   771us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.583020 (+286166us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:43.583065 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.583134 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:44.802608 (+1219474us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:44.952537 (+149929us) raft_consensus.cc:1685] finished
0709 12:18:44.952558 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.952762 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8281,"raft.queue_time_us":11209,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":8094,"spinlock_wait_cycles":7587328,"thread_start_us":207416,"threads_started":1,"wal-append.queue_time_us":263303}
I20260709 12:18:44.957762 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:44.958806 31704 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:44.957787 28601 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:44.963904 29322 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:44.925861 31690 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:44.964533 29325 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:44.958839 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:44.942320 31740 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:44.935230 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:44.965041 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:44.969432 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.970892 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2143) took 1167 ms. Trace:
I20260709 12:18:44.971005 28603 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:44.971331 28606 rpcz_store.cc:276] 0709 12:18:43.803244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.930867 (+127623us) service_pool.cc:224] Handling call
0709 12:18:44.970673 (+1039806us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54003d2f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:44.970836 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502017920}
I20260709 12:18:44.972276 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:44.911158 31449 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:18:44.982475 31700 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:44.998325 28599 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:45.001168 28599 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:44.995595 31574 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.002882 31655 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.003175 31574 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:45.021991 31758 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.003s
I20260709 12:18:45.024758 31574 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.026149 31449 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:45.026732 28606 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:45.026965 31748 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.027637 31449 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.028129 28677 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:44.973527 31690 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.028635 31766 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.030059 31676 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:45.032488 31468 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:45.032914 31721 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.020s	user 0.013s	sys 0.000s
I20260709 12:18:45.033480 31721 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:45.033958 31721 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.034718 31655 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.035972 31721 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:45.037086 31781 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:18:44.966712 31780 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:45.037818 31780 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.008847 31719 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:45.039393 31719 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.039850 31780 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.040334 31740 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:45.047271 31740 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:45.047659 31740 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:45.048575 29317 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:45.050547 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 115603us
I20260709 12:18:45.052744 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:45.041260 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.054924 28749 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.046178 28755 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:45.056303 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:45.057029 28755 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:45.055611 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.059065 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:45.043174 28756 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:45.042451 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.061579 28754 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.061487 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.044476 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 2189) took 1207 ms. Trace:
I20260709 12:18:45.040891 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:45.069628 28749 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:45.069896 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:45.070852 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.070946 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.062454 28750 rpcz_store.cc:276] 0709 12:18:43.837016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.838183 (+  1167us) service_pool.cc:224] Handling call
0709 12:18:45.044248 (+1206065us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b54003e8d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:45.044386 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85897600}
I20260709 12:18:45.076920 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:45.083413 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.084141 28756 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:45.084120 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 54231.6us
I20260709 12:18:45.085839 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.086185 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.087761 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.088661 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:45.090740 28553 auto_rebalancer.cc:893] Removing replace marker failed: Replica e3ce74ba14714b4dbd2d75e27f34eb0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:45.091341 28553 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:18:45.091718 28553 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:18:45.102319 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.107936 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.101933 31729 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:45.112613 31749 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:45.113150 30962 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:45.113556 31677 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:45.116550 31677 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.116607 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.114638 31784 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:45.116982 31677 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.113981 31780 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:45.042775 31719 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.137712 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.135192 28754 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
W20260709 12:18:45.147719 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 88726.7us
I20260709 12:18:45.148532 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.104058 31676 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:45.155211 28756 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:45.157577 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.097151 31687 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:45.170099 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:45.161844 31620 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:45.162587 31562 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:45.162675 31719 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:45.164573 31780 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.167269 31738 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:45.170352 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:45.136613 31576 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.147773 31729 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.184794 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.120090 31759 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.206947 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.209088 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1900) took 1246 ms. Trace:
I20260709 12:18:45.170284 31687 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:45.146489 31749 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:18:45.209628 28678 rpcz_store.cc:276] 0709 12:18:43.963110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.964039 (+   929us) service_pool.cc:224] Handling call
0709 12:18:43.964463 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:44.007084 (+ 42621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.007143 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.015376 (+  8233us) log.cc:844] Serialized 26 byte log entry
0709 12:18:44.990835 (+975459us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18003056e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:18:45.001321 (+ 10486us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:45.001361 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.001429 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.208692 (+207263us) raft_consensus.cc:1685] finished
0709 12:18:45.208721 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.209004 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85960,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":25441,"spinlock_wait_cycles":7573888,"thread_start_us":10155,"threads_started":1,"wal-append.queue_time_us":927135}
W20260709 12:18:45.173331 31792 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:18:45.213996 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.151454 31707 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:18:45.183138 31676 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:45.235255 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:45.173171 31784 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:45.181298 31562 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:45.245926 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:45.233498 31743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.020s	sys 0.028s
I20260709 12:18:45.248817 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.232084 31408 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:45.232149 31687 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.235549 31749 consensus_queue.cc:1243] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:45.266732 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:45.267479 28756 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:45.247987 31772 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.244954 31768 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:45.271399 28648 connection.cc:256] RPC call timeout handler was delayed by -1.5775952240001061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 12:18:45.252957 31743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.021s	sys 0.029s
W20260709 12:18:45.274564 28648 connection.cc:256] RPC call timeout handler was delayed by -1.5568952240000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 12:18:45.247033 31620 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:45.253527 31408 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:45.251044 31562 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:45.250459 31664 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.280293 28678 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:45.285648 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.286046 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.207389 31738 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.211051 31576 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.287395 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:45.269707 31709 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:45.290014 28749 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:45.287122 31408 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.206120 31780 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:45.297185 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.301488 31392 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.302101 31759 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.301541 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1795) took 2110 ms. Trace:
I20260709 12:18:45.308226 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:45.273643 31721 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.346593 28747 rpcz_store.cc:276] 0709 12:18:43.190743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.386742 (+195999us) service_pool.cc:224] Handling call
0709 12:18:43.843203 (+456461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:43.843398 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.843420 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:43.843464 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:43.843496 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.843568 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.301387 (+1457819us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54001c5a50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:45.301486 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048978304}
W20260709 12:18:45.311609 28602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2146) took 1487 ms (client timeout 1894 ms). Trace:
W20260709 12:18:45.316939 31790 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:18:45.276154 31743 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:45.317519 31798 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:45.322574 29318 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.361109 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 522) took 2334 ms. Trace:
I20260709 12:18:45.326309 31740 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.329921 31690 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.333024 31676 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.335220 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:45.398972 28601 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:45.353226 31709 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:45.338183 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.403031 28753 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:45.339797 31677 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.404798 31700 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.405325 31700 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.406495 31677 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.407414 31700 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.344127 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.274322 31768 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:45.310335 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.352487 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:45.353397 28605 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:18:45.414675 28605 pending_rounds.cc:85] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 5
I20260709 12:18:45.414872 28747 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:45.414918 28605 pending_rounds.cc:107] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:18:45.415302 28605 raft_consensus.cc:2889] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:45.350539 28602 rpcz_store.cc:269] 0709 12:18:43.823903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.941404 (+117501us) service_pool.cc:224] Handling call
0709 12:18:45.311389 (+1369985us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54001234d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:45.311544 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153899392}
I20260709 12:18:45.355629 28606 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:45.416419 28606 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:45.367110 31392 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.368721 31576 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.368983 31743 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.371606 31798 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:45.347888 31449 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.379539 29318 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:45.386287 28749 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:45.526510 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:45.387302 28598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2144) took 1583 ms (client timeout 1962 ms). Trace:
W20260709 12:18:45.529450 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 108796us
I20260709 12:18:45.361539 28748 rpcz_store.cc:276] 0709 12:18:43.022197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.255373 (+233176us) service_pool.cc:224] Handling call
0709 12:18:43.255670 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:43.255865 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.255888 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:43.256330 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.390689 (+134359us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:43.426822 (+ 36133us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.481715 (+ 54893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.481815 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.329204 (+1847389us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18004457e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1
0709 12:18:45.330701 (+  1497us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b18004457e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:18:45.332764 (+  2063us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b18004457e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1
0709 12:18:45.356457 (+ 23693us) raft_consensus.cc:1685] finished
0709 12:18:45.356489 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.356609 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37740,"prepare.run_wall_time_us":36,"raft.queue_time_us":46319,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":9122,"spinlock_wait_cycles":34008064,"thread_start_us":184021,"threads_started":2,"wal-append.queue_time_us":216635}
I20260709 12:18:45.389401 28607 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:45.392370 28754 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:45.403556 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.336624 31748 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:45.412114 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68057.6us
I20260709 12:18:45.420775 31773 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 12:18:45.421469 31746 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.982s	user 0.002s	sys 0.002s
I20260709 12:18:45.417179 28606 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:45.517966 31801 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:18:45.525156 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.570595 28602 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:45.572021 28678 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:45.590302 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:45.590888 28674 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.590790 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:45.591663 28678 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.403817 28679 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:45.570744 28598 rpcz_store.cc:269] 0709 12:18:43.814508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.075971 (+261463us) service_pool.cc:224] Handling call
0709 12:18:45.387140 (+1311169us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54002c1854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:45.387243 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59843456}
W20260709 12:18:45.577416 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 300317us
I20260709 12:18:45.596341 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:45.597129 28648 connection.cc:256] RPC call timeout handler was delayed by -1.4389952240001094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2336s for a response
W20260709 12:18:45.597707 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 692723us
W20260709 12:18:45.598920 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2868952240000908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2505s for a response
W20260709 12:18:45.599748 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.435045 28680 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:45.602244 28598 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:45.601423 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.604460 31748 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:45.604717 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:45.578712 28606 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.431843 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:45.616918 28674 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
W20260709 12:18:45.582499 31668 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:18:45.583871 31744 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:45.584424 31443 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:45.576872 31753 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:45.532290 28605 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:45.410758 31664 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:45.528957 31749 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.608855 28571 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:45.430438 31768 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:45.535570 31408 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.619280 28678 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:45.637072 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.637629 28678 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:45.421806 31562 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.528398 31740 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.528756 31690 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.411372 31759 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.631969 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 704791us
I20260709 12:18:45.629613 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.634186 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:45.422914 31677 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:45.637987 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:45.666954 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.667845 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:45.668641 28598 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:45.670074 28606 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:18:45.638904 28678 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:45.671128 28606 pending_rounds.cc:85] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 6
I20260709 12:18:45.671403 28606 pending_rounds.cc:107] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:18:45.671640 28606 raft_consensus.cc:2889] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:45.640377 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.640944 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.635934 31766 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:45.638332 31753 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.643420 31664 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.618314 31772 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:45.644670 31798 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.645643 31477 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.641583 31749 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.523129 31709 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:45.646657 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 74311.2us
I20260709 12:18:45.653836 29326 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:45.621341 31744 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:45.525661 31780 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.669806 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:45.674954 28676 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:45.629678 31443 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:45.577482 31449 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.676985 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:45.681809 31784 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:45.680644 28682 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:45.725792 31784 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.678252 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:45.727596 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.696043 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.696514 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:45.728683 28605 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:45.708091 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 293876us
I20260709 12:18:45.648736 31704 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:45.647902 31468 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.718264 28676 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:45.746893 28676 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:45.677719 31718 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:45.716355 28571 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:45.721777 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:45.753453 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:45.754009 29326 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.745554 31440 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.721838 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 117164us
I20260709 12:18:45.674584 31677 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.714710 31477 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.631541 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 752) took 2119 ms. Trace:
W20260709 12:18:45.771323 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47639.2us
I20260709 12:18:45.726408 28674 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:45.681234 31759 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.713619 31690 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:18:45.736904 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:45.721084 31772 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.783175 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.693281 31740 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:45.738983 31780 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.751384 28750 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
W20260709 12:18:45.775908 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 59645.1us
I20260709 12:18:45.726382 31664 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.779603 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.756233 31627 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.787149 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:45.771849 31677 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.793836 28571 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:45.782166 31718 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:45.785013 31770 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.800144 28674 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:45.781337 31707 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:45.756146 31468 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.771131 31440 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.809046 29323 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:45.813755 30980 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:45.817479 31638 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:18:45.817677 31774 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:18:45.787585 31748 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:18:45.825958 31777 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.826393 31756 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:45.830896 29326 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:45.798056 31747 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:45.781432 31744 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.824054 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:18:45.868966 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45015.5us
I20260709 12:18:45.795203 31664 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:18:45.871758 31664 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:45.872058 31562 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.863601 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:45.790297 31780 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.863576 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:45.792361 31443 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.795516 31627 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.835135 31576 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:45.871101 31408 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.874002 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:45.872155 31664 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:45.895128 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:45.777875 29318 rpcz_store.cc:276] 0709 12:18:43.503439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.505335 (+  1896us) service_pool.cc:224] Handling call
0709 12:18:43.526530 (+ 21195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.226939 (+700409us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400660420. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f6dc0 00007f6fe3a811c0 00007f6fe3a82231 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c
0709 12:18:45.322155 (+1095216us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b58004901d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39db0aa 00007f6fe3a5d447 00007f6fe3a75fe7 00007f6fe3a777de 00007f6fe3a81b49 00007f6fe3a82416 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4
0709 12:18:45.574057 (+251902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.618203 (+ 44146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420896768}
I20260709 12:18:45.886547 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 613) took 1011 ms. Trace:
W20260709 12:18:45.836653 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67978.4us
I20260709 12:18:45.906450 28677 rpcz_store.cc:276] 0709 12:18:44.874717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.875894 (+  1177us) service_pool.cc:224] Handling call
0709 12:18:44.884206 (+  8312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:45.055024 (+170818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.886277 (+831253us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003b7254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:45.886478 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330566912}
I20260709 12:18:45.880070 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.887585 28607 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:45.866032 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.908885 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.899376 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:45.914768 28749 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:45.916040 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:45.885914 31803 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260709 12:18:45.917932 28749 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.854854 31756 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:45.876323 31687 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.598s	user 0.002s	sys 0.005s
I20260709 12:18:45.854206 31731 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.918464 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:45.847324 31759 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.845357 31749 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:45.877414 31468 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.841027 31602 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:45.865017 31773 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.868266 31574 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:18:45.883613 31744 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.830049 31770 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.877148 31477 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.929199 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.920307 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:45.986582 28677 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:45.927764 31756 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:45.886247 31768 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:45.937595 31440 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:45.938117 31718 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.940922 31706 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.941129 31747 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:45.875684 31449 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:45.834270 31743 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:18:45.864255 31821 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:18:45.956941 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:45.941543 31704 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:45.865386 31777 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.975668 28749 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
W20260709 12:18:45.979923 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.978915 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76795.8us
I20260709 12:18:46.018543 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:45.841022 31810 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:18:45.925729 31443 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:45.924817 31753 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:45.941952 31741 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:45.990754 30980 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 12:18:46.007247 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 50428.2us
I20260709 12:18:45.930176 31664 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.008107 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:46.041996 28748 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 4: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:46.009764 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:46.010864 31824 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.952903 31602 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:46.019923 28675 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:46.089076 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 189761us
I20260709 12:18:45.931288 31687 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:46.035166 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:46.098558 31664 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:46.127424 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 92313.3us
I20260709 12:18:45.990132 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:46.128829 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:46.129923 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:46.130964 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:46.110296 31704 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.133572 31690 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:46.109946 31780 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.137651 31823 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:46.138159 31823 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:46.138558 31823 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:46.139513 31825 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:46.139864 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:46.140506 31813 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 12:18:46.065372 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:46.078362 31772 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:46.089448 31814 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:18:45.942162 31731 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:45.986428 31773 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.068149 31741 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:46.068354 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:46.065352 28755 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:46.079396 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1809) took 1044 ms. Trace:
I20260709 12:18:46.072912 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:46.124876 31711 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:45.971428 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 43652.1us
I20260709 12:18:46.011823 31747 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:46.187981 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.175199 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:46.238111 28748 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:46.090471 31766 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:46.098332 31655 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.070026 31824 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.237813 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:46.283089 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45362us
I20260709 12:18:46.283690 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:46.284533 28599 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 8 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:18:46.282634 29326 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:46.282611 28604 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:46.187321 31780 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.117156 31576 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:46.228163 31392 consensus_meta.cc:287] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 12:18:46.131482 29318 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEARNER]: Advancing to term 9
W20260709 12:18:46.227293 31801 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:46.142284 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1771) took 1268 ms. Trace:
I20260709 12:18:46.241655 28751 rpcz_store.cc:276] 0709 12:18:45.035125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.081683 (+ 46558us) service_pool.cc:224] Handling call
0709 12:18:45.086910 (+  5227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:45.100549 (+ 13639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:45.100577 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:45.123757 (+ 23180us) log.cc:844] Serialized 26 byte log entry
0709 12:18:45.252040 (+128283us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:45.252078 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:45.252145 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.885329 (+633184us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:46.069767 (+184438us) raft_consensus.cc:1685] finished
0709 12:18:46.069790 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.079309 (+  9519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29100,"raft.queue_time_us":13412,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":10896,"spinlock_wait_cycles":50433280,"thread_start_us":77810,"threads_started":1,"wal-append.queue_time_us":230183}
I20260709 12:18:46.226317 31777 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:46.221159 31768 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:46.292488 28602 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:46.216192 31627 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:46.226998 31770 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:46.242444 31711 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:46.245556 29325 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:46.245571 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1810) took 1210 ms. Trace:
I20260709 12:18:46.296278 28752 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:46.237053 31826 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:46.268898 31706 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.302450 29326 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:46.280618 31712 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.305523 28673 rpcz_store.cc:276] 0709 12:18:44.873877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.874017 (+   140us) service_pool.cc:224] Handling call
0709 12:18:44.874278 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.874483 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:44.889554 (+ 15071us) log.cc:844] Serialized 14 byte log entry
0709 12:18:46.141688 (+1252134us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b1800405520. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a
0709 12:18:46.141928 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:46.141990 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:46.142050 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.142117 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.142231 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14892,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":33551,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":32904,"spinlock_wait_cycles":6812416,"thread_start_us":13164,"threads_started":1,"wal-append.queue_time_us":54095,"wal-append.run_cpu_time_us":1180,"wal-append.run_wall_time_us":1009055}
I20260709 12:18:46.244686 31823 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:46.308784 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.013s
I20260709 12:18:46.229259 31677 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.282125 31687 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:46.293641 31709 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:46.323096 28755 rpcz_store.cc:276] 0709 12:18:45.035358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.082341 (+ 46983us) service_pool.cc:224] Handling call
0709 12:18:46.041545 (+959204us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:46.041723 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:46.245226 (+203503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.245503 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6562176}
I20260709 12:18:46.331470 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:46.330293 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.000s	sys 0.014s
W20260709 12:18:46.334546 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 557730us
I20260709 12:18:46.329808 28673 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:46.336767 28677 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:46.338225 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:46.338985 29325 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:46.296257 31655 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.298091 31780 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:46.294027 31772 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:46.343096 28678 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:46.343288 28756 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 6. Ops: []
I20260709 12:18:46.331228 31837 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:44.438668 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:46.334141 31704 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.350210 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:46.364132 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.344964 31709 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:46.371580 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:46.374709 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:46.366603 31676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.006s	sys 0.014s
I20260709 12:18:46.356334 31837 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:46.382174 31772 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:46.382890 31739 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.335592 31712 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:46.379554 31676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.007s	sys 0.014s
I20260709 12:18:46.387184 31772 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.387719 31773 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.387570 31831 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:18:46.330968 31741 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.387989 31739 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:46.370373 31704 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:46.410265 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 120723us
I20260709 12:18:46.426990 31833 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.427755 31704 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:46.427628 31833 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.348173 31576 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.428304 31704 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.434403 31704 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.435575 31587 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:46.428560 31754 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:46.429219 31676 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.425185 31747 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:46.456236 31840 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:18:46.355815 31711 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:46.457598 31817 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.658s	user 0.002s	sys 0.000s
I20260709 12:18:46.459040 31739 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:46.457717 31838 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:18:46.438004 31704 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.449671 31826 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:46.438197 31731 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.449846 31824 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.392103 31810 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:18:46.488040 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:46.489506 28680 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:46.490056 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:46.489720 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:46.495383 28677 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
W20260709 12:18:46.497295 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.567117 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.580263 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:46.480072 31677 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.599393 31655 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
W20260709 12:18:46.603554 31849 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:18:46.604166 31855 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.604760 31855 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:46.605774 31844 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:18:46.607081 31855 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:46.607302 31842 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:18:46.432687 31709 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:46.580385 30980 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.616957 30980 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.619720 30980 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:46.580291 31687 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:46.620576 31687 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:46.429610 31837 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:46.622573 31687 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:46.622695 31837 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:46.471518 31676 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.582684 31824 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.492565 31664 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:46.633760 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 120591us
W20260709 12:18:46.604823 31847 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:18:46.470984 31754 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.592724 31780 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:46.636883 31824 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.594496 31811 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:46.489403 31826 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:46.659431 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.651027 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:46.637346 31772 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:46.648097 31718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.096s
I20260709 12:18:46.687561 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:46.661341 31831 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:46.688222 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.650400 31811 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:46.645975 31664 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.661005 31853 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:46.685956 31443 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.003s
W20260709 12:18:46.716336 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.729321 31811 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.733065 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:46.687397 31718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.011s	sys 0.097s
I20260709 12:18:46.696321 31712 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.755307 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:46.757290 29318 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEARNER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:46.761952 31824 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.763269 31826 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.699607 31831 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.701447 31852 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:46.778026 31852 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:46.778744 31836 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.641s	user 0.003s	sys 0.000s
I20260709 12:18:46.730803 31664 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:46.781699 31756 consensus_meta.cc:287] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.004s
I20260709 12:18:46.734800 31853 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.782117 31756 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:46.698978 31851 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:46.777374 31754 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:46.780165 31852 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:47.193418 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 535) took 1524 ms. Trace:
I20260709 12:18:46.791486 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 759) took 1828 ms. Trace:
I20260709 12:18:46.850616 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1817) took 3220 ms. Trace:
I20260709 12:18:47.211840 28603 rpcz_store.cc:276] 0709 12:18:43.606031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.090273 (+484242us) service_pool.cc:224] Handling call
0709 12:18:44.970836 (+880563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.971445 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.826158 (+1854713us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54003d2f50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:46.826320 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024213376}
W20260709 12:18:46.788149 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.213848 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:46.912762 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:47.247118 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.851990 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 746) took 1217 ms. Trace:
W20260709 12:18:47.247750 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.045058 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 744) took 1426 ms. Trace:
I20260709 12:18:47.209657 28756 rpcz_store.cc:276] 0709 12:18:45.668887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.676629 (+  7742us) service_pool.cc:224] Handling call
0709 12:18:45.711367 (+ 34738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:46.351202 (+639835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.193055 (+841853us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b5400115154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:47.193331 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452832000}
I20260709 12:18:47.041676 29322 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:47.051435 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.958386 29325 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:47.256731 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:47.257638 28680 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:47.259665 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:47.260380 28680 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:46.909929 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.877478 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:47.263427 28677 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:47.250252 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 767) took 1516 ms. Trace:
I20260709 12:18:47.210105 29327 rpcz_store.cc:276] 0709 12:18:44.962729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.969652 (+  6923us) service_pool.cc:224] Handling call
0709 12:18:44.969923 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.970118 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:46.643731 (+1673613us) log.cc:844] Serialized 14 byte log entry
0709 12:18:46.787861 (+144130us) log.cc:844] Serialized 14 byte log entry
0709 12:18:46.789118 (+  1257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:46.789177 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:46.789234 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.789324 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.789472 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1674155,"prepare.queue_time_us":1674651,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":86,"raft.queue_time_us":8123,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"spinlock_wait_cycles":40402176,"thread_start_us":141830,"threads_started":1}
I20260709 12:18:46.879665 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:47.266696 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.266685 29322 rpcz_store.cc:276] 0709 12:18:45.733803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.040930 (+1307127us) service_pool.cc:224] Handling call
0709 12:18:47.041292 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:47.249999 (+208707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.250199 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:47.298084 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.248872 29323 rpcz_store.cc:276] 0709 12:18:45.618372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.618698 (+   326us) service_pool.cc:224] Handling call
0709 12:18:47.044793 (+1426095us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540007ab54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:47.044949 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279815040}
W20260709 12:18:47.322110 29320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.014s	sys 0.015s
W20260709 12:18:47.197265 31860 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:18:47.322678 29320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.014s	sys 0.015s
I20260709 12:18:47.326159 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1909) took 1801 ms. Trace:
I20260709 12:18:47.326670 28679 rpcz_store.cc:276] 0709 12:18:45.525065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.597172 (+ 72107us) service_pool.cc:224] Handling call
0709 12:18:45.597471 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:45.792889 (+195418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:45.792915 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:45.804914 (+ 11999us) log.cc:844] Serialized 26 byte log entry
0709 12:18:46.116691 (+311777us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:46.116747 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.247007 (+1130260us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400299d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:47.247082 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:47.247142 (+    60us) raft_consensus.cc:1685] finished
0709 12:18:47.247164 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:47.326063 (+ 78899us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3433,"raft.queue_time_us":4897,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13048,"spinlock_wait_cycles":448656640,"thread_start_us":287853,"threads_started":1,"wal-append.queue_time_us":392976,"wal-append.run_cpu_time_us":1637,"wal-append.run_wall_time_us":1025453}
W20260709 12:18:47.333566 29317 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.019s	sys 0.012s
I20260709 12:18:47.334558 29327 pending_rounds.cc:85] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 8
I20260709 12:18:47.335052 29327 pending_rounds.cc:107] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:18:47.335332 29327 raft_consensus.cc:2889] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:47.336128 29317 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.020s	sys 0.012s
I20260709 12:18:47.248961 31831 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:47.247660 29321 rpcz_store.cc:276] 0709 12:18:45.634782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.634919 (+   137us) service_pool.cc:224] Handling call
0709 12:18:45.642342 (+  7423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:45.642590 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:46.644581 (+1001991us) log.cc:844] Serialized 14 byte log entry
0709 12:18:46.851417 (+206836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:46.851549 (+   132us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:46.851630 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:46.851760 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:46.851926 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1010803,"prepare.queue_time_us":1045181,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":13488,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":1486,"thread_start_us":197223,"threads_started":1}
W20260709 12:18:47.317142 31776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.009s	sys 0.039s
I20260709 12:18:47.340534 29323 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:47.341308 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.341933 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:47.091260 31813 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:46.962586 31738 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:47.246650 31855 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.794126 31747 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:47.071202 31821 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:46.816121 31664 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:47.354123 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.344750 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 771) took 1609 ms. Trace:
I20260709 12:18:47.373814 29323 rpcz_store.cc:276] 0709 12:18:45.734970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.340098 (+1605128us) service_pool.cc:224] Handling call
0709 12:18:47.340350 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:47.344489 (+  4139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.344691 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:47.365089 28680 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:46.967061 31811 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:47.246869 31837 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.782641 31833 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:47.376255 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 189066us
I20260709 12:18:47.390096 29322 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:46.862898 31853 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:47.264971 31477 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.322877 31754 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:47.381655 29321 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:47.324792 31443 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:47.363006 31776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.015s	sys 0.041s
I20260709 12:18:46.866044 31602 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.368954 31831 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.394344 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 715) took 1599 ms. Trace:
I20260709 12:18:47.395613 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 772) took 1645 ms. Trace:
I20260709 12:18:47.408682 29321 rpcz_store.cc:276] 0709 12:18:45.749765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.344023 (+1594258us) service_pool.cc:224] Handling call
0709 12:18:47.375266 (+ 31243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:47.395358 (+ 20092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.395557 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:47.408583 29322 rpcz_store.cc:276] 0709 12:18:45.794458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.371502 (+1577044us) service_pool.cc:224] Handling call
0709 12:18:47.389852 (+ 18350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:47.394024 (+  4172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.394272 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:47.267170 31851 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:47.385890 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.383162 31738 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:47.381094 31747 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.415108 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.389130 31676 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:47.444495 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.376634 31813 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:47.445376 28607 raft_consensus.cc:2410] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:47.443811 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 721) took 1642 ms. Trace:
I20260709 12:18:47.380475 31855 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.445993 29321 rpcz_store.cc:276] 0709 12:18:45.801224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.409808 (+1608584us) service_pool.cc:224] Handling call
0709 12:18:47.443310 (+ 33502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:47.443497 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.443522 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:47.443563 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:47.443600 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.443650 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:47.443751 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:47.380756 31821 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:47.381412 31664 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.391690 31837 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.453189 31851 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:47.447127 31776 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.453850 31837 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:47.425139 31831 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.400758 31754 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.398618 31477 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.457863 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.481758 28607 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:47.482010 31832 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:47.482390 31832 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:47.483196 31832 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:47.483915 31862 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:18:47.485021 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1906) took 2080 ms. Trace:
I20260709 12:18:47.485450 28675 rpcz_store.cc:276] 0709 12:18:45.404333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.404484 (+   151us) service_pool.cc:224] Handling call
0709 12:18:45.404794 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:46.124663 (+719869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.484749 (+1360086us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400252954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:47.484942 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414198016}
W20260709 12:18:47.487205 31859 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:18:47.489610 31587 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:47.490154 31587 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.492487 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:47.493306 28680 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:47.494132 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:47.494676 28679 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:47.494918 31664 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:47.495558 31706 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:47.406114 31443 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.474707 31855 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:47.475849 31756 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:47.476174 31813 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:47.445132 31676 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:47.413556 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 766) took 1678 ms. Trace:
I20260709 12:18:47.474233 31821 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:47.484246 31832 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.505314 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.448283 31738 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:47.450455 31602 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:47.536937 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:47.537778 28603 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6. Re-sending same reply.
I20260709 12:18:47.541245 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:47.542155 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:47.543215 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:47.496260 31706 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.545044 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 774) took 1449 ms. Trace:
I20260709 12:18:47.545553 29321 rpcz_store.cc:276] 0709 12:18:46.090191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.451537 (+1361346us) service_pool.cc:224] Handling call
0709 12:18:47.498400 (+ 46863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:47.506148 (+  7748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.506176 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:47.538824 (+ 32648us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:47.538908 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.539003 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:47.539145 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42636}
I20260709 12:18:47.497148 31587 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:47.454057 31776 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:47.570302 31776 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:47.571331 31776 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:47.574345 29322 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:47.576357 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.583841 28607 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 4.
I20260709 12:18:47.585028 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:47.576812 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:47.578800 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.579119 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:47.589509 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:47.581576 28752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1805) took 2547 ms (client timeout 1765 ms). Trace:
I20260709 12:18:47.594462 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:47.577493 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:47.592916 28752 rpcz_store.cc:269] 0709 12:18:45.034183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.052503 (+ 18320us) service_pool.cc:224] Handling call
0709 12:18:47.581321 (+2528818us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54003e9254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:47.581459 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2858166528}
I20260709 12:18:47.559185 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:47.560381 31587 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:47.561092 31756 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:47.561309 31831 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:47.503204 29318 rpcz_store.cc:276] 0709 12:18:45.733566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.777012 (+1043446us) service_pool.cc:224] Handling call
0709 12:18:47.343188 (+566176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:47.376240 (+ 33052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.384109 (+  7869us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:47.387410 (+  3301us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:47.393229 (+  5819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.399075 (+  5846us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:47.411985 (+ 12910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:47.599577 28603 raft_consensus.cc:2376] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6. Re-sending same reply.
I20260709 12:18:47.602905 31693 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:47.603031 31587 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:47.603986 31739 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:47.505565 31676 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:47.611053 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:47.614749 28604 raft_consensus.cc:2376] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5. Re-sending same reply.
I20260709 12:18:47.615242 28603 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:47.608104 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:47.647571 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.604571 31756 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.609948 31739 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:18:47.620291 31868 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:18:47.607122 31587 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:47.651973 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:47.653009 31874 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.576824 31738 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:47.654268 28603 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:47.765372 28679 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
W20260709 12:18:47.712677 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:47.677292 28647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.541s (SENT) [suppressed 37 similar messages]
I20260709 12:18:47.706614 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.133104 28600 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:48.101186 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.005s	sys 0.038s
I20260709 12:18:48.073879 31739 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:47.760372 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:48.112886 31721 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:48.135314 31587 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.135411 31721 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:47.751457 28598 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
W20260709 12:18:48.133874 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.005s	sys 0.040s
I20260709 12:18:47.705989 31664 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:48.137560 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 1.25783e+06us
I20260709 12:18:48.137909 31664 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.138504 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:48.140614 31676 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:48.140998 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 718) took 2340 ms. Trace:
W20260709 12:18:47.682461 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.141448 29323 rpcz_store.cc:276] 0709 12:18:45.800302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.389352 (+1589050us) service_pool.cc:224] Handling call
0709 12:18:47.442979 (+ 53627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:47.444137 (+  1158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.444277 (+   140us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:47.534622 (+ 90345us) log.cc:844] Serialized 572 byte log entry
0709 12:18:47.534832 (+   210us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:47.534866 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.534956 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.140804 (+605848us) raft_consensus.cc:1685] finished
0709 12:18:48.140825 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.140943 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:47.649868 31756 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:48.143173 31676 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:48.144151 31676 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.130260 28601 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:47.861889 31443 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:48.131620 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.150755 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.152170 28604 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:47.856941 31706 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:48.164367 29290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.011s	sys 0.016s
W20260709 12:18:48.166081 29290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.011s	sys 0.016s
W20260709 12:18:48.166397 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 623042us
W20260709 12:18:48.175935 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.176646 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.177011 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.158489 28719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.012s	sys 0.034s
W20260709 12:18:48.181216 28719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.012s	sys 0.034s
W20260709 12:18:48.186165 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.187815 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.189519 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.027s	sys 0.026s
I20260709 12:18:48.170987 31888 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:18:48.199136 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.027s	sys 0.026s
W20260709 12:18:48.193130 29322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.019s	sys 0.016s
W20260709 12:18:48.200670 29322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.019s	sys 0.016s
I20260709 12:18:47.654963 31388 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:48.193284 29326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 713) took 2395 ms (client timeout 1590 ms). Trace:
W20260709 12:18:48.191186 31602 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.000s
I20260709 12:18:48.188771 31822 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:48.204977 29326 rpcz_store.cc:269] 0709 12:18:45.794044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.873701 (+ 79657us) service_pool.cc:224] Handling call
0709 12:18:48.189627 (+2315926us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b5400587354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:48.189769 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907802496}
I20260709 12:18:48.189924 31831 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:48.214319 28604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
W20260709 12:18:48.218550 28606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.007s	sys 0.005s
I20260709 12:18:48.198266 31443 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:48.219002 28606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.007s	sys 0.005s
I20260709 12:18:48.163934 31874 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:48.203361 31888 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:48.213912 31784 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:48.217844 28604 raft_consensus.cc:606] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:48.263999 28750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1824) took 2845 ms (client timeout 2427 ms). Trace:
W20260709 12:18:48.264983 28750 rpcz_store.cc:269] 0709 12:18:45.418137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.573647 (+155510us) service_pool.cc:224] Handling call
0709 12:18:48.263753 (+2690106us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001b30d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:48.263907 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335987584}
W20260709 12:18:48.274080 29325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 712) took 2480 ms (client timeout 2100 ms). Trace:
W20260709 12:18:48.274485 29325 rpcz_store.cc:269] 0709 12:18:45.793733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.374490 (+580757us) service_pool.cc:224] Handling call
0709 12:18:48.273906 (+1899416us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b540047b8d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:48.274007 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318283648}
I20260709 12:18:48.275861 28601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc886982591478e97f84ddb724a679a"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:48.276386 28601 raft_consensus.cc:606] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:48.276737 28601 raft_consensus.cc:614] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:48.279320 28601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:48.251214 31602 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:48.208974 31388 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.486088 28754 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:18:48.488785 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.008s	sys 0.055s
I20260709 12:18:48.253285 31664 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:48.491047 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.008s	sys 0.055s
W20260709 12:18:48.491621 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.485144 28599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.011s	sys 0.035s
W20260709 12:18:48.495600 28599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.012s	sys 0.036s
I20260709 12:18:48.209388 31754 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.262540 31876 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.226368 31831 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:48.495483 31720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.009s	sys 0.077s
I20260709 12:18:48.513000 31664 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:48.532027 31756 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:48.534070 31832 consensus_meta.cc:287] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.997s	user 0.007s	sys 0.002s
I20260709 12:18:48.534173 31776 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.534803 31776 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.536473 31831 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.534252 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 753) took 1030 ms. Trace:
I20260709 12:18:48.537454 29322 rpcz_store.cc:276] 0709 12:18:47.503377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.575240 (+ 71863us) service_pool.cc:224] Handling call
0709 12:18:47.575561 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:47.575904 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.575932 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:47.577606 (+  1674us) log.cc:844] Serialized 52 byte log entry
0709 12:18:48.201982 (+624376us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:48.202041 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.202141 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.534009 (+331868us) raft_consensus.cc:1685] finished
0709 12:18:48.534028 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.534190 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":267251,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"thread_start_us":623948,"threads_started":1,"wal-append.queue_time_us":954525}
I20260709 12:18:48.538475 31880 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.539077 31880 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.539613 31756 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:48.541036 31676 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.514684 31721 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:48.254191 31443 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:48.541481 31880 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:48.524572 31720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.010s	sys 0.077s
I20260709 12:18:48.547103 31873 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.515141 31888 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:48.529482 31771 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.021s	sys 0.030s
W20260709 12:18:48.556274 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.546216 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.557564 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.548316 31887 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:48.543995 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 745) took 2923 ms. Trace:
I20260709 12:18:48.562614 29317 rpcz_store.cc:276] 0709 12:18:45.620820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.621083 (+   263us) service_pool.cc:224] Handling call
0709 12:18:45.621477 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:45.674780 (+ 53303us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:47.337737 (+1662957us) log.cc:844] Serialized 14 byte log entry
0709 12:18:47.653890 (+316153us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:47.654477 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:18:47.654639 (+   162us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:47.654848 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.717565 (+ 62717us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.543778 (+826213us) raft_consensus.cc:1685] finished
0709 12:18:48.543799 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.543923 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1042434,"prepare.queue_time_us":1026648,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":670443,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":223246,"thread_start_us":950929,"threads_started":3,"wal-append.queue_time_us":1164091}
I20260709 12:18:48.552592 28602 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:48.493726 31602 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:48.529322 31783 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.022s	sys 0.030s
W20260709 12:18:48.570294 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.559818 31693 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.950s	user 0.010s	sys 0.001s
I20260709 12:18:48.539491 31711 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:48.546183 31874 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:48.566129 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 805764us
W20260709 12:18:48.556699 31771 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.021s	sys 0.030s
I20260709 12:18:48.517210 31876 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:48.571453 31811 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.188s	user 0.012s	sys 0.001s
I20260709 12:18:48.547848 31443 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:48.556556 31664 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.556849 31873 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:48.571794 31783 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.022s	sys 0.030s
I20260709 12:18:48.565457 31676 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.567795 31721 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.566110 31440 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:48.578311 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.572501 28648 leader_election.cc:336] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.506s (SENT)
I20260709 12:18:48.573266 31768 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.618325 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.619083 29317 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:48.618995 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.619700 29326 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:48.619768 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.620314 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.620883 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.621083 29325 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:48.621304 28681 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:48.573374 31754 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:48.567149 31887 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.614684 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:48.620347 29318 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
W20260709 12:18:48.579890 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.631572 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.633127 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:48.571369 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 894018us
I20260709 12:18:48.576342 31776 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:48.634665 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 62212.2us
W20260709 12:18:48.636283 28648 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.667s (SENT)
W20260709 12:18:48.637379 28648 leader_election.cc:336] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.683s (SENT)
I20260709 12:18:48.637877 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:48.639673 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:48.577896 31757 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.610806 31745 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.640954 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:48.613387 31693 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.644750 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:48.654696 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.621821 31784 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:48.641834 28648 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.690s (SENT)
I20260709 12:18:48.579396 31874 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:48.621974 31443 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:48.666055 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:48.700814 29327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.017s	sys 0.019s
I20260709 12:18:48.701574 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:48.706578 29327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.017s	sys 0.019s
I20260709 12:18:48.707231 28682 raft_consensus.cc:2410] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:18:48.702957 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 61164.9us
I20260709 12:18:48.700152 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:48.616309 31676 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:48.714166 28648 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.711s (SENT)
I20260709 12:18:48.710032 31874 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:48.717150 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 536) took 3048 ms. Trace:
I20260709 12:18:48.642678 31831 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:48.665572 31832 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:48.730144 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:48.730782 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.033s
W20260709 12:18:48.731092 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.033s
I20260709 12:18:48.731014 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:48.731608 28682 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:48.720072 28648 leader_election.cc:336] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.723s (SENT)
I20260709 12:18:48.732530 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:48.643615 31865 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:48.618875 31721 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.665757 31856 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:48.717582 28754 rpcz_store.cc:276] 0709 12:18:45.669209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.670294 (+  1085us) service_pool.cc:224] Handling call
0709 12:18:48.264559 (+2594265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.490838 (+226279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.716966 (+226128us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b54001b30d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:48.717095 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5965185408}
I20260709 12:18:48.628451 31440 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.638900 31768 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.715411 31443 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.638796 31754 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.664920 31757 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.765460 31757 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:48.767359 29319 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:48.770164 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:48.706251 31822 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:18:48.730243 31832 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:48.773229 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 473310us
I20260709 12:18:48.666154 31693 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.777271 28674 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:48.708458 31784 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.783660 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.784497 28598 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:48.784572 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:48.785250 28607 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:48.787009 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:48.775579 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.739063 31893 raft_consensus.cc:2764] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:48.666347 31745 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.776639 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2172) took 1202 ms. Trace:
I20260709 12:18:48.790759 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:48.791220 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.792011 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:48.795732 28598 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:48.796419 28679 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:48.795842 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.792479 28682 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:48.792968 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:48.796977 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.775555 31832 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:48.793617 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.797573 28600 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
W20260709 12:18:48.799190 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.803769 28604 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 4: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:48.805308 31887 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.805902 31887 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.806506 31676 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.806422 31887 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:48.807243 31676 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:48.814803 28607 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:48.787002 31602 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:48.831646 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.841234 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1917) took 2979 ms. Trace:
I20260709 12:18:48.842036 28603 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:48.841688 28678 rpcz_store.cc:276] 0709 12:18:45.861722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.118435 (+256713us) service_pool.cc:224] Handling call
0709 12:18:46.245165 (+126730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:46.350943 (+105778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.840985 (+2490042us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b5400273b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:48.841172 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224796032}
I20260709 12:18:48.807888 31676 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:48.843827 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 349672us
I20260709 12:18:48.794565 31896 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:48.804486 31720 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:48.821019 31822 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:48.860885 31822 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:48.861963 31745 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:48.851538 31740 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:48.863451 31822 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.842478 31707 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:48.844261 31700 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.864820 31700 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:48.866199 31887 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:48.866803 31707 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:48.866998 31700 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:48.867825 31707 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:48.868371 31768 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.868898 31707 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:48.869084 31876 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:48.856151 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 136106us
W20260709 12:18:48.870253 31883 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 12:18:48.870724 28648 leader_election.cc:336] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.822s (SENT)
I20260709 12:18:48.871119 31693 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:48.871886 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2169) took 1298 ms. Trace:
I20260709 12:18:48.872668 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 768) took 3138 ms. Trace:
I20260709 12:18:48.874825 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:48.878504 28678 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
W20260709 12:18:48.878708 28721 connection.cc:256] RPC call timeout handler was delayed by -1.7288214820000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
W20260709 12:18:48.879122 28721 connection.cc:256] RPC call timeout handler was delayed by -1.710283575999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30950000000000005s for a response
W20260709 12:18:48.879514 28721 connection.cc:256] RPC call timeout handler was delayed by -1.5920214820000638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 12:18:48.880357 28721 connection.cc:256] RPC call timeout handler was delayed by -1.46618125100008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
W20260709 12:18:48.880726 28721 connection.cc:256] RPC call timeout handler was delayed by -1.2426550760001192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 12:18:48.881367 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:48.872238 28599 rpcz_store.cc:276] 0709 12:18:47.573415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.576888 (+  3473us) service_pool.cc:224] Handling call
0709 12:18:47.577222 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:47.577548 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.577580 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:47.578065 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:18:48.496065 (+918000us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:48.736745 (+240680us) log.cc:844] Serialized 14 byte log entry
0709 12:18:48.737197 (+   452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.737295 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.871690 (+134395us) raft_consensus.cc:1685] finished
0709 12:18:48.871708 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.871831 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":312669,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":7059,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":17122,"thread_start_us":1137695,"threads_started":2,"wal-append.queue_time_us":1030339}
I20260709 12:18:48.876713 29327 rpcz_store.cc:276] 0709 12:18:45.734104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.333973 (+1599869us) service_pool.cc:224] Handling call
0709 12:18:47.334353 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:47.707945 (+373592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.707991 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:47.708773 (+   782us) log.cc:844] Serialized 52 byte log entry
0709 12:18:48.561056 (+852283us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b480021c858. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe89a8aa1 00007f6fe899fb37 00007f6fe899f9ca 00007f6fe8a9726f 00007f6fe8a96f37 00007f6fe8aab55c 00007f6fe8aab508 00007f6fe8aab488 00007f6fe8aab443 00007f6fe8aaa6ec 00007f6fe79d4a96
0709 12:18:48.707698 (+146642us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:48.707742 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.707803 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.872210 (+164407us) raft_consensus.cc:1685] finished
0709 12:18:48.872229 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.872598 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2003,"raft.queue_time_us":4045,"raft.run_cpu_time_us":30607,"raft.run_wall_time_us":1215814,"spinlock_wait_cycles":10202368,"thread_start_us":1367863,"threads_started":2,"wal-append.queue_time_us":1081960}
I20260709 12:18:48.882442 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.883013 28599 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:48.884120 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:48.884755 28678 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:18:48.882826 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 1918) took 3020 ms. Trace:
I20260709 12:18:48.888288 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:48.888643 29319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 762) took 3925 ms (client timeout 3095 ms). Trace:
W20260709 12:18:48.889045 29319 rpcz_store.cc:269] 0709 12:18:44.963583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.964804 (+  1221us) service_pool.cc:224] Handling call
0709 12:18:48.888468 (+3923664us) spinlock_profiling.cc:243] Waited 3.8 s on lock 0x7b5400680e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:48.888573 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8734135552}
I20260709 12:18:48.889640 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.890131 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.890750 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.891220 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.886201 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:48.872407 28648 leader_election.cc:336] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.894s (SENT)
I20260709 12:18:48.891959 28754 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:48.889045 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.894411 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:48.890219 29325 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:48.895015 28756 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:48.895673 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.896771 29319 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:48.899326 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:48.899963 28755 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:48.901014 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:48.901665 28752 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:48.903267 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.904160 29325 raft_consensus.cc:2410] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:18:48.904896 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 70720us
I20260709 12:18:48.905373 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:48.905479 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:48.892426 28648 leader_election.cc:336] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.928s (SENT)
I20260709 12:18:48.907655 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:48.908546 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.906317 28750 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:48.907662 28747 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:48.938719 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:48.946787 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 54373.3us
W20260709 12:18:48.947796 28648 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.955s (SENT)
I20260709 12:18:48.948325 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:48.908721 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.938568 28756 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:48.950498 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.955957 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:48.956750 28678 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:48.964121 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:48.964634 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.964785 28675 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:48.965219 29319 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:48.966413 29319 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:48.879809 31902 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:48.967222 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.970110 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.964121 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.882984 31664 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.971107 29325 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:48.972849 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:48.970752 29321 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:48.974026 28678 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 3.
I20260709 12:18:48.974646 29325 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:48.978142 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:48.980780 28754 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:48.988395 29319 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:48.898372 31874 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:48.994375 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.000126 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:48.945111 31873 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:48.886197 31872 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:48.969305 31768 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:48.850479 31896 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:48.949375 31721 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.878099 31720 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:49.004935 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 106221us
I20260709 12:18:49.008045 28675 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:48.995218 31839 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:49.034592 31839 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:49.040308 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.046576 31876 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.046998 31876 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.047747 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.010946 31740 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.009207 28750 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:18:48.973282 31908 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:49.055970 31908 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.056519 31784 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.014221 31912 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:49.057006 31676 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:49.057526 31912 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:49.057871 31912 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:49.058818 31896 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:49.058668 31912 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:49.059957 31912 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:48.995716 31892 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:49.060534 31754 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.060791 31892 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:48.993150 31905 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.062958 31892 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:49.013100 31823 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:49.065797 31908 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.017642 31443 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.004567 31602 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.066875 31602 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.017702 31477 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:49.021138 31894 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:49.022256 31748 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.070012 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.005610 31893 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:18:49.023743 28682 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:49.083966 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.084611 28682 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:49.024892 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.025609 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.085711 28680 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:49.025739 31720 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:49.026746 31771 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:49.027737 31904 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:18:49.031152 31831 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.090703 31602 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.004683 31745 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:18:49.090878 31831 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.091399 31832 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.008145 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.092592 31711 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:49.093051 28605 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:18:49.054927 31740 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.094463 31832 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.095770 31740 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:48.989161 31902 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:49.070761 28599 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:18:49.097030 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.023531 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.097836 31902 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:49.092628 28678 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:49.099138 28679 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:49.074486 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.014389 31845 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:49.088394 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:48.999471 31693 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:18:49.053994 31876 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.101012 31693 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:49.101397 31693 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:49.102310 31693 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.103576 31693 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.087666 31748 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.110222 31587 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:49.110276 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.111037 28679 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:49.111443 31748 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.083621 31887 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.111843 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.109692 28680 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:49.093016 31711 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:49.117283 28675 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:49.117612 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.113415 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.113484 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.117167 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.119524 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.119105 28679 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:49.120258 28680 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:49.121147 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.122283 28680 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:49.115674 28755 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:49.086835 31776 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:49.127574 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.128222 28680 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:49.125129 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.129091 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.130306 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.130542 31707 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.126207 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.123914 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.131376 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.131405 28682 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:49.132315 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.133181 28679 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:49.127055 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.134536 28675 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 3.
I20260709 12:18:49.135469 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.136178 28675 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:49.144888 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 197120us
W20260709 12:18:49.145833 28648 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.017s (SENT)
I20260709 12:18:49.130064 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.149801 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.151665 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.153007 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:49.157269 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.162586 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.171703 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:49.173115 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 267133us
I20260709 12:18:49.123682 31832 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:49.148087 28648 leader_election.cc:336] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.096s (SENT)
I20260709 12:18:49.175549 29319 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:49.130977 31707 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:49.179507 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.183027 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.177711 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:49.185328 28573 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.765s (SENT)
I20260709 12:18:49.184051 31707 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.151261 31704 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:49.211076 31747 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:49.213267 31856 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.173101 31700 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:49.112396 31887 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:49.247177 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 92804.4us
W20260709 12:18:49.247400 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 96282.5us
I20260709 12:18:49.248106 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.222636 28675 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
W20260709 12:18:49.223084 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45501.1us
W20260709 12:18:49.220728 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 339393us
W20260709 12:18:49.225255 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.177762 31832 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.173627 31776 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:49.250223 29290 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:49.250658 31832 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.251245 31776 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.252058 29290 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:49.235419 31707 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:49.237046 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.240585 31893 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:49.248139 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.257154 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.222646 31726 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:18:49.174602 31912 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:18:49.224610 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 701) took 4633 ms. Trace:
I20260709 12:18:49.226869 31700 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.255263 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:49.258971 29320 rpcz_store.cc:276] 0709 12:18:44.586953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:44.589748 (+  2795us) service_pool.cc:224] Handling call
0709 12:18:44.660250 (+ 70502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:44.727190 (+ 66940us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:44.786470 (+ 59280us) log.cc:844] Serialized 14 byte log entry
0709 12:18:45.587445 (+800975us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18003d97e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe795358f 00007f6fe0992571 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd
0709 12:18:46.631049 (+1043604us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b18003d97e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:18:46.631390 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:18:47.338662 (+707272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:47.338958 (+   296us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:47.339179 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.339548 (+   369us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.219795 (+1880247us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b540042c050. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:49.219945 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1739003,"prepare.queue_time_us":1923229,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":18320,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":30760,"spinlock_wait_cycles":47364992,"thread_start_us":787807,"threads_started":3,"wal-append.queue_time_us":984923,"wal-append.run_cpu_time_us":26062,"wal-append.run_wall_time_us":2737892}
I20260709 12:18:49.255445 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.226581 31745 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:49.253098 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.262542 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:49.270131 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:49.270366 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.271832 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.272285 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.274236 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.270951 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:49.275163 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.277982 28675 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:49.279803 28682 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:49.284299 28599 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:49.256248 31477 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:49.256306 31893 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:49.293057 28648 leader_election.cc:336] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.962s (SENT)
I20260709 12:18:49.297745 31919 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:49.315497 31919 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.317061 31905 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:49.256907 31747 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:49.319101 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:49.286809 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.314370 31443 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:49.311218 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:49.327019 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:49.328608 31922 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:49.278846 31920 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:49.329526 31920 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.329870 31920 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:49.258142 31602 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 12:18:49.339330 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 89529.3us
I20260709 12:18:49.288666 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:49.342512 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:49.343436 31896 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.343833 31896 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.344236 31896 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.352319 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.353003 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.280143 31771 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:49.279413 31875 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:49.335556 31922 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:18:49.337651 31707 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.338030 31902 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.355324 31875 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:49.355676 31902 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.355891 31875 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.356127 31902 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.357909 31720 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.359104 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:49.323432 31893 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:49.338686 31926 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:49.274523 31700 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:49.353096 28750 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:49.354374 28754 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:49.354704 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.360113 31843 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:49.418850 31843 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:49.360980 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.420147 28756 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:49.361608 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.420917 31388 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:49.424490 31843 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.425594 31843 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:48.795308 28606 rpcz_store.cc:276] 0709 12:18:47.574390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.579192 (+  4802us) service_pool.cc:224] Handling call
0709 12:18:47.579495 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:47.579881 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:47.579911 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:47.580470 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 12:18:48.248548 (+668078us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:48.756171 (+507623us) log.cc:844] Serialized 14 byte log entry
0709 12:18:48.759183 (+  3012us) log.cc:844] Serialized 14 byte log entry
0709 12:18:48.761416 (+  2233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.761508 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:48.761561 (+    53us) raft_consensus.cc:1685] finished
0709 12:18:48.761579 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.776575 (+ 14996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4248,"prepare.queue_time_us":547427,"raft.queue_time_us":7049,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":13254,"spinlock_wait_cycles":6064640,"thread_start_us":1156021,"threads_started":2,"wal-append.queue_time_us":980047}
I20260709 12:18:49.429452 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:48.887712 28676 rpcz_store.cc:276] 0709 12:18:45.862325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.187343 (+325018us) service_pool.cc:224] Handling call
0709 12:18:48.541272 (+2353929us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:48.541465 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.541672 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:48.786308 (+244636us) log.cc:844] Serialized 14 byte log entry
0709 12:18:48.882487 (+ 96179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:48.882549 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:48.882595 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.882667 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:48.882773 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2730,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":3607,"spinlock_wait_cycles":15338880,"thread_start_us":340138,"threads_started":2}
I20260709 12:18:49.430506 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.431083 28606 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:49.434494 31700 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.367830 31902 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.370158 31771 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:49.285634 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:49.371423 31711 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:49.352385 31896 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.447198 31711 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.376734 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.448745 28749 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:49.377597 31839 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:49.378379 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.449752 28598 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:49.449944 31839 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:49.450762 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.308748 31822 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:18:49.451277 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:49.323280 31876 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.451612 31771 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.453338 31876 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:49.332605 31693 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:49.453975 31693 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.454358 31693 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:49.335074 31905 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:49.455474 31905 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.455825 31905 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:49.455994 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:49.275266 31745 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.458051 31745 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.458755 31739 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.385257 28748 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:49.385869 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.388991 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.460599 28752 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
W20260709 12:18:49.390328 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 119428us
W20260709 12:18:49.391857 28722 connection.cc:256] RPC call timeout handler was delayed by -2.1190028299999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 12:18:49.466909 28722 connection.cc:256] RPC call timeout handler was delayed by -2.0849243250002019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 12:18:49.467363 28722 connection.cc:256] RPC call timeout handler was delayed by -1.9462028299999474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 12:18:49.467716 28722 connection.cc:256] RPC call timeout handler was delayed by -1.6977064490001794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:18:49.468020 28722 connection.cc:256] RPC call timeout handler was delayed by -1.5478554789999635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 12:18:49.468413 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.279150 31704 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:18:49.393630 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.469569 28607 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:49.397650 31664 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:49.403718 31893 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.404735 31602 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:49.471596 31876 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.473994 31602 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:49.474486 31602 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:49.474244 31876 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.476341 31876 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:49.404651 31748 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:49.405289 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46258.1us
I20260709 12:18:49.477408 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 630) took 1986 ms. Trace:
I20260709 12:18:49.391227 31922 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:18:49.407459 31440 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.408568 31740 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:49.407402 31875 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:49.410413 31832 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.412206 31831 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.413008 31888 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.314095 31917 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:18:49.421046 28751 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
W20260709 12:18:49.338176 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51407.6us
W20260709 12:18:49.495057 28605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2159) took 2146 ms (client timeout 1690 ms). Trace:
I20260709 12:18:49.495754 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.495920 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.496351 28751 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:49.497200 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.497733 28751 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:49.497893 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.423233 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.498492 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.499018 28604 raft_consensus.cc:2376] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8. Re-sending same reply.
I20260709 12:18:49.435418 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.435175 31920 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.280283 31886 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.436609 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:49.437055 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:49.442638 28602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2168) took 1865 ms (client timeout 1825 ms). Trace:
W20260709 12:18:49.512984 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 76458us
W20260709 12:18:49.513195 28602 rpcz_store.cc:269] 0709 12:18:47.573104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.576565 (+  3461us) service_pool.cc:224] Handling call
0709 12:18:49.438477 (+1861912us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b5400093154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:49.438614 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2181429632}
I20260709 12:18:49.442154 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.340196 31919 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.457209 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:49.470485 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:49.518533 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48114.4us
I20260709 12:18:49.477916 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:49.477957 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:49.477900 28681 rpcz_store.cc:276] 0709 12:18:47.490717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.492558 (+  1841us) service_pool.cc:224] Handling call
0709 12:18:47.492859 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:48.621666 (+1128807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.477195 (+855529us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400299854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:49.477347 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594424704}
I20260709 12:18:49.486403 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:49.489763 28752 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:49.525626 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:49.526979 28752 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:49.490849 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.489823 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.527823 28748 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 4.
I20260709 12:18:49.491881 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.492558 28750 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:49.500857 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.502434 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.533138 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.499044 28751 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:49.477408 31887 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:49.495463 28605 rpcz_store.cc:269] 0709 12:18:47.340857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:47.341060 (+   203us) service_pool.cc:224] Handling call
0709 12:18:49.480482 (+2139422us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400217d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:49.487081 (+  6599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4020171520}
I20260709 12:18:49.539602 28752 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:49.504983 31896 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.509622 31440 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.510608 28749 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:49.477176 31905 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:49.487027 31902 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.541689 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.544559 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.538964 31741 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:49.551059 28753 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:49.559159 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:49.552686 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:49.553617 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.552752 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.555442 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.555473 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.560374 28756 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:49.556262 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.557303 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:49.560861 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 74529.7us
I20260709 12:18:49.557587 29319 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:49.557861 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:49.562418 29327 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:49.557840 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 79996.7us
I20260709 12:18:49.558523 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.563637 28678 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:49.564044 29326 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:49.564531 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.565416 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.565798 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.568363 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.574206 28752 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:49.574244 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:49.575455 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.573482 29321 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:18:49.576475 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.577180 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.578403 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.579115 28604 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:49.579264 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.579627 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:49.581147 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.582363 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:49.583526 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:49.577097 29322 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:49.585343 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:49.585904 29320 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.579840 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.586933 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.517448 31886 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.588135 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.518770 31918 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:49.546815 31831 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:49.576267 31902 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:49.591373 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.591812 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.587051 28604 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:49.547945 31876 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.576280 31889 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.547528 31822 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:49.593443 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 151364us
I20260709 12:18:49.590529 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.587548 29317 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:49.594861 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.620536 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:49.620836 29326 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:49.621129 29325 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:49.610102 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:49.611877 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:49.622046 28604 raft_consensus.cc:2376] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9. Re-sending same reply.
I20260709 12:18:49.622859 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.589236 31721 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.589335 31477 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.589270 31776 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:49.588575 31676 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:49.628887 31917 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.564842 31835 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:49.566187 31887 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:49.618588 28607 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:49.592885 31517 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:49.625511 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.647539 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.647655 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.584941 31576 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.648201 28752 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:18:49.648504 28607 raft_consensus.cc:2368] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 4. Current term is 5.
W20260709 12:18:49.650182 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.650784 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.651137 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.612578 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.608639 31908 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:49.606853 31831 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:49.628780 31721 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.584758 31896 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:18:49.609642 31918 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:49.629029 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:49.629552 28648 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:49.629890 28606 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:49.591303 31886 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.635254 28601 raft_consensus.cc:606] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:18:49.608302 31921 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:49.547241 31440 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:49.609050 31902 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.660024 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.627384 29320 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:49.616981 31856 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:49.641281 31905 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.616806 31876 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:49.644241 31920 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.807880 31876 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.645328 31917 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.819301 31917 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:49.726511 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.756376 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.794653 31440 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.646258 31835 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:49.730355 31908 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:49.646168 31887 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.795471 31832 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.795431 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:49.952946 28607 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:49.690569 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 78071us
W20260709 12:18:49.754603 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.953817 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.691120 31831 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:49.748551 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.798799 31921 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:49.672966 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 54583.7us
I20260709 12:18:49.793744 28601 raft_consensus.cc:614] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:49.748885 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:49.858767 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 229262us
I20260709 12:18:49.973843 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:49.976408 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.642258 31776 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.646440 31517 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.641366 31700 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:49.960632 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:49.965482 29325 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
W20260709 12:18:49.971304 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 387765us
I20260709 12:18:49.927695 31902 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:49.728991 31833 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.699190 31918 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.689834 31721 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:49.990232 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:50.018741 28753 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:49.990896 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:49.982476 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:50.004110 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 50426.5us
I20260709 12:18:49.951912 31835 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:50.014904 28599 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:49.946360 31738 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:50.020915 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:50.003243 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:50.036616 28607 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:50.037487 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:50.023244 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 415507us
I20260709 12:18:49.951953 31887 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:50.024367 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 52102.1us
I20260709 12:18:50.040011 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:49.980070 31921 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:50.002175 31602 consensus_meta.cc:287] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.527s	user 0.014s	sys 0.002s
W20260709 12:18:50.049908 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.031785 31832 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.980618 31776 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:50.072697 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:51.030565 28748 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:49.990939 31517 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:50.002817 31811 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:50.091121 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49386.7us
W20260709 12:18:50.787698 31888 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.281s	user 0.012s	sys 0.000s
I20260709 12:18:50.033843 31822 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.033656 31875 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:50.182864 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:50.191527 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.039811 31738 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:50.090687 31919 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:50.165298 31711 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.718s	user 0.005s	sys 0.005s
I20260709 12:18:51.056661 31822 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.079068 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.079774 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.080363 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.080896 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.081511 29317 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:51.083250 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.083823 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:18:51.057914 31889 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:50.990197 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 969232us
I20260709 12:18:50.263963 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:50.446056 29321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.036s	sys 0.081s
I20260709 12:18:51.061702 31738 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:50.683344 28647 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.541s (SENT)
W20260709 12:18:50.536979 29327 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.974s	user 0.011s	sys 0.000s
I20260709 12:18:51.097918 29327 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
W20260709 12:18:51.098481 29327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 746) took 1541 ms (client timeout 1960 ms). Trace:
W20260709 12:18:51.098834 29327 rpcz_store.cc:269] 0709 12:18:49.557416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.557555 (+   139us) service_pool.cc:224] Handling call
0709 12:18:51.098428 (+1540873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:50.983924 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 745) took 1426 ms. Trace:
W20260709 12:18:50.654239 29326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.031s	sys 0.074s
I20260709 12:18:51.100394 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:51.100705 29326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.371s	user 0.040s	sys 0.087s
I20260709 12:18:50.425614 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:51.101078 28680 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:50.482250 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.101910 28754 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:51.102243 28647 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:51.102766 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.099864 29318 rpcz_store.cc:276] 0709 12:18:49.557055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.568308 (+ 11253us) service_pool.cc:224] Handling call
0709 12:18:49.568847 (+   539us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:49.569366 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.569392 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:49.585999 (+ 16607us) log.cc:844] Serialized 598 byte log entry
0709 12:18:49.954160 (+368161us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:49.954216 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.954295 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:50.303422 (+349127us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b480021c858. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe89a8aa1 00007f6fe899fb37 00007f6fe899f9ca 00007f6fe8a9726f 00007f6fe8a96f37 00007f6fe8aab55c 00007f6fe8aab508 00007f6fe8aab488 00007f6fe8aab443 00007f6fe8aaa6ec 00007f6fe79d4a96
0709 12:18:50.687372 (+383950us) raft_consensus.cc:1685] finished
0709 12:18:50.687400 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:50.983851 (+296451us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":3150,"raft.run_wall_time_us":726998,"spinlock_wait_cycles":30035200,"thread_start_us":310229,"threads_started":1,"wal-append.queue_time_us":1032008}
I20260709 12:18:51.104463 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:51.088994 31741 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.512s	user 0.005s	sys 0.007s
I20260709 12:18:50.237172 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:51.037139 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 997142us
W20260709 12:18:50.723836 31693 consensus_meta.cc:287] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.265s	user 0.015s	sys 0.003s
I20260709 12:18:50.359922 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:50.662528 31843 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.237s	user 0.012s	sys 0.000s
I20260709 12:18:51.037799 31905 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:51.042383 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.037883 31832 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:50.277446 31740 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.233618 31896 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:50.425005 31664 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.293826 31893 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:50.306892 31908 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:50.299247 31676 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:51.118911 31720 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.027s	sys 0.023s
W20260709 12:18:50.679543 31745 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.221s	user 0.009s	sys 0.009s
I20260709 12:18:51.056874 29323 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:50.291915 31477 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:50.900499 31922 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:50.576402 31757 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.071815 31920 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 1.012s
I20260709 12:18:51.032084 31602 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.064920 31888 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:18:51.037797 31811 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:51.130395 31745 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.134274 31811 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.067538 31919 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:50.903103 31917 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.083s	user 0.011s	sys 0.003s
I20260709 12:18:51.115636 31741 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:51.089900 31889 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.120464 31896 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:51.131516 31720 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.028s	sys 0.024s
W20260709 12:18:50.830104 28503 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 305) took 22925 ms (client timeout 15000 ms). Trace:
I20260709 12:18:51.190728 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:51.130842 31477 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.125137 31664 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:51.040405 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:50.380082 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:51.222924 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:51.223994 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.119870 31693 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:50.135788 28603 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:51.233855 31711 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:51.234462 28603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2192) took 1966 ms (client timeout 1700 ms). Trace:
I20260709 12:18:51.234838 31711 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.192755 28598 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:50.455555 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2191) took 1188 ms. Trace:
I20260709 12:18:51.236212 31532 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:51.237232 31532 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.101013 28678 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:51.240666 28599 rpcz_store.cc:276] 0709 12:18:49.267508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.451059 (+183551us) service_pool.cc:224] Handling call
0709 12:18:50.455291 (+1004232us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b540004bd54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:50.455455 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196697856}
I20260709 12:18:51.241361 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 762) took 1629 ms. Trace:
I20260709 12:18:51.108011 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:51.241950 29323 rpcz_store.cc:276] 0709 12:18:49.611760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.611954 (+   194us) service_pool.cc:224] Handling call
0709 12:18:51.240824 (+1628870us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400458654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:51.241058 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3242260352}
I20260709 12:18:51.243340 28674 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.108328 28681 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:50.541752 28600 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.002s	user 0.011s	sys 0.000s
I20260709 12:18:51.245183 28600 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:51.108090 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:51.245975 28600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2193) took 1978 ms (client timeout 1719 ms). Trace:
I20260709 12:18:51.246407 28673 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
W20260709 12:18:51.246480 28600 rpcz_store.cc:269] 0709 12:18:49.267975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.456931 (+188956us) service_pool.cc:224] Handling call
0709 12:18:51.245837 (+1788906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.243590 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.194808 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.248216 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.249840 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:51.250216 28600 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:51.250834 28747 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:51.250968 28600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 498) took 1986 ms (client timeout 2212 ms). Trace:
W20260709 12:18:51.251492 28600 rpcz_store.cc:269] 0709 12:18:49.264949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.247721 (+1982772us) service_pool.cc:224] Handling call
0709 12:18:51.250883 (+  3162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.252585 28599 raft_consensus.cc:2368] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:51.252996 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.029633 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.254417 28751 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:51.255705 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.058646 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.257206 28753 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:51.258361 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.259867 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.110915 28756 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:51.122313 31740 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.265013 31741 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:51.265843 31741 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.266327 31745 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.266618 31711 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:51.253453 28598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1864) took 1830 ms (client timeout 1543 ms). Trace:
W20260709 12:18:51.145355 31831 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.155s	user 0.010s	sys 0.000s
I20260709 12:18:51.208863 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:50.466744 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.089416 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:51.092401 31440 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.131s	user 0.012s	sys 0.000s
I20260709 12:18:51.343320 29317 raft_consensus.cc:2368] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:51.343247 31440 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.210839 29319 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:51.211107 31443 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:51.089993 29321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.455s	user 0.055s	sys 0.107s
I20260709 12:18:51.124847 31676 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:51.212930 28503 rpcz_store.cc:269] 0709 12:18:27.910213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.925529 (+ 15316us) service_pool.cc:224] Handling call
0709 12:18:50.830015 (+22904486us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:42.872592 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:42.873219 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:42.873269 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:18:42.873291 (+    22us) tablet.cc:662] Decoding operations
0709 12:18:42.874875 (+  1584us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:42.874947 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:42.874975 (+    28us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:18:42.881324 (+  6349us) tablet.cc:701] Row locks acquired
0709 12:18:42.925430 (+ 44106us) write_op.cc:260] PREPARE: finished
0709 12:18:42.959160 (+ 33730us) write_op.cc:270] Start()
0709 12:18:43.009409 (+ 50249us) write_op.cc:276] Timestamp: P: 1783599522940784 usec, L: 0
0709 12:18:43.020858 (+ 11449us) op_driver.cc:348] REPLICATION: starting
0709 12:18:43.068690 (+ 47832us) log.cc:844] Serialized 7671 byte log entry
0709 12:18:43.348986 (+280296us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:43.738891 (+389905us) op_driver.cc:464] REPLICATION: finished
0709 12:18:43.959354 (+220463us) write_op.cc:301] APPLY: starting
0709 12:18:43.959449 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:43.959816 (+   367us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:43.959853 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:44.101006 (+141153us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:44.101361 (+   355us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:18:44.101408 (+    47us) write_op.cc:312] APPLY: finished
0709 12:18:44.101866 (+   458us) log.cc:844] Serialized 132 byte log entry
0709 12:18:44.102051 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:44.102217 (+   166us) write_op.cc:454] Released schema lock
0709 12:18:44.102298 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:44.169910 (+ 67612us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:44.171337 (+  1427us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1532237,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":220194,"apply.run_cpu_time_us":5602,"apply.run_wall_time_us":151439,"num_ops":19,"prepare.queue_time_us":101923,"prepare.run_cpu_time_us":37458,"prepare.run_wall_time_us":255005,"raft.queue_time_us":182916,"raft.run_cpu_time_us":24478,"raft.run_wall_time_us":134268,"replication_time_us":717801,"spinlock_wait_cycles":3888512,"thread_start_us":425961,"threads_started":4,"wal-append.queue_time_us":67039,"wal-append.run_cpu_time_us":18035,"wal-append.run_wall_time_us":2079762}]]}
W20260709 12:18:50.984570 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 945280us
I20260709 12:18:50.392163 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37386 (request call id 12) took 2041 ms. Trace:
I20260709 12:18:51.227030 31602 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:51.233971 31693 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:51.235003 28603 rpcz_store.cc:269] 0709 12:18:49.267744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.455730 (+187986us) service_pool.cc:224] Handling call
0709 12:18:51.234020 (+1778290us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000bde54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:51.234192 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464211840}
I20260709 12:18:50.301581 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:51.406631 28606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2197) took 2084 ms (client timeout 2074 ms). Trace:
W20260709 12:18:51.407042 28606 rpcz_store.cc:269] 0709 12:18:49.322881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.301221 (+978340us) service_pool.cc:224] Handling call
0709 12:18:51.406416 (+1105195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.408200 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:51.409232 28606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1854) took 2023 ms (client timeout 2120 ms). Trace:
W20260709 12:18:51.409708 28606 rpcz_store.cc:269] 0709 12:18:49.385369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.407830 (+2022461us) service_pool.cc:224] Handling call
0709 12:18:51.409135 (+  1305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.411103 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.041033 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:51.253113 28599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2187) took 1986 ms (client timeout 2175 ms). Trace:
I20260709 12:18:51.146140 31832 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:51.148375 31886 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.202s	user 0.006s	sys 0.002s
I20260709 12:18:51.416527 28607 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.416638 31938 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.417104 31886 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.417651 31938 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.419710 31886 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:51.149910 31889 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:51.134691 31902 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.107s	user 0.011s	sys 0.000s
I20260709 12:18:51.422680 28601 rpcz_store.cc:276] 0709 12:18:48.279066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.279195 (+   129us) service_pool.cc:224] Handling call
0709 12:18:50.296321 (+2017126us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540004bd54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a79853 00007f6fe8a4760a 00007f6fe1fcd7d4 00007f6fe1fcd762 00007f6fe1fcd691 00007f6fe1fcd60c 00007f6fe1fcc8c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:50.320765 (+ 24444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3117147392}
I20260709 12:18:51.423344 31902 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.424468 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.424594 31676 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:51.425283 28601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2202) took 1984 ms (client timeout 2078 ms). Trace:
I20260709 12:18:51.137657 31917 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:51.433924 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 694781us
I20260709 12:18:51.151515 31919 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.435946 31517 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.132071 31922 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:51.135869 31876 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.327s	user 0.009s	sys 0.003s
I20260709 12:18:51.444195 28604 raft_consensus.cc:2368] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 4. Current term is 5.
I20260709 12:18:51.444646 28750 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:51.444772 31876 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:51.445529 28604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2195) took 2131 ms (client timeout 1838 ms). Trace:
I20260709 12:18:51.446120 31922 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.446314 31952 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.140208 31896 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:51.447937 31876 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.450155 31952 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:51.155246 31887 consensus_meta.cc:287] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.050s	user 0.002s	sys 0.009s
I20260709 12:18:51.453945 31887 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.120967 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.457898 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:51.458623 28754 raft_consensus.cc:2376] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11. Re-sending same reply.
I20260709 12:18:51.459583 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:50.400110 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.463936 31517 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.148491 31921 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.091310 28755 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:51.151438 31918 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.083s	user 0.007s	sys 0.000s
I20260709 12:18:51.468827 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1874) took 1204 ms. Trace:
I20260709 12:18:51.469277 28755 rpcz_store.cc:276] 0709 12:18:50.263050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.263644 (+   594us) service_pool.cc:224] Handling call
0709 12:18:51.467336 (+1203692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.469429 31918 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.470678 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.471901 31918 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.207506 28748 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
W20260709 12:18:51.267275 28598 rpcz_store.cc:269] 0709 12:18:49.423016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.450506 (+ 27490us) service_pool.cc:224] Handling call
0709 12:18:51.253207 (+1802701us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400233f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:51.253381 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4003385216}
I20260709 12:18:51.471980 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.266700 31740 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.293161 31937 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:51.474274 28752 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:51.267379 31711 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.474583 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.299201 28505 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 4 to 6, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 6 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:18:51.276782 31532 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:51.327013 31721 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.211s	user 0.010s	sys 0.011s
I20260709 12:18:51.335561 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:51.154698 31835 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.081s	user 0.009s	sys 0.000s
I20260709 12:18:51.337072 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.460706 31440 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.344707 28749 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:51.338406 28600 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:51.133368 31757 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.482064 28751 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:51.481966 31835 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.482721 31738 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.483115 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.484059 31757 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.347172 31741 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.484328 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.380359 28602 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:51.484961 28605 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:51.485215 28600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1863) took 2058 ms (client timeout 2057 ms). Trace:
I20260709 12:18:51.485502 31738 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:51.485738 28600 rpcz_store.cc:269] 0709 12:18:49.422757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.252453 (+1829696us) service_pool.cc:224] Handling call
0709 12:18:51.481157 (+228704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.486271 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.486873 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.487466 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:51.487697 28600 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:51.477388 31711 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:51.489969 28752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1865) took 1742 ms (client timeout 2017 ms). Trace:
W20260709 12:18:51.491472 28602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2196) took 2171 ms (client timeout 1746 ms). Trace:
I20260709 12:18:51.490706 28505 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 4, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.491719 31711 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:51.491863 28602 rpcz_store.cc:269] 0709 12:18:49.320746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.587896 (+267150us) service_pool.cc:224] Handling call
0709 12:18:51.491255 (+1903359us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400122ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:51.491409 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4039683456}
I20260709 12:18:51.489998 31921 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.493175 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.494076 31917 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.494767 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.494968 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.495201 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.495683 29318 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:51.484375 31835 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.496258 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.496469 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:51.496690 28605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2182) took 2233 ms (client timeout 1793 ms). Trace:
W20260709 12:18:51.497207 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 65433.4us
I20260709 12:18:51.496877 28505 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 5, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 5 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:51.497157 28605 rpcz_store.cc:269] 0709 12:18:49.263452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.565589 (+302137us) service_pool.cc:224] Handling call
0709 12:18:51.496470 (+1930881us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54002c0954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:51.496621 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4393739008}
I20260709 12:18:51.497735 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.498185 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:51.498605 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.498821 29327 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:51.499527 28605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1860) took 2077 ms (client timeout 2135 ms). Trace:
I20260709 12:18:51.498883 28505 catalog_manager.cc:5697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 4 to 5, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 5 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:51.499886 28605 rpcz_store.cc:269] 0709 12:18:49.421939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.498221 (+2076282us) service_pool.cc:224] Handling call
0709 12:18:51.499459 (+  1238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.500739 31440 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:51.501217 31440 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:18:51.501478 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 389355us
I20260709 12:18:51.501662 31440 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.501722 29317 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:18:51.502331 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:51.503033 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.502913 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:51.503969 28605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1868) took 2079 ms (client timeout 2140 ms). Trace:
I20260709 12:18:51.404769 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:51.506415 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:51.507170 28677 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.507212 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:51.508033 28682 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:51.412038 28606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1865) took 1988 ms (client timeout 2085 ms). Trace:
W20260709 12:18:51.508602 28606 rpcz_store.cc:269] 0709 12:18:49.423333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.410616 (+1987283us) service_pool.cc:224] Handling call
0709 12:18:51.411972 (+  1356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.508780 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:51.509747 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.510406 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:51.414975 28599 rpcz_store.cc:269] 0709 12:18:49.266519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.242887 (+1976368us) service_pool.cc:224] Handling call
0709 12:18:51.253027 (+ 10140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.511088 28678 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.511334 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:51.511451 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.512068 28679 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:51.512200 28599 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
W20260709 12:18:51.512851 28599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1862) took 2090 ms (client timeout 2342 ms). Trace:
I20260709 12:18:51.512993 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:51.513212 28599 rpcz_store.cc:269] 0709 12:18:49.422507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.511141 (+2088634us) service_pool.cc:224] Handling call
0709 12:18:51.512793 (+  1652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.513720 28675 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:51.514242 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.515131 28599 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:51.515515 28599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1857) took 2129 ms (client timeout 2682 ms). Trace:
I20260709 12:18:51.515759 31835 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:51.425673 28601 rpcz_store.cc:269] 0709 12:18:49.440584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.424126 (+1983542us) service_pool.cc:224] Handling call
0709 12:18:51.425226 (+  1100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.411620 31831 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.530488 31831 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.531342 28679 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:51.531806 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.532553 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2186) took 2268 ms. Trace:
I20260709 12:18:51.532867 28601 rpcz_store.cc:276] 0709 12:18:49.264456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.531438 (+2266982us) service_pool.cc:224] Handling call
0709 12:18:51.532500 (+  1062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.533748 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.534412 28601 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:51.534817 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1858) took 2148 ms. Trace:
I20260709 12:18:51.535108 28601 rpcz_store.cc:276] 0709 12:18:49.386362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.533486 (+2147124us) service_pool.cc:224] Handling call
0709 12:18:51.534769 (+  1283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.428388 29320 raft_consensus.cc:2368] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:51.536943 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:51.537555 28602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2204) took 2096 ms (client timeout 2106 ms). Trace:
I20260709 12:18:51.537711 29319 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
W20260709 12:18:51.537971 28602 rpcz_store.cc:269] 0709 12:18:49.441034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.492857 (+2051823us) service_pool.cc:224] Handling call
0709 12:18:51.537472 (+ 44615us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.538995 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.539664 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:51.430450 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 766) took 1375 ms. Trace:
I20260709 12:18:51.542209 31952 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.542428 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:51.543042 31952 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.542006 29325 rpcz_store.cc:276] 0709 12:18:50.024369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.026229 (+  1860us) service_pool.cc:224] Handling call
0709 12:18:50.026534 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:50.026726 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:50.026955 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 12:18:50.787335 (+760380us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b1800067300. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a 00007f6fe3a89a2a
0709 12:18:51.361589 (+574254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:51.367087 (+  5498us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:51.374670 (+  7583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.389065 (+ 14395us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.400151 (+ 11086us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":111,"prepare.run_cpu_time_us":97375,"prepare.run_wall_time_us":958770,"raft.queue_time_us":190647,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":3685,"spinlock_wait_cycles":17828096,"thread_start_us":563344,"threads_started":2,"wal-append.queue_time_us":1386843}
W20260709 12:18:51.430902 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 380571us
I20260709 12:18:51.425876 31902 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.544874 28756 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:51.544888 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:51.458171 31958 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:51.287479 31822 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.468410 28747 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:51.548408 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.474607 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1870) took 1402 ms. Trace:
I20260709 12:18:51.549063 28748 rpcz_store.cc:276] 0709 12:18:50.072275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.072421 (+   146us) service_pool.cc:224] Handling call
0709 12:18:51.474485 (+1402064us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.473433 31938 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.543687 31952 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.550189 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:51.550877 28748 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:51.554955 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.473626 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:51.254446 31664 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.477527 28598 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
W20260709 12:18:51.556964 28598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2198) took 2233 ms (client timeout 2198 ms). Trace:
I20260709 12:18:51.557217 28754 raft_consensus.cc:2376] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9. Re-sending same reply.
W20260709 12:18:51.557428 28598 rpcz_store.cc:269] 0709 12:18:49.323577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.474236 (+2150659us) service_pool.cc:224] Handling call
0709 12:18:51.556872 (+ 82636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.558280 28598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:51.558615 28747 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:51.559010 28598 raft_consensus.cc:606] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:51.559396 28598 raft_consensus.cc:614] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:51.341225 31477 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.560818 31938 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:51.561314 31938 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.561779 31938 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:51.562392 31477 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.497212 29323 raft_consensus.cc:2410] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:51.488219 28749 raft_consensus.cc:2376] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9. Re-sending same reply.
I20260709 12:18:51.504683 31832 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:51.563771 31832 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:51.564476 28598 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:51.565207 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2183) took 2301 ms. Trace:
I20260709 12:18:51.564925 31832 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.565603 28598 rpcz_store.cc:276] 0709 12:18:49.263692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.560208 (+2296516us) service_pool.cc:224] Handling call
0709 12:18:51.564016 (+  3808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.564888 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.565080 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.565636 31811 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.510603 28606 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:51.568261 28606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1856) took 2182 ms (client timeout 2219 ms). Trace:
I20260709 12:18:51.549460 28505 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 5, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 5 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:51.568636 28606 rpcz_store.cc:269] 0709 12:18:49.385884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.509424 (+2123540us) service_pool.cc:224] Handling call
0709 12:18:51.568207 (+ 58783us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:51.414717 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.376178 31443 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:51.490402 28752 rpcz_store.cc:269] 0709 12:18:49.747694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.748594 (+   900us) service_pool.cc:224] Handling call
0709 12:18:51.489757 (+1741163us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54002d50d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:51.489914 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3422546816}
I20260709 12:18:51.516996 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 748) took 1841 ms. Trace:
I20260709 12:18:51.519361 28680 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:51.522657 29318 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:51.522472 31776 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.480719 31721 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.482125 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:51.525277 28605 rpcz_store.cc:269] 0709 12:18:49.424148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.500672 (+2076524us) service_pool.cc:224] Handling call
0709 12:18:51.503913 (+  3241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.526479 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:51.591468 28678 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
W20260709 12:18:51.488181 28600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1869) took 2063 ms (client timeout 2116 ms). Trace:
W20260709 12:18:51.591974 28600 rpcz_store.cc:269] 0709 12:18:49.435903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.486512 (+2050609us) service_pool.cc:224] Handling call
0709 12:18:51.488124 (+  1612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.485754 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.593120 28751 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:51.594244 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.595312 28751 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:51.596097 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.597044 28751 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
W20260709 12:18:51.445950 28604 rpcz_store.cc:269] 0709 12:18:49.314038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.622649 (+308611us) service_pool.cc:224] Handling call
0709 12:18:51.445269 (+1822620us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400233a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:51.445442 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4181911424}
I20260709 12:18:51.598289 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.545548 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1873) took 1309 ms. Trace:
I20260709 12:18:51.456123 31887 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:51.388355 28674 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:18:51.543458 29319 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:51.473102 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 542) took 1071 ms. Trace:
I20260709 12:18:51.556111 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:51.603222 28756 rpcz_store.cc:276] 0709 12:18:50.236574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.236851 (+   277us) service_pool.cc:224] Handling call
0709 12:18:51.545442 (+1308591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.379747 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:51.515870 28599 rpcz_store.cc:269] 0709 12:18:49.386132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.513905 (+2127773us) service_pool.cc:224] Handling call
0709 12:18:51.515464 (+  1559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.516325 28571 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:51.536021 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:51.572110 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.583199 28677 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:51.526717 28603 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:51.536052 31741 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.539750 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2203) took 2099 ms. Trace:
I20260709 12:18:51.598457 28604 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:51.431474 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 337780us
I20260709 12:18:51.599160 28753 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
W20260709 12:18:51.601135 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 79832.3us
I20260709 12:18:51.600718 28505 catalog_manager.cc:5697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 5, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:18:51.607003 28748 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:51.606861 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 508) took 1992 ms. Trace:
I20260709 12:18:51.609372 28602 rpcz_store.cc:276] 0709 12:18:49.440815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.538700 (+2097885us) service_pool.cc:224] Handling call
0709 12:18:51.539701 (+  1001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.609552 28601 rpcz_store.cc:276] 0709 12:18:49.615164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.535733 (+1920569us) service_pool.cc:224] Handling call
0709 12:18:51.606800 (+ 71067us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:51.607626 28603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2201) took 2167 ms (client timeout 2051 ms). Trace:
W20260709 12:18:51.611328 28603 rpcz_store.cc:269] 0709 12:18:49.440301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.404392 (+1964091us) service_pool.cc:224] Handling call
0709 12:18:51.607544 (+203152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.611626 28682 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:51.605439 28750 rpcz_store.cc:276] 0709 12:18:50.395517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.395661 (+   144us) service_pool.cc:224] Handling call
0709 12:18:51.024260 (+628599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:51.445247 (+420987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.448348 (+  3101us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400337054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:51.466906 (+ 18558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923858816}
I20260709 12:18:51.614277 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.618273 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 504) took 2248 ms. Trace:
I20260709 12:18:51.618796 28604 rpcz_store.cc:276] 0709 12:18:49.368007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.597927 (+2229920us) service_pool.cc:224] Handling call
0709 12:18:51.598283 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.613812 (+ 15529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.616292 (+  2480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.620136 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:51.623126 28755 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:51.618980 31440 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.621376 31741 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.627167 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:51.627313 31440 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.627892 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.628326 31740 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:51.629168 29325 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:51.600721 31811 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.628224 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:51.631379 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.582715 29321 rpcz_store.cc:276] 0709 12:18:49.580104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.580550 (+   446us) service_pool.cc:224] Handling call
0709 12:18:49.580939 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:49.589530 (+  8591us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:49.609956 (+ 20426us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.405806 (+1795850us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:51.406913 (+  1107us) log.cc:844] Serialized 52 byte log entry
0709 12:18:51.407176 (+   263us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:51.407517 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.407700 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.407838 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:51.413462 (+  5624us) raft_consensus.cc:1685] finished
0709 12:18:51.413475 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.421210 (+  7735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11780,"prepare.queue_time_us":26021,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":116,"raft.queue_time_us":20338,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":16877,"thread_start_us":1729538,"threads_started":1,"wal-append.queue_time_us":1507937}
I20260709 12:18:51.559787 31896 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.629956 28749 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:51.631326 31740 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:51.634101 28753 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
W20260709 12:18:51.634783 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 65513.6us
I20260709 12:18:51.618305 31664 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:51.608690 31745 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:51.640918 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.627295 31741 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:51.650403 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 134158us
I20260709 12:18:51.648350 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.643674 31477 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.656253 31477 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:51.659914 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.668794 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.670228 28599 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:18:51.668457 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:51.677320 31676 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.677716 31517 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:51.678066 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:51.679003 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:51.679150 31440 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:51.679507 31676 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:51.679713 31440 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:51.679890 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:51.673032 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2199) took 2327 ms. Trace:
I20260709 12:18:51.678158 31517 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.669787 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.676244 28599 pending_rounds.cc:85] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 6
I20260709 12:18:51.680493 28600 rpcz_store.cc:276] 0709 12:18:49.323898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.601525 (+2277627us) service_pool.cc:224] Handling call
0709 12:18:51.601871 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.645343 (+ 43472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:51.645390 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:51.645447 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:51.651282 (+  5835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.651378 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.651521 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34234,"raft.queue_time_us":31720,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3647}
I20260709 12:18:51.656563 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 764) took 1934 ms. Trace:
I20260709 12:18:51.669013 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:51.659595 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:51.659096 28505 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 4, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.689093 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.684619 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.683493 28599 pending_rounds.cc:107] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:18:51.692629 31893 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:51.656607 31740 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.693017 28599 raft_consensus.cc:2889] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:51.693264 31893 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:51.693437 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:51.693946 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1853) took 2308 ms. Trace:
I20260709 12:18:51.694360 28599 rpcz_store.cc:276] 0709 12:18:49.385081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.610943 (+2225862us) service_pool.cc:224] Handling call
0709 12:18:51.645796 (+ 34853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.693697 (+ 47901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.693874 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.694387 31893 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.690094 28755 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:18:51.658833 31477 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.656373 31946 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.656527 31831 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:51.687620 31517 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.713490 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:51.661679 31876 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:18:51.712896 28752 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:51.716804 28753 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
W20260709 12:18:51.712569 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 235719us
I20260709 12:18:51.717999 31832 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:51.720721 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:51.684329 29326 rpcz_store.cc:276] 0709 12:18:49.694740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.694904 (+   164us) service_pool.cc:224] Handling call
0709 12:18:49.695274 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.695532 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:49.729321 (+ 33789us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.441333 (+1712012us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.476552 (+ 35219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:51.481685 (+  5133us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:51.570959 (+ 89274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.606156 (+ 35197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.629049 (+ 22893us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21344,"prepare.queue_time_us":54242,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":123,"raft.queue_time_us":185994,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":1592,"thread_start_us":1657255,"threads_started":2,"wal-append.queue_time_us":1312736}
I20260709 12:18:51.708202 31831 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.725576 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 544) took 1194 ms. Trace:
I20260709 12:18:51.727839 28607 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:51.729068 28752 rpcz_store.cc:276] 0709 12:18:50.531589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.619619 (+1088030us) service_pool.cc:224] Handling call
0709 12:18:51.725509 (+105890us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:51.737856 28607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 507) took 2220 ms (client timeout 1793 ms). Trace:
I20260709 12:18:51.669922 31745 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:51.738291 28607 rpcz_store.cc:269] 0709 12:18:49.517059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.075774 (+558715us) service_pool.cc:224] Handling call
0709 12:18:51.729180 (+1653406us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:51.742082 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62278.6us
I20260709 12:18:51.743055 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:51.744166 28752 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:51.742904 31972 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:51.726460 31918 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:51.703866 31938 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.749356 31918 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.758148 31918 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:51.758498 31776 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:51.757380 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:51.752990 29322 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:51.748287 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 549) took 1021 ms. Trace:
I20260709 12:18:51.754380 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 545) took 1156 ms. Trace:
I20260709 12:18:51.759616 28755 rpcz_store.cc:276] 0709 12:18:50.723659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.706744 (+983085us) service_pool.cc:224] Handling call
0709 12:18:51.727343 (+ 20599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.744601 (+ 17258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:51.744644 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:51.744707 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:51.744761 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.744845 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.744985 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.760283 28756 rpcz_store.cc:276] 0709 12:18:50.597837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.698291 (+1100454us) service_pool.cc:224] Handling call
0709 12:18:51.731608 (+ 33317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.754035 (+ 22427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:51.754063 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:51.754100 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:51.754137 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.754203 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.754330 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:51.730939 31831 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:51.769456 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:51.740628 31952 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:51.748255 31811 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:51.757572 28505 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 4, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.775753 31975 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:51.727001 31835 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:18:51.780884 28752 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:51.781498 31835 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:51.782006 31835 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:51.782126 28752 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:51.782953 31835 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.717083 31946 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.746781 31832 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:51.785197 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 749) took 2170 ms. Trace:
I20260709 12:18:51.784869 31832 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:51.786198 28674 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:51.779184 28755 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:51.788380 28750 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:51.780026 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:51.779387 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:51.789170 28756 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:51.783406 28752 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:51.791514 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:51.753573 31721 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:51.785638 29322 rpcz_store.cc:276] 0709 12:18:49.614338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.614494 (+   156us) service_pool.cc:224] Handling call
0709 12:18:51.784974 (+2170480us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540055ebd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:51.785120 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4423550720}
W20260709 12:18:51.799203 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.793583 31811 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:51.802501 31811 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.804602 28747 raft_consensus.cc:2376] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7. Re-sending same reply.
I20260709 12:18:51.808494 31745 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:51.813199 28505 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 4 to 6, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 6 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:51.815879 31965 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260709 12:18:51.815086 28505 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 4 to 5, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 5 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:51.822033 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52654.3us
I20260709 12:18:51.797729 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:51.776335 31975 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:51.826377 28756 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:51.747980 31440 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:51.829195 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:51.825052 28678 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:51.798861 31908 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:51.832834 28755 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:51.834318 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:51.834625 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 129039us
I20260709 12:18:51.835214 28681 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.835704 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.839123 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:51.839717 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 68291.1us
I20260709 12:18:51.838083 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:51.829829 31822 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:51.832056 31908 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.830104 31975 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.849558 29322 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:51.846706 29326 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:51.849313 31908 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:51.856913 28505 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 2 to 3, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 3 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.861042 28505 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 3 to 4, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 4 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.862849 28505 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 5 to 6, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 6 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:18:51.856650 31952 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:51.872067 31952 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.841106 31443 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:51.912842 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70873.3us
I20260709 12:18:52.038378 28607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:52.034622 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.041769 28607 raft_consensus.cc:606] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
W20260709 12:18:51.935822 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 215230us
I20260709 12:18:52.042423 28607 raft_consensus.cc:614] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:51.875630 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:52.009367 28681 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:52.043501 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:18:51.918612 28674 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:52.006378 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 497) took 2741 ms. Trace:
I20260709 12:18:51.961722 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 501) took 2665 ms. Trace:
I20260709 12:18:51.879851 29325 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:52.046187 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 502) took 2780 ms. Trace:
I20260709 12:18:51.939754 29327 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
I20260709 12:18:52.053004 28682 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:52.054768 31963 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.389s	user 0.002s	sys 0.000s
I20260709 12:18:52.057724 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:51.872551 31952 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.060767 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:52.060930 29292 leader_election.cc:336] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.502s (SENT)
I20260709 12:18:51.872372 31908 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.061542 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:51.851912 31664 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:52.062613 31896 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:52.062518 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:51.851526 31822 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:52.063525 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:52.050269 28605 rpcz_store.cc:276] 0709 12:18:49.265950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.591726 (+2325776us) service_pool.cc:224] Handling call
0709 12:18:51.600056 (+  8330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:51.616373 (+ 16317us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:51.616410 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:51.618646 (+  2236us) log.cc:844] Serialized 26 byte log entry
0709 12:18:51.683747 (+ 65101us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:51.683804 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.683898 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:51.815167 (+131269us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:51.818697 (+  3530us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b48000d0158. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe89a8aa1 00007f6fe899fb37 00007f6fe899f9ca 00007f6fe8a9726f 00007f6fe8a96f37 00007f6fe8aab55c 00007f6fe8aab508 00007f6fe8aab488 00007f6fe8aab443 00007f6fe8aaa6ec 00007f6fe79d4a96
0709 12:18:52.041189 (+222492us) raft_consensus.cc:1685] finished
0709 12:18:52.042588 (+  1399us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.046107 (+  3519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4607,"raft.queue_time_us":13592,"raft.run_cpu_time_us":2694,"raft.run_wall_time_us":202432,"spinlock_wait_cycles":59788416,"thread_start_us":54520,"threads_started":1,"wal-append.queue_time_us":40433}
I20260709 12:18:52.016184 31920 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:52.046172 28598 rpcz_store.cc:276] 0709 12:18:49.264711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.566781 (+2302070us) service_pool.cc:224] Handling call
0709 12:18:51.567144 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.567522 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:51.728330 (+160808us) log.cc:844] Serialized 14 byte log entry
0709 12:18:52.005943 (+277613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:52.006011 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:52.006069 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.006164 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.006305 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41747,"prepare.queue_time_us":119329,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":64739,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8135,"thread_start_us":325901,"threads_started":2}
I20260709 12:18:52.087376 28648 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:52.088344 31896 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:52.089303 31896 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:52.047610 28606 rpcz_store.cc:276] 0709 12:18:49.265715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.590727 (+2325012us) service_pool.cc:224] Handling call
0709 12:18:51.601160 (+ 10433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:51.601429 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:51.691517 (+ 90088us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.930505 (+238988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:51.930575 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:51.930635 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.930714 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.930873 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10391,"prepare.queue_time_us":85686,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":66538,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"thread_start_us":284737,"threads_started":3,"wal-append.queue_time_us":88583}
I20260709 12:18:52.089318 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:52.095877 28677 raft_consensus.cc:2368] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
W20260709 12:18:52.096856 28648 leader_election.cc:336] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.699s (SENT)
I20260709 12:18:52.099242 28682 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:52.104650 31443 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:52.112131 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:52.084605 31477 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:52.092954 31876 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:52.120895 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:52.121590 29327 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:52.091764 31893 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:52.099246 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.115567 28673 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:52.119433 29318 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:52.124373 28648 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.700s (SENT)
I20260709 12:18:52.124290 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:52.129834 31978 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.274s	user 0.000s	sys 0.002s
I20260709 12:18:52.130940 31831 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.131513 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:52.131795 31477 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.132231 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:52.132333 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.132943 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:52.133154 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.134735 28674 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:52.139508 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.116580 31664 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:52.167707 31835 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.169669 31440 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:52.169929 31835 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:52.171445 29326 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:18:52.171583 31831 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.167045 28681 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 5: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.167445 28682 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.176937 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:52.177233 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 116375us
I20260709 12:18:52.178118 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:52.171977 31835 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:52.087423 31822 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:52.183233 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 555) took 1331 ms. Trace:
I20260709 12:18:52.185593 28750 rpcz_store.cc:276] 0709 12:18:50.852342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.645007 (+792665us) service_pool.cc:224] Handling call
0709 12:18:52.183005 (+537998us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b540003eb54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:52.183166 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216131456}
I20260709 12:18:52.189198 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:52.166234 31977 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.189476 28678 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.169229 31664 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.188908 28676 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:52.191715 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:52.195940 29318 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:52.196972 28679 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:52.195984 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.198499 29326 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:52.199860 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.201457 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.202278 28676 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.203697 28681 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.203790 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.204594 28682 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.205125 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:52.205418 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.209322 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:52.265615 31977 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:52.208711 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.198266 31664 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.173282 31893 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.329962 28605 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:52.285318 31970 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260709 12:18:52.189198 31832 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.265166 28598 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:52.306687 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 182342us
I20260709 12:18:52.214008 28606 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.345204 28674 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:52.312968 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.314392 29318 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:52.315577 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:52.178690 31517 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:52.321727 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 131354us
I20260709 12:18:52.322716 28679 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.361367 28607 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:52.365389 31974 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:52.384967 31974 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.385330 31974 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:52.385774 31443 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.386509 31443 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:18:52.390897 28648 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.719s (SENT)
I20260709 12:18:52.391564 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:52.392619 31738 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:52.398061 28677 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:52.367786 28679 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:52.373134 28599 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:52.375305 29292 leader_election.cc:336] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.897s (SENT)
I20260709 12:18:52.405169 28678 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:52.376744 31958 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:18:52.464802 28676 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:52.376596 31832 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.377980 31893 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:52.369407 31980 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:18:52.403275 28682 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:52.408464 28679 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:52.466667 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.467005 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.467361 31832 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.467617 28679 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:52.467995 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:52.408938 31920 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:52.468746 31920 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:52.469671 28682 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:52.471482 28676 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:52.367197 31477 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:52.410207 31975 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.003s
I20260709 12:18:52.411629 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2205) took 2970 ms. Trace:
I20260709 12:18:52.473666 28601 rpcz_store.cc:276] 0709 12:18:49.441275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.610468 (+2169193us) service_pool.cc:224] Handling call
0709 12:18:51.636304 (+ 25836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:51.651159 (+ 14855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:51.651187 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:51.656379 (+  5192us) log.cc:844] Serialized 26 byte log entry
0709 12:18:51.747562 (+ 91183us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:51.752749 (+  5187us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.929759 (+177010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.411212 (+481453us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b54001234d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:52.411257 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:52.411306 (+    49us) raft_consensus.cc:1685] finished
0709 12:18:52.411399 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.411553 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11167,"prepare.queue_time_us":5009,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":86308,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":191,"spinlock_wait_cycles":3919744,"thread_start_us":257311,"threads_started":2,"wal-append.queue_time_us":115873}
I20260709 12:18:52.475739 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.412025 28607 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:52.477213 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.477701 28607 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.412618 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.480957 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.412989 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 550) took 1668 ms. Trace:
I20260709 12:18:52.481647 28753 rpcz_store.cc:276] 0709 12:18:50.744903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.745256 (+1000353us) service_pool.cc:224] Handling call
0709 12:18:52.316580 (+571324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:52.328579 (+ 11999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.328616 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:52.328678 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:52.328727 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.328815 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.412820 (+ 84005us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54002d55d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:52.412914 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188441344}
I20260709 12:18:52.412853 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.484716 28598 raft_consensus.cc:2368] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10.
I20260709 12:18:52.485554 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.485672 31920 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.486704 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.487282 28598 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:52.487703 31920 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.488045 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:52.415211 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 99747.7us
I20260709 12:18:52.419314 31721 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:52.420804 28680 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:52.421406 31968 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.570s	user 0.002s	sys 0.000s
I20260709 12:18:52.423437 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 1959) took 1085 ms. Trace:
W20260709 12:18:52.377593 31985 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:52.504751 28673 rpcz_store.cc:276] 0709 12:18:51.365612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.372984 (+  7372us) service_pool.cc:224] Handling call
0709 12:18:52.420307 (+1047323us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54003e12d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:52.423328 (+  3021us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115186944}
I20260709 12:18:52.425041 28647 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:52.507467 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 82550.2us
I20260709 12:18:52.508375 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:52.375022 31977 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:52.426259 29292 leader_election.cc:336] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.897s (SENT)
I20260709 12:18:52.427799 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.428157 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.428556 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:52.430064 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.430526 31887 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:52.431928 31938 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.422782 28681 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:52.433549 28605 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:52.435104 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:52.435178 31946 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.444763 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:52.445252 31918 consensus_meta.cc:287] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.008s
I20260709 12:18:52.434487 31974 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:52.517539 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.459553 31443 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:52.463454 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.464183 29318 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:18:52.465188 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:52.373785 31517 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:52.481019 28679 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:18:52.358835 31908 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.413884 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.504077 31721 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:52.492015 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.476423 28601 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:52.492857 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.493705 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.493870 31975 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.494263 28750 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:18:52.492774 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.530791 28749 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.494369 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.493705 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.531000 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.498594 28598 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.502099 28607 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:52.510769 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:52.456647 28754 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 5.
W20260709 12:18:52.521999 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 86963.3us
I20260709 12:18:52.524343 28606 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:52.532665 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 2236) took 1013 ms. Trace:
I20260709 12:18:52.490929 31896 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:52.515062 31887 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:52.530793 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.532099 28747 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.535919 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.533004 28754 rpcz_store.cc:276] 0709 12:18:51.519187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.558125 (+ 38938us) service_pool.cc:224] Handling call
0709 12:18:52.282175 (+724050us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:52.532605 (+250430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31694592}
I20260709 12:18:52.536810 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.541671 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.542686 28607 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.546914 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:52.548195 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.548796 31974 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:52.549031 28749 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.549441 31974 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:52.549849 31974 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.550187 31974 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.547191 28753 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 5.
I20260709 12:18:52.552810 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:52.553622 28673 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:52.517112 31958 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:52.520835 31811 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:52.560689 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.520185 31993 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:52.563283 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 170188us
I20260709 12:18:52.528697 31822 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:52.565204 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.565335 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.510141 31952 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.567341 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.539160 28605 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:52.568127 28601 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.513630 31664 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.569306 28598 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:52.571030 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:52.570019 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56851us
I20260709 12:18:52.571625 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:52.571374 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.526129 31918 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:52.573031 28598 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:52.576732 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.576866 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.577356 28606 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:52.577693 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.579043 28677 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:18:52.580843 31843 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:18:52.581682 28648 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.838s (SENT)
I20260709 12:18:52.581660 31721 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.569397 31517 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:18:52.582369 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:52.583261 31908 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:52.583244 31721 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.584794 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 505) took 3163 ms. Trace:
I20260709 12:18:52.578886 31811 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:52.585875 31811 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:52.586076 31745 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:52.586284 31811 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:52.586638 31745 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.573019 31741 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:52.590080 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2231) took 1103 ms. Trace:
W20260709 12:18:52.590165 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 163929us
I20260709 12:18:52.585184 28602 rpcz_store.cc:276] 0709 12:18:49.421625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.614224 (+2192599us) service_pool.cc:224] Handling call
0709 12:18:51.650306 (+ 36082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:51.666321 (+ 16015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:51.666355 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:51.666846 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:18:51.717736 (+ 50890us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:51.719344 (+  1608us) log.cc:844] Serialized 14 byte log entry
0709 12:18:51.719517 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.719600 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:52.420709 (+701109us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:52.584514 (+163805us) raft_consensus.cc:1685] finished
0709 12:18:52.584617 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.584737 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13073,"prepare.queue_time_us":928,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":38308,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":232,"spinlock_wait_cycles":102538496,"thread_start_us":50481,"threads_started":1,"wal-append.queue_time_us":107102}
W20260709 12:18:52.590945 29292 leader_election.cc:336] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.976s (SENT)
I20260709 12:18:52.591429 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.593011 28602 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:52.591529 29292 leader_election.cc:336] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.976s (SENT)
I20260709 12:18:52.593914 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.594118 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:52.581087 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.596779 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.597352 28605 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:52.599895 28605 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:52.590565 28752 rpcz_store.cc:276] 0709 12:18:51.487102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.799286 (+312184us) service_pool.cc:224] Handling call
0709 12:18:51.830094 (+ 30808us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:51.851512 (+ 21418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:51.851561 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:51.938289 (+ 86728us) log.cc:844] Serialized 52 byte log entry
0709 12:18:52.096114 (+157825us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:52.317806 (+221692us) log.cc:844] Serialized 14 byte log entry
0709 12:18:52.490733 (+172927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.492420 (+  1687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:52.589857 (+ 97437us) raft_consensus.cc:1685] finished
0709 12:18:52.589878 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:52.590022 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":407,"prepare.queue_time_us":394869,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":79306,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":7255,"thread_start_us":462802,"threads_started":3,"wal-append.queue_time_us":186423}
I20260709 12:18:52.604863 28598 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.606077 28598 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:52.607208 28598 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:52.608312 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:52.608383 28606 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:52.610297 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:52.610054 31811 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.612608 31938 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:52.613231 31938 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:52.613365 31987 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:52.613806 31952 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.614543 31987 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:52.614189 31938 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.614933 31987 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:52.615350 31987 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:52.616540 28648 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.051s (SENT)
I20260709 12:18:52.616950 31443 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:52.617372 31443 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:52.617560 28648 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.051s (SENT)
I20260709 12:18:52.618103 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:52.616616 31992 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:52.619787 31992 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:52.620101 31992 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:52.621024 31992 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.622381 31992 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.612558 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:52.623803 31443 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.624997 31832 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:52.625312 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.626060 31443 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.626534 31745 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:52.628078 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.630105 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:52.630656 29323 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:18:52.631384 31918 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:52.573215 31822 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:52.632361 31987 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.632659 31822 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.603869 31974 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:52.634582 28600 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.598278 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:52.636725 28599 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.637068 28598 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:52.641085 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:52.641928 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 73646.2us
I20260709 12:18:52.643334 28602 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.644173 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:52.644856 29325 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.644271 28601 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
W20260709 12:18:52.646664 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68707.4us
I20260709 12:18:52.647997 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:52.648746 31952 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:52.650272 31975 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.574030 31993 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.652865 29318 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:52.654515 28648 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.078s (SENT)
I20260709 12:18:52.654963 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:52.655788 31952 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:52.656080 28648 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.106s (SENT)
I20260709 12:18:52.657425 31887 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.659137 31887 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.659992 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:52.660811 29321 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:18:52.654539 31993 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.661500 31664 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:52.662132 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.662489 28606 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:52.662720 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:52.663193 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.641566 31745 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:52.664939 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:52.665587 29318 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:52.666896 28573 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:52.668864 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:52.671123 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:52.671947 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:52.672073 31918 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:52.673564 31952 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:52.677335 28648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.198s (SENT) [suppressed 74 similar messages]
I20260709 12:18:52.685490 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:52.685725 31664 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:52.686292 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:52.688179 31876 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:52.696074 29323 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:52.637140 31811 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.713964 28647 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:52.719513 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 52712us
W20260709 12:18:52.721658 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.724184 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.725186 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.725909 28750 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.724328 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.727306 28752 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:18:52.726629 31958 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:52.731178 28755 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:52.731434 31958 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:52.732455 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.696696 31918 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:52.728816 31977 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:52.738633 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.754233 28748 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:52.728159 31517 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:52.753237 28720 leader_election.cc:336] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.537s (SENT)
I20260709 12:18:52.732002 31958 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.758723 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:52.756184 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:52.756295 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.725211 31908 raft_consensus.cc:2764] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:18:52.739477 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.763799 28755 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.763753 28750 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.739177 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:52.765705 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.766968 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.758975 31517 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.733477 31876 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.773051 28573 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:52.775426 29323 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:52.776839 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:52.772528 31517 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:52.783443 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.783766 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.785362 28754 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:52.787432 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.788054 28749 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:52.788872 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.789412 28747 raft_consensus.cc:2376] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8. Re-sending same reply.
I20260709 12:18:52.789822 31876 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:52.791203 29292 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.194s (SENT)
I20260709 12:18:52.791071 31517 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:52.792482 29292 leader_election.cc:336] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.222s (SENT)
W20260709 12:18:52.793833 29292 leader_election.cc:336] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.231s (SENT)
I20260709 12:18:52.794186 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:52.794775 28677 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:52.768936 31977 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:52.798632 31974 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:52.802943 31987 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.803416 31822 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:52.794299 31908 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:52.815505 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:52.872334 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.842105 28647 leader_election.cc:400] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:52.872730 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.807096 28679 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:52.873090 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.877087 28647 leader_election.cc:403] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:52.865682 28747 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:18:52.844331 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.807183 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.878239 28756 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.858193 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:52.780905 31938 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:52.877444 28751 raft_consensus.cc:2376] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5. Re-sending same reply.
I20260709 12:18:52.881383 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.881647 31938 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:52.881760 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.882223 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.882480 28756 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 5: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.871878 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.882673 31938 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.883255 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.883666 28756 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:52.884413 31876 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:52.886797 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106609us
I20260709 12:18:52.866039 31887 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.895465 28748 raft_consensus.cc:2410] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:18:52.894501 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 100856us
I20260709 12:18:52.882436 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.861668 31977 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.899046 31887 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:52.900499 31843 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:52.901865 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.902304 31946 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:52.902575 28601 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:52.902694 31946 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.903064 31946 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:52.903097 31887 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.904304 31664 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:52.904887 32000 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:52.864751 31517 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:52.908663 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.879132 31908 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.910265 28677 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:52.914407 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:52.905884 31745 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:52.917358 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.921669 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.917928 28756 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:52.916190 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.923738 28599 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:52.922449 29325 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:18:52.924125 28749 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:52.925215 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:52.926242 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.926990 28747 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:52.926496 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.898679 31822 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:52.930749 28600 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:52.930816 28602 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:52.931483 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:52.929919 28753 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:18:52.853725 31918 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:52.910255 31811 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:18:52.931885 28607 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:52.985662 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 64680.9us
I20260709 12:18:52.946489 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:52.937402 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.812059 28750 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:52.988108 28749 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:52.985373 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:52.992726 28605 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.957221 28647 leader_election.cc:400] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:52.993724 28647 leader_election.cc:403] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:52.962379 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:52.994823 28756 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:52.931960 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:52.996225 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 66067.7us
I20260709 12:18:53.000305 28747 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
W20260709 12:18:53.006145 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 76629.9us
I20260709 12:18:52.914994 31908 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:52.984872 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:53.008324 28751 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:52.923272 31745 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:53.012811 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:52.930322 31843 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:53.020998 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:53.021370 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:53.021733 28748 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:53.022753 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:53.023545 28750 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:53.020803 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:53.034415 28754 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:52.923857 31738 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:18:53.043627 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:53.014803 31832 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:53.048874 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:53.045607 28751 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:18:53.046993 28750 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.049782 28748 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:53.051260 28751 pending_rounds.cc:85] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 6
I20260709 12:18:53.055972 28751 pending_rounds.cc:107] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:18:53.056214 28751 raft_consensus.cc:2889] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:53.058452 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:53.036309 31952 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:53.068368 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.065653 28749 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:18:53.076960 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.084898 28753 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:53.088373 31720 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:53.089301 28722 leader_election.cc:336] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.543s (SENT)
I20260709 12:18:53.089792 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:53.090754 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 146950us
I20260709 12:18:53.091084 28679 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:18:53.092844 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 84606us
I20260709 12:18:53.093156 31440 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:53.095492 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:53.100492 28505 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 337) took 17883 ms (client timeout 15000 ms). Trace:
I20260709 12:18:53.049233 32000 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:53.085295 28753 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:53.110530 28750 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:53.130388 28754 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
W20260709 12:18:53.145195 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 188137us
W20260709 12:18:53.158380 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.159451 28674 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:53.164637 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 140363us
I20260709 12:18:53.081068 31832 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:53.150839 31741 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:18:53.100903 28505 rpcz_store.cc:269] 0709 12:18:35.188522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.188697 (+   175us) service_pool.cc:224] Handling call
0709 12:18:53.058250 (+17869553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:52.369879 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:52.370937 (+  1058us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:52.371016 (+    79us) write_op.cc:435] Acquired schema lock
0709 12:18:52.371043 (+    27us) tablet.cc:662] Decoding operations
0709 12:18:52.439142 (+ 68099us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:52.439249 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:52.439295 (+    46us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:18:52.441198 (+  1903us) tablet.cc:701] Row locks acquired
0709 12:18:52.441263 (+    65us) write_op.cc:260] PREPARE: finished
0709 12:18:52.441491 (+   228us) write_op.cc:270] Start()
0709 12:18:52.441689 (+   198us) write_op.cc:276] Timestamp: P: 1783599532441411 usec, L: 0
0709 12:18:52.441723 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:18:52.442604 (+   881us) log.cc:844] Serialized 5192 byte log entry
0709 12:18:52.601120 (+158516us) op_driver.cc:464] REPLICATION: finished
0709 12:18:52.790199 (+189079us) write_op.cc:301] APPLY: starting
0709 12:18:52.790299 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:52.790594 (+   295us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:52.790739 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:52.792422 (+  1683us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:52.842537 (+ 50115us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:18:52.842597 (+    60us) write_op.cc:312] APPLY: finished
0709 12:18:52.843115 (+   518us) log.cc:844] Serialized 95 byte log entry
0709 12:18:52.843337 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:52.843521 (+   184us) write_op.cc:454] Released schema lock
0709 12:18:52.843597 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:52.844092 (+   495us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:52.844124 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":748,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":178215,"apply.run_cpu_time_us":4273,"apply.run_wall_time_us":53867,"num_ops":13,"prepare.queue_time_us":311068,"prepare.run_cpu_time_us":34678,"prepare.run_wall_time_us":201939,"raft.queue_time_us":17565,"raft.run_cpu_time_us":13085,"raft.run_wall_time_us":150021,"replication_time_us":159211,"thread_start_us":401318,"threads_started":4,"wal-append.queue_time_us":137937}]]}
W20260709 12:18:53.173032 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 267354us
I20260709 12:18:53.126026 32000 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:53.145195 31992 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:53.214574 29323 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:53.211894 28753 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:53.218600 28753 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.145332 31876 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:18:53.158747 31477 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:18:53.060003 31822 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:53.231405 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 139737us
I20260709 12:18:53.219352 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:53.170579 31974 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:18:53.214363 32000 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:53.104841 31745 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.227087 31517 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:18:53.243114 31952 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:53.262833 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:53.266851 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 171423us
I20260709 12:18:53.257755 31440 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:53.247234 31887 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:18:53.251148 32017 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7.
I20260709 12:18:53.261307 31952 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:53.262455 31987 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:53.292732 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 134824us
I20260709 12:18:53.287972 31745 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:53.246964 31832 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:53.294792 28722 leader_election.cc:336] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.803s (SENT)
I20260709 12:18:53.287752 31876 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:53.307327 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:53.324223 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:53.297626 31920 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:18:53.328063 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 87863.2us
W20260709 12:18:53.338409 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 119131us
I20260709 12:18:53.341207 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.342280 31876 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:53.342700 31876 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.343035 31876 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:53.344583 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46724.3us
I20260709 12:18:53.345889 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:53.306226 32023 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:53.349527 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.297848 31987 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.346789 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.334539 31738 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:53.333333 31920 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:53.360826 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:53.349884 32017 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:18:53.362648 28504 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.367828 28605 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:53.325866 32015 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:18:53.344831 31477 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:18:53.374752 31477 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:53.375115 31477 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:53.375988 31477 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.377418 31477 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:53.365964 31958 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.002s
W20260709 12:18:53.369973 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 65116.9us
I20260709 12:18:53.348392 32022 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:53.327805 31440 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:53.361486 31738 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:53.370361 32012 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:18:53.361653 31974 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.369450 28504 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 7, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 7 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.399735 28753 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:18:53.399137 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 63543.3us
I20260709 12:18:53.411350 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:53.397651 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.413895 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:53.379244 32014 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:53.416420 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:53.416821 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:53.418677 28504 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 5, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 5 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.346810 32024 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:18:53.421275 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:53.365317 32016 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:18:53.424798 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:53.424099 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:53.424022 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:53.425464 29326 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:18:53.410955 31738 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:53.428141 29325 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:53.350203 31952 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:53.423445 28504 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 2 to 6, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 6 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.431149 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:53.415052 31720 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:53.365785 32023 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.434751 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.436244 28676 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:53.399312 31958 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:53.438009 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.423453 32029 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:53.436594 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:53.438318 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:53.439095 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:53.417688 32014 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:53.439306 28504 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 3 to 6, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 6 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.424590 32030 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.441802 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:53.449337 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 154561us
I20260709 12:18:53.451763 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.452206 31952 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.453006 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.454147 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:53.455185 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.414837 31920 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:53.443989 32015 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:53.457072 31920 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:53.444788 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:53.462201 28674 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:53.456161 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.459920 28673 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:53.432904 32028 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:53.421376 31974 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:53.467936 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.442955 32029 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.466645 28504 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 2 to 8, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 8 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:53.472343 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:53.472500 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:53.474848 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.475495 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.469266 31440 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.477145 28682 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:18:53.477046 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:53.477596 32032 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:53.473093 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.446643 32014 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:53.483353 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 142228us
W20260709 12:18:53.486368 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 88824.9us
I20260709 12:18:53.491129 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.442793 32017 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:18:53.478106 32019 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:18:53.513586 28682 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:53.514075 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45732.7us
I20260709 12:18:53.540807 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.478029 32032 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:53.554572 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 70069.3us
I20260709 12:18:53.549893 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:53.479638 32037 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:53.466187 31908 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.474205 32029 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:53.474438 32028 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:53.506291 28504 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 7, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129), pending config changed. New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:53.581254 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47255.4us
I20260709 12:18:53.582111 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:53.583247 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:53.584414 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.555878 29325 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:53.587397 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46720.7us
W20260709 12:18:53.587648 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 143666us
W20260709 12:18:53.587323 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 110350us
I20260709 12:18:53.589901 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:53.591313 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:53.504524 32016 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:18:53.600953 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:53.457708 32030 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:53.636859 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53668.8us
I20260709 12:18:53.638468 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:53.640938 28678 raft_consensus.cc:2368] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8.
I20260709 12:18:53.642477 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:53.538453 32043 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:53.649268 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:53.650300 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57150.3us
I20260709 12:18:53.648595 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:53.651970 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 96694.9us
I20260709 12:18:53.653066 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:53.655793 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:53.657395 28601 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:53.591912 31987 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:53.593255 32024 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:53.657686 29322 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:53.601902 32037 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:53.600770 31741 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:53.557473 32032 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:53.554211 31876 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.667577 28504 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 3 to 5, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 5 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.641338 32038 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:53.680776 32038 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:53.681546 32030 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:53.679944 31987 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:18:53.682147 32030 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:53.682538 32030 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:53.683359 32030 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.685678 28504 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:53.688997 32041 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:18:53.690223 31876 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:53.692124 32016 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:53.692987 32016 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:53.696805 32025 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:53.697254 32025 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:53.698099 32025 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.699445 32025 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:53.701390 32040 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:18:53.656363 31975 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:53.717949 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.722755 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.752381 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:53.765120 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 99338.9us
I20260709 12:18:53.768019 29325 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:53.664923 32024 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.778055 31822 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:53.780526 32020 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:53.783771 32037 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.787824 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.789001 32035 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.789644 32035 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.791793 32035 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:53.789090 31843 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:53.792640 31843 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:53.792824 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:53.793407 28601 raft_consensus.cc:2376] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7. Re-sending same reply.
I20260709 12:18:53.780606 31958 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:53.795595 31720 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:53.796049 31720 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:53.796864 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:53.797487 28753 raft_consensus.cc:2376] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7. Re-sending same reply.
I20260709 12:18:53.799525 31811 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:53.799966 31811 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:53.800926 31811 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:53.802870 32023 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:53.808035 31946 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.904s	user 0.006s	sys 0.005s
I20260709 12:18:53.808133 31720 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:53.808320 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:53.843880 29319 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:53.813074 28504 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
W20260709 12:18:53.815277 31992 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.000s
I20260709 12:18:53.820001 28677 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:18:53.821319 32049 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:18:53.822474 31745 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.513s	user 0.003s	sys 0.006s
I20260709 12:18:53.824452 31843 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.825897 31908 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:53.826483 31721 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.829129 31974 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:53.829869 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:53.832286 32000 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 12:18:53.800686 32028 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:53.838974 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51231.4us
W20260709 12:18:53.841939 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 240815us
I20260709 12:18:53.872648 29290 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.842344 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:53.873871 28755 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:53.847003 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 355921us
I20260709 12:18:53.776906 32024 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.850728 28504 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:53.858206 32015 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:18:53.863744 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 206725us
I20260709 12:18:53.869042 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:53.869423 28753 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:18:53.869410 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:53.871178 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:53.876924 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.876006 28504 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 8, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 8 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:18:53.880661 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:53.857803 31992 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:53.889653 28750 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:53.870041 31977 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:53.892001 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:53.848760 31946 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.909590 32043 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:53.898733 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.898808 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.886293 31843 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:53.901047 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:53.903807 31876 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:53.916952 28752 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.903983 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:53.918258 28602 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.904844 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:53.905588 31477 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:53.906060 32031 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:53.894941 31745 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:53.910429 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:53.871851 32025 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 12:18:53.930001 32022 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
I20260709 12:18:53.930416 32022 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:53.923908 31517 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:53.930889 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:53.931042 32022 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:53.931835 32022 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:53.932488 29317 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.933077 32025 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:53.933480 32030 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:53.913401 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 267718us
W20260709 12:18:53.936554 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.938055 31938 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:53.938510 31938 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.938905 31938 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:53.913587 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 271148us
I20260709 12:18:53.872165 31721 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:53.918720 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:53.912480 31975 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:53.926141 31741 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:53.926630 32032 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:53.973367 29319 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:18:53.973831 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77967.6us
I20260709 12:18:53.928107 31738 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:53.926177 32052 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:53.922919 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:53.949854 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:53.976305 29326 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.952587 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:53.977615 29325 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:53.912663 31974 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:53.955643 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.956027 29317 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:53.927222 31811 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:53.904142 32029 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:53.986608 32029 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:53.989089 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.990089 28675 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:18:53.992214 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.993093 28675 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:53.995951 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 77327.4us
I20260709 12:18:53.996978 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:53.999029 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:54.001461 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:54.002225 28678 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:54.002007 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:53.975585 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52732.4us
I20260709 12:18:54.006989 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.008311 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:54.008956 29322 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:53.999749 28674 raft_consensus.cc:2376] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7. Re-sending same reply.
W20260709 12:18:54.009932 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.006s	sys 0.014s
W20260709 12:18:54.010345 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.006s	sys 0.014s
I20260709 12:18:54.011075 32055 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:54.017649 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.018234 28754 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:54.018923 28681 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:53.933499 32025 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:53.880203 32000 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.013062 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:54.022229 28673 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 12:18:53.954998 32040 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:53.954706 31975 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.974774 31517 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:54.022716 28748 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:54.025710 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:53.939711 32015 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.026134 28750 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:53.977105 31992 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.020569 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:54.032941 28750 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:54.028118 28751 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:54.012280 31745 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:53.973801 32022 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:18:54.010661 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 527250us
W20260709 12:18:54.052459 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.053093 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:18:54.075937 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.076225 28754 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.053527 32051 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:54.056169 28749 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 5.
I20260709 12:18:54.056859 31974 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:54.059295 32014 consensus_meta.cc:287] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 12:18:54.032397 31975 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:54.070605 31721 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.081403 32051 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:54.093122 32051 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:54.094262 32051 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.025190 31987 consensus_queue.cc:1243] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:54.095901 32051 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:54.023247 32020 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:54.096885 32020 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:54.080401 29322 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:54.098021 32020 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.082626 31974 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.106350 31974 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.087827 31721 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:18:54.108109 31721 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:54.108721 31721 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.111259 31721 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.070399 28750 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.113763 28750 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.117246 28753 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:54.117750 28753 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:54.019881 31946 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.053153 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:54.122946 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 69919.5us
I20260709 12:18:54.123699 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.098802 31987 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:54.128273 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.135304 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:54.138229 28754 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:18:54.013993 31977 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:18:54.156215 28648 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.156260 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:54.075279 31745 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:54.064188 31918 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:54.195233 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:54.173945 28674 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:54.211143 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:54.214713 28753 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.050734 31992 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:54.223278 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67143.8us
I20260709 12:18:54.226481 28680 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:54.227671 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:54.194149 31946 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:54.207784 31745 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:54.233299 28753 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:54.234807 28675 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:54.212561 31477 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:54.218914 32016 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:54.232460 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.208504 31918 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.082993 32014 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.237673 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:54.235550 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:54.243840 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:54.228528 31958 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:54.253927 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 240930us
W20260709 12:18:54.260643 28720 leader_election.cc:336] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.088s (SENT)
I20260709 12:18:54.194334 28750 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:54.205196 32025 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.275223 28682 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:54.284905 28753 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:54.248884 31477 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:54.244709 32016 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:18:54.312377 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 80005.9us
I20260709 12:18:54.316545 32052 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:54.316735 32054 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.274957 31908 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:54.316890 32058 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
W20260709 12:18:54.318466 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45371.7us
I20260709 12:18:54.242300 31975 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.335875 28602 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:54.302738 31977 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:54.313331 32035 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:18:54.317679 32059 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:54.354089 31908 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:54.311870 31477 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:54.354504 32033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.003s	sys 0.018s
I20260709 12:18:54.355762 31920 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:54.356155 31876 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:54.356808 32036 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:54.357076 32061 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:18:54.357707 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:54.360605 32058 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:54.361349 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 119830us
I20260709 12:18:54.433218 28748 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.230444 31517 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.363358 29326 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
W20260709 12:18:54.364063 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.316617 32066 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.365079 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.354141 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:54.381467 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53149.3us
W20260709 12:18:54.351260 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 333644us
W20260709 12:18:54.442678 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77689.7us
I20260709 12:18:54.442819 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:54.374344 28680 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:54.400552 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.330564 31738 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:54.323566 32032 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:54.346051 32056 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:54.362437 31977 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:54.416555 32033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.003s	sys 0.018s
I20260709 12:18:54.444018 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.399349 32059 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:54.417243 32025 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:54.423053 31876 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:54.416342 31477 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:54.454627 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:54.456868 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 102791us
I20260709 12:18:54.347138 32015 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:18:54.345541 32020 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:18:54.486166 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:54.512053 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.460330 31977 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:54.453434 28673 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:54.516764 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.453682 31664 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:54.528807 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 95044.8us
I20260709 12:18:54.478447 31974 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:18:54.537918 28752 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.620s	user 0.021s	sys 0.000s
I20260709 12:18:54.538395 28752 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:54.539000 28748 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:54.517023 32074 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:54.317739 32052 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:54.559291 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 73218.9us
I20260709 12:18:54.560225 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.517017 32000 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:54.439435 32036 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.541316 32015 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.447248 32058 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.543404 31992 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.540714 32037 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.541618 31974 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:54.553973 32023 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:54.602244 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 158318us
I20260709 12:18:54.610040 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:54.654430 28677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1830) took 1223 ms (client timeout 1567 ms). Trace:
I20260709 12:18:54.662158 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2005) took 1179 ms. Trace:
W20260709 12:18:54.662601 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.665671 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 55724.4us
I20260709 12:18:54.666687 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:54.654868 28677 rpcz_store.cc:269] 0709 12:18:53.430728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.430928 (+   200us) service_pool.cc:224] Handling call
0709 12:18:54.614588 (+1183660us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400273154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:54.654367 (+ 39779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892130048}
W20260709 12:18:54.667646 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53204.9us
I20260709 12:18:54.669170 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:54.662778 28681 rpcz_store.cc:276] 0709 12:18:53.432178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.435374 (+  3196us) service_pool.cc:224] Handling call
0709 12:18:53.444324 (+  8950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:54.019317 (+574993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:54.611064 (+591747us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400272254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:54.611303 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321017216}
I20260709 12:18:54.669770 28748 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:54.665813 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 785) took 1251 ms. Trace:
W20260709 12:18:54.607674 32064 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:18:54.676927 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:54.677865 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:54.575394 32082 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.670670 29317 rpcz_store.cc:276] 0709 12:18:53.414092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.414214 (+   122us) service_pool.cc:224] Handling call
0709 12:18:54.665641 (+1251427us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b5400680e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:54.665758 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165723264}
I20260709 12:18:54.604303 32022 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:54.561158 32074 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:18:54.679466 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 132037us
I20260709 12:18:54.614676 32054 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:54.694509 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.697482 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:54.564590 32057 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 12:18:54.678409 32000 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:54.673307 31843 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.004s
I20260709 12:18:54.674383 31987 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.604622 32015 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.667109 31992 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:54.510243 32016 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:54.696345 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 136217us
I20260709 12:18:54.665230 32063 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.717712 32063 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.718530 32058 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:54.719808 32063 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.707195 32060 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:54.709008 28748 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:54.677250 31918 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.709354 32054 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.680491 32026 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:54.590449 31876 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:54.714432 32062 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:18:54.714645 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.714674 32076 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.591391 32059 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.716827 32067 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 12:18:54.614905 32037 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:54.726058 32072 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:18:54.666953 32023 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:54.751916 32075 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 12:18:54.752663 31721 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.753784 32023 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:54.756632 32073 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260709 12:18:54.757916 32065 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:18:54.760600 32037 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:54.713724 31938 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
I20260709 12:18:54.711300 32032 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.761785 32032 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:54.721453 32051 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.000s
I20260709 12:18:54.763866 32032 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.713014 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:54.765491 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52594.3us
I20260709 12:18:54.765352 28747 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:54.767078 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:54.712510 32038 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:54.748965 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.751633 32077 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:54.763852 31946 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:54.710865 31975 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.767664 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:54.748898 32083 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:18:54.712402 32056 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.720713 32022 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:54.771000 32076 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:54.771750 32043 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.860s	user 0.013s	sys 0.010s
I20260709 12:18:54.725440 32036 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:54.727169 31987 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:54.746961 31811 consensus_meta.cc:287] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.002s
I20260709 12:18:54.723508 32015 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:54.737190 32026 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:54.721676 32099 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:54.739105 32054 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.782346 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:54.826524 29317 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:54.723013 31745 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:54.808290 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 59395.5us
I20260709 12:18:54.829849 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.800560 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:54.800480 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:54.817082 28682 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:54.823621 28676 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:54.824110 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62388.3us
I20260709 12:18:54.831559 28681 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:54.831379 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:18:54.825105 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 130664us
I20260709 12:18:54.793860 31946 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:54.720384 31974 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.793895 32040 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:54.818601 31720 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.961s	user 0.010s	sys 0.001s
I20260709 12:18:54.834825 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:54.831401 29321 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:54.794230 32059 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.834590 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:54.835404 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:54.836647 28679 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:54.837908 31876 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:54.817665 31887 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:54.792702 32077 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:54.844139 29322 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:54.846557 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:54.860834 29321 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:54.847272 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:54.847939 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:54.848140 29319 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:54.848299 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:54.844995 29317 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:54.844951 28680 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:54.786437 31938 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.865867 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:54.835704 32022 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:18:54.846920 32055 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.006s	sys 0.000s
I20260709 12:18:54.873189 29318 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:54.844415 32069 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:18:54.876794 28602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:54.877550 28602 raft_consensus.cc:606] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:18:54.849681 32076 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:54.849583 32099 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:54.833328 32036 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:18:54.844326 32078 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:54.887861 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:54.859584 31721 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:54.895066 28680 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:54.749995 32074 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.898908 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:54.896256 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:54.891630 28605 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:54.889792 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:54.896554 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:54.896720 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:54.901115 28605 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:54.889132 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:54.869621 31974 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:54.877835 32055 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.006s	sys 0.000s
I20260709 12:18:54.861303 32077 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:54.824885 32056 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:54.909659 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:54.909896 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:54.910475 28605 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:54.849830 31720 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.897425 28754 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:54.906518 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:54.899098 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.899744 29317 raft_consensus.cc:2376] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7. Re-sending same reply.
W20260709 12:18:54.911929 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 81407.5us
I20260709 12:18:54.868177 32031 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:18:54.915390 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:54.865409 31477 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:54.916149 28598 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:18:54.896302 31975 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:54.894158 31517 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:54.885190 31918 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:18:54.923537 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.925927 32076 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.929163 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:54.866925 32071 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.219s
W20260709 12:18:54.931411 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 100102us
I20260709 12:18:54.905038 32055 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:54.932420 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:54.931071 28600 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:54.909873 31721 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:54.991935 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:54.998008 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 82688.3us
I20260709 12:18:54.930383 29318 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:54.933043 32024 consensus_meta.cc:287] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.044s	user 0.012s	sys 0.000s
I20260709 12:18:54.897449 31946 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:55.041973 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 112886us
W20260709 12:18:55.034341 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 98982.9us
W20260709 12:18:55.043100 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.043303 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:55.040493 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:55.049736 29325 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:55.050594 31952 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:54.894870 32026 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.044476 32024 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.056620 31477 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:55.070493 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.071439 31987 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.070787 32026 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.072077 32014 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.034821 32022 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.058454 31938 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:54.932919 31975 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.037791 32000 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:55.064424 28571 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:55.033776 31664 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.931767 31517 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.066546 31992 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:55.067997 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:55.068598 32076 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:55.069514 32024 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.069998 28678 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:55.072992 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.056691 32056 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:55.060317 31977 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.000s
I20260709 12:18:55.092859 32000 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:55.094508 32102 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:18:55.094211 31977 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.095167 32050 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:55.095597 32050 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.096009 32050 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.098433 31720 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.081450 32099 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.074191 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:55.075948 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:55.074359 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:55.078280 32066 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.001s
I20260709 12:18:55.037673 32040 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.034138 32037 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.012508 32015 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:18:55.075132 32025 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 12:18:55.065207 31952 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.080050 31946 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:55.093984 32055 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:55.085249 32097 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:18:55.059466 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:55.104301 32110 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
I20260709 12:18:55.102015 32066 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:55.120016 31920 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.082592 31745 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.106458 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:55.109156 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:55.125846 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:55.086422 32112 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:55.110301 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.112051 28720 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:55.072568 31908 consensus_queue.cc:1175] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" responder_term: 8 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: [7.6-7.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:55.114668 29317 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:55.101215 29325 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:55.118793 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:55.132136 28679 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:55.132524 29320 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:55.133414 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:55.118923 29321 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
W20260709 12:18:55.092223 32030 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.158s	user 0.012s	sys 0.000s
I20260709 12:18:55.096264 32000 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.127139 28751 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:18:55.125078 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57145.8us
I20260709 12:18:55.125258 31920 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.143708 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:55.128595 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:55.144169 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:55.144832 29326 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:18:55.108253 31952 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.134403 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:55.155541 28756 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:55.156420 29326 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:55.135782 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:55.137049 31720 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:55.138482 32070 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:55.134114 32076 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:55.141925 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:55.116623 31992 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:55.089282 31664 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.153000 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:55.159152 28720 leader_election.cc:400] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8.
W20260709 12:18:55.141491 32095 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:18:55.165294 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:55.167152 29320 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:55.112783 32037 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.141469 31741 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:55.175333 28679 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:55.162902 31720 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.162331 32063 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:18:55.188659 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:55.162523 32071 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:55.192341 29320 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:55.193159 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:55.180626 28720 leader_election.cc:400] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:18:55.182633 29325 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:55.184664 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.107918 32040 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.158854 31517 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.166399 31938 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:55.173712 32070 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.109993 31721 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.179246 31987 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:55.196846 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.193917 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:55.190040 31720 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.198019 29321 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:55.264467 29321 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:55.264773 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:55.265487 28673 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:18:55.203064 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:55.203826 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:55.266585 28674 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:55.203905 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:55.267329 28678 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:55.204437 28679 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:55.207507 29327 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:55.220531 31987 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.186013 31741 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:55.222729 29320 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:55.221021 32109 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:55.261852 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:55.133678 32112 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:55.262508 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53413.7us
I20260709 12:18:55.196691 31832 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:55.272707 29325 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:18:55.262575 31517 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:55.274225 32119 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:18:55.274662 32093 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.197677 32022 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:55.205513 32070 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:55.280532 29320 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:55.282231 29325 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:55.265251 29321 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.303650 29322 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:18:55.304755 32104 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
W20260709 12:18:55.305245 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.307493 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:55.308141 28748 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:55.308502 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:55.273116 32030 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:55.277400 31745 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.309105 28751 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:55.279636 32066 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.311436 29321 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.279436 31517 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:55.317348 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:55.331003 28753 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:55.284397 31832 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:55.337598 28750 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:55.309954 31975 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.339964 28748 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:55.337598 32030 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:18:55.348356 32115 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:18:55.317999 31745 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.344520 31920 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.367398 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:55.364159 32114 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:18:55.369480 32120 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:18:55.352982 31741 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:55.370244 29290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.234s	user 0.034s	sys 0.044s
I20260709 12:18:55.370427 28678 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:18:55.372855 32040 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.376348 28675 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
W20260709 12:18:55.395354 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 87137.1us
I20260709 12:18:55.396798 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:55.378799 29321 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 12:18:55.381743 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.398007 29321 pending_rounds.cc:85] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 7
I20260709 12:18:55.323341 32077 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.333559 32066 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:55.387704 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.287693 32093 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.332612 32032 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:18:55.375419 31938 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.392489 32037 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:55.393926 29290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.258s	user 0.035s	sys 0.045s
I20260709 12:18:55.397214 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:55.398355 29321 pending_rounds.cc:107] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:18:55.390002 28678 pending_rounds.cc:85] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 4
I20260709 12:18:55.360512 31952 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.405757 29321 raft_consensus.cc:2889] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:55.404088 28678 pending_rounds.cc:107] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 12:18:55.403981 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 1.26865e+06us
I20260709 12:18:55.406775 28678 raft_consensus.cc:2889] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:55.408841 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:18:55.410811 32117 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:18:55.411921 32077 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:55.416625 31664 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.416728 32030 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.421239 31811 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.421964 31811 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.422755 31952 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.402366 31720 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:55.425657 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.426841 31720 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:55.477388 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:55.489306 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.429577 31938 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.445513 31920 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:18:55.450742 31893 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:18:55.399132 31832 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:55.536850 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 126743us
I20260709 12:18:55.556612 32101 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:55.557727 32121 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:18:55.561303 32093 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.562841 31811 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.563711 28721 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:55.564714 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:55.565773 28721 leader_election.cc:400] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:18:55.566020 28721 leader_election.cc:403] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:18:55.566650 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:55.567018 32076 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:55.567360 32035 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:55.567469 32076 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.567862 32035 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.568020 32076 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.568625 32040 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.570137 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:55.546123 32048 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:55.541291 32077 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:55.545181 31974 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.008s
W20260709 12:18:55.583261 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:55.540807 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 132066us
I20260709 12:18:55.585470 29290 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:55.541692 32118 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:18:55.602094 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 172804us
I20260709 12:18:55.568323 32035 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.605008 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:55.609030 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:55.571975 31741 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:55.564675 31938 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:55.580681 32048 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:55.628283 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:55.638859 32059 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.789s	user 0.005s	sys 0.006s
I20260709 12:18:55.552213 32050 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.597524 31987 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:55.588166 32099 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:55.601078 32025 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:55.600129 31664 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.544865 31440 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:18:55.600828 32077 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:55.600726 32074 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:55.684033 28749 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:55.689086 29318 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:55.616677 32037 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.560118 31517 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:55.728663 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 146482us
I20260709 12:18:55.617326 32101 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:55.621440 32048 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:55.603950 32071 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:18:55.621969 32112 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.615819 32070 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.739208 29320 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:55.616117 31721 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:18:55.684393 31811 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.687422 32099 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.728504 32123 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:55.755715 32070 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.696225 31946 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.761145 29317 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:55.764312 29322 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:18:55.792852 29322 pending_rounds.cc:85] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 7
I20260709 12:18:55.793100 29322 pending_rounds.cc:107] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:18:55.793313 29322 raft_consensus.cc:2889] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:55.751936 32071 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:55.741832 32074 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:55.776364 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:55.746580 32066 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.768005 32099 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:55.812455 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 204472us
I20260709 12:18:55.813179 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:55.813196 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:55.813872 28681 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:55.813994 32038 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.814651 32038 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.744974 31876 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:55.787603 29320 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:55.776916 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:55.739729 32037 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.810738 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:55.740170 31664 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.783617 32123 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:55.816725 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:18:55.828665 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.807719 32071 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:55.828368 29317 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:55.767776 31811 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.810930 32112 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.835474 28681 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:55.837502 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:55.823477 31975 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.794028 31946 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.840173 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:55.848889 28748 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:55.840999 29318 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:55.841328 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:55.846382 32025 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:55.855213 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:55.847023 32128 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:55.848045 28750 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:55.839205 32066 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.852857 31974 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:55.853281 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.828251 32093 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:55.857571 32126 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:18:55.879707 28599 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
W20260709 12:18:55.880877 32134 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:18:55.880996 31974 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.820514 32101 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.883652 31974 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.884512 32093 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:55.885404 32038 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:55.855240 32037 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.885564 32093 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.886642 32037 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:55.887173 32037 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:55.881029 28748 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:18:55.835529 32077 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.899175 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:55.899986 28750 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
W20260709 12:18:55.900669 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 59421.6us
I20260709 12:18:55.902243 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:55.904265 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:55.907061 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:55.902869 29318 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:55.905857 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:55.827702 31876 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.857182 31664 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:55.915371 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1914) took 1588 ms. Trace:
I20260709 12:18:55.919945 28750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60476
I20260709 12:18:55.952425 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:55.951936 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:55.922739 31977 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.928488 31745 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:55.930603 32024 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:55.937543 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37386 (request call id 15) took 1061 ms. Trace:
I20260709 12:18:55.941927 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2232) took 1052 ms. Trace:
I20260709 12:18:55.911787 29317 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:18:55.955621 28750 raft_consensus.cc:606] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Received request to transfer leadership
I20260709 12:18:55.958683 28602 rpcz_store.cc:276] 0709 12:18:54.876465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.876624 (+   159us) service_pool.cc:224] Handling call
0709 12:18:55.937111 (+1060487us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54003b4aa0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39fc520 00007f6fe3a79652 00007f6fe8a4760a 00007f6fe1fcd7d4 00007f6fe1fcd762 00007f6fe1fcd691 00007f6fe1fcd60c 00007f6fe1fcc8c2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:55.937432 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129894656}
I20260709 12:18:55.959518 28750 raft_consensus.cc:614] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:55.951936 28754 rpcz_store.cc:276] 0709 12:18:54.326613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.326742 (+   129us) service_pool.cc:224] Handling call
0709 12:18:54.326999 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:54.913742 (+586743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.915082 (+1001340us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b54001c4b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:55.915298 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1311255808}
I20260709 12:18:55.848523 32112 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:55.964112 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.856062 32025 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.960206 28606 rpcz_store.cc:276] 0709 12:18:54.889948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.890204 (+   256us) service_pool.cc:224] Handling call
0709 12:18:54.904090 (+ 13886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:55.100280 (+196190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:55.100302 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:55.100330 (+    28us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:55.100350 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.941669 (+841319us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54000bf254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:55.941713 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:55.941842 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450757888}
I20260709 12:18:55.960937 29322 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:55.888093 32037 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.848775 31975 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.897393 32066 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.973011 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:55.949877 32050 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:55.959019 32090 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.958619 32024 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:55.847390 32123 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:55.991545 28754 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:55.847047 32071 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:55.994995 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.970953 31664 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:56.007265 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:56.008805 28752 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:56.030455 29322 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:18:56.040757 28754 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:56.040887 28752 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:56.045291 28605 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:18:55.957865 32074 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:55.993685 32090 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:56.053011 32135 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:18:56.056468 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.057670 31975 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:56.061371 32112 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:56.063503 32040 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
W20260709 12:18:56.063889 32026 consensus_meta.cc:287] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.992s	user 0.004s	sys 0.007s
I20260709 12:18:56.065337 32025 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:56.065801 32066 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:56.066318 31946 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:56.024315 31664 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:56.069558 31664 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:56.070106 32133 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.209s	user 0.003s	sys 0.000s
I20260709 12:18:56.072801 32090 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:56.073514 32040 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.074383 32068 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:56.073994 32040 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:56.046393 32024 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:56.074791 32068 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:56.075314 32024 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:56.075649 32068 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:56.044487 32071 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:56.079732 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.081151 31517 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:56.077343 31811 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:56.079272 32035 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:56.119119 32068 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:56.079367 32076 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.005s
I20260709 12:18:56.076253 32040 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:56.051931 32048 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:56.077278 31876 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:56.060060 32099 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:56.128468 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 220370us
I20260709 12:18:56.132292 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:56.130920 32035 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:56.145489 31811 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:56.123382 32076 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:56.158041 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:56.162736 29290 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:56.163549 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.164947 32026 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:56.164834 32148 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:18:56.165372 32026 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.165745 32026 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:56.160074 32147 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 12:18:56.168701 28553 auto_rebalancer.cc:893] Removing replace marker failed: Replica a7ec63b6634944d0b5b5ea92fa2d303e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:18:56.169263 28553 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:18:56.169669 28553 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:18:56.154934 32112 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:18:56.175217 32090 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:18:56.176555 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.176808 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:56.152869 31952 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:18:56.151448 31946 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:18:56.179069 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 757) took 1344 ms. Trace:
I20260709 12:18:56.179474 29327 rpcz_store.cc:276] 0709 12:18:54.834468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.834583 (+   115us) service_pool.cc:224] Handling call
0709 12:18:56.178893 (+1344310us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540042a9d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:56.179013 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707742464}
I20260709 12:18:56.179944 31946 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:56.177417 29317 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:56.180480 31946 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:56.189085 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:56.189815 31946 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:56.191455 31946 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:56.191759 28571 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:56.192626 29326 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:56.193823 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:56.197202 29327 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:56.199561 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:56.197268 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:56.198081 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:56.202520 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:56.203657 29327 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
W20260709 12:18:56.212419 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.234280 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:56.235479 29327 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:56.237944 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1908) took 2234 ms. Trace:
I20260709 12:18:56.230410 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1915) took 1903 ms. Trace:
I20260709 12:18:56.249295 28749 rpcz_store.cc:276] 0709 12:18:54.327223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.327337 (+   114us) service_pool.cc:224] Handling call
0709 12:18:54.360765 (+ 33428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:55.726342 (+1365577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.230045 (+503703us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400338454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:56.230330 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943643008}
I20260709 12:18:56.238477 28747 rpcz_store.cc:276] 0709 12:18:54.003642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.006172 (+  2530us) service_pool.cc:224] Handling call
0709 12:18:54.021761 (+ 15589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:54.765219 (+743458us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:54.824262 (+ 59043us) log.cc:844] Serialized 14 byte log entry
0709 12:18:54.914952 (+ 90690us) log.cc:844] Serialized 14 byte log entry
0709 12:18:54.918767 (+  3815us) log.cc:844] Serialized 14 byte log entry
0709 12:18:54.926013 (+  7246us) log.cc:844] Serialized 14 byte log entry
0709 12:18:54.926346 (+   333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:54.933235 (+  6889us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:54.933292 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:55.422245 (+488953us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b18000c79c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219
0709 12:18:55.566707 (+144462us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b18000c79c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1
0709 12:18:55.567168 (+   461us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b18000c79c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:18:55.923667 (+356499us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b18000c79c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240
0709 12:18:55.924254 (+   587us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b18000c79c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1
0709 12:18:55.955709 (+ 31455us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b18000c79c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe89a8328 00007f6fe899f901 00007f6fe899f8a7 00007f6fe8a97288 00007f6fe8a96f37 00007f6fe8aab55c 00007f6fe8aab508
0709 12:18:56.237600 (+281891us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400306954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:56.237668 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:56.237820 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83773,"prepare.queue_time_us":1399866,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":19554,"raft.queue_time_us":30135,"raft.run_cpu_time_us":7957,"raft.run_wall_time_us":1096416,"spinlock_wait_cycles":1815416320,"thread_start_us":70575,"threads_started":2,"wal-append.queue_time_us":51786}
I20260709 12:18:56.158756 32101 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:56.281927 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 76572.2us
I20260709 12:18:56.283711 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:56.284693 29317 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:56.284940 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2239) took 1368 ms. Trace:
W20260709 12:18:56.285713 32150 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:18:56.285367 28605 rpcz_store.cc:276] 0709 12:18:54.916613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.924358 (+  7745us) service_pool.cc:224] Handling call
0709 12:18:54.924701 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:56.045750 (+1121049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.284671 (+238921us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540004bd54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:56.284877 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576398208}
I20260709 12:18:56.301005 32074 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.301751 32074 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:56.305480 32024 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:56.255508 32050 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:56.326303 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.329375 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 769) took 1463 ms. Trace:
I20260709 12:18:56.329917 29326 rpcz_store.cc:276] 0709 12:18:54.866022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.157400 (+291378us) service_pool.cc:224] Handling call
0709 12:18:56.185579 (+1028179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.192997 (+  7418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.329097 (+136100us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540042a9d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:56.329300 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327466368}
I20260709 12:18:56.332597 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2228) took 1443 ms. Trace:
I20260709 12:18:56.333073 28599 rpcz_store.cc:276] 0709 12:18:54.888816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.889577 (+   761us) service_pool.cc:224] Handling call
0709 12:18:56.332319 (+1442742us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54003d3454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:56.332513 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578877184}
I20260709 12:18:56.313758 28605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:56.336297 28605 raft_consensus.cc:606] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:56.253931 32108 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.340655 28747 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:56.368093 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:56.367375 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:56.366530 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:56.363116 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.368804 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:56.279201 32066 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:56.371205 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:56.357758 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.305559 32155 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:18:56.375824 28675 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
W20260709 12:18:56.376257 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.377336 28677 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:56.383050 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:56.379928 28749 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:56.378618 28679 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:56.378207 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:56.384707 28681 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:56.379009 28755 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:18:56.377791 32108 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:56.390239 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2036) took 1270 ms. Trace:
I20260709 12:18:56.289359 32101 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:56.397256 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.361702 31811 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:56.398492 31811 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:56.374970 31952 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:56.400044 31952 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:18:56.377779 32129 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.119s	user 0.001s	sys 0.005s
I20260709 12:18:56.390656 28682 rpcz_store.cc:276] 0709 12:18:55.119347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.119474 (+   127us) service_pool.cc:224] Handling call
0709 12:18:55.128695 (+  9221us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:55.129078 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:55.129123 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:55.129747 (+   624us) log.cc:844] Serialized 52 byte log entry
0709 12:18:55.987709 (+857962us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18003aef40. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:18:56.133464 (+145755us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:56.133524 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.133636 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:56.389886 (+256250us) raft_consensus.cc:1685] finished
0709 12:18:56.389906 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:56.390168 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3838,"raft.queue_time_us":1409,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3840,"spinlock_wait_cycles":3075840,"thread_start_us":145514,"threads_started":1,"wal-append.queue_time_us":1129759}
W20260709 12:18:56.403591 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.391441 32048 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:56.410468 32132 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.706s	user 0.002s	sys 0.001s
I20260709 12:18:56.337164 32074 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:56.312008 32054 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:18:56.376989 32050 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:56.416903 28747 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:56.424852 28605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:56.425429 28605 raft_consensus.cc:606] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:18:56.425726 28605 raft_consensus.cc:614] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:56.426561 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:56.428041 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.435947 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.420060 32099 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:56.438556 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:56.384696 32066 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:56.439214 28681 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:56.439715 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.442176 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.442787 28747 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:56.443856 28752 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:18:56.448221 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 220049us
I20260709 12:18:56.449621 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:56.450778 28682 raft_consensus.cc:2410] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:56.466739 29320 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:18:56.472702 32163 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.473280 32163 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:56.473321 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.475371 32163 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:56.478096 32161 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.171s	user 0.000s	sys 0.002s
I20260709 12:18:56.478852 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:56.480047 28675 raft_consensus.cc:2410] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:56.480749 28677 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:56.429689 32026 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:56.444797 32108 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:56.492408 28681 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:56.495527 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:56.495810 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:56.496273 28605 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:56.496480 28599 raft_consensus.cc:2368] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
I20260709 12:18:56.498163 28599 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:56.451905 32048 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:56.499528 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:56.938011 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.867908 28722 leader_election.cc:336] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.627s (SENT)
W20260709 12:18:56.938704 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.938784 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:56.604713 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 82415.3us
I20260709 12:18:56.940418 28750 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:18:56.941120 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:56.716416 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:56.942129 28756 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:56.942830 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.732872 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.943495 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:56.505813 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:56.944195 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.733916 28753 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:56.945008 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.945057 28751 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
W20260709 12:18:56.560218 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48751.2us
W20260709 12:18:56.582437 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.509647 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.955497 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.727380 29321 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:56.565106 28749 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:56.521548 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:56.895013 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:56.944525 28679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.023s	sys 0.027s
W20260709 12:18:56.959826 28679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.023s	sys 0.027s
W20260709 12:18:56.707050 28648 leader_election.cc:336] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.205s (SENT)
W20260709 12:18:57.018366 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 311333us
W20260709 12:18:57.020223 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.944370 28755 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:18:57.031118 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:56.454272 32076 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.037462 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.037695 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.058235 32076 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:57.060451 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57707.2us
I20260709 12:18:57.040251 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:57.062642 28604 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:57.038938 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 95495.7us
I20260709 12:18:57.037493 32099 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.063189 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.063742 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:57.064232 28751 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:57.065243 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.041894 32066 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.044518 32048 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.050186 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:57.078984 29326 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:57.051147 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:56.491904 31946 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.080379 29319 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:57.080355 31946 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.083036 31946 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:56.872217 32071 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.052507 32101 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:56.560914 32050 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.084453 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:57.086660 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:56.641484 32055 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.416s
I20260709 12:18:57.088078 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:57.089147 28600 raft_consensus.cc:2410] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:57.083850 32071 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.091907 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.092861 28750 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:57.093086 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.093823 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.094523 28750 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:56.872006 32000 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.095507 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.095630 32000 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.096807 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.097719 28750 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:57.097867 32000 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.040177 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.098688 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.072508 29325 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:57.099231 28753 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:56.499927 31517 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:57.105325 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:57.105599 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.073074 32099 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.074499 29317 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:56.724661 31952 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.077212 31975 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.077761 32108 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:57.096882 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:57.095064 32068 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.975s	user 0.009s	sys 0.000s
I20260709 12:18:57.134953 28749 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:57.061478 28573 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:57.100615 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.071607 32067 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.100975 28750 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:57.136961 28682 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:57.129684 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.107237 28681 pending_rounds.cc:85] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 6
I20260709 12:18:56.946568 32093 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.131297 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.080288 32048 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.148748 28756 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:57.149317 28751 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:57.156070 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.069325 32043 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:57.128605 31946 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:57.136057 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 74660.9us
I20260709 12:18:57.091974 32071 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.165284 28751 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:57.138345 28681 pending_rounds.cc:107] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:18:57.166543 28681 raft_consensus.cc:2889] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:57.105000 32146 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.139394 32067 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.124591 31517 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.140554 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.133952 31975 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.141201 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.148584 28755 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:18:57.156948 28753 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:57.157124 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:18:57.106953 28748 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:57.139328 32055 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:57.148311 32108 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:57.135653 32016 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.171329 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.189420 28750 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:57.189252 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:57.191181 28750 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:57.192258 28751 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:57.175439 28755 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:57.201412 28750 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:57.207319 28754 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:18:57.207485 28756 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:57.170269 32043 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:57.208695 28749 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:57.187553 32055 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:57.223891 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 356004us
I20260709 12:18:57.206151 31952 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:57.169502 31946 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.174201 32048 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:18:57.210268 32093 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:57.206408 32016 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.247753 32173 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.249588 32067 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.174592 32146 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:57.256531 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 192876us
I20260709 12:18:57.203181 32069 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:18:57.225829 32055 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.213374 32108 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:18:57.253620 31811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.027s	sys 0.022s
I20260709 12:18:57.283617 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:57.285303 28607 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:57.253042 32093 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:57.284792 31811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.027s	sys 0.022s
I20260709 12:18:57.253739 32066 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:57.289038 32066 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.297825 32066 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.290464 32093 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:57.301302 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 96315.7us
I20260709 12:18:57.262115 32043 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:57.311879 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:57.312582 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.262392 32173 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:57.319972 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 90981.1us
I20260709 12:18:57.322858 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:57.321729 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:18:57.313025 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.314328 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:57.314778 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:57.327064 29325 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.307760 32108 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:18:57.315284 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.313541 32040 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.317029 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.317430 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.317830 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:57.318068 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.318480 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:57.334806 28751 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:57.335227 29320 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.335668 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.336218 28751 raft_consensus.cc:2376] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6. Re-sending same reply.
I20260709 12:18:57.307629 32066 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:57.330250 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 66089.9us
I20260709 12:18:57.337173 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.337550 28748 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:57.340334 28755 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:57.341513 28755 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:57.343690 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.344211 28754 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:57.344838 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.347165 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.347209 32067 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.348526 32067 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.351073 32067 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.345305 32076 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 12:18:57.354099 32160 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 1.043s	user 0.013s	sys 0.007s
W20260709 12:18:57.355223 32141 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 1.509s	user 0.010s	sys 0.006s
I20260709 12:18:57.322070 32139 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:57.356134 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.361250 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.361474 29321 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:18:57.362496 32173 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.363467 31946 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.331372 31987 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:57.364212 31987 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.364679 31987 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.366722 32146 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.333134 32053 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:18:57.371114 31975 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.372197 32016 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.372997 29320 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:57.322310 32175 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:18:57.331132 32148 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.343148 32040 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.386984 32040 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:57.388588 32172 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:18:57.391194 28756 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:18:57.392879 29325 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:57.396064 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:57.403543 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.404397 28751 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:57.408097 32035 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.408766 32035 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.411021 32035 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.411494 32076 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.400918 32040 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:18:57.346230 32066 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.417557 31987 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.419216 32066 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.377602 32148 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.420045 31987 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.421784 32148 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.402346 31975 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:57.422863 31975 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:57.417655 32050 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:57.430768 28721 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:57.434170 28722 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.986s (SENT)
I20260709 12:18:57.434798 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:57.411974 32076 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.445709 29321 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:18:57.447388 32076 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.448505 31938 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:57.449118 31938 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:57.449226 32173 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:57.450193 31938 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.451774 32099 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.452042 32148 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.438539 31720 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:57.452566 32148 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.453153 31720 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:57.439079 32053 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:57.466351 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:57.467072 28751 raft_consensus.cc:2376] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9. Re-sending same reply.
I20260709 12:18:57.440704 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:57.441164 32071 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.441484 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:57.469087 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 130423us
I20260709 12:18:57.442209 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:57.443315 32093 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.454902 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:57.477638 29323 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:57.469746 29319 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:57.479429 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:57.480463 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:57.470485 29326 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.483219 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:57.484457 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:57.485771 32184 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:57.393095 32139 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.454017 31720 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.476980 32148 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:57.496589 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 171516us
I20260709 12:18:57.489984 32173 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:57.496184 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:57.490149 32076 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:57.503417 29326 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:57.497409 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 606) took 1008 ms. Trace:
I20260709 12:18:57.505156 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:57.423965 31975 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.537549 32123 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:57.514209 32139 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.517349 32055 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.503328 32076 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.497280 32184 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:57.501416 32043 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:18:57.520839 32179 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:57.521231 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:57.522605 32093 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.525126 28751 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:57.526511 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.527256 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:57.526556 32000 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.503854 32173 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.528585 32067 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:57.627990 32000 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.628274 32067 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.630577 32067 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.630970 32000 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.529060 32066 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.631966 32066 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.635627 32066 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.644585 32028 raft_consensus.cc:993] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:18:57.645324 32028 raft_consensus.cc:1081] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:18:57.628015 32173 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.535295 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 1937) took 1467 ms. Trace:
I20260709 12:18:57.494774 32068 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:57.537339 32053 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:57.562824 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 66790.4us
I20260709 12:18:57.565063 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:57.578630 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 70184.3us
I20260709 12:18:57.669100 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:57.589043 28674 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:18:57.669848 28674 pending_rounds.cc:85] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 5
I20260709 12:18:57.670094 28674 pending_rounds.cc:107] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:18:57.670354 28674 raft_consensus.cc:2889] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:57.590127 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:57.590891 28677 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:57.488785 32071 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.597783 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:57.600041 28607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:57.596161 32188 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:57.605487 32183 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:57.606021 32055 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.593801 32076 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:57.589759 31952 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.607317 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:57.665169 32053 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:57.610962 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1907) took 1114 ms. Trace:
I20260709 12:18:57.622548 28750 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:57.624814 32048 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:57.627344 32026 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.656352 28752 rpcz_store.cc:276] 0709 12:18:56.067818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.079477 (+ 11659us) service_pool.cc:224] Handling call
0709 12:18:57.535084 (+1455607us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540003fa54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:57.535231 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834599168}
I20260709 12:18:57.658985 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:57.671703 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:57.678467 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 113516us
I20260709 12:18:57.701690 28682 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:57.661806 32163 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.702670 28607 raft_consensus.cc:606] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:57.659802 32068 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:18:57.777081 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.729473 28602 rpcz_store.cc:276] 0709 12:18:56.496711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.501196 (+  4485us) service_pool.cc:224] Handling call
0709 12:18:57.086496 (+585300us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800003398. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:57.610727 (+524231us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400002154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:57.610892 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968969344}
W20260709 12:18:57.720113 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 112877us
W20260709 12:18:57.785080 32189 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:57.785463 28750 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:57.609124 31477 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.786396 28750 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.788220 28750 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.716668 32174 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:57.704469 32099 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:57.781385 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:57.796720 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.797039 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:57.704337 32148 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:57.781648 32048 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:57.786314 28607 raft_consensus.cc:614] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:57.761708 28722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.193s (SENT) [suppressed 38 similar messages]
W20260709 12:18:57.704522 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.701103 32093 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:18:57.793124 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1910) took 1295 ms. Trace:
I20260709 12:18:57.757392 32139 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.782126 32163 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:57.802314 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 130735us
I20260709 12:18:57.846015 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:57.849817 28603 rpcz_store.cc:276] 0709 12:18:56.497642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.497738 (+    96us) service_pool.cc:224] Handling call
0709 12:18:57.658813 (+1161075us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b5800003398. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:18:57.793044 (+134231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169327488}
W20260709 12:18:57.851076 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.851871 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:57.854588 28680 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:57.864938 28750 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:18:57.865536 28750 pending_rounds.cc:85] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 8
I20260709 12:18:57.865859 28750 pending_rounds.cc:107] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:18:57.866171 28750 raft_consensus.cc:2889] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:57.868645 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:57.800565 32148 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.849059 28676 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
W20260709 12:18:57.809576 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.793752 32068 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:57.793685 32174 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.730643 32131 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:57.785697 32184 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 12:18:57.880807 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.870898 32066 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:57.883251 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 121569us
I20260709 12:18:57.824429 31745 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.885705 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:57.885859 32067 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.887537 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:57.929580 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:57.730118 31952 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.888597 32053 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.846235 28674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34892
I20260709 12:18:57.824512 32183 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:57.891105 28679 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
W20260709 12:18:57.894171 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.002408 32182 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:58.002959 32182 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:58.004022 32182 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.003814 32071 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.504915 28747 rpcz_store.cc:276] 0709 12:18:56.488768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.489586 (+   818us) service_pool.cc:224] Handling call
0709 12:18:56.509535 (+ 19949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:56.509767 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:56.561452 (+ 51685us) log.cc:844] Serialized 14 byte log entry
0709 12:18:57.423744 (+862292us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b180046f600. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a 00007f6fe3a89a2a
0709 12:18:57.497054 (+ 73310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:57.497102 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:57.497178 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.497263 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:57.497365 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51673,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":878,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":2347,"spinlock_wait_cycles":19023616,"thread_start_us":73052,"threads_started":1}
I20260709 12:18:58.010281 32071 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:58.015374 32168 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.724s	user 0.001s	sys 0.002s
I20260709 12:18:58.011914 32071 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.851504 32030 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.025038 32030 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.900517 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:58.028791 28601 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.778573 32173 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.034406 32173 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:57.902813 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.036399 28605 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:57.880951 32059 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:18:57.882227 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:57.918013 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:57.918866 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.039050 28599 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:57.880504 32148 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:57.871114 32000 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:58.040758 32000 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.796514 31477 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.947568 28598 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:57.948065 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:57.901857 32174 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.047307 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2049) took 1720 ms. Trace:
I20260709 12:18:58.047801 28678 rpcz_store.cc:276] 0709 12:18:56.327404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.327566 (+   162us) service_pool.cc:224] Handling call
0709 12:18:56.377925 (+ 50359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:56.386082 (+  8157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:56.386116 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:56.386580 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:18:56.550945 (+164365us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:56.550990 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:56.553553 (+  2563us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.014626 (+1461073us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:58.046961 (+ 32335us) raft_consensus.cc:1685] finished
0709 12:18:58.046990 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.047233 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8179,"raft.queue_time_us":7921,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5804,"spinlock_wait_cycles":18017664,"thread_start_us":149679,"threads_started":1,"wal-append.queue_time_us":834355}
I20260709 12:18:57.930792 32043 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:57.950173 32067 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.869664 32139 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.051859 32000 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.952598 31952 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:57.930588 32131 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:58.052305 32139 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:58.052685 32067 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:58.053423 32131 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:57.947676 31745 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.826339 32188 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:18:58.058276 31745 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:58.079658 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 378887us
I20260709 12:18:58.082178 32175 raft_consensus.cc:993] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:18:58.085455 31517 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:58.106962 32182 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.110594 28601 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:57.800992 32099 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:57.996294 28674 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.151290 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.151773 28674 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.050460 31477 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:57.927193 31938 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.111323 32030 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:58.121296 28607 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:18:58.122054 32148 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.134313 32059 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:58.140807 32187 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.136862 32026 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:57.995114 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:57.900053 32140 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.149961 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:57.901232 32190 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.234s
I20260709 12:18:58.153762 32199 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:58.168838 32199 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:58.169209 32199 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:57.932025 32066 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.156973 32187 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:58.174360 32066 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:58.174950 31938 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:58.175627 32187 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:58.177145 31938 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:58.179704 32000 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:58.180912 32067 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:58.180979 31745 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:58.181368 32067 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:58.181409 31745 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:58.181910 32067 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.182610 31745 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.158409 32026 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:58.184757 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 95186.8us
I20260709 12:18:58.185441 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:58.185972 32108 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:58.186532 32026 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:58.187131 32192 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 12:18:58.159196 32140 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:58.159457 28604 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:58.163483 32163 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:58.190459 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.197145 28648 leader_election.cc:336] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.824s (SENT)
W20260709 12:18:58.145534 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.163578 31517 raft_consensus.cc:1081] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
W20260709 12:18:58.202401 32195 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:58.226430 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:58.288241 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 61914.6us
I20260709 12:18:58.289398 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.289603 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:58.290169 28603 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:58.291270 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.292348 28682 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:58.207828 32174 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:58.156333 32071 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:58.233259 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:58.233470 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.300004 28680 raft_consensus.cc:2410] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:58.234558 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:58.236999 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 408801us
W20260709 12:18:58.271308 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 381340us
I20260709 12:18:57.920306 32048 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.301759 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:58.302439 28675 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:58.250494 32190 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:58.270623 32055 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:18:58.158368 32148 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:58.272269 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 75157.8us
W20260709 12:18:58.316781 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.317262 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.226460 31664 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:58.274278 28720 leader_election.cc:400] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:18:58.322710 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:58.323158 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49097.3us
I20260709 12:18:58.323705 28680 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 6: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:58.323923 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:58.168254 32076 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.277038 31938 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:58.277771 32035 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:18:58.278574 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.342629 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.301956 32093 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.283963 28679 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:58.285166 28676 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:58.285843 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.286931 28673 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:58.317979 32066 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:58.308926 29323 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:18:58.311157 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:58.355988 29322 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:18:58.357884 29322 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:58.156576 32059 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:58.320236 28648 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.574s (SENT)
W20260709 12:18:58.359648 28648 leader_election.cc:336] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.622s (SENT)
I20260709 12:18:58.326479 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:58.361958 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:58.300215 32175 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:58.314644 32190 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.330035 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:58.364353 28682 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.330708 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.331739 32163 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:58.302119 32187 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:18:58.335547 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1906) took 1839 ms. Trace:
I20260709 12:18:58.270576 32026 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.344296 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.400403 28606 rpcz_store.cc:276] 0709 12:18:56.496142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.497474 (+  1332us) service_pool.cc:224] Handling call
0709 12:18:57.453077 (+955603us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b5800003398. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:18:57.453262 (+   185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.482703 (+ 29441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.482740 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:57.483372 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 12:18:57.685364 (+201992us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:57.917923 (+232559us) log.cc:844] Serialized 14 byte log entry
0709 12:18:57.918187 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.918259 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.335245 (+416986us) raft_consensus.cc:1685] finished
0709 12:18:58.335338 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.335478 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72936,"prepare.queue_time_us":615828,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":32056,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":20914,"spinlock_wait_cycles":181400960,"thread_start_us":375478,"threads_started":2,"wal-append.queue_time_us":353801}
I20260709 12:18:58.279918 28674 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.320693 31975 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.353986 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:58.365203 28603 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:58.366329 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.405696 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:58.405887 28598 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:58.371408 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:58.406854 28750 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:58.410013 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:58.410269 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:58.410751 28752 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:18:58.410880 29317 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:58.411713 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:58.412384 28747 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:58.415671 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:58.371924 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:58.373054 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:58.419200 28753 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:58.342026 32071 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:58.345935 32069 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:58.419234 28755 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:58.337399 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.423708 28680 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:18:58.362001 32066 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.426407 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:58.430823 29320 raft_consensus.cc:2376] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10. Re-sending same reply.
I20260709 12:18:58.426697 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.432083 28679 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:58.427126 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:58.428822 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:58.423534 28504 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 228) took 9056 ms. Trace:
I20260709 12:18:58.433109 28756 raft_consensus.cc:2410] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:58.434331 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.436353 29317 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:58.367260 32190 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.400817 32048 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:58.367415 32173 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:58.450480 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.344807 31664 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.442214 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:58.398908 32139 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:58.440755 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:58.451896 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.453451 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:58.657459 29320 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:58.658537 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:58.451198 28675 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:58.659098 29320 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.455118 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.552210 31720 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
W20260709 12:18:58.648707 28646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.014s
I20260709 12:18:58.547781 32173 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:58.418121 32026 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:58.550032 29318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.020s	sys 0.028s
I20260709 12:18:58.424118 31975 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.496362 28674 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:58.569274 28599 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:58.498055 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:58.606778 28602 raft_consensus.cc:1217] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Deduplicated request from leader. Original: 5.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 12:18:58.439620 32066 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.710269 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:58.628527 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.345633 31938 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:58.650514 32099 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:58.620872 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:18:58.749042 32210 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:58.749235 31664 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:58.749790 31664 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:58.750172 31664 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:58.750514 31664 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:58.753284 32076 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:58.754032 32068 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.868s	user 0.007s	sys 0.003s
I20260709 12:18:58.754604 32068 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.669246 32140 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:58.758239 32059 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:18:58.758693 32200 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.600s	user 0.001s	sys 0.002s
W20260709 12:18:58.761348 32199 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.002s
I20260709 12:18:58.761759 32199 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.763880 32199 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:58.734966 32148 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:18:58.764974 32212 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:18:58.765429 32148 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:58.765808 32148 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:58.766592 32148 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.767710 32148 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.677908 32208 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.768821 32208 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.769913 32139 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:58.770303 32139 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:58.770915 32208 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:58.771095 32139 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.771593 28604 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:58.772425 28678 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:18:58.772228 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 369378us
I20260709 12:18:58.667119 32174 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:58.404201 32163 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:58.731348 32173 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:58.799140 28674 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:18:58.799582 28674 pending_rounds.cc:85] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 4
I20260709 12:18:58.568930 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:58.539669 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.422832 32069 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:58.352387 32035 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:58.613803 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.649145 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 766931us
I20260709 12:18:58.561599 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:58.433007 28504 rpcz_store.cc:276] 0709 12:18:49.351437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.352687 (+  1250us) service_pool.cc:224] Handling call
0709 12:18:58.407934 (+9055247us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:54.540571 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:54.569521 (+ 28950us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:54.569558 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:18:54.569576 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:54.570802 (+  1226us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:54.570862 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:54.570893 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:18:54.571827 (+   934us) tablet.cc:701] Row locks acquired
0709 12:18:54.571848 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:54.572008 (+   160us) write_op.cc:270] Start()
0709 12:18:54.572134 (+   126us) write_op.cc:276] Timestamp: P: 1783599534571957 usec, L: 0
0709 12:18:54.572160 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:18:54.692606 (+120446us) log.cc:844] Serialized 5233 byte log entry
0709 12:18:55.317060 (+624454us) op_driver.cc:464] REPLICATION: finished
0709 12:18:55.606470 (+289410us) write_op.cc:301] APPLY: starting
0709 12:18:55.606559 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:55.606802 (+   243us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:55.616469 (+  9667us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:55.754919 (+138450us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:55.755201 (+   282us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:18:55.755251 (+    50us) write_op.cc:312] APPLY: finished
0709 12:18:55.755574 (+   323us) log.cc:844] Serialized 89 byte log entry
0709 12:18:55.755756 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:55.755919 (+   163us) write_op.cc:454] Released schema lock
0709 12:18:55.755972 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:55.783540 (+ 27568us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:55.786448 (+  2908us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":122600,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":275377,"apply.run_cpu_time_us":4934,"apply.run_wall_time_us":153013,"num_ops":12,"prepare.queue_time_us":258260,"prepare.run_cpu_time_us":17079,"prepare.run_wall_time_us":354014,"raft.queue_time_us":148861,"raft.run_cpu_time_us":45387,"raft.run_wall_time_us":274531,"replication_time_us":713244,"thread_start_us":534975,"threads_started":4,"wal-append.queue_time_us":224773,"wal-append.run_cpu_time_us":44846,"wal-append.run_wall_time_us":1948480}]]}
I20260709 12:18:58.570531 29322 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:58.638983 28682 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:58.657049 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.659876 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.662920 28603 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:18:58.665194 28646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.001s	sys 0.014s
I20260709 12:18:58.668615 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:58.666088 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:58.667353 29318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.032s	sys 0.046s
I20260709 12:18:58.678247 29320 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:58.678579 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:58.709029 28607 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:58.676530 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:58.666043 32207 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:58.710829 28602 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:58.799855 28674 pending_rounds.cc:107] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:18:58.865091 29317 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:58.818845 28678 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:58.865958 28681 raft_consensus.cc:2410] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:58.867008 28681 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:58.867486 28679 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
W20260709 12:18:58.868223 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 306699us
I20260709 12:18:58.865162 28674 raft_consensus.cc:2889] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:58.720635 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.873047 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:18:58.873734 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.874059 29322 raft_consensus.cc:2410] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:58.737112 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.874631 28599 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:58.875495 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.876538 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.877456 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.878449 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.879361 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.879868 28599 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:18:58.880721 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:58.539491 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.799751 32163 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:58.451169 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:58.882491 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:58.882715 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 431586us
I20260709 12:18:58.883934 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.871932 28675 raft_consensus.cc:2410] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:58.885180 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.886196 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.886538 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:58.886686 28607 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
W20260709 12:18:58.868368 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.887912 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.888257 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.881230 32035 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:58.881260 28599 raft_consensus.cc:2376] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7. Re-sending same reply.
I20260709 12:18:58.797022 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:58.905135 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:58.905812 29320 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.906020 28754 raft_consensus.cc:2410] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:58.905133 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.896426 28600 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:58.909758 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.912223 29322 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:58.913674 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 116718us
W20260709 12:18:58.917434 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:58.918090 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.918835 29320 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:18:58.921305 28605 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:58.922575 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:58.926734 28678 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:58.927404 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:58.928125 28605 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:18:58.810500 32193 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.653s	user 0.002s	sys 0.000s
I20260709 12:18:58.926998 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.930902 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.667236 32067 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:58.907262 32147 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.766s	user 0.016s	sys 0.003s
I20260709 12:18:58.799913 32173 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:58.932549 28603 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:58.932819 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.776924 32099 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 12:18:58.905313 32163 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:58.911410 32199 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:58.911119 32215 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:58.908041 32101 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:58.935927 32147 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.795s	user 0.016s	sys 0.003s
I20260709 12:18:58.993335 29327 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:58.996309 32191 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.840s	user 0.001s	sys 0.001s
W20260709 12:18:58.993985 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 283620us
I20260709 12:18:58.998766 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1948) took 1662 ms. Trace:
I20260709 12:18:58.999203 28748 rpcz_store.cc:276] 0709 12:18:57.336692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.340583 (+  3891us) service_pool.cc:224] Handling call
0709 12:18:57.359343 (+ 18760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.392398 (+ 33055us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:57.392457 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:57.405912 (+ 13455us) log.cc:844] Serialized 26 byte log entry
0709 12:18:57.793340 (+387428us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:57.793378 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.793450 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.995562 (+1202112us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:58.998422 (+  2860us) raft_consensus.cc:1685] finished
0709 12:18:58.998451 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:58.998694 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8507,"raft.queue_time_us":35652,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7730,"spinlock_wait_cycles":130176384,"thread_start_us":302068,"threads_started":1,"wal-append.queue_time_us":676306}
I20260709 12:18:58.800295 32208 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 12:18:58.921504 31987 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:18:59.003012 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.928084 32035 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:58.926692 32214 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.935108 31517 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.936483 32206 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:18:58.964874 32076 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.018045 32076 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.005004 32215 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.020879 32215 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.022324 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:59.024255 32139 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.024899 32026 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.025465 32026 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.026283 32026 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:59.029219 28501 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 4 to 5, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 5 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:59.031490 32093 consensus_meta.cc:287] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.677s	user 0.004s	sys 0.004s
I20260709 12:18:59.030942 28501 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 4 to 6, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 6 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.031955 32093 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.034138 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 529) took 1135 ms. Trace:
I20260709 12:18:59.034535 28602 rpcz_store.cc:276] 0709 12:18:57.898939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.900539 (+  1600us) service_pool.cc:224] Handling call
0709 12:18:57.900855 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:58.864881 (+964026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.033913 (+169032us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54003dbdd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:59.034078 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623100288}
I20260709 12:18:59.035495 31938 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:59.035701 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:58.994196 32199 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.036761 32199 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.039333 32066 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.040488 29323 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:18:59.003906 32101 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.043629 32101 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:59.045282 32190 consensus_meta.cc:287] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.001s
I20260709 12:18:59.045418 32067 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.045713 32190 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.002842 32069 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.046977 32069 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.016894 32214 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.047900 32190 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:58.906759 32207 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.048725 28604 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:59.048758 29317 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:59.049860 32214 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.050108 32207 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:18:59.053534 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 458183us
I20260709 12:18:59.050953 28501 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.059008 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.011886 32035 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.064316 28753 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:59.072548 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:59.073175 28753 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.072273 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 849) took 1197 ms. Trace:
I20260709 12:18:59.074910 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:59.075277 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:59.075459 28747 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:59.072223 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 149458us
I20260709 12:18:59.078706 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:59.085283 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:59.087781 28750 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:59.088511 28747 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:18:59.053133 32076 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.103652 28752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:18:59.104285 28752 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.104674 28752 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.070889 32035 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:59.105834 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 846) took 1653 ms. Trace:
I20260709 12:18:59.090581 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:59.055142 32068 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.093845 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.089257 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.040536 31517 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.014569 31987 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.107887 28747 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:18:59.052385 32196 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:18:59.106204 29321 rpcz_store.cc:276] 0709 12:18:57.452391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.452959 (+   568us) service_pool.cc:224] Handling call
0709 12:18:57.453262 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:57.453585 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:57.453632 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:57.454121 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:18:57.809018 (+354897us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:57.809074 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.809181 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:58.809820 (+1000639us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:59.092041 (+282221us) raft_consensus.cc:1685] finished
0709 12:18:59.092072 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.105763 (+ 13691us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11766,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2665,"spinlock_wait_cycles":108667264,"thread_start_us":354472,"threads_started":1,"wal-append.queue_time_us":702990}
I20260709 12:18:59.111562 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:59.109469 28605 raft_consensus.cc:2410] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:18:59.109347 28607 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:59.110608 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:59.113718 29320 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:59.113795 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:59.113680 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 201227us
I20260709 12:18:59.115729 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:59.120118 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.121321 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.122598 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:59.123735 28752 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.126099 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:18:59.126658 29320 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.126739 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:59.131683 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:59.132104 28753 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:18:59.132501 29322 raft_consensus.cc:2410] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:18:59.138383 28501 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 3 to 5, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:18:59.141762 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:59.145908 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:59.148845 29320 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:18:59.153077 28752 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:59.107475 32227 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:59.155130 29320 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:59.157109 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:18:59.159233 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.162947 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:59.164335 28501 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.174639 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:59.175279 29322 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
W20260709 12:18:59.178478 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.162209 32067 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:59.154564 32204 raft_consensus.cc:2764] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:59.187148 32147 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:59.189620 32147 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.190018 32147 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.190685 31745 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:59.185964 32207 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:18:59.189633 32204 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:18:59.195291 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.196065 28598 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:18:59.163864 32076 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:59.196818 32076 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:59.197429 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.197629 32076 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.198522 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.162478 32224 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.199410 32224 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.154801 32196 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:59.116704 32050 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:18:59.115041 32163 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:18:59.202880 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:18:59.202687 28501 catalog_manager.cc:5697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 4 to 5, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 5 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.158699 32227 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:59.204046 32221 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:18:59.156599 31664 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.219676 31664 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.220314 32140 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:59.220773 32140 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.221143 32140 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.222258 31987 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.225243 28501 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 3 to 6, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 6 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.201479 32224 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.206631 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.229372 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.230515 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.231559 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.207690 32173 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:59.209028 32066 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:59.157151 32123 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:59.232690 32173 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:59.233053 32123 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.233439 32123 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:59.233531 32173 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.234954 32173 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.236685 32231 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:59.237280 32231 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.237723 32231 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.186550 32067 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:18:59.240995 32067 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.244763 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.197986 31517 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.196424 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.187454 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:59.215907 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 195431us
I20260709 12:18:59.227927 28501 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.211241 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.073856 29318 rpcz_store.cc:276] 0709 12:18:57.875160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.875356 (+   196us) service_pool.cc:224] Handling call
0709 12:18:57.875712 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.875980 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:58.865262 (+989282us) log.cc:844] Serialized 14 byte log entry
0709 12:18:59.071937 (+206675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:59.071988 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:59.072052 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.072110 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.072210 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3779,"prepare.queue_time_us":863129,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":16227,"thread_start_us":1155182,"threads_started":2}
I20260709 12:18:59.246032 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.246970 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:18:59.189020 32219 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 12:18:59.255119 28607 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:18:59.255702 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 256404us
I20260709 12:18:59.268870 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.269311 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:59.270744 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:59.265179 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.212356 32214 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.276659 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.277668 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.273571 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.272552 28606 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:18:59.277541 28501 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 1 to 5, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:18:59.280164 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.281219 28607 raft_consensus.cc:2410] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:18:59.282534 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:59.283414 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.290645 28603 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:59.291344 28603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:18:59.291839 28603 raft_consensus.cc:606] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:59.292191 28603 raft_consensus.cc:614] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:59.292742 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:59.188567 32230 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:59.293377 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:59.294354 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:59.294854 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:18:59.294996 28753 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:59.296175 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:59.300823 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:59.302060 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:59.302826 28747 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:18:59.304646 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:59.307008 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:18:59.307657 28753 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:59.212159 32000 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:18:59.312294 28603 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:59.244792 32227 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:59.321110 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:59.321425 28606 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:59.321866 28606 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:59.323390 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:59.324422 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:59.326563 28604 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:18:59.326936 28604 pending_rounds.cc:85] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 7
I20260709 12:18:59.327147 28604 pending_rounds.cc:107] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:18:59.327369 28604 raft_consensus.cc:2889] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:59.325639 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:59.329388 28747 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.298553 32139 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:59.295975 32208 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:59.332650 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 208901us
W20260709 12:18:59.323042 32148 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.002s
W20260709 12:18:59.357170 32233 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:18:59.361500 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 191603us
I20260709 12:18:59.291899 32215 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.362474 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:59.274824 32123 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.276239 32140 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.344918 28606 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.369948 28606 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.368526 28680 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:18:59.347628 32048 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.895s	user 0.009s	sys 0.003s
I20260709 12:18:59.298326 31987 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:18:59.380483 28601 raft_consensus.cc:2410] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:18:59.369262 32000 consensus_queue.cc:1243] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:59.378247 32206 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:18:59.389101 32206 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.365931 32208 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.351533 32059 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:18:59.395471 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2080) took 1051 ms. Trace:
I20260709 12:18:59.396013 28676 rpcz_store.cc:276] 0709 12:18:58.343699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.825391 (+481692us) service_pool.cc:224] Handling call
0709 12:18:58.921973 (+ 96582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:59.116156 (+194183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.116184 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:59.117739 (+  1555us) log.cc:844] Serialized 26 byte log entry
0709 12:18:59.275038 (+157299us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:59.275074 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.275137 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:59.395180 (+120043us) raft_consensus.cc:1685] finished
0709 12:18:59.395208 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.395395 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1754,"raft.queue_time_us":103793,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":348913,"threads_started":2,"wal-append.queue_time_us":271012}
I20260709 12:18:59.398072 32215 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:18:59.398754 32232 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:18:59.400099 32238 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:59.402298 28598 raft_consensus.cc:2368] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7.
I20260709 12:18:59.414692 28501 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 2 to 5, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 5 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:59.416926 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 52818.7us
I20260709 12:18:59.417289 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 820) took 1113 ms. Trace:
I20260709 12:18:59.420761 28501 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 4 to 6, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 6 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.370002 31517 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.373991 32148 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:59.442827 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 148387us
I20260709 12:18:59.417805 29319 rpcz_store.cc:276] 0709 12:18:58.304212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.304329 (+   117us) service_pool.cc:224] Handling call
0709 12:18:58.334124 (+ 29795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:58.334502 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:58.334535 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:58.335019 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:18:58.637797 (+302778us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:58.637840 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.637923 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:59.104563 (+466640us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:18:59.402194 (+297631us) raft_consensus.cc:1685] finished
0709 12:18:59.402225 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.417201 (+ 14976us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2521,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8561,"spinlock_wait_cycles":10580736,"thread_start_us":271181,"threads_started":1,"wal-append.queue_time_us":557663}
W20260709 12:18:59.445173 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 181490us
I20260709 12:18:59.402048 31938 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:59.441354 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 172098us
I20260709 12:18:59.468273 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.469918 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:18:59.445544 32235 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:18:59.471906 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.474610 28603 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 6.
I20260709 12:18:59.475833 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:59.476691 28603 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:59.445722 29292 connection.cc:256] RPC call timeout handler was delayed by -1.474561580999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29009999999999997s for a response
I20260709 12:18:59.477133 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:59.478327 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3878904910000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 12:18:59.478710 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3860904910000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 12:18:59.479490 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.479838 28747 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:59.482339 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.487131 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.516302 28604 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:59.517468 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.450291 32131 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.522106 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.492610 28573 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:18:59.485615 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:59.419472 32147 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:59.525413 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45966.1us
I20260709 12:18:59.523072 28604 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:59.486238 32229 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:59.533548 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:59.533478 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51259.8us
W20260709 12:18:59.534198 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.529321 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2078) took 1702 ms. Trace:
I20260709 12:18:59.534965 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:59.529414 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 43933.1us
W20260709 12:18:59.537649 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 188740us
I20260709 12:18:59.538077 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:59.465920 31938 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.532090 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.486996 32148 raft_consensus.cc:2764] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:18:59.536532 28603 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:59.530740 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.535192 28677 rpcz_store.cc:276] 0709 12:18:57.827105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.831156 (+  4051us) service_pool.cc:224] Handling call
0709 12:18:57.831558 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:58.137192 (+305634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:58.137239 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:58.219788 (+ 82549us) log.cc:844] Serialized 26 byte log entry
0709 12:18:58.624208 (+404420us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:58.624274 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.519260 (+894986us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54003750d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:59.519309 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:59.519355 (+    46us) raft_consensus.cc:1685] finished
0709 12:18:59.519367 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.529239 (+  9872us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141909,"raft.queue_time_us":154022,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":69636,"spinlock_wait_cycles":282435456,"thread_start_us":330443,"threads_started":1,"wal-append.queue_time_us":549479}
I20260709 12:18:59.513208 32214 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:59.539251 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:59.538323 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:18:59.542693 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 50176.8us
I20260709 12:18:59.544210 28604 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:18:59.547902 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.547971 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.549141 28604 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:18:59.550185 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.551308 28603 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:59.524751 32139 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:18:59.512691 32101 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.514364 32190 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:18:59.591419 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.537598 32240 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:59.548024 32215 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:59.537441 32248 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.556828 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:18:59.596032 32199 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.010s
I20260709 12:18:59.545230 32230 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:18:59.609787 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53048us
I20260709 12:18:59.610666 28602 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:59.548446 32163 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:18:59.529742 32131 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.587213 32196 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.552654 32247 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:59.611619 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 57739us
I20260709 12:18:59.609050 32214 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.596966 32245 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:59.597275 31987 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:59.541990 32229 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:59.618096 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 75445us
I20260709 12:18:59.608668 32215 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.615329 32190 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:59.627279 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.594234 32148 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:18:59.612766 32050 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:59.609597 32206 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.648324 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.648885 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:59.649652 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.650087 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:59.650601 28681 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.629721 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.611392 32240 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:18:59.653560 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:18:59.653921 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 115665us
I20260709 12:18:59.634007 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:18:59.636593 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.654975 28675 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:59.636935 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.655790 28674 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:18:59.629012 32140 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.547818 32069 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:59.641417 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.656936 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:59.667438 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.609933 32000 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:18:59.652360 28677 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:18:59.654294 28682 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:59.635238 28753 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:59.637996 28750 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:59.651021 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.673950 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:59.674541 28750 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.673950 28681 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:59.611490 32199 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.637830 32215 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.671183 32173 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.657405 28752 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:18:59.676331 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.671139 32069 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:59.677109 28673 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:59.645251 32050 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:59.652894 32247 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.686165 28750 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:59.683061 28606 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:18:59.684258 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.687211 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:18:59.687637 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:59.688197 28603 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:59.685236 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.688508 28603 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:59.689424 28606 pending_rounds.cc:85] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 7
I20260709 12:18:59.647890 32190 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:59.689700 28606 pending_rounds.cc:107] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:18:59.687786 28750 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.690081 28606 raft_consensus.cc:2889] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:59.635151 32214 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.693668 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:59.694243 28604 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.689219 28603 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.696086 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:18:59.678928 32140 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.697856 28750 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:18:59.702828 32252 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:59.703047 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 857) took 1036 ms. Trace:
I20260709 12:18:59.703378 32252 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.703914 32252 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:59.704423 32253 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:18:59.703501 29317 rpcz_store.cc:276] 0709 12:18:58.666953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.926284 (+259331us) service_pool.cc:224] Handling call
0709 12:18:58.926517 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:59.049739 (+123222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.702808 (+653069us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400628254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:18:59.702989 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280385408}
I20260709 12:18:59.712025 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.659480 32139 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.686054 32230 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:18:59.699232 32243 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:18:59.704465 32254 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.719267 32229 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.719017 32240 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:18:59.722730 32035 consensus_meta.cc:287] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.608s	user 0.013s	sys 0.006s
I20260709 12:18:59.695582 32173 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:18:59.724630 32208 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.724884 32050 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.725443 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 539) took 1574 ms. Trace:
I20260709 12:18:59.725886 32260 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:59.726040 28605 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 12:18:59.726301 32244 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.001s
I20260709 12:18:59.765029 28605 pending_rounds.cc:85] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 5
I20260709 12:18:59.686775 32224 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:18:59.690039 32248 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:59.734579 28606 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:59.729296 32099 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:59.755911 31938 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.756711 28751 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:59.757705 28601 rpcz_store.cc:276] 0709 12:18:58.150795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.150965 (+   170us) service_pool.cc:224] Handling call
0709 12:18:59.725247 (+1574282us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54003d2a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:59.725379 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2824269184}
I20260709 12:18:59.761516 32199 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.765265 28605 pending_rounds.cc:107] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:18:59.800689 28605 raft_consensus.cc:2889] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:59.764629 32260 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.785866 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:18:59.787329 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 72101.2us
I20260709 12:18:59.798606 28751 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:59.798621 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.804397 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.802152 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 2294) took 1430 ms. Trace:
I20260709 12:18:59.804953 28754 rpcz_store.cc:276] 0709 12:18:58.371836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.372540 (+   704us) service_pool.cc:224] Handling call
0709 12:18:59.801883 (+1429343us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54002d50d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:59.802078 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087452544}
I20260709 12:18:59.804656 28681 raft_consensus.cc:2410] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:59.799597 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.808893 28677 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:59.814347 28606 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:18:59.738916 32140 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:18:59.819123 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.818117 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.820205 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:59.820786 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.820864 28677 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 5.
I20260709 12:18:59.817736 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.822898 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.823457 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.724347 32227 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.825511 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:59.827358 28754 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:59.797195 32099 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:59.828200 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.829905 28681 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:18:59.828135 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.832728 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:59.751176 32067 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.833293 28681 raft_consensus.cc:2376] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8. Re-sending same reply.
I20260709 12:18:59.834003 28675 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:18:59.834136 32264 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:18:59.835675 32227 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.836750 32214 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.830296 31987 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:18:59.815886 32260 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:59.833456 32099 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.828812 31938 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:59.785002 32069 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.830186 32147 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.758307 32035 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.803308 32131 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.815864 32050 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.845305 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.843103 28749 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:59.843772 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.844523 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.848151 28681 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
W20260709 12:18:59.851948 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 195073us
I20260709 12:18:59.852691 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:59.853065 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.853824 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:59.818497 32265 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.858704 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.832984 32254 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.859488 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:59.785126 32190 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.861927 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:18:59.861886 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.862584 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.874341 28682 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:18:59.875252 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:18:59.877080 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.877004 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.877564 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:18:59.878676 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.879065 28675 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:59.855444 31938 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.883251 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:59.884045 28675 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.885587 32230 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:59.887113 32230 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.887904 32230 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.861327 32227 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:59.864956 32140 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:59.864703 32273 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:59.898294 28682 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:18:59.900756 32267 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:18:59.901230 32215 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.888875 32182 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:18:59.876030 32173 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.871171 32265 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.907060 32066 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:59.908352 28600 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:59.935235 28600 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:18:59.865748 32147 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:59.922245 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45290.5us
I20260709 12:18:59.923509 28604 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:18:59.930529 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.932309 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:59.937762 28720 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:18:59.938433 28682 raft_consensus.cc:2368] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8.
I20260709 12:18:59.860296 32269 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:18:59.914784 32227 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.916517 32184 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:18:59.929196 32218 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.871s	user 0.004s	sys 0.004s
I20260709 12:18:59.921243 32140 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.920250 32273 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:18:59.927335 32254 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:59.935236 32231 consensus_meta.cc:287] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 12:18:59.950157 28674 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:18:59.943480 32139 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.942425 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:59.935098 32066 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:18:59.945086 28678 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:18:59.973603 28678 pending_rounds.cc:85] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 4
I20260709 12:18:59.973963 28678 pending_rounds.cc:107] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:18:59.974301 28678 raft_consensus.cc:2889] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:59.975729 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:18:59.945705 32227 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.995272 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:18:59.996042 28601 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:18:59.954942 32067 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.998209 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1922) took 1074 ms. Trace:
I20260709 12:18:59.998590 28602 rpcz_store.cc:276] 0709 12:18:58.923841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.035450 (+111609us) service_pool.cc:224] Handling call
0709 12:18:59.997996 (+962546us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400233f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:18:59.998152 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320369536}
I20260709 12:18:59.999225 32247 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.999688 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:00.000582 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 366654us
I20260709 12:19:00.001505 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.002488 31745 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:00.002904 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:18:59.957793 28600 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.004794 28600 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.965087 28675 raft_consensus.cc:2410] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:18:59.915155 31938 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.979425 32265 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:18:59.981070 32173 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:59.981422 32215 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.959825 32184 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.939162 32272 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.984673 32231 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:18:59.969993 32273 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:00.022480 32184 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:18:59.987780 32066 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:18:59.959239 32147 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:59.989519 31720 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:59.989962 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 819) took 1686 ms. Trace:
I20260709 12:18:59.991330 32035 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:18:59.997885 32099 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.016100 32000 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:00.000638 32206 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:59.970782 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:00.010210 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 82390.1us
I20260709 12:19:00.002604 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:00.052000 28682 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:00.011476 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.011674 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:18:59.976630 28678 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:00.015443 28571 leader_election.cc:400] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8.
I20260709 12:19:00.016280 28607 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:59.969513 32140 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:00.019272 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:00.042678 29325 rpcz_store.cc:276] 0709 12:18:58.303884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.303998 (+   114us) service_pool.cc:224] Handling call
0709 12:18:58.327471 (+ 23473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:58.327991 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:58.328034 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:58.328707 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 12:18:58.774523 (+445816us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:58.774581 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:58.774689 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:59.876545 (+1101856us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b24002edd08. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08189c4 00007f6fe0816acb 00007f6fe09d1dc9 00007f6fe09d1a55 00007f6fe09d109d 00007f6fe360310e 00007f6fe361a88c 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221
0709 12:18:59.989571 (+113026us) raft_consensus.cc:1685] finished
0709 12:18:59.989602 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:59.989879 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1586,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":12186880,"thread_start_us":445379,"threads_started":1,"wal-append.queue_time_us":717723}
I20260709 12:19:00.060899 28601 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:18:59.933230 32252 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.065786 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:18:59.942886 32250 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:00.022467 32231 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.053514 28571 leader_election.cc:403] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:19:00.060086 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2422662720000517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 12:19:00.063723 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 61197.6us
W20260709 12:19:00.067595 28648 connection.cc:256] RPC call timeout handler was delayed by -1.2199162470001284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2775s for a response
I20260709 12:19:00.068135 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:00.069712 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:00.069782 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:00.071193 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:00.073015 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.074054 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:00.074471 28751 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:00.072309 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.075541 28606 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:00.075726 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:00.076013 28606 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:00.076910 28606 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.078050 28606 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.017434 32069 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:19:00.017560 32131 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:19:00.041425 31720 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:00.086678 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:00.087419 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:00.087515 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:00.082943 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.077338 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.088717 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:00.084705 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69456.5us
I20260709 12:19:00.049973 32000 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:00.060014 32173 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:00.095357 28677 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:00.095191 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.099172 28601 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:00.041805 32227 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.065750 32101 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:00.072690 32067 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:00.094235 32214 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:00.069188 32206 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:00.106642 32279 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:19:00.085489 31745 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:00.087024 32257 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:00.085824 32035 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:00.094370 32199 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:00.139878 28681 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:00.094926 32196 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:00.145624 28601 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:00.141538 32258 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:00.153714 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:00.175452 32282 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:19:00.143257 32214 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.143121 28600 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:00.072834 32076 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:19:00.100310 32231 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:00.141021 32067 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:00.208400 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67144.7us
I20260709 12:19:00.192183 32257 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:00.210319 32281 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 12:19:00.211123 32287 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:19:00.211668 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70036.2us
I20260709 12:19:00.213614 32199 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.213980 28606 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:00.138041 32227 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.143085 31975 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:00.139768 31517 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:00.252722 31517 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:00.253615 31517 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.214579 32000 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:00.254776 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.255297 32000 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:00.256263 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.257515 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.258423 32140 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:00.259598 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.215040 31720 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.261427 31720 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:00.262408 32199 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:00.085635 32260 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.267266 32260 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.217483 32099 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:00.241108 32067 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.269868 32140 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:00.237444 32214 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.272375 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1924) took 1348 ms. Trace:
I20260709 12:19:00.140709 32173 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:00.227586 32206 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.230335 32252 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.094636 32190 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8.
W20260709 12:19:00.234274 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 145614us
W20260709 12:19:00.235188 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 169480us
I20260709 12:19:00.173246 31745 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:00.238636 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:00.107650 32204 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 12:19:00.233853 32196 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:00.234824 32258 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.243047 32257 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:00.297665 32286 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.226s	user 0.000s	sys 0.004s
I20260709 12:19:00.297761 32258 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.251794 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1919) took 1328 ms. Trace:
I20260709 12:19:00.272881 28605 rpcz_store.cc:276] 0709 12:18:58.924330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.312127 (+387797us) service_pool.cc:224] Handling call
0709 12:18:59.725707 (+413580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:59.801304 (+ 75597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.272163 (+470859us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54003d2a50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:00.272313 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906512640}
I20260709 12:19:00.300601 28598 rpcz_store.cc:276] 0709 12:18:58.923097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.198298 (+275201us) service_pool.cc:224] Handling call
0709 12:19:00.251606 (+1053308us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400216454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:00.251739 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466982144}
I20260709 12:19:00.301306 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.301697 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:00.302120 28605 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:00.302963 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:00.305442 28722 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:00.279284 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:00.306097 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.306691 28753 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:00.307224 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.280117 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:00.308887 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.309034 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:00.285127 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:00.309896 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.285507 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:00.286158 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.310621 28600 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:00.310860 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.291512 32196 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:00.286947 31745 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:00.295194 31938 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:00.327744 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.328150 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.328384 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.328944 28748 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:00.295279 32255 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.629s	user 0.002s	sys 0.005s
I20260709 12:19:00.295994 32173 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.329828 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.300017 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.286511 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:00.342655 28601 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:00.311895 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.310880 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:00.254772 31517 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.283231 32260 raft_consensus.cc:2764] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:19:00.330494 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.347615 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.347209 28600 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:00.345698 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.337077 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.351281 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.352412 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.353358 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.354646 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.355608 28753 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:00.321236 32099 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:00.359187 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50218.3us
I20260709 12:19:00.359046 28648 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:00.360965 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.361891 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.365653 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.367923 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.329463 32291 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:00.372713 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.373085 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.367871 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.330003 32140 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:19:00.288932 32273 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.329535 32035 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:00.349714 32252 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:00.377653 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:00.380069 29323 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:00.380218 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:00.380647 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:00.381160 29327 raft_consensus.cc:2376] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7. Re-sending same reply.
I20260709 12:19:00.381776 29323 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:19:00.382072 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:00.382179 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:00.382820 32297 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:00.383173 29321 raft_consensus.cc:2410] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:19:00.382802 29325 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:00.382107 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:00.385046 29320 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:00.382774 29326 raft_consensus.cc:2376] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6. Re-sending same reply.
I20260709 12:19:00.375422 32227 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:00.378413 32035 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:00.392978 32227 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:00.393034 32035 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.353081 32206 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:00.393922 32227 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.394585 32206 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:00.395502 32206 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.398339 32139 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.349050 32208 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:19:00.401854 32252 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.402304 32252 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:00.338872 32257 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.409816 32273 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.410107 32257 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:00.372887 32260 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.412187 32230 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.412967 32250 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:00.413415 32250 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:00.414374 32230 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.414935 32291 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:00.420900 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:00.422062 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:00.422894 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:00.423090 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 81894.5us
I20260709 12:19:00.391882 32067 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.430279 28598 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:00.374888 32238 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:00.422657 29319 raft_consensus.cc:2376] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12. Re-sending same reply.
I20260709 12:19:00.426779 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:00.444566 31517 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:00.445111 31517 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.376968 32231 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:00.372033 32292 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:00.375100 32245 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.022s	sys 0.028s
I20260709 12:19:00.447815 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:00.439656 32234 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:00.444109 32260 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:00.448963 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.439512 32230 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:00.442029 32279 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:00.446256 32190 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:00.446447 32292 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.421690 32291 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.456951 32190 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:00.459723 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.448691 32258 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.461107 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:00.462255 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:00.462584 32258 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.463220 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:00.464241 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:00.450145 32245 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.026s	sys 0.032s
I20260709 12:19:00.466014 29323 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 9. Ops: [7.8-7.8]
W20260709 12:19:00.598935 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.555872 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 610) took 1264 ms. Trace:
I20260709 12:19:00.660871 28752 rpcz_store.cc:276] 0709 12:18:59.291054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.293132 (+  2078us) service_pool.cc:224] Handling call
0709 12:19:00.555647 (+1262515us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540012f554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:00.555796 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835701632}
I20260709 12:19:00.648263 31517 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:00.534889 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.623771 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2255) took 1965 ms. Trace:
I20260709 12:19:00.456995 32292 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:00.550427 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:00.688356 29325 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:19:00.704321 29325 pending_rounds.cc:85] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 6
I20260709 12:19:00.664454 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.704603 29325 pending_rounds.cc:107] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:19:00.704860 29325 raft_consensus.cc:2889] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:00.703083 28752 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:19:00.678665 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.466961 29320 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:00.717629 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53252.4us
I20260709 12:19:00.718737 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:00.719599 29327 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
W20260709 12:19:00.720476 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.722100 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:00.721379 32147 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:00.501953 32260 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:00.666127 32245 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:00.735757 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:00.724941 32245 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.666750 28599 rpcz_store.cc:276] 0709 12:18:58.658788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.925964 (+267176us) service_pool.cc:224] Handling call
0709 12:18:58.926380 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:58.965011 (+ 38631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:58.965040 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:58.995297 (+ 30257us) log.cc:844] Serialized 52 byte log entry
0709 12:18:59.295495 (+300198us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:59.343907 (+ 48412us) log.cc:844] Serialized 14 byte log entry
0709 12:18:59.344148 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.344221 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:59.727441 (+383220us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b18000e3ce0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:00.302360 (+574919us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18000e3ce0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:00.623526 (+321166us) raft_consensus.cc:1685] finished
0709 12:19:00.623548 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:00.623705 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38172,"prepare.queue_time_us":53413,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":38391,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":32606,"spinlock_wait_cycles":52838912,"thread_start_us":281129,"threads_started":1,"wal-append.queue_time_us":354808}
I20260709 12:19:00.636133 32199 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.741714 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.742728 28678 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:00.743144 31517 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:00.744493 31517 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.743391 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:00.746325 29327 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
W20260709 12:19:00.746927 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.748126 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.625438 32214 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.753150 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.756500 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.761956 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.766144 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:00.766583 31517 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.767177 32257 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.767261 32214 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.768095 29317 raft_consensus.cc:2368] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9.
I20260709 12:19:00.776996 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1857) took 2501 ms. Trace:
I20260709 12:19:00.777479 28680 rpcz_store.cc:276] 0709 12:18:58.275587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:58.678273 (+402686us) service_pool.cc:224] Handling call
0709 12:19:00.776737 (+2098464us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000c7954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:00.776913 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140770176}
I20260709 12:19:00.777348 31745 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.779633 28679 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:19:00.780011 28679 pending_rounds.cc:85] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 6
I20260709 12:19:00.780251 28679 pending_rounds.cc:107] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:19:00.780484 28679 raft_consensus.cc:2889] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:00.782312 32067 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.782904 32067 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:00.783447 32067 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.749791 32260 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.784884 32026 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.785393 32067 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:00.765489 32147 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:00.785975 32067 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:00.782763 32035 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.789083 32035 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:00.741784 32196 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:00.792975 32123 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:00.794941 32252 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:00.796046 31745 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:00.796504 32299 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.807482 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:00.799657 29290 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:00.808314 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51930.3us
I20260709 12:19:00.808332 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.806082 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.809792 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:00.812000 28748 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:00.809561 29290 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.809767 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1955) took 1735 ms. Trace:
I20260709 12:19:00.812000 28678 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:19:00.813495 28749 rpcz_store.cc:276] 0709 12:18:59.074197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.074308 (+   111us) service_pool.cc:224] Handling call
0709 12:18:59.091113 (+ 16805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:59.850800 (+759687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.809457 (+958657us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54000361d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:00.809689 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728613120}
I20260709 12:19:00.812886 28752 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:19:00.816790 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.822063 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1977) took 1172 ms. Trace:
I20260709 12:19:00.823707 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.822990 28754 rpcz_store.cc:276] 0709 12:18:59.649839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.828117 (+178278us) service_pool.cc:224] Handling call
0709 12:18:59.846952 (+ 18835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:59.890423 (+ 43471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:59.890453 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:59.926319 (+ 35866us) log.cc:844] Serialized 26 byte log entry
0709 12:19:00.049876 (+123557us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:00.049937 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.296977 (+247040us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:00.821819 (+524842us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b54001b49d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:00.821884 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:00.821917 (+    33us) raft_consensus.cc:1685] finished
0709 12:19:00.821924 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:00.822022 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7873,"raft.queue_time_us":42192,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2225,"spinlock_wait_cycles":92638976,"thread_start_us":101302,"threads_started":1,"wal-append.queue_time_us":136555}
I20260709 12:19:00.835678 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.837025 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:00.840297 28752 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:00.846257 28678 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:00.847019 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:00.848277 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.849211 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:00.852452 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:00.852903 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:00.854266 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 169808us
I20260709 12:19:00.855069 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:00.858467 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:00.878942 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:01.015883 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.014122 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:00.880419 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:01.016450 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.833983 32257 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:00.838845 32026 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.845796 32214 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:00.848928 32230 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:00.850237 31664 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:00.823498 32071 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:00.817894 32163 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.817866 32299 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.010545 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.065030 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:01.012555 32294 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:01.011653 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:00.832187 31745 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:01.066375 32190 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:01.066556 31745 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.066988 31745 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:01.067961 32305 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:19:01.011143 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.068529 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.069100 28677 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:01.069403 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:01.069525 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:01.070144 32304 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:00.852175 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:01.070549 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:00.881835 32250 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:01.071133 28680 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:19:01.071496 32307 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:19:01.071784 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2102) took 1093 ms. Trace:
I20260709 12:19:01.071846 28678 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:00.879526 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:01.072587 32250 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:01.072893 29325 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:01.020503 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.013465 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:01.073403 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.073541 28752 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:01.073792 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 60408.5us
I20260709 12:19:01.062414 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.075292 28749 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:01.022047 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:01.079218 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2103) took 1100 ms. Trace:
I20260709 12:19:01.079664 28678 rpcz_store.cc:276] 0709 12:18:59.979108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.071407 (+1092299us) service_pool.cc:224] Handling call
0709 12:19:01.071681 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.072324 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.079165 (+  6841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:01.072204 28680 rpcz_store.cc:276] 0709 12:18:59.978767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.070546 (+1091779us) service_pool.cc:224] Handling call
0709 12:19:01.070854 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.071543 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.071731 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:01.023989 32248 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.025138 32257 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:01.084229 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 72662.4us
I20260709 12:19:01.093444 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:01.085053 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 232932us
I20260709 12:19:01.060618 32071 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:01.056332 32229 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:01.096120 32071 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.096830 32229 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.097586 28680 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:01.098203 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2105) took 1118 ms. Trace:
I20260709 12:19:01.055555 32067 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:01.097196 32071 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:01.105780 29325 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:01.098871 32309 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:19:01.098506 28680 rpcz_store.cc:276] 0709 12:18:59.979796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.081403 (+1101607us) service_pool.cc:224] Handling call
0709 12:19:01.097410 (+ 16007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.097972 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.098142 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:01.122226 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.123126 28680 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:01.116927 28677 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:01.098685 32163 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:01.127985 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.060765 32026 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.099231 32257 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:01.098368 31664 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:01.100174 32250 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:01.130754 28678 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:19:01.131371 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.131880 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.100559 32260 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:01.139562 28677 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:01.136330 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2092) took 1210 ms. Trace:
I20260709 12:19:01.141067 28673 rpcz_store.cc:276] 0709 12:18:59.925709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.003777 (+ 78068us) service_pool.cc:224] Handling call
0709 12:19:00.004061 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.004309 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:00.010679 (+  6370us) log.cc:844] Serialized 14 byte log entry
0709 12:19:01.135773 (+1125094us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800481fc0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a
0709 12:19:01.135943 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:01.135991 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:01.136052 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.136131 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.136271 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23734,"prepare.queue_time_us":12448,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1326,"spinlock_wait_cycles":2706816,"thread_start_us":12351,"threads_started":1,"wal-append.queue_time_us":48474}
I20260709 12:19:01.143307 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.143697 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.144280 28754 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:01.144358 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2107) took 1164 ms. Trace:
I20260709 12:19:01.144865 28677 rpcz_store.cc:276] 0709 12:19:00.010917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.139136 (+1128219us) service_pool.cc:224] Handling call
0709 12:19:01.139407 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.144110 (+  4703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.144303 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:01.145993 28673 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:01.130771 32199 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:01.101550 32248 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.147972 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2108) took 1131 ms. Trace:
I20260709 12:19:01.149946 28673 rpcz_store.cc:276] 0709 12:19:00.016564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.142717 (+1126153us) service_pool.cc:224] Handling call
0709 12:19:01.145816 (+  3099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.147342 (+  1526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.147911 (+   569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:01.154351 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:01.135339 32250 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.136971 32252 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:01.140887 32196 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:01.161561 28673 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:19:01.164898 28752 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:01.166648 28749 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:01.159924 32250 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.176379 28754 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:01.181612 32248 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:01.184621 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1958) took 1319 ms. Trace:
I20260709 12:19:01.185678 32026 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:01.185035 28602 rpcz_store.cc:276] 0709 12:18:59.865686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.088962 (+223276us) service_pool.cc:224] Handling call
0709 12:19:00.089256 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:00.143673 (+ 54417us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:00.311296 (+167623us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b18002cad60. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:00.776326 (+465030us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b18002cad60. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:19:01.009547 (+233221us) log.cc:844] Serialized 14 byte log entry
0709 12:19:01.132787 (+123240us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:01.136964 (+  4177us) log.cc:844] Serialized 26 byte log entry
0709 12:19:01.137126 (+   162us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:01.137165 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.137229 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:01.184373 (+ 47144us) raft_consensus.cc:1685] finished
0709 12:19:01.184391 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.184563 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38738,"prepare.queue_time_us":69351,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":42,"raft.queue_time_us":56984,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":19563,"spinlock_wait_cycles":15270912,"thread_start_us":274109,"threads_started":2,"wal-append.queue_time_us":172694}
I20260709 12:19:01.193378 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1975) took 1550 ms. Trace:
I20260709 12:19:01.193918 28751 rpcz_store.cc:276] 0709 12:18:59.642670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.816523 (+173853us) service_pool.cc:224] Handling call
0709 12:18:59.816819 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.075147 (+258328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.193049 (+1117902us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400110b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:01.193296 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591916928}
W20260709 12:19:01.195266 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.197063 32294 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:01.197947 32294 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:01.198241 32294 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:01.199043 32294 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.199877 32299 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:01.200176 32294 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.201927 32292 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.203085 29326 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:01.205806 29318 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:19:01.206171 32310 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:19:01.179749 32229 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:01.207748 32174 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.208321 32174 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.213088 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:01.213641 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:01.213967 28751 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:01.214069 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 546) took 1746 ms. Trace:
I20260709 12:19:01.214614 28607 rpcz_store.cc:276] 0709 12:18:59.468114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.470705 (+  2591us) service_pool.cc:224] Handling call
0709 12:19:00.009616 (+538911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.063120 (+ 53504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.213833 (+1150713us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400233f50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:01.213998 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238615936}
I20260709 12:19:01.216060 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.206265 29326 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:01.219521 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:01.220880 29319 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:01.221225 29326 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:01.222442 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.223280 29326 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:01.228021 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:01.229359 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:01.248277 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:01.228245 32148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.562s	user 0.018s	sys 0.009s
W20260709 12:19:01.259265 32148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.598s	user 0.019s	sys 0.009s
I20260709 12:19:01.259330 31664 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:01.260969 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:01.297183 32318 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:01.298784 28673 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:01.299701 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:01.228137 32260 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:01.288085 32174 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:01.289968 32292 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:01.250855 32252 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:19:01.327970 32148 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:19:01.336272 31745 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.338960 32257 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:01.332226 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 76652.9us
I20260709 12:19:01.341230 31745 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:01.343060 32257 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:01.344779 32248 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.293583 32250 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:01.346823 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.256613 32279 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:19:01.350116 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:01.352519 29319 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:01.354342 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:01.359871 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.392796 29318 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:01.395808 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.398783 29318 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:01.345474 32248 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.408869 29318 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:01.388150 31987 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:01.420064 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.332363 31664 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.443616 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:01.451254 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 239051us
I20260709 12:19:01.425141 31987 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.456714 32224 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:01.458426 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2111) took 1184 ms. Trace:
I20260709 12:19:01.458930 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.458806 28677 rpcz_store.cc:276] 0709 12:19:00.274070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.153494 (+879424us) service_pool.cc:224] Handling call
0709 12:19:01.153781 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.157152 (+  3371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:01.157181 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:01.157705 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:19:01.309078 (+151373us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:01.309144 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.309241 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:01.458209 (+148968us) raft_consensus.cc:1685] finished
0709 12:19:01.458230 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.458368 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3021,"raft.queue_time_us":19510,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":12782,"thread_start_us":130743,"threads_started":1,"wal-append.queue_time_us":216581}
I20260709 12:19:01.462647 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.463218 28677 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:19:01.467049 29319 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:01.469812 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:01.469966 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 799) took 1046 ms. Trace:
I20260709 12:19:01.470340 29323 rpcz_store.cc:276] 0709 12:19:00.424033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.424179 (+   146us) service_pool.cc:224] Handling call
0709 12:19:00.425822 (+  1643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:00.659556 (+233734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.464426 (+804870us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b5400628254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:01.469909 (+  5483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91914624}
I20260709 12:19:01.470940 29322 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:01.474710 29322 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:19:01.478502 31987 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:01.479053 32250 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:01.476727 29323 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:01.472510 32331 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:01.480939 32331 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:01.481045 32329 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.481642 32329 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.481904 32331 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:01.446661 32279 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:19:01.473475 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:01.488776 32297 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:01.489213 32297 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.489248 32248 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:01.491436 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:01.483810 32292 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:01.491302 32297 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.492051 32066 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.494634 32316 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:01.505764 32285 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.432s	user 0.013s	sys 0.034s
W20260709 12:19:01.507936 32285 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.436s	user 0.013s	sys 0.034s
I20260709 12:19:01.497829 32292 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:01.510521 32329 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:01.509963 32292 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:01.519232 32288 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 1.435s	user 0.003s	sys 0.008s
W20260709 12:19:01.521768 32314 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.449s	user 0.000s	sys 0.002s
I20260709 12:19:01.522377 32323 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:01.522814 32323 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:01.523499 32297 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.523628 32323 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.524910 32323 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:01.524752 32292 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.525785 32297 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:01.526458 32292 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:01.565555 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 211122us
I20260709 12:19:01.567571 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:01.569162 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:01.570123 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:01.579421 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.579131 28603 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.593745 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:01.595758 28676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 695) took 1966 ms (client timeout 1667 ms). Trace:
I20260709 12:19:01.596341 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.598132 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.598733 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1872) took 1771 ms. Trace:
I20260709 12:19:01.599273 28679 rpcz_store.cc:276] 0709 12:18:59.827416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.827541 (+   125us) service_pool.cc:224] Handling call
0709 12:19:00.779276 (+951735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.780896 (+  1620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.598224 (+817328us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54000c7950. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:01.598502 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173646208}
I20260709 12:19:01.600893 28673 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:01.601557 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2106) took 1621 ms. Trace:
W20260709 12:19:01.602255 28674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1869) took 1783 ms (client timeout 2179 ms). Trace:
I20260709 12:19:01.602052 28678 rpcz_store.cc:276] 0709 12:18:59.980095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.083257 (+1103162us) service_pool.cc:224] Handling call
0709 12:19:01.130497 (+ 47240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.135473 (+  4976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.601097 (+465624us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b5400252950. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:01.601353 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107664768}
W20260709 12:19:01.602901 28674 rpcz_store.cc:269] 0709 12:18:59.818681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.818836 (+   155us) service_pool.cc:224] Handling call
0709 12:19:01.601843 (+1783007us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400299d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:01.602061 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299368192}
I20260709 12:19:01.604822 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:01.601552 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2086) took 1722 ms. Trace:
I20260709 12:19:01.608675 28681 rpcz_store.cc:276] 0709 12:18:59.878793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.879575 (+   782us) service_pool.cc:224] Handling call
0709 12:18:59.879914 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.202012 (+322098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.600988 (+1398976us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540016bf54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:01.601344 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597383936}
I20260709 12:19:01.610325 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2100) took 1632 ms. Trace:
I20260709 12:19:01.610870 28675 rpcz_store.cc:276] 0709 12:18:59.978007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.129779 (+151772us) service_pool.cc:224] Handling call
0709 12:19:01.606121 (+1476342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.606597 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:01.606620 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:01.606684 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:01.606733 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.606830 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.610005 (+  3175us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400299d50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:01.610157 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3394313472}
I20260709 12:19:01.616572 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:01.624607 28676 rpcz_store.cc:269] 0709 12:18:59.629307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.634909 (+  5602us) service_pool.cc:224] Handling call
0709 12:19:01.595113 (+1960204us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400273654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:01.595459 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3239059840}
I20260709 12:19:01.610301 28678 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:19:01.631024 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:01.631639 28572 connection.cc:256] RPC call timeout handler was delayed by -1.0651420140000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 12:19:01.634032 28572 leader_election.cc:336] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.774s (SENT)
I20260709 12:19:01.634570 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:01.642841 28603 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
W20260709 12:19:01.643493 28603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1952) took 1960 ms (client timeout 1529 ms). Trace:
W20260709 12:19:01.643800 28603 rpcz_store.cc:269] 0709 12:18:59.682631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.687427 (+  4796us) service_pool.cc:224] Handling call
0709 12:19:01.578108 (+1890681us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b58007856d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39db0aa 00007f6fe3a5d447 00007f6fe3a75fe7 00007f6fe3a777de 00007f6fe3a8327c 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c
0709 12:19:01.643365 (+ 65257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4320470912}
W20260709 12:19:01.647459 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 203764us
I20260709 12:19:01.648665 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:01.649456 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.649281 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:01.652611 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:01.658288 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:01.659125 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 791) took 1279 ms. Trace:
I20260709 12:19:01.659680 29317 rpcz_store.cc:276] 0709 12:19:00.379711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.379884 (+   173us) service_pool.cc:224] Handling call
0709 12:19:01.658646 (+1278762us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540010ac54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:01.658874 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890186112}
I20260709 12:19:01.664633 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:01.665813 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 807) took 1090 ms. Trace:
I20260709 12:19:01.666217 29321 rpcz_store.cc:276] 0709 12:19:00.575371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.575560 (+   189us) service_pool.cc:224] Handling call
0709 12:19:01.664028 (+1088468us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:19:01.665728 (+  1700us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4961152}
I20260709 12:19:01.673401 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.674630 29327 raft_consensus.cc:2410] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:19:01.677040 31987 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.679517 32026 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:01.652725 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 1952) took 2590 ms. Trace:
I20260709 12:19:01.677030 32000 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:01.676116 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:01.681391 32000 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:01.682195 32000 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:01.684217 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.685377 29325 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:01.680454 28755 rpcz_store.cc:276] 0709 12:18:59.061917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:59.062328 (+   411us) service_pool.cc:224] Handling call
0709 12:18:59.802152 (+739824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:59.802716 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:59.822636 (+ 19920us) log.cc:844] Serialized 14 byte log entry
0709 12:18:59.927090 (+104454us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:59.927142 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:59.927198 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:59.927264 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.458420 (+1531156us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18003aea00. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4
0709 12:19:01.652225 (+193805us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54002d50d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:01.652474 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24054,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":84,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7485,"spinlock_wait_cycles":1709855488,"thread_start_us":104073,"threads_started":1,"wal-append.queue_time_us":128070,"wal-append.run_cpu_time_us":13596,"wal-append.run_wall_time_us":1061277}
I20260709 12:19:01.687731 32048 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:01.693938 32048 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:01.684073 32000 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.689620 31517 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:01.690919 32035 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:01.698488 28673 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:01.680131 32026 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:01.767587 32252 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.772773 32048 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:01.780319 32250 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:01.789880 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 163566us
I20260709 12:19:01.790365 31987 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:01.831725 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:01.835280 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 258221us
I20260709 12:19:01.829816 31517 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:01.768350 32252 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.850395 29321 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:01.851891 28755 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:01.856638 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.857821 28747 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:01.860060 32329 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:19:01.861083 32026 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.862493 32026 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.862536 32163 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:01.863421 32163 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:01.866256 32163 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:01.866994 32344 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:01.868204 28674 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:01.867861 32344 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:01.868731 32326 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.420s	user 0.003s	sys 0.000s
W20260709 12:19:01.876066 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:01.876602 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.876322 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:01.884047 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.891175 32351 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.891993 32351 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:01.894531 32351 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:01.878798 32188 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:01.898928 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 215566us
I20260709 12:19:01.898764 32188 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:01.899749 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2312) took 1562 ms. Trace:
I20260709 12:19:01.900586 28677 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
W20260709 12:19:01.902065 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 125122us
I20260709 12:19:01.902141 32248 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:19:01.903083 32214 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:01.903486 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.904402 29320 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:01.905258 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.905396 32214 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:01.905975 28754 raft_consensus.cc:2376] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8. Re-sending same reply.
I20260709 12:19:01.906626 32229 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:01.907282 28673 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:01.907615 29317 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:19:01.907959 29317 pending_rounds.cc:85] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 7
I20260709 12:19:01.908288 29317 pending_rounds.cc:107] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:19:01.908629 29317 raft_consensus.cc:2889] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:01.910183 32206 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:01.910851 32252 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:01.912135 32344 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:01.902081 32123 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.913399 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.913214 32123 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.913949 29327 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:19:01.914251 32342 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:19:01.914834 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:01.916002 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2112) took 1565 ms. Trace:
I20260709 12:19:01.916370 28680 rpcz_store.cc:276] 0709 12:19:00.350971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.152033 (+801062us) service_pool.cc:224] Handling call
0709 12:19:01.152304 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.304681 (+152377us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:19:01.445416 (+140735us) log.cc:844] Serialized 14 byte log entry
0709 12:19:01.585308 (+139892us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:01.586568 (+  1260us) log.cc:844] Serialized 26 byte log entry
0709 12:19:01.586881 (+   313us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:01.586943 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.587101 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:01.915671 (+328570us) raft_consensus.cc:1685] finished
0709 12:19:01.915693 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.915823 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45312,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":193760,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":3968,"thread_start_us":403565,"threads_started":3,"wal-append.queue_time_us":51405}
I20260709 12:19:01.918874 28679 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:19:01.907996 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.919034 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:01.919561 29321 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:01.919869 29323 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:01.920158 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:01.920907 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:01.921765 29319 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:01.922959 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.923884 29326 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:01.919885 28751 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:01.925146 31745 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:01.925649 31745 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:19:01.926664 32071 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.004s
I20260709 12:19:01.926869 31745 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.900223 28756 rpcz_store.cc:276] 0709 12:19:00.337559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.450047 (+112488us) service_pool.cc:224] Handling call
0709 12:19:00.500535 (+ 50488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:00.500927 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:00.500955 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:00.548868 (+ 47913us) log.cc:844] Serialized 26 byte log entry
0709 12:19:00.718182 (+169314us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:00.732532 (+ 14350us) log.cc:844] Serialized 14 byte log entry
0709 12:19:00.732836 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.732941 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:01.863403 (+1130462us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b18003bcc20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1
0709 12:19:01.865608 (+  2205us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18003bcc20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:01.899322 (+ 33714us) raft_consensus.cc:1685] finished
0709 12:19:01.899344 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.899530 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13520,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":468,"raft.queue_time_us":239,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":5163,"spinlock_wait_cycles":10958976,"thread_start_us":168892,"threads_started":1,"wal-append.queue_time_us":188574}
W20260709 12:19:01.930924 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51688.2us
I20260709 12:19:01.933972 32196 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.934159 32179 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:01.934613 32196 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.934842 32179 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:01.914273 28752 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:01.884253 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 163578us
I20260709 12:19:01.941669 32337 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:01.942154 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:01.941716 32339 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 12:19:01.944651 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 73320.1us
I20260709 12:19:01.942973 32196 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:01.938804 31745 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:01.978502 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.975385 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:01.938794 32279 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:01.968319 32000 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:01.994736 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.986956 32055 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:19:01.999837 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.980540 32196 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:02.007967 29323 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:02.010768 28755 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
W20260709 12:19:02.014204 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 380268us
I20260709 12:19:01.984844 32214 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:02.016234 29326 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:01.996204 32329 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.023228 32224 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:02.023985 32224 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.024520 32173 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:02.025563 32173 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:02.026350 32227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.375s	user 0.010s	sys 0.044s
W20260709 12:19:02.026759 32227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.421s	user 0.010s	sys 0.044s
I20260709 12:19:02.027459 32147 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:02.027837 32147 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:02.029112 32179 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.028851 32147 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.030231 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:02.031261 29327 raft_consensus.cc:2410] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:19:02.030249 32123 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.037951 28752 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:02.042542 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:02.047875 32319 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:02.048520 32331 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:19:02.017278 32055 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:02.056026 32214 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.056819 32055 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:02.057983 32299 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:02.000586 32000 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.058665 32299 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.056344 32355 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:02.060017 32196 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.061079 32324 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:02.061589 32324 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:02.061117 32355 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.062675 32324 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.064741 32355 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.066648 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:02.068068 31987 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.068789 31987 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.069859 32242 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:02.068118 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:02.099479 28747 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:01.986995 32353 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 12:19:02.103811 32329 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.107177 32319 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:02.108387 32319 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.108992 32329 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.110056 32230 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.110762 32230 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.111800 32227 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:02.113656 32299 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:02.125535 32362 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.126318 32362 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.129622 32230 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.136976 32353 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:02.137631 32353 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:02.137852 32050 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:02.138254 32050 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:02.138736 32353 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.139206 32050 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.141208 32362 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:02.149725 28750 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
W20260709 12:19:02.152362 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 84415us
I20260709 12:19:02.155292 32174 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:02.156706 32349 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:02.157084 32349 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:02.158179 32349 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.163882 32261 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:02.164371 32261 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:02.149881 32050 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.165544 32261 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.166786 32261 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:02.167398 32069 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.168046 32069 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.050208 32279 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.170645 32069 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:02.171401 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.171554 32279 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:02.106178 32339 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:19:02.175536 32173 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:02.178746 32066 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 12:19:02.179086 32324 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:02.179409 32199 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.179967 32199 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:02.181289 32323 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.008s
I20260709 12:19:02.182847 32000 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:02.104951 32248 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.184962 32248 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.182897 32199 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:02.148025 31517 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:02.186906 31517 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:02.212263 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 276519us
I20260709 12:19:02.186009 31987 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:02.268293 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.273929 32188 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:02.274840 31517 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.276072 29326 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:02.276566 31517 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.276767 32257 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:02.277139 32196 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:02.267987 32242 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.277565 32257 consensus_queue.cc:1243] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:02.277899 32242 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.278463 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:02.279207 29325 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:02.280098 32242 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.280376 29323 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
W20260709 12:19:02.141100 32337 consensus_queue.cc:1175] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" responder_term: 11 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [10.6-10.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:02.288700 32329 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.288947 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.289376 32329 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.289855 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.290638 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.291326 28607 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:02.291599 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:02.292452 29321 raft_consensus.cc:2410] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:19:02.292855 32339 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:02.293536 32339 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.294145 32248 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.295644 32339 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.299073 28600 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:02.289144 28602 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:02.299226 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:02.302207 28571 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:02.303107 32323 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.303205 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:02.303485 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.303777 32323 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:02.304637 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 165717us
I20260709 12:19:02.304937 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:02.305975 32323 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:02.307188 28750 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:02.308107 28755 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:02.308223 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.309154 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:02.309499 28601 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:02.310359 28756 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:02.312785 32351 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:02.313323 32351 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:02.304342 28606 raft_consensus.cc:2410] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:19:02.328706 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45204.2us
I20260709 12:19:02.329793 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:02.302028 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:02.336621 28604 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:02.337153 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:02.341970 28600 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:02.291613 32329 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.348882 32279 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.349352 32093 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.349999 29321 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:02.349865 32279 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.350397 29321 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:02.351263 29321 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.352612 31987 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:02.349046 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.352278 29321 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.352213 32279 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:02.354465 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52376.1us
I20260709 12:19:02.353902 31987 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.357244 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.358093 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.363641 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.368700 28751 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:02.369220 32214 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:02.361923 31987 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.372813 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.362227 32048 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:02.374336 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.374619 32048 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.369740 28752 raft_consensus.cc:2410] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:19:02.375092 32048 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.375830 28677 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:02.377144 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:02.378036 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.380036 32370 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:02.380723 32370 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:02.381875 32179 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:02.382337 32179 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:02.381825 32370 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.369868 32242 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:19:02.383642 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:02.383951 32242 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:02.372069 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.369679 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.375118 28678 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:02.338400 32250 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:02.383342 32179 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.385828 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.393779 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:02.349895 32093 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.394495 29321 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:19:02.488332 29321 pending_rounds.cc:85] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 6
I20260709 12:19:02.488595 29321 pending_rounds.cc:107] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:19:02.488852 29321 raft_consensus.cc:2889] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:02.406119 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.481371 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:02.481494 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.481371 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:02.409595 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:02.493430 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:02.493369 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.406559 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:02.485282 28676 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:02.492033 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.386314 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:02.501247 28602 raft_consensus.cc:2376] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8. Re-sending same reply.
W20260709 12:19:02.504483 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:02.390501 32035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.001s	sys 0.017s
I20260709 12:19:02.517513 28752 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:02.518497 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:02.519493 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.522794 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.480927 32242 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:02.506309 32196 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:19:02.528640 28749 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:02.529022 29325 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:19:02.515357 32035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.002s	sys 0.022s
I20260709 12:19:02.369701 32123 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 12:19:02.522920 32179 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:02.542594 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.545331 28752 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
W20260709 12:19:02.545593 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.542058 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:02.399992 32248 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:19:02.548605 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.549422 29317 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:19:02.549561 28601 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:02.503149 32174 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:02.553880 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.556088 28676 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:02.553803 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.361485 32351 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.557299 28750 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:19:02.561616 28747 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:19:02.565243 29323 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:19:02.549490 32344 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:02.553767 32371 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.569168 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.571897 28755 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:02.572379 28676 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:19:02.572940 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.574476 28752 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
W20260709 12:19:02.573091 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63431.9us
W20260709 12:19:02.602625 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.535151 32250 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:02.605600 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:02.606364 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:02.610993 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 138119us
I20260709 12:19:02.613287 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:02.613400 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 206932us
W20260709 12:19:02.614765 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.570228 32344 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:02.610071 32351 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.627903 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:02.627831 28755 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:02.639779 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:02.570894 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:02.646497 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:02.600327 32242 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.650478 28675 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:19:02.652925 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:02.653415 28679 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:02.650900 28675 pending_rounds.cc:85] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 5
I20260709 12:19:02.655018 31517 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:02.655553 28675 pending_rounds.cc:107] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:19:02.655817 28675 raft_consensus.cc:2889] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:02.624501 32371 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.662034 32337 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:02.675267 28755 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:02.675024 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.681885 32346 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:02.684909 28679 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:19:02.685307 28679 pending_rounds.cc:85] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 5
I20260709 12:19:02.685535 28679 pending_rounds.cc:107] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 12:19:02.687705 32375 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:19:02.688340 32147 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:19:02.692601 32382 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:19:02.700940 32261 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.001s
I20260709 12:19:02.702508 32371 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.674892 32337 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.703063 32337 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.677980 32344 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.703991 32344 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.672703 32173 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:02.656576 32055 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.707963 32173 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:02.709067 32173 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.709928 32349 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.686776 32346 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.711874 32346 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.712949 32224 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:02.714322 32324 consensus_meta.cc:287] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
I20260709 12:19:02.714766 32093 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.715379 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:02.717643 32214 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:02.718164 32214 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:02.718856 32055 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:02.719054 32214 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:02.707391 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.721818 28607 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:02.685810 28679 raft_consensus.cc:2889] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:02.721642 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:02.733321 28722 leader_election.cc:336] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.912s (SENT)
I20260709 12:19:02.733893 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:02.740995 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 126070us
I20260709 12:19:02.741180 32067 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:02.741699 32067 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:02.741860 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:02.742575 28599 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:19:02.742842 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:02.743803 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:02.742062 32067 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:02.745318 28749 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:02.744185 28680 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:02.709656 32250 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.665488 32174 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:02.763556 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.754807 32000 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:02.794205 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:02.748579 32035 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:02.754036 32257 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:02.786398 32123 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:02.813266 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:02.815251 32379 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:19:02.811671 32353 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:02.795270 32250 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.816447 32353 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:02.816919 32353 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.816956 32250 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.803632 32371 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:19:02.818657 32371 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:02.819011 32371 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:02.819425 32250 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:02.795956 32331 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:19:02.820808 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 68406.6us
I20260709 12:19:02.821426 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:02.821666 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:02.822563 32188 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:02.807788 32000 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:02.824559 32340 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:19:02.824800 32000 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.803189 32199 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:19:02.834272 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 100941us
I20260709 12:19:02.805707 32066 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:02.827433 32123 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:02.835099 28722 leader_election.cc:336] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.529s (SENT)
W20260709 12:19:02.845444 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 101754us
I20260709 12:19:02.824613 32035 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:02.845927 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:02.844076 32048 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.819900 32371 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:02.846334 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:02.848932 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.845393 32123 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:02.884259 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49171.9us
I20260709 12:19:02.880652 32257 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:19:02.912835 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:02.917999 28604 raft_consensus.cc:2410] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:19:02.849081 32377 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 12:19:02.917030 28722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.977s (SENT) [suppressed 38 similar messages]
I20260709 12:19:02.901949 32035 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:02.927150 28752 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:02.934681 32386 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:19:02.936331 32389 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:02.938184 32337 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:02.939144 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 58512.8us
I20260709 12:19:02.940083 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:02.940815 28754 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:02.920869 32371 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:02.940835 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:02.926784 32378 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.390s	user 0.004s	sys 0.000s
I20260709 12:19:02.884269 32066 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.946868 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:02.915478 32199 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:19:02.949869 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 103603us
I20260709 12:19:02.930904 32393 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.953567 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:02.957017 28722 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.027s (SENT)
I20260709 12:19:02.956029 28749 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:02.959251 32349 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:02.959896 28753 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:19:02.961795 32380 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:19:02.954998 32397 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:02.964931 32397 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:02.965855 32397 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.968782 32257 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.972699 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:02.979238 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:02.993453 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49734.3us
W20260709 12:19:03.000806 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.002275 32066 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.003536 32340 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:03.003324 32050 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:19:03.007577 32048 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.009434 32066 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.009958 32066 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.012454 32066 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.020716 32254 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:03.021310 32254 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:03.022053 32199 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.022398 32254 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.023763 32254 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.016223 32067 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.026538 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:03.027285 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:03.028294 28751 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:19:03.028836 32398 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:19:02.958256 32393 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.986471 32377 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:03.032769 32067 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.042970 32204 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:19:03.043828 31987 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.006s
I20260709 12:19:03.044131 32204 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:03.044623 32204 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:03.044251 31987 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.045401 28756 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 9. Ops: []
W20260709 12:19:03.046675 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.047802 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:03.059813 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:03.063521 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:03.064520 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.066742 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:03.068372 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 89221.4us
I20260709 12:19:03.064127 29319 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:03.068792 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:03.072208 29323 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
W20260709 12:19:03.074046 29292 leader_election.cc:336] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.818s (SENT)
I20260709 12:19:02.977517 32353 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:02.986275 32346 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.061102 31987 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.050959 32174 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:03.110579 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.070966 32204 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.116833 32204 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:03.117337 32346 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.125020 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:03.125568 29319 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:19:03.127130 29321 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:03.127250 32248 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.127909 32248 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.128095 32377 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:03.129994 32248 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:03.130395 32349 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:03.124428 32346 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:19:03.072991 32050 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:19:03.132552 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63454.9us
I20260709 12:19:03.133935 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:03.135563 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.135772 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.136263 28602 raft_consensus.cc:2368] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:03.136379 28600 raft_consensus.cc:2368] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9.
I20260709 12:19:03.136828 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.138697 28599 raft_consensus.cc:2368] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9.
I20260709 12:19:03.136852 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:03.139196 32069 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.134892 32123 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.150104 32123 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.150926 32340 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:03.151966 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:03.152055 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 88815us
W20260709 12:19:03.154848 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:03.165091 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.148624 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:03.173738 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.177404 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:03.178020 28754 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.180224 28749 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:03.180287 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:03.181203 28750 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:03.181993 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:03.190893 28754 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:03.196586 28751 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:03.108928 32179 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:19:03.204946 32370 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:03.208412 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:03.208710 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:03.209036 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.209393 28754 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
W20260709 12:19:03.213227 32395 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:19:03.216513 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 650290us
I20260709 12:19:03.218080 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:03.220213 32242 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:03.222479 32227 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:03.222894 32227 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:03.223238 32227 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:03.224982 32355 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:03.226773 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:03.228634 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.209075 28751 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:03.229027 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:03.184614 32362 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:03.122655 32174 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:19:03.177593 32393 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.240993 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:03.243371 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:03.256961 32048 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:03.257675 32337 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.258402 32252 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.258342 32337 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:03.262828 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.266773 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:03.267518 28751 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.242640 32397 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:03.240772 32362 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:03.259037 32252 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.275678 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.275996 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:03.277154 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:03.277915 32318 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:03.277937 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.278863 32330 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:03.280462 32279 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.281126 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.243116 32340 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:03.288707 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.290009 28750 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:03.291576 32318 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.297247 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:03.298368 32330 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:03.299098 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:03.299624 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:03.299991 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.300450 32330 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.300722 32245 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.300819 32147 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.301023 32330 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:03.296705 32340 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:03.274253 32179 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:03.282456 32397 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:03.270787 32123 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:03.347968 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:03.349198 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.349277 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.304464 28598 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.301167 32227 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.344681 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.354141 28675 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:03.356168 28601 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:03.294595 32352 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.290959 32362 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:03.298411 32318 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.368256 28678 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:03.301465 32147 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.370210 28607 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:03.341233 32179 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:03.377067 28680 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:03.352615 32397 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.372611 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:03.389355 28681 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.390105 28673 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:03.393405 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.395290 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 1963) took 1066 ms. Trace:
I20260709 12:19:03.398124 32352 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.401388 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:03.402089 28679 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.395764 28604 rpcz_store.cc:276] 0709 12:19:02.311007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.384606 (+ 73599us) service_pool.cc:224] Handling call
0709 12:19:03.370574 (+985968us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400093654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:03.377472 (+  6898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978995200}
I20260709 12:19:03.406920 28755 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:03.360317 32173 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:03.301594 32330 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.336439 32279 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.350282 32123 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:03.394178 32179 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:03.386683 32353 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.433192 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:03.433018 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 230690us
I20260709 12:19:03.436013 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:03.437139 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:03.301237 32245 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.428416 32196 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.441560 32069 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:03.452767 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:03.455629 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 160209us
I20260709 12:19:03.457512 28607 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:03.460656 28682 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:19:03.448709 32055 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.005s
I20260709 12:19:03.461046 28682 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:03.463507 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.463961 28680 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:03.468235 28682 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.469219 28682 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:03.469313 32330 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.446834 32340 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.464963 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:03.476562 28599 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:03.485769 28679 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:03.483211 32355 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.483544 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.474550 28604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:03.447252 32173 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.486953 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.550414 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.521903 28682 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:19:03.551154 28599 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:03.551272 28682 pending_rounds.cc:85] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 4
I20260709 12:19:03.526144 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:03.552060 28604 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:03.552593 28604 raft_consensus.cc:614] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:03.517114 28756 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [6.8-7.9]
W20260709 12:19:03.523291 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45789us
I20260709 12:19:03.538900 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.556176 28673 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:03.556671 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:03.551702 28682 pending_rounds.cc:107] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:19:03.557710 28682 raft_consensus.cc:2889] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:03.558812 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:03.584116 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 72739.6us
I20260709 12:19:03.583992 28598 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:03.457460 32196 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.590045 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.592417 28607 raft_consensus.cc:2410] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:03.480898 32396 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:03.641435 28598 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:03.553818 32331 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.642767 32331 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.595276 28571 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:03.592885 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.648247 28679 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11.
W20260709 12:19:03.527858 32388 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.636s	user 0.004s	sys 0.000s
W20260709 12:19:03.514801 32407 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:19:03.653661 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58492.7us
I20260709 12:19:03.486799 32355 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.649061 32067 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:03.659301 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.659235 32067 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.660036 28675 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:19:03.661057 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.661623 28675 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:03.662415 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:03.663311 32406 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:19:03.664184 32393 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:03.664350 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.591939 32048 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.665596 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.666714 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.667006 32173 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.667388 28674 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:03.667598 32362 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.534304 32227 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.665287 32048 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.664233 28681 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:03.671727 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.651986 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:03.662887 28675 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:19:03.535826 32370 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:03.679468 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.680277 28679 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:19:03.592368 32257 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:03.678578 28682 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:03.645825 32261 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.644855 32318 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:03.700927 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:03.486974 32066 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.185s
I20260709 12:19:03.700927 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:03.703315 28681 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:03.706336 28677 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.710563 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:03.703715 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:03.658334 32344 consensus_meta.cc:287] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.954s	user 0.007s	sys 0.007s
I20260709 12:19:03.465987 32123 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.652849 32352 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.706053 28679 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:19:03.705844 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:03.665517 32245 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.668654 32242 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:03.721299 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.683275 32370 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:03.722990 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:03.702518 32257 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:03.739172 28673 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:03.705497 32414 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:03.741484 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 182732us
I20260709 12:19:03.737282 28720 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11.
I20260709 12:19:03.744624 28720 leader_election.cc:403] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:03.745834 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:03.755474 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:03.755662 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:03.757054 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 1967) took 1435 ms. Trace:
I20260709 12:19:03.735351 32123 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:03.742885 32257 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.780069 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:03.713732 32261 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.757436 28606 rpcz_store.cc:276] 0709 12:19:02.312016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.517139 (+205123us) service_pool.cc:224] Handling call
0709 12:19:02.536966 (+ 19827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:02.547675 (+ 10709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:02.547717 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:02.573997 (+ 26280us) log.cc:844] Serialized 26 byte log entry
0709 12:19:02.669592 (+ 95595us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:02.669633 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.669708 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:03.527190 (+857482us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:03.739773 (+212583us) raft_consensus.cc:1685] finished
0709 12:19:03.739802 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:03.746969 (+  7167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4752,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5361,"spinlock_wait_cycles":17467264,"thread_start_us":56252,"threads_started":1,"wal-append.queue_time_us":218517}
I20260709 12:19:03.746121 32340 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:03.724418 32318 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.764236 32173 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:03.777479 32349 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:03.807510 28751 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.004s
I20260709 12:19:03.807883 28751 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:03.808491 28677 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
W20260709 12:19:03.813468 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62226.4us
I20260709 12:19:03.782733 32416 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.781191 32279 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.817381 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:03.762982 32242 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:19:03.791337 32344 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:03.824117 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:03.827625 32410 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:19:03.829074 32245 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.829344 32362 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.829594 32245 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.830245 32416 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:03.832254 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 109373us
W20260709 12:19:03.832548 32421 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:19:03.833314 32330 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:03.833729 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:03.834628 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:03.835459 32230 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:03.837241 29292 leader_election.cc:336] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.155s (SENT)
I20260709 12:19:03.837638 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:03.840996 32050 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:03.824997 28606 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:03.836124 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:03.832556 28605 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:03.823529 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:03.845358 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 89940.7us
I20260709 12:19:03.846336 28720 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:03.749513 32414 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.807039 32340 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:03.813725 32371 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11.
I20260709 12:19:03.841519 32050 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.815855 32377 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:03.834656 32330 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:03.844774 32337 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.878477 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:03.847386 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:03.870333 32173 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:03.850750 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:03.883841 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:03.822779 32344 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:03.899287 32067 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:03.873211 31987 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:03.814760 32349 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:03.918193 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 94713.9us
I20260709 12:19:03.873502 32279 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:03.920562 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.912292 32174 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.788158 32370 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.869050 32196 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:03.933429 28606 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:03.900130 32352 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:03.915741 32344 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:03.938112 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 100904us
I20260709 12:19:03.938977 32370 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:03.939926 28604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
W20260709 12:19:03.941745 32425 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:19:03.946475 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:03.989813 28607 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:03.923312 31987 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:03.948567 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.948891 32355 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.949956 32066 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:03.950654 32199 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:03.953188 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:03.953596 32254 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.929s	user 0.012s	sys 0.000s
I20260709 12:19:03.878068 32337 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:03.915216 32230 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:03.881556 32330 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:03.984099 28604 raft_consensus.cc:606] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:04.019605 28604 raft_consensus.cc:614] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:03.876125 32362 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:19:03.868856 32397 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:04.002820 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.932696 32067 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:03.975909 32394 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:19:03.884781 32377 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:03.957477 32352 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:04.059402 32352 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:04.059688 32397 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.060179 32245 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.060510 29321 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:04.019191 32230 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.062759 32230 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.001849 31987 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:04.025933 28601 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.000s
I20260709 12:19:04.095830 28601 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:19:03.930625 32174 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.031111 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.110213 28679 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:04.110322 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.050974 32050 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.018999 32340 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.051713 32048 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:03.996809 32055 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:19:04.052357 32349 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.009016 32066 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.125356 32066 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:04.056206 28682 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:04.056730 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.018920 32242 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.058233 32377 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.058588 32067 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.056306 28598 raft_consensus.cc:2410] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:19:04.067754 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 216970us
W20260709 12:19:04.138358 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.114893 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.127314 32242 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.142241 28607 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:19:04.117573 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.147823 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.149793 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.150545 28751 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:04.152213 28748 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:04.152287 32242 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.154767 32230 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.157281 32352 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.030221 32254 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:04.158368 32174 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:04.158922 29292 leader_election.cc:336] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.155s (SENT)
I20260709 12:19:04.159364 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:04.150053 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 223982us
I20260709 12:19:04.161734 28679 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:04.155180 32437 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:19:04.163757 28750 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 6: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:04.028362 32330 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.120386 32418 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:04.121338 32416 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.169986 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.171737 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:04.168074 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:04.256085 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.273943 28751 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:04.186932 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.277240 28677 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:04.186210 28755 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:04.210965 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.207228 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:04.188834 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.210579 28606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:04.220894 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:04.222450 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 81751.7us
I20260709 12:19:04.278867 28607 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:04.217839 32441 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.303725 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.187556 32279 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.310659 28752 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:04.310345 32441 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.311075 32279 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.220635 32397 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:04.311618 28750 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:04.310467 28606 raft_consensus.cc:606] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:04.312579 28606 raft_consensus.cc:614] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:04.190954 32179 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.000s
I20260709 12:19:04.211372 32427 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:04.204478 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.313223 32179 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.186273 32254 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:04.310732 28604 raft_consensus.cc:2376] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9. Re-sending same reply.
W20260709 12:19:04.168205 32396 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.001s
I20260709 12:19:04.315596 32179 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.315999 32396 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:04.188424 32432 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.317610 32432 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.318529 32279 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.167029 32196 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:04.163862 32362 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:04.304847 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 94619.8us
I20260709 12:19:04.352871 32441 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.220700 32428 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:04.323688 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:04.278895 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 117665us
I20260709 12:19:04.345562 32337 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.312237 32397 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.328838 32173 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.329290 32377 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:04.332731 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:04.334214 32261 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.315120 32254 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.411660 28673 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:04.374135 32324 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:04.413127 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:04.339581 32415 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.552s	user 0.000s	sys 0.002s
I20260709 12:19:04.351845 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.361991 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.363353 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.418725 28681 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
W20260709 12:19:04.364115 28605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2293) took 2077 ms (client timeout 1613 ms). Trace:
I20260709 12:19:04.352461 32067 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.394235 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.327059 28676 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:04.361207 32352 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:04.416553 32257 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
I20260709 12:19:04.347530 32318 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.370615 32196 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.354159 32414 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.403591 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:04.404222 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.423542 28750 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:04.441632 28604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:04.442246 28604 raft_consensus.cc:606] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:04.419778 28605 rpcz_store.cc:269] 0709 12:19:02.286897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:02.289505 (+  2608us) service_pool.cc:224] Handling call
0709 12:19:04.363949 (+2074444us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400122ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:04.364050 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2705408384}
I20260709 12:19:04.381282 32230 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.429001 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:04.429566 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 214038us
I20260709 12:19:04.450693 28677 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:04.440930 32196 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:04.436510 29321 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
W20260709 12:19:04.434266 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 103194us
I20260709 12:19:04.439791 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.377633 32362 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.456329 28681 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:04.459847 32457 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:04.398039 32428 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.454077 32048 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:04.415766 32173 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.423643 32377 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.428697 32324 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.454190 32441 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:04.486732 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.501101 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.483319 32318 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:19:04.505587 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 105219us
I20260709 12:19:04.437734 32257 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.507400 28605 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:04.509016 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.487480 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:04.509822 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.510426 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.510823 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.511834 28681 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:04.512661 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.513185 28599 raft_consensus.cc:2376] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8. Re-sending same reply.
I20260709 12:19:04.509428 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.518994 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.490513 32048 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.464841 32330 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.518605 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.522396 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.520279 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.519884 28605 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:04.522727 28606 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:04.525717 28602 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:04.523666 28600 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:04.526539 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.537034 28605 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:04.531862 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.537940 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.538513 28599 raft_consensus.cc:2376] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8. Re-sending same reply.
I20260709 12:19:04.526942 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.538632 28605 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:04.506628 32432 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:04.540170 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:04.544315 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.546058 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.546782 28674 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:04.546775 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.547916 28602 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.546800 28606 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:04.549265 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:04.505419 32441 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.559968 28607 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:04.522121 32048 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:04.521940 32230 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.669734 32230 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.670614 32377 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:04.671880 32173 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.550740 28606 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:19:04.672588 28606 pending_rounds.cc:85] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 7
I20260709 12:19:04.672827 28606 pending_rounds.cc:107] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:19:04.673054 28606 raft_consensus.cc:2889] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:04.634619 28676 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
W20260709 12:19:04.674741 31987 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.002s
I20260709 12:19:04.675154 31987 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.676399 28751 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:04.677254 32441 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:04.618739 32330 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.678051 32428 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.678627 32324 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.678748 32048 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.554740 32414 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:19:04.658944 32362 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.646042 32353 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:04.680037 32353 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:04.681058 28603 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:04.681519 32353 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.682633 32353 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:04.607168 28571 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:04.688967 32179 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:04.583050 32355 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:04.582513 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.582015 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.690232 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 574) took 1033 ms. Trace:
I20260709 12:19:04.690696 29318 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:04.691794 28601 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:19:04.692152 28601 pending_rounds.cc:85] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 8
I20260709 12:19:04.602537 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.518395 32454 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:19:04.614857 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:04.609822 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.693076 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:04.693416 28753 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:04.693629 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.561404 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.608820 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.694962 29327 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:04.695917 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.693667 28756 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.565161 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:04.520345 32318 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:19:04.521898 32451 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:19:04.616798 32257 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:04.654536 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 112841us
W20260709 12:19:04.620334 32344 consensus_meta.cc:287] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.001s
W20260709 12:19:04.652024 32456 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:19:04.652657 32196 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.716809 32230 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.644340 32463 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:04.616634 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.581769 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.677210 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.679126 32324 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:04.590834 32397 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:04.688869 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 81774.1us
I20260709 12:19:04.722621 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:04.723536 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:04.723978 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.724854 32179 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:04.725299 32179 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.725644 32179 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:04.726166 32252 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.726243 32069 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:04.727389 32069 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:04.727722 32069 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:04.721431 32048 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.729918 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:04.730170 32069 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.731333 32069 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:04.583905 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2018) took 1407 ms. Trace:
I20260709 12:19:04.732640 28747 rpcz_store.cc:276] 0709 12:19:03.176532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.176663 (+   131us) service_pool.cc:224] Handling call
0709 12:19:03.195343 (+ 18680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:03.195837 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:19:03.242295 (+ 46458us) log.cc:844] Serialized 14 byte log entry
0709 12:19:03.454124 (+211829us) log.cc:844] Serialized 14 byte log entry
0709 12:19:03.459822 (+  5698us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:03.465220 (+  5398us) log.cc:844] Serialized 26 byte log entry
0709 12:19:03.466621 (+  1401us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:03.466692 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:03.466783 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:03.514966 (+ 48183us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b1800419260. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:03.519573 (+  4607us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b1800419260. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:04.338877 (+819304us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:04.583710 (+244833us) raft_consensus.cc:1685] finished
0709 12:19:04.583732 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.583848 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14786,"prepare.queue_time_us":46540,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":5240,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":3222,"spinlock_wait_cycles":22238848,"thread_start_us":194475,"threads_started":1,"wal-append.queue_time_us":466422}
I20260709 12:19:04.735041 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.735631 28747 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:04.690624 28598 rpcz_store.cc:276] 0709 12:19:03.656474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.656617 (+   143us) service_pool.cc:224] Handling call
0709 12:19:04.690034 (+1033417us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400121bd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:04.690166 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795069312}
I20260709 12:19:04.737107 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.739238 32331 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:04.691170 32355 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:04.692353 28601 pending_rounds.cc:107] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:19:04.741007 28601 raft_consensus.cc:2889] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:04.741247 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.740586 28504 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 4 to 7, term changed from 7 to 9, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:04.742302 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.742359 28504 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 7, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 7 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:04.743259 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.549364 32242 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.743948 28754 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:04.744335 32242 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.746579 32242 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:04.602041 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 114621us
I20260709 12:19:04.748850 32355 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:04.749259 31987 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:04.749626 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.749872 31987 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:04.750375 31987 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.751564 32451 consensus_queue.cc:1243] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:04.752084 32451 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:04.752527 32451 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.753201 32254 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:04.528208 32067 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:19:04.754580 32254 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:04.645104 32462 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:04.696647 29327 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:04.756794 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.690239 29322 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:04.719290 32344 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.757369 29327 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:04.757964 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.758376 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.758649 28748 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:04.759104 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.759586 28602 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:04.697225 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.760497 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.761089 28602 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:04.761212 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.702396 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.761971 28600 raft_consensus.cc:2368] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12.
I20260709 12:19:04.761880 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.762187 29319 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:04.762848 28602 raft_consensus.cc:2410] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:04.762936 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.706269 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.707754 28750 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:04.763605 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.763991 29325 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:04.698654 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.698050 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.716869 32439 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:04.765777 28753 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
W20260709 12:19:04.711057 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 149882us
I20260709 12:19:04.713131 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:04.628140 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.712352 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:04.717341 29326 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:04.719393 28599 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:04.719449 28607 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:04.716707 32147 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:04.768151 32340 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:04.743402 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.743960 28504 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:04.769402 28599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:04.771050 28599 raft_consensus.cc:606] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:04.753309 32362 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:04.754065 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.754642 32451 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:04.767231 28755 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.721405 32324 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.551891 32416 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:04.771368 28504 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:04.787448 28679 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:04.788569 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:04.733803 32179 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:04.801470 28747 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:19:04.810529 28648 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.582s (SENT)
W20260709 12:19:04.813457 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 236758us
I20260709 12:19:04.876019 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:04.876935 28682 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:04.926810 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:04.927145 32344 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:04.927556 29323 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:04.930788 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 133350us
I20260709 12:19:04.932862 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.933494 28751 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:04.931455 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:04.815492 32393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.006s	sys 0.019s
I20260709 12:19:04.761874 32254 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:04.952307 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:04.957188 28756 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:04.955541 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:04.967115 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:04.970070 28752 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:04.949070 28600 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:04.949270 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.971594 28603 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:04.948822 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.948822 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:04.973075 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:04.950790 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 183936us
I20260709 12:19:04.952234 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 738) took 1128 ms. Trace:
W20260709 12:19:04.930352 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 121489us
I20260709 12:19:04.792853 32416 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:04.957180 28680 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:04.957362 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.958509 28598 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
W20260709 12:19:04.974797 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 164302us
I20260709 12:19:04.975298 28673 rpcz_store.cc:276] 0709 12:19:03.823415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.823534 (+   119us) service_pool.cc:224] Handling call
0709 12:19:04.403711 (+580177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:04.412218 (+  8507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.952027 (+539809us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54000c7e50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:04.952164 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303573376}
W20260709 12:19:04.978400 28648 leader_election.cc:336] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.613s (SENT)
I20260709 12:19:04.978789 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:04.968894 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:19:04.980746 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46008.7us
I20260709 12:19:04.974412 28504 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:04.984220 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.984995 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.985743 28753 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:19:04.986872 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:04.988016 28607 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:04.801913 32242 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.166s
W20260709 12:19:04.956506 32393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.006s	sys 0.019s
I20260709 12:19:04.996917 32050 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.001080 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.959048 32439 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:05.002420 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:04.801203 32362 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.011399 32254 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.012001 32331 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:05.012596 32331 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.000494 32418 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:05.014084 32418 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.014425 32418 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:05.014500 32331 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.001856 32393 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:05.015910 32393 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.017316 32324 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:05.020745 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.022014 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.023200 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.023967 32377 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:05.024618 32441 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:05.024528 32439 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.025255 32340 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.025398 32470 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:05.025813 32340 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.005196 28753 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:04.995078 28755 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:04.974364 32454 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:04.978047 32416 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:04.992934 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:05.008577 32252 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:05.038569 28722 leader_election.cc:400] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12.
I20260709 12:19:05.010514 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:05.042107 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.042634 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:05.032541 31987 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:05.041441 28749 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
W20260709 12:19:05.034837 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.043751 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.048933 28676 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:05.049537 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.031267 32377 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:05.054419 32467 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:19:05.035058 32454 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.065549 32454 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.067451 28680 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:05.050613 32147 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:05.056941 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.040872 28722 leader_election.cc:403] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:19:05.050742 32245 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:05.077029 32245 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.057559 32230 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:05.077414 32245 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:05.078577 28753 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:05.079134 28682 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:05.080098 32439 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:05.080255 28753 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:05.089986 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.074090 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:05.090157 28753 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:05.091296 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.091514 32468 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12.
I20260709 12:19:05.092401 28504 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 7, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 7 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.094487 32196 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:05.095582 32179 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:05.096024 28756 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:05.009970 32050 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.074843 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.117362 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:05.072583 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.100492 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:05.113617 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 64197.9us
I20260709 12:19:05.114600 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:05.118886 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44858.2us
I20260709 12:19:05.116027 28749 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:05.119570 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:05.119997 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:05.120817 28679 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.115099 28676 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:19:05.122138 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 85508.6us
I20260709 12:19:05.122936 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.116037 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.124960 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:05.133601 29323 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:05.059609 32362 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:05.134441 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.136071 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:05.137297 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.153216 28504 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:05.160036 28504 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:05.163579 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.158480 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:05.166270 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:05.167171 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.169431 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.173198 28679 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:05.133347 32451 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.174019 32439 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:05.129895 32330 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:05.133261 32048 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:05.177687 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:05.178319 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.176961 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:05.172266 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.184937 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:05.190272 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.191797 28754 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:05.192361 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:05.193902 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:05.301368 28678 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:05.209275 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.216468 32067 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 12:19:05.302498 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 117661us
I20260709 12:19:05.201993 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.174722 32230 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:05.216845 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:05.179634 32467 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:05.176911 32196 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:05.179464 32324 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:05.307988 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:05.234531 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:05.187909 32330 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.197355 32048 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.174640 32466 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:05.304636 32441 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:05.269781 32439 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:19:05.273437 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:05.273604 32416 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.276017 32471 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:05.276377 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:05.312284 32355 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.004s
W20260709 12:19:05.281160 32469 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:05.179329 32346 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:19:05.216212 32252 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:05.235391 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:05.296911 28504 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 8, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 8 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:05.373060 32474 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:05.215756 32432 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:19:05.312417 32147 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:05.165380 32179 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:05.216642 32433 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:19:05.387192 32252 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:19:05.301602 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 129420us
W20260709 12:19:05.301602 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 107774us
I20260709 12:19:05.300194 32318 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:05.313997 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 112085us
I20260709 12:19:05.190811 32468 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:05.316797 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:05.318956 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:05.305573 32331 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:05.319368 28754 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:05.304939 32467 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.323369 28748 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:05.305774 32393 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:05.324326 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:05.327451 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:05.405341 28603 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:19:05.332535 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.334117 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.406839 28602 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:05.407994 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.408448 28598 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:19:05.409312 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:05.409569 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:05.337965 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 61694.3us
I20260709 12:19:05.278810 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:05.411130 28749 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.348119 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:05.411909 28607 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.348927 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.413471 28600 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:05.312067 32069 consensus_meta.cc:287] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.002s
I20260709 12:19:05.336789 32050 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.360801 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.414278 28601 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:05.362730 28673 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:05.363741 32416 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.419405 29323 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:05.313654 32048 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.309561 32462 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:05.425057 28605 raft_consensus.cc:2410] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:19:05.312295 32330 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.374611 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.201381 32451 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.373320 28504 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 8, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 8 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:05.394140 28682 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:05.375242 31987 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:05.374295 32441 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:05.398705 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:05.396636 28606 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7. Re-sending same reply.
I20260709 12:19:05.463260 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.464039 28606 raft_consensus.cc:2410] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:19:05.464062 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.464679 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.465142 28600 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:05.465466 28598 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
W20260709 12:19:05.462096 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 63473.7us
I20260709 12:19:05.469384 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:05.416348 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.418150 32252 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.393460 32179 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:05.427105 32454 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.429401 32437 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:05.431080 32340 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.404719 32471 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:19:05.485381 32437 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:05.486305 32437 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.487308 32437 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.419323 32331 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:05.434398 32353 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.488833 32353 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.441022 28750 raft_consensus.cc:2410] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:05.491153 28599 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:05.434906 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.492033 28601 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:05.458228 31987 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.393492 32245 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.493007 31987 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.494616 32245 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.472275 32393 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:19:05.497083 32252 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.435643 28603 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:19:05.498624 28603 pending_rounds.cc:85] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 7
I20260709 12:19:05.498904 28603 pending_rounds.cc:107] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:19:05.499155 28603 raft_consensus.cc:2889] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:05.500277 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.435684 28678 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:05.500780 32454 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.440304 32067 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:05.501751 32067 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:05.502708 32067 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.503998 32067 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.404870 32467 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.506039 32331 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.507916 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1908) took 1301 ms. Trace:
I20260709 12:19:05.510557 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.515064 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.447805 32346 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.448618 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 879) took 1019 ms. Trace:
I20260709 12:19:05.425645 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:05.455055 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.384840 32355 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.456697 28504 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:05.460211 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:05.470733 28602 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:05.493023 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:05.532863 28601 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:19:05.424413 32344 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:05.503448 32441 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.537928 32377 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:05.538220 32393 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:05.538393 32377 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:05.538806 32377 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.472491 32432 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:05.539939 32432 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:05.515162 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:05.516613 28605 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:05.540716 28606 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.541353 28605 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:05.542021 32355 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:05.518676 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.543567 28677 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:05.444686 28607 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:05.516135 29317 rpcz_store.cc:276] 0709 12:19:04.429317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.509198 (+ 79881us) service_pool.cc:224] Handling call
0709 12:19:05.448389 (+939191us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5400790254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:05.448545 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639312640}
W20260709 12:19:05.471360 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 266745us
I20260709 12:19:05.508395 28675 rpcz_store.cc:276] 0709 12:19:04.206228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.363720 (+157492us) service_pool.cc:224] Handling call
0709 12:19:04.371250 (+  7530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:04.804204 (+432954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.804246 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:04.913865 (+109619us) log.cc:844] Serialized 26 byte log entry
0709 12:19:05.296831 (+382966us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:05.296870 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.296947 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:05.507642 (+210695us) raft_consensus.cc:1685] finished
0709 12:19:05.507669 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:05.507843 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1129,"raft.queue_time_us":22454,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":32994,"thread_start_us":779613,"threads_started":2,"wal-append.queue_time_us":556367}
I20260709 12:19:05.531244 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:05.537429 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 111842us
I20260709 12:19:05.537088 32346 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.540340 32432 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:05.543690 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 83567.1us
I20260709 12:19:05.537010 32344 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.546820 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.550203 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.548086 32462 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:05.552672 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:05.552943 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:05.495898 32179 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:05.578722 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 111946us
I20260709 12:19:05.579965 28606 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:05.565184 32444 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:05.564258 32457 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:05.562950 32462 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:05.591560 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:05.594929 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:05.582520 32418 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.006s
I20260709 12:19:05.588011 32173 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.598125 32433 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:05.598603 32393 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:05.600200 32254 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:05.606236 28504 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 4 to 7, term changed from 8 to 11, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to <none>, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:05.620815 28504 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:05.622303 28504 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:05.618110 32433 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:05.624223 28504 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 7, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 7 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.624910 32173 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.625891 28504 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:05.627017 32173 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.607204 32467 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.596532 32471 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:19:05.596817 32462 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:05.611264 32377 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.618037 32353 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.632483 32377 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.571206 32340 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:05.612792 32252 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.604136 31987 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:05.613831 28752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.015s	sys 0.031s
I20260709 12:19:05.581480 32468 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.599434 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:05.619336 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 410124us
I20260709 12:19:05.625312 32433 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:05.612257 32344 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:05.637321 28752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.015s	sys 0.031s
I20260709 12:19:05.637910 32393 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:05.630290 32467 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:05.639475 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.663004 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.664279 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:05.640256 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:05.649729 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.666075 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:05.666862 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:05.669958 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.671787 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:05.639052 32451 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.672773 32196 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:05.660008 32468 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.644138 32254 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:05.686364 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:05.712260 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49346us
I20260709 12:19:05.662137 32439 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:05.713025 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:05.669831 32340 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:05.630184 32330 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.674466 32353 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:05.618575 32418 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.677124 32471 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.721267 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:05.721081 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 49389.8us
I20260709 12:19:05.750180 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.673738 32355 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:05.669750 32252 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:05.717298 32467 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:05.764422 28675 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:05.770807 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.783838 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:05.784039 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:05.785935 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:05.786774 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:05.794360 28748 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.720374 32318 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:05.794605 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:05.717589 32439 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.737664 32245 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:05.813612 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 100661us
I20260709 12:19:05.814327 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:05.748816 32340 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.746955 32050 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:05.676759 32434 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 12:19:05.818698 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.822404 28675 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:05.736989 32174 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:19:05.820310 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.719054 32324 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:05.763664 32355 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.825258 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:05.823980 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.789238 32346 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.794261 32482 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:05.809551 32147 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:05.815471 32439 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.829908 28675 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:05.757570 32475 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:19:05.831892 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:05.835368 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.843914 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:05.869719 28679 raft_consensus.cc:2368] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:19:05.870276 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.870849 28679 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:05.819589 32454 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:05.836656 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.837441 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:05.840749 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.823599 32340 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:05.847821 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:05.878618 28747 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.809597 32230 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:05.849239 28749 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:05.885355 32230 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.829583 32355 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:05.889950 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49296.1us
I20260709 12:19:05.829659 32245 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:05.891602 32245 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.893096 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:05.901170 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:05.904240 32457 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:05.867668 32482 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:05.876986 32454 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.904750 32457 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.911080 28720 leader_election.cc:400] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:19:05.915939 28720 leader_election.cc:403] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:05.900254 32483 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:05.915411 32457 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.918467 32444 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:19:05.834412 32484 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:19:05.793589 32393 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:05.901471 32362 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:05.924973 28747 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:05.917315 32454 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:05.910697 32489 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:05.972512 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:05.950433 31987 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.918864 32048 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.956791 32196 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:05.984553 32418 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:05.984869 32196 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:05.985308 32196 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:05.986095 32048 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:05.993203 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:05.994227 28747 raft_consensus.cc:2410] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:06.003739 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:06.004602 28749 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:06.005690 28756 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:05.963563 32483 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:06.010608 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.012449 29322 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:05.980861 32489 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:05.952215 32377 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:19:06.027067 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:05.915654 32254 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:05.980808 32173 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:06.024767 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:06.072638 28756 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:06.004901 32252 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:06.014827 32418 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:06.085775 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.052s
W20260709 12:19:06.087523 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.000s	sys 0.052s
I20260709 12:19:06.029595 32489 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:05.966534 32324 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:06.015543 32468 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:06.092654 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 330178us
I20260709 12:19:06.107574 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.108352 29323 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:06.108871 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.110481 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.112749 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.134093 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.134876 29326 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:06.087685 32173 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.139093 32173 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.100730 32418 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:06.086323 32252 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:06.161490 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 347205us
W20260709 12:19:06.153900 32478 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:19:06.171929 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2352) took 1464 ms. Trace:
I20260709 12:19:06.172333 28752 rpcz_store.cc:276] 0709 12:19:04.707434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.982639 (+275205us) service_pool.cc:224] Handling call
0709 12:19:05.002502 (+ 19863us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:05.051473 (+ 48971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.051517 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:05.052236 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 12:19:05.644260 (+592024us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:19:05.644299 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.676204 (+ 31905us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b540003f554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:05.676269 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:06.171617 (+495348us) raft_consensus.cc:1685] finished
0709 12:19:06.171637 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.171867 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1100,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2763,"spinlock_wait_cycles":86216192,"thread_start_us":572928,"threads_started":1,"wal-append.queue_time_us":744144}
I20260709 12:19:06.164278 28748 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
W20260709 12:19:06.176311 32485 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 12:19:06.177497 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 624548us
I20260709 12:19:06.178671 32497 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:06.179549 32497 consensus_queue.cc:1243] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:19:06.152693 32067 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.001s
I20260709 12:19:06.180485 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:06.180680 29320 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:19:06.181108 29320 pending_rounds.cc:85] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 9
I20260709 12:19:06.181239 32497 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:06.181336 29320 pending_rounds.cc:107] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:19:06.184630 29320 raft_consensus.cc:2889] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:06.150382 32437 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.001s
I20260709 12:19:06.190901 28603 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:06.191571 32497 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:06.194584 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:06.195858 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:06.164224 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 191816us
W20260709 12:19:06.164535 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71682us
I20260709 12:19:06.198443 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:06.202639 29326 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:06.204337 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.141207 32330 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.211835 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:06.212287 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 187707us
I20260709 12:19:06.213778 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:06.209102 32497 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:06.218075 32517 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:06.218508 32517 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:06.218828 32517 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:06.220547 32495 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:19:06.222186 32494 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:06.131163 32483 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.086109 32482 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:06.205317 32481 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:19:06.235623 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.235945 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:06.207861 32433 consensus_meta.cc:287] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.002s
I20260709 12:19:06.238309 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:06.239048 28681 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:06.239058 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:06.212149 32432 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.002s
I20260709 12:19:06.207861 32496 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:06.239156 29327 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:06.242149 29318 raft_consensus.cc:2368] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9.
I20260709 12:19:06.242276 29326 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:06.210629 32377 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:06.216490 32067 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:06.246749 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.216869 32173 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:06.240989 32434 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:19:06.256057 32491 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:19:06.260080 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:06.268662 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 149676us
I20260709 12:19:06.248080 32377 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:06.216607 32505 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:19:06.208364 32196 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.273721 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.258281 32434 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:06.280270 28681 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:06.282912 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.244151 32457 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.243602 32433 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.286408 32433 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:06.288533 29321 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:06.273728 32377 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:06.248303 32432 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.303570 32252 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.258064 32418 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:06.307715 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.316867 29317 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:06.321254 32340 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.323953 32340 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.326823 29317 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:06.324679 32434 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:06.328012 32462 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 12:19:06.310161 32067 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:06.342989 32434 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:06.343827 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.325673 32147 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:06.346645 29320 raft_consensus.cc:2410] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:06.351600 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.354120 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 653) took 1603 ms. Trace:
I20260709 12:19:06.357199 28748 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:06.357299 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:06.357236 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:06.358820 28752 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:06.354506 28755 rpcz_store.cc:276] 0709 12:19:04.750425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.029835 (+279410us) service_pool.cc:224] Handling call
0709 12:19:05.030279 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:05.147926 (+117647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.147975 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:05.177739 (+ 29764us) log.cc:844] Serialized 52 byte log entry
0709 12:19:05.685861 (+508122us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:05.788809 (+102948us) log.cc:844] Serialized 14 byte log entry
0709 12:19:05.789024 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.789097 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:06.353918 (+564821us) raft_consensus.cc:1685] finished
0709 12:19:06.353938 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.354065 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40415,"prepare.queue_time_us":106664,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":16255,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":10351,"spinlock_wait_cycles":38537984,"thread_start_us":423885,"threads_started":1,"wal-append.queue_time_us":628172}
I20260709 12:19:06.360471 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:06.350777 32496 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.362267 32496 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:06.365474 32467 consensus_meta.cc:287] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.000s
I20260709 12:19:06.365926 32467 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:06.368008 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.369114 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.369621 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.370075 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.370826 29326 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:06.371029 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.371507 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.371707 29321 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:06.372807 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.373003 29319 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:06.373512 29325 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:06.373894 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.374236 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.374455 29319 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 6.
I20260709 12:19:06.375710 32489 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.376024 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.376236 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:06.380671 32466 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:06.380728 32416 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:06.381239 32466 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:06.381786 32432 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:06.382004 32416 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:06.382484 32416 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:06.382130 32466 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:06.383143 32471 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 12:19:06.383562 32471 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:06.398712 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.442109 29323 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:06.477142 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:06.477991 28755 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:06.479689 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:06.481316 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:06.482838 28753 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:06.510480 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:06.413988 32512 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:19:06.386653 32069 raft_consensus.cc:993] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:19:06.529280 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2008) took 1074 ms. Trace:
I20260709 12:19:06.529346 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2007) took 1074 ms. Trace:
I20260709 12:19:06.529892 29320 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:19:06.513911 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:06.529729 28598 rpcz_store.cc:276] 0709 12:19:05.454651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.550246 (+ 95595us) service_pool.cc:224] Handling call
0709 12:19:05.574859 (+ 24613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.579021 (+  4162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.579063 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:05.579645 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:19:06.023428 (+443783us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:06.085140 (+ 61712us) log.cc:844] Serialized 14 byte log entry
0709 12:19:06.528969 (+443829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.529044 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:06.529092 (+    48us) raft_consensus.cc:1685] finished
0709 12:19:06.529105 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.529226 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":446667,"prepare.queue_time_us":107630,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":3567,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6898,"thread_start_us":419622,"threads_started":1,"wal-append.queue_time_us":563590}
W20260709 12:19:06.524641 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.526382 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:06.527796 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.521507 28681 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:06.532940 28682 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:06.385390 32050 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:06.529948 28607 rpcz_store.cc:276] 0709 12:19:05.454429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.544554 (+ 90125us) service_pool.cc:224] Handling call
0709 12:19:05.564298 (+ 19744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:05.564567 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:05.581030 (+ 16463us) log.cc:844] Serialized 14 byte log entry
0709 12:19:06.528870 (+947840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:06.528954 (+    84us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:06.529026 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.529120 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.529273 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":495762,"prepare.queue_time_us":16299,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":451641,"threads_started":1,"wal-append.queue_time_us":587472}
I20260709 12:19:06.400933 32489 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:06.543946 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.348196 32462 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.610183 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.527033 32362 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:06.353474 32439 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.399168 32355 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.387940 32496 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:06.622624 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2004) took 1169 ms. Trace:
I20260709 12:19:06.550937 32511 raft_consensus.cc:1081] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:19:06.539063 32050 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:06.536235 32432 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:06.623027 28605 rpcz_store.cc:276] 0709 12:19:05.453659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.542087 (+ 88428us) service_pool.cc:224] Handling call
0709 12:19:05.542353 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.556312 (+ 13959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.556356 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:05.565236 (+  8880us) log.cc:844] Serialized 26 byte log entry
0709 12:19:06.027987 (+462751us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:06.212597 (+184610us) log.cc:844] Serialized 14 byte log entry
0709 12:19:06.622310 (+409713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.622389 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:06.622439 (+    50us) raft_consensus.cc:1685] finished
0709 12:19:06.622451 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.622568 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":456982,"prepare.queue_time_us":144817,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":6334,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9570,"thread_start_us":547116,"threads_started":2,"wal-append.queue_time_us":604611}
I20260709 12:19:06.612959 32482 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:19:06.625176 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 525949us
I20260709 12:19:06.632091 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.624156 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2335) took 1274 ms. Trace:
I20260709 12:19:06.626890 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.629783 28682 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:06.539271 32471 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 12:19:06.630450 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 360897us
I20260709 12:19:06.383658 32416 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:06.623651 32454 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.001s
I20260709 12:19:06.617444 32507 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.543924 32505 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:19:06.643362 28676 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:06.639503 32432 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:06.632714 28600 rpcz_store.cc:276] 0709 12:19:05.350259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.537515 (+187256us) service_pool.cc:224] Handling call
0709 12:19:05.537844 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.545073 (+  7229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.545102 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:05.564599 (+ 19497us) log.cc:844] Serialized 26 byte log entry
0709 12:19:06.067168 (+502569us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:06.250253 (+183085us) log.cc:844] Serialized 14 byte log entry
0709 12:19:06.623878 (+373625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.623950 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:06.623988 (+    38us) raft_consensus.cc:1685] finished
0709 12:19:06.623999 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.624104 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415426,"prepare.queue_time_us":105807,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":381359,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":24841,"thread_start_us":581716,"threads_started":2,"wal-append.queue_time_us":564031}
I20260709 12:19:06.645998 29327 raft_consensus.cc:2368] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9.
I20260709 12:19:06.654376 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.620201 32362 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.655092 29326 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:06.655265 29323 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:06.613817 32393 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:19:06.663767 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.604586 32527 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:19:06.618242 32377 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:06.666687 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:06.644718 32457 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:06.680644 32526 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:19:06.683776 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 56984.9us
W20260709 12:19:06.674742 32529 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 12:19:06.620090 32067 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.684998 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.677449 32437 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:06.696139 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.697305 32174 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:06.697731 32488 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:06.698155 32488 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:06.698948 32488 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.665784 32517 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.679250 32050 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:06.656270 32507 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.650537 32454 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:06.867077 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:06.707412 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2043) took 1433 ms. Trace:
I20260709 12:19:06.870656 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:06.871029 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:06.701848 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 591) took 1383 ms. Trace:
I20260709 12:19:06.865221 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.713444 32362 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.878185 28606 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:06.880157 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.880779 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:06.881040 28572 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.618s (SENT)
I20260709 12:19:06.881464 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:06.881789 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:06.877837 28604 rpcz_store.cc:276] 0709 12:19:05.318871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.324020 (+  5149us) service_pool.cc:224] Handling call
0709 12:19:06.701656 (+1377636us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400233554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:06.701790 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604190592}
I20260709 12:19:06.882625 28606 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:19:06.703316 32525 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:19:06.883538 28604 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:06.702764 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 914) took 1150 ms. Trace:
I20260709 12:19:06.887254 28604 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:06.887392 29317 rpcz_store.cc:276] 0709 12:19:05.552176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.552360 (+   184us) service_pool.cc:224] Handling call
0709 12:19:06.702601 (+1150241us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400587fd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:06.702708 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755684736}
I20260709 12:19:06.877982 28751 rpcz_store.cc:276] 0709 12:19:05.274100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.274474 (+   374us) service_pool.cc:224] Handling call
0709 12:19:05.274747 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:05.420177 (+145430us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:05.813144 (+392967us) log.cc:844] Serialized 14 byte log entry
0709 12:19:06.193572 (+380428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:06.193639 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:06.193712 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.707180 (+513468us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000e7c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:06.707226 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.707353 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36305,"prepare.queue_time_us":86926,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":33134,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6557,"spinlock_wait_cycles":333935360,"thread_start_us":721090,"threads_started":2,"wal-append.queue_time_us":302881}
W20260709 12:19:06.891575 29292 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.072s (SENT)
I20260709 12:19:06.891966 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:06.892959 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:06.893039 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:06.701520 32534 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:19:06.893848 28599 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:06.840857 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 214762us
W20260709 12:19:06.729552 32523 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 12:19:06.890105 32433 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:06.708637 32521 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:06.889254 32467 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.899657 32340 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:06.900930 28572 leader_election.cc:336] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.838s (SENT)
I20260709 12:19:06.901523 32536 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:06.902086 32454 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.693070 32432 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
I20260709 12:19:06.696636 32511 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.903496 32507 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:06.702138 32524 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:19:06.904107 32488 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:06.909530 28680 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:19:06.911402 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:06.920722 32344 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:06.922653 32517 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.699316 32439 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:06.923882 32377 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:06.924346 32460 raft_consensus.cc:2764] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:06.736279 32434 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.714732 32471 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:06.729893 32346 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:07.071369 32537 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:07.071619 32346 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:07.072000 32537 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.072691 32346 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.074120 32346 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:07.074299 32537 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:06.925592 32050 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:06.920231 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.076856 28598 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:06.934177 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.078898 29317 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:07.083015 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.709614 32355 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.944583 28602 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
W20260709 12:19:06.945832 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 280408us
W20260709 12:19:06.950187 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.086057 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:07.086478 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.945226 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:07.087240 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 142056us
I20260709 12:19:06.877482 32462 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:06.941090 32147 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:07.048687 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 147767us
I20260709 12:19:07.050034 28603 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.057437 28599 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:07.070827 32434 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:07.090279 28572 leader_election.cc:336] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.843s (SENT)
I20260709 12:19:07.089974 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:06.956913 32467 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.099138 28598 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:07.104974 32462 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:07.106376 32518 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.740s	user 0.002s	sys 0.000s
I20260709 12:19:07.107596 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 756) took 1122 ms. Trace:
I20260709 12:19:07.108217 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 757) took 1122 ms. Trace:
I20260709 12:19:07.108637 28680 rpcz_store.cc:276] 0709 12:19:05.986003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.986122 (+   119us) service_pool.cc:224] Handling call
0709 12:19:05.986438 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.061065 (+1074627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.107937 (+ 46872us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b540018fe54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:07.108134 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122155264}
I20260709 12:19:07.114001 32467 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.099720 32507 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:07.101118 32147 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.116128 32541 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:07.117506 32434 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.118106 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:07.150522 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:07.151132 28749 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.119071 32254 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.151723 32254 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.119514 32451 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.121430 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.068715 32344 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.152755 32451 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.153976 32254 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:07.154352 32344 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:07.154810 32451 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:07.155282 32349 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:07.155699 32349 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.155993 32174 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.121567 32517 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:07.121970 32377 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:07.122072 32538 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.157473 32444 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.157042 32517 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.157989 32444 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.159924 32517 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:07.157265 32538 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.107992 28675 rpcz_store.cc:276] 0709 12:19:05.985606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.988641 (+  3035us) service_pool.cc:224] Handling call
0709 12:19:05.988996 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.996857 (+  7861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.996901 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:06.012021 (+ 15120us) log.cc:844] Serialized 26 byte log entry
0709 12:19:06.235933 (+223912us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:06.235974 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.236038 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:07.105788 (+869750us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:07.107280 (+  1492us) raft_consensus.cc:1685] finished
0709 12:19:07.107302 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.107530 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12612,"raft.queue_time_us":88362,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":15431,"spinlock_wait_cycles":312573824,"thread_start_us":146076,"threads_started":1,"wal-append.queue_time_us":266163}
I20260709 12:19:07.137130 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.163401 28747 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:07.137373 28753 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:07.138603 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.140022 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.156404 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.166237 28756 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:07.141027 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:07.167297 28754 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:07.141122 28752 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:19:07.150980 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.152208 32147 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.121132 32340 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:07.156041 32349 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.125078 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:07.156598 32475 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:07.160028 32444 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:07.105775 32462 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.165069 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:07.167513 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.127190 28603 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:07.173794 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:07.195847 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.174701 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.063477 32511 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.193818 28748 raft_consensus.cc:2368] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:07.196496 28756 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:07.199411 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.203712 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:07.149205 32507 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:07.161489 32468 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:07.213714 32468 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:07.206126 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.215420 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:07.215159 32507 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.216018 28756 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.216773 28753 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:07.219413 28501 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 333) took 24230 ms (client timeout 15000 ms). Trace:
I20260709 12:19:07.206248 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.195370 32179 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.201923 32242 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:07.193512 32254 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:19:07.157109 32377 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:06.735236 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.223176 32377 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:07.205425 32230 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:07.223794 32230 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.157485 32196 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:07.225489 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.225878 32230 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:07.226346 28675 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:07.211334 32511 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:07.211544 32416 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.227418 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:07.232779 28675 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14.
I20260709 12:19:07.231498 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:07.228319 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.196786 32432 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:19:07.269724 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 70408.6us
I20260709 12:19:07.269788 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:07.245718 28754 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:07.258849 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.262765 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.281388 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.232908 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:07.282492 28752 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:07.282500 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.272365 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.235481 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:07.287065 28604 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:19:07.193248 32174 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:19:07.231922 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.285622 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.308871 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 755) took 1351 ms. Trace:
W20260709 12:19:07.313998 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.314189 28676 rpcz_store.cc:276] 0709 12:19:05.957368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.964630 (+  7262us) service_pool.cc:224] Handling call
0709 12:19:05.964941 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:06.656235 (+691294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.308636 (+652401us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54001bd854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:07.308809 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559706368}
I20260709 12:19:07.285302 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.316128 28599 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:07.287482 28606 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:07.285917 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.317436 28605 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:07.318241 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.291858 29320 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:07.232779 28678 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:07.320293 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:07.286322 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 50916.4us
I20260709 12:19:07.313807 28602 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.282666 28682 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:07.312141 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.323362 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.323797 28754 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:07.324240 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.324666 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.325007 29323 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:07.325544 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.325943 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.326176 28754 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:19:07.326498 28754 pending_rounds.cc:85] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 4
I20260709 12:19:07.326756 28754 pending_rounds.cc:107] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:19:07.326985 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.327286 28754 raft_consensus.cc:2889] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:07.264508 32179 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:07.328728 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.330351 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.330987 28602 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:07.319473 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.331264 29322 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.330298 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.332892 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.333531 29321 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:07.329222 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.334005 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.334544 28599 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.334996 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.334151 28604 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:19:07.336282 29317 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:07.332959 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:07.332410 28606 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14.
I20260709 12:19:07.337630 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.257956 32490 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:07.230808 28753 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:07.340886 28754 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:19:07.312674 32318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.013s	sys 0.007s
I20260709 12:19:07.348415 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.290757 32511 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.252720 32230 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:07.281735 32538 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.338856 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.339161 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.316872 32174 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:07.343631 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.343152 28604 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:07.344563 28599 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:07.347611 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.348238 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:07.348628 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.339178 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.372381 29319 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:07.373746 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.374064 28751 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:19:07.374893 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.345530 28756 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
W20260709 12:19:07.348780 32318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.013s	sys 0.007s
I20260709 12:19:07.350203 28749 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:07.233522 32488 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:07.231681 32505 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:19:07.313743 32261 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:07.331947 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.388751 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.352257 29327 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:07.389523 28682 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:07.339340 32418 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:07.358877 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.405617 28605 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:07.406189 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:07.404983 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:07.406487 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.406868 28679 raft_consensus.cc:2368] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:07.407028 28605 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.362587 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.375861 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:07.351982 32467 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:07.376292 28756 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:07.376788 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.369498 29326 raft_consensus.cc:2410] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:19:07.377774 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.378810 29320 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:07.364537 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.381108 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.422955 28604 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:07.381948 28752 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:07.382598 28749 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:07.424504 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.425271 29320 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:07.427126 28749 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:07.284332 32462 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:07.381659 32050 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:07.382985 28606 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:19:07.347487 32355 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.347723 32489 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.385572 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.375895 32174 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:07.388803 32261 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.357975 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.392756 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.395347 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.473299 28598 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.473806 29323 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14.
W20260709 12:19:07.473729 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 81058.1us
I20260709 12:19:07.388506 32488 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.397507 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.429440 32432 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.369467 32230 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.400782 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.401180 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:07.349510 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.418745 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:07.219794 28501 rpcz_store.cc:269] 0709 12:18:42.988713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.033815 (+ 45102us) service_pool.cc:224] Handling call
0709 12:19:07.219191 (+24185376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:59.693054 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:59.720138 (+ 27084us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:59.720190 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:18:59.720208 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:59.721233 (+  1025us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:59.721287 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:59.721323 (+    36us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:18:59.722269 (+   946us) tablet.cc:701] Row locks acquired
0709 12:18:59.722283 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:18:59.722434 (+   151us) write_op.cc:270] Start()
0709 12:18:59.722545 (+   111us) write_op.cc:276] Timestamp: P: 1783599539722384 usec, L: 0
0709 12:18:59.722559 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:18:59.723233 (+   674us) log.cc:844] Serialized 4416 byte log entry
0709 12:19:00.072076 (+348843us) op_driver.cc:464] REPLICATION: finished
0709 12:19:01.480880 (+1408804us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe74b5ef0
0709 12:19:01.516871 (+ 35991us) write_op.cc:301] APPLY: starting
0709 12:19:01.518601 (+  1730us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:01.521414 (+  2813us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:01.521446 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:01.522798 (+  1352us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:01.523063 (+   265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:19:01.523109 (+    46us) write_op.cc:312] APPLY: finished
0709 12:19:01.523384 (+   275us) log.cc:844] Serialized 83 byte log entry
0709 12:19:01.984187 (+460803us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:02.077946 (+ 93759us) write_op.cc:454] Released schema lock
0709 12:19:02.164416 (+ 86470us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:02.165044 (+   628us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:02.165077 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":74471,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1440500,"apply.run_cpu_time_us":21126,"apply.run_wall_time_us":652077,"num_ops":11,"prepare.queue_time_us":158870,"prepare.run_cpu_time_us":74856,"prepare.run_wall_time_us":148703,"raft.queue_time_us":112898,"raft.run_cpu_time_us":48205,"raft.run_wall_time_us":1436516,"replication_time_us":349354,"spinlock_wait_cycles":9931136,"thread_start_us":2094247,"threads_started":5,"wal-append.queue_time_us":508393,"wal-append.run_cpu_time_us":29180,"wal-append.run_wall_time_us":2169433}]]}
W20260709 12:19:07.481460 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 62796.2us
I20260709 12:19:07.468037 32242 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:07.444588 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 102769us
W20260709 12:19:07.461280 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 57440.9us
I20260709 12:19:07.483273 28571 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:07.338810 32454 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:19:07.381526 32538 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:07.462086 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 84374.4us
I20260709 12:19:07.462631 28675 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:07.462419 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.463212 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.463589 28677 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:07.340930 32490 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:07.471728 28605 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:07.476337 28678 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:07.398223 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.497404 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.433558 32467 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:07.419462 29322 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:07.483608 28721 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.490170 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:07.428280 32418 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.494910 28598 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:07.476555 32261 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.536473 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.427474 32439 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:07.537536 28680 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:19:07.471138 32355 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.538434 32346 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.492333 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.488420 32509 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:07.543535 28677 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:07.545141 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.561591 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:07.550330 32549 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:19:07.537499 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:07.553589 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71499.7us
I20260709 12:19:07.572039 28605 raft_consensus.cc:2368] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:07.555300 28604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
W20260709 12:19:07.547544 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63980.5us
I20260709 12:19:07.575928 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.473090 32489 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.478466 32344 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:07.581194 28673 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 6.
I20260709 12:19:07.482772 32432 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.584012 32432 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.561733 28599 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:07.490890 28676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34892
I20260709 12:19:07.588828 28676 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:07.589334 28676 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.590360 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2330) took 2254 ms. Trace:
I20260709 12:19:07.580168 32489 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.594810 32441 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:07.596671 32462 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:07.597492 32471 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:07.595736 32441 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:07.598016 32471 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:07.598685 32441 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:07.599197 32471 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.599862 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.608819 32344 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:07.609613 32344 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.613138 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.603049 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:07.617003 28756 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:07.617631 32377 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.620929 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:07.612280 32344 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:07.626051 32377 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:07.626546 32377 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.626978 32377 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.630641 32468 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.632028 32468 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:07.590858 28601 rpcz_store.cc:276] 0709 12:19:05.335836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.533766 (+197930us) service_pool.cc:224] Handling call
0709 12:19:05.565782 (+ 32016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.578454 (+ 12672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.578496 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:05.590313 (+ 11817us) log.cc:844] Serialized 26 byte log entry
0709 12:19:05.952087 (+361774us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:05.962000 (+  9913us) log.cc:844] Serialized 14 byte log entry
0709 12:19:06.520491 (+558491us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b1800493240. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a89716 00007f6fe3a9a287 00007f6fe3a9a208
0709 12:19:06.520810 (+   319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.589963 (+1069153us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b54003db3d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:07.590030 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:07.590092 (+    62us) raft_consensus.cc:1685] finished
0709 12:19:07.590110 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.590288 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93677,"prepare.queue_time_us":9928,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":8764,"raft.queue_time_us":569351,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":7019,"spinlock_wait_cycles":30033920,"thread_start_us":353603,"threads_started":1,"wal-append.queue_time_us":533125,"wal-append.run_cpu_time_us":2075,"wal-append.run_wall_time_us":1033450}
I20260709 12:19:07.638808 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.639739 32254 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:07.640103 32254 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.640461 32254 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.641839 32517 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:07.643766 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:07.599210 32441 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:07.645494 32441 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.646865 32441 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.648013 32254 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.649137 32471 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:07.539247 32467 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:07.540500 32490 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.671080 32349 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.673190 32349 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:07.675518 28607 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:07.540686 32050 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:07.660332 28721 leader_election.cc:400] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14.
I20260709 12:19:07.679034 28721 leader_election.cc:403] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 12:19:07.679574 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:07.668541 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.661422 28679 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:07.671419 32560 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.673602 32254 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:07.490716 31987 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.167s
I20260709 12:19:07.675935 28604 raft_consensus.cc:606] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.658471 28674 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:07.658946 28599 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:07.694039 28604 raft_consensus.cc:614] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:07.694883 28603 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:19:07.661345 28676 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:07.677141 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.697180 28677 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:07.698652 28677 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:19:07.678040 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 188454us
I20260709 12:19:07.683907 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.686857 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.677217 28678 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:07.674360 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.660158 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:07.692219 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.557216 32497 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:07.702493 28722 leader_election.cc:400] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14.
I20260709 12:19:07.703758 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:07.706154 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:07.751336 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45255.2us
I20260709 12:19:07.752269 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:07.677500 32557 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.760641 32557 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.685751 32462 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14.
I20260709 12:19:07.740533 32437 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:19:07.769934 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.732077 32444 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:07.676800 32344 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:07.741763 28598 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:07.694576 32050 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:07.788220 28676 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.791025 28604 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:07.747217 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.793103 28603 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:07.758919 28601 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:19:07.739569 28599 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:07.772763 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.773660 28607 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:07.740742 32561 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:07.742724 32497 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:07.783404 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 79364.4us
I20260709 12:19:07.821157 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.822463 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.823608 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.799772 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:07.809194 28753 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:07.809988 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:07.776338 32444 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.775349 32324 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.740404 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:07.787335 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 83644.4us
I20260709 12:19:07.829150 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:07.742502 32475 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:19:07.797474 32462 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:07.797320 32558 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:07.839362 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 99039.8us
W20260709 12:19:07.833689 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 343555us
I20260709 12:19:07.845618 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:07.851948 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.853082 28676 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:07.854280 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:07.817159 32340 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:07.866641 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:07.856698 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:07.816147 32344 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:07.869292 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:07.869900 28607 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.872730 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:07.833227 32538 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:07.838989 32444 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:07.797103 32560 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:19:07.817787 32541 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:19:07.844957 32554 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.887212 28607 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:07.860823 32346 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.861887 32340 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.820178 32561 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.849503 32048 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:07.882814 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:07.879987 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:07.874104 32564 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:07.888984 32050 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:07.895313 32562 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:19:07.834054 32349 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:19:07.881377 32497 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.892233 32558 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:07.869344 32462 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:07.925484 32462 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.878744 32254 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.906738 28648 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:07.893002 32451 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:07.889559 31987 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.889312 32538 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:07.897114 32488 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:07.901484 32340 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:07.897012 32567 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:07.902912 32048 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.903707 32557 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:07.910300 32454 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:07.911549 32418 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.913280 32355 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:07.933647 28648 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:07.896651 32566 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:19:07.929842 32437 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:19:07.996289 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 120346us
W20260709 12:19:07.949327 32483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.587s	user 0.012s	sys 0.011s
W20260709 12:19:07.992130 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 192956us
W20260709 12:19:07.949824 32466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.009s	sys 0.020s
W20260709 12:19:07.994434 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 61319.9us
I20260709 12:19:07.929993 32434 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:07.987003 32048 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:08.014945 28750 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:07.988088 32362 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:07.985304 32567 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:07.997107 32416 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.002s
I20260709 12:19:08.021273 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:19:08.016029 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 159435us
W20260709 12:19:08.008028 32466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.017s	sys 0.023s
W20260709 12:19:08.001828 32483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.639s	user 0.013s	sys 0.012s
I20260709 12:19:07.918438 32344 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:07.998750 32437 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:08.035133 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:08.009613 32488 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:08.015242 32557 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.007941 32179 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:19:08.018908 32454 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:08.070345 32466 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 12:19:08.079721 32570 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:19:08.063477 32416 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:19:08.081542 32349 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:08.082291 32147 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:08.082690 32147 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:08.083462 32147 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.084679 32567 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.086076 32567 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:08.088290 32538 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.053920 32318 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:08.088501 32557 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:08.094291 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 76362.9us
I20260709 12:19:08.101867 28601 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:08.104524 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.107327 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.108160 28601 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:19:08.111308 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:08.112069 28601 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:08.112560 28601 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:08.115809 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.116672 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.119530 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.122294 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.080184 32554 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.954489 32564 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:08.125979 32580 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:08.126183 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:08.137645 28605 raft_consensus.cc:2376] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9. Re-sending same reply.
I20260709 12:19:08.131250 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.113716 28601 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.075204 32488 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:08.152326 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 285763us
I20260709 12:19:08.155483 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:08.147987 32147 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:08.172969 28605 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:19:08.153951 32471 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.001s
I20260709 12:19:08.016412 32558 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.147465 32468 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:08.150388 32580 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:08.124277 32466 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:19:08.170693 32318 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:08.181898 32569 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 12:19:08.174868 32561 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:08.191963 32560 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:19:08.141781 32554 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.194090 32468 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.146749 32437 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:08.195698 32261 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.004s
W20260709 12:19:08.256191 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 425337us
I20260709 12:19:08.259559 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:08.252602 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 649590us
I20260709 12:19:08.301224 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:08.226023 32589 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.242862 32433 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:08.258533 32196 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:19:08.246328 32377 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.003s
I20260709 12:19:08.306921 29290 leader_election.cc:400] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:08.322188 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:08.227152 32576 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:19:08.228785 32573 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 12:19:08.242558 32565 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
W20260709 12:19:08.324851 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 146403us
I20260709 12:19:08.240217 32567 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.252957 32067 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:08.303560 32242 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.800s	user 0.008s	sys 0.003s
W20260709 12:19:08.245585 32490 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
W20260709 12:19:08.325693 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.322619 29290 leader_election.cc:403] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:08.327921 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:08.340369 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:08.232956 32581 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:08.242216 32418 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:08.315785 32509 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:08.206359 32416 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 12:19:08.315941 32196 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:08.353014 32242 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:08.340509 32432 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:08.349804 28679 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:08.233340 32517 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
W20260709 12:19:08.374428 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 217735us
I20260709 12:19:08.325644 32475 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.363330 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:08.200472 32588 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 12:19:08.363788 32564 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:08.206053 32488 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.342555 32437 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:08.383698 32471 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:08.399786 32607 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:08.315234 32261 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.384668 28720 leader_election.cc:400] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14.
I20260709 12:19:08.413749 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:08.373164 32441 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.726s	user 0.012s	sys 0.000s
I20260709 12:19:08.200672 32454 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.365142 32324 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:08.364256 32557 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:08.361976 32439 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:08.389736 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:08.392747 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 68202.2us
I20260709 12:19:08.426549 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:08.322474 32433 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.327323 32377 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.364600 32509 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:08.353264 32567 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:08.410005 28572 leader_election.cc:336] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.532s (SENT)
I20260709 12:19:08.432013 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:08.376814 32418 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:08.433342 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43675.8us
I20260709 12:19:08.233683 32580 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.313788 32537 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:19:08.234185 32318 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.444617 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2057) took 1243 ms. Trace:
I20260709 12:19:08.414920 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 608) took 1104 ms. Trace:
I20260709 12:19:08.415957 28679 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:08.416251 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:08.412199 32554 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:08.400887 32444 consensus_meta.cc:287] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 12:19:08.449402 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:08.364549 32340 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.321807 32589 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.394285 32560 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.361213 32490 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.428170 28682 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:08.480376 29292 leader_election.cc:400] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:08.493436 28604 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:19:08.437790 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.398988 32581 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:19:08.446314 28602 rpcz_store.cc:276] 0709 12:19:07.310533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.674830 (+364297us) service_pool.cc:224] Handling call
0709 12:19:07.675157 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.675495 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.675520 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:07.685603 (+ 10083us) log.cc:844] Serialized 26 byte log entry
0709 12:19:07.928859 (+243256us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:07.928896 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.928974 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.414717 (+485743us) raft_consensus.cc:1685] finished
0709 12:19:08.414737 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.414852 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33869,"raft.queue_time_us":12282,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5123,"thread_start_us":195310,"threads_started":1,"wal-append.queue_time_us":304370}
I20260709 12:19:08.427634 32471 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:08.444998 28749 rpcz_store.cc:276] 0709 12:19:07.201094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.427844 (+226750us) service_pool.cc:224] Handling call
0709 12:19:07.428184 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.430222 (+  2038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.430266 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:07.464927 (+ 34661us) log.cc:844] Serialized 26 byte log entry
0709 12:19:07.848453 (+383526us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:07.890203 (+ 41750us) log.cc:844] Serialized 14 byte log entry
0709 12:19:07.890453 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.890548 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.444398 (+553850us) raft_consensus.cc:1685] finished
0709 12:19:08.444417 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.444559 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48403,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":41466,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":7076,"thread_start_us":360496,"threads_started":1,"wal-append.queue_time_us":438272}
I20260709 12:19:08.425391 32331 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:08.441008 32242 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:08.454101 32444 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.429668 32439 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.460664 32433 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.443024 32595 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:08.540584 32595 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.540982 32595 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:08.393266 32475 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.544502 32561 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.545178 32561 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.546195 32475 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.430992 32509 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:08.547844 32561 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.464372 32537 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:08.548616 32537 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:08.549494 32537 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.550642 32537 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:08.554562 32505 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:08.558358 32482 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:08.559072 32482 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.561594 32536 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:08.562036 32536 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:08.562822 32536 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.564076 32536 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:08.428576 32324 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:08.472270 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:08.470891 32174 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.992s	user 0.011s	sys 0.001s
I20260709 12:19:08.479915 32517 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:08.422304 32196 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.597036 32196 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:08.601843 32601 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:19:08.602491 32439 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:08.605296 32602 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
I20260709 12:19:08.533329 28681 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:08.534399 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.468235 32261 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.465660 32377 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:08.567739 32444 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:08.535053 32331 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.535140 32471 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:08.575790 32584 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.416s	user 0.003s	sys 0.000s
I20260709 12:19:08.578586 32567 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.470047 32418 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:08.586392 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 114225us
I20260709 12:19:08.619566 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:08.501062 32468 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:08.481603 32607 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.501402 32600 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
W20260709 12:19:08.537921 32048 consensus_meta.cc:287] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.505s	user 0.003s	sys 0.007s
I20260709 12:19:08.466159 32606 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.494504 32432 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:08.489568 32067 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:08.612684 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.644868 28602 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:08.645787 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.647184 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.647311 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:08.625360 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:08.479835 32588 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 12:19:08.594290 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:08.607446 32581 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:08.635424 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.596194 32174 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.628408 32444 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:08.641350 32048 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.653288 32174 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:08.653764 32048 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.653980 28600 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:08.654796 28599 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:08.654412 32324 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.654919 32482 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.656276 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:08.657100 28679 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:08.657771 31987 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.002s
I20260709 12:19:08.658174 31987 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:08.658499 32589 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:08.659714 32331 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.663383 32612 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:19:08.665313 32471 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.668054 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:08.669740 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:08.670286 28605 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:08.670935 28605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:08.671535 28605 raft_consensus.cc:606] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:08.675015 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49748.3us
I20260709 12:19:08.675532 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:08.676298 28678 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:08.680889 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:08.682984 28676 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:08.679456 28679 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:08.685144 28602 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:08.689414 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.689646 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:08.694180 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:08.696539 32554 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:08.696949 32554 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:08.697482 32554 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:08.696904 32067 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.700321 29292 leader_election.cc:400] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:08.670842 32574 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:08.703016 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:08.704005 28749 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:08.688524 31987 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:08.710057 28749 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:08.721374 28605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
W20260709 12:19:08.722512 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.509490 32564 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.730342 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:08.730651 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:08.731035 28749 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:08.702342 32574 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.695873 32468 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:08.736389 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:08.745677 32467 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.059s	user 0.013s	sys 0.000s
I20260709 12:19:08.745581 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:08.746268 28748 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:08.746131 32467 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.715821 31987 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:08.749053 31987 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:08.752648 28680 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:08.752874 32594 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.408s	user 0.000s	sys 0.002s
I20260709 12:19:08.754982 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2200) took 1196 ms. Trace:
I20260709 12:19:08.755319 28680 rpcz_store.cc:276] 0709 12:19:07.558237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.558492 (+   255us) service_pool.cc:224] Handling call
0709 12:19:07.558899 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:08.753042 (+1194143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:08.754794 (+  1752us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003e12d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:08.754931 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2744774912}
I20260709 12:19:08.700299 32147 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:08.751565 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 451116us
I20260709 12:19:08.763351 28750 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:08.766666 28680 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:08.707830 32340 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.773419 28750 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:19:08.769598 32147 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.776831 32147 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:08.734324 32574 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:08.772534 28749 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:08.738155 32615 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:19:08.769941 32468 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.805426 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:08.806388 28749 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:08.809926 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:08.808328 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47976.7us
I20260709 12:19:08.827901 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:08.831393 32454 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:08.832165 32454 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.838438 32600 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.839017 32600 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.841796 29319 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:08.843194 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:08.845022 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:08.845266 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:08.845628 29325 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:08.846807 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:08.847512 29319 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:08.850303 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:08.850852 29317 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:08.782894 32606 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:08.857877 28749 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:08.858405 29322 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:08.784014 32490 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:08.861227 28748 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:08.886113 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:08.887038 29325 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:08.891691 28605 raft_consensus.cc:606] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:08.892107 28605 raft_consensus.cc:614] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:08.734606 32432 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.894203 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:08.811162 32196 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:19:08.922227 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:08.923133 28747 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:08.908886 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:08.928025 29317 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:08.908447 32600 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:08.894141 32467 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:08.885346 32433 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:19:08.941192 32230 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:08.941558 32617 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:19:08.890689 32606 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.946681 32606 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:08.954237 32568 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 1.029s	user 0.002s	sys 0.001s
I20260709 12:19:08.955612 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 603) took 1646 ms. Trace:
I20260709 12:19:08.956854 28571 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:08.959800 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:08.960793 28747 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:08.955991 28606 rpcz_store.cc:276] 0709 12:19:07.309299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.568794 (+259495us) service_pool.cc:224] Handling call
0709 12:19:07.569238 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.569655 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.569694 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:07.570242 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:19:07.831222 (+260980us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:07.989922 (+158700us) log.cc:844] Serialized 14 byte log entry
0709 12:19:07.991592 (+  1670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.991674 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.953574 (+961900us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:08.955305 (+  1731us) raft_consensus.cc:1685] finished
0709 12:19:08.955425 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.955551 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":347504,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":11209,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":6194,"spinlock_wait_cycles":13974784,"thread_start_us":418851,"threads_started":2,"wal-append.queue_time_us":337998}
I20260709 12:19:08.961951 32346 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:08.973623 32346 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:08.974498 32346 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.975234 32554 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.956009 31987 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.967630 32340 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:19:08.979243 32340 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:08.979569 32340 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:08.980222 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:08.981153 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:08.980299 28756 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:08.981971 28747 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:08.983801 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:08.984527 28755 raft_consensus.cc:2368] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:08.986467 32340 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:08.987763 32340 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:08.969450 32538 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:19:08.990644 32482 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:08.991112 32482 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:08.995494 32482 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:08.996711 32554 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:08.997448 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.010393 28679 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:09.012326 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:09.012795 29317 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:09.024812 28678 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:09.026666 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:09.027563 32554 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:09.028055 32554 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:09.032397 32067 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:09.032827 32067 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:09.033671 32067 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.035018 32067 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:09.005842 32418 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:09.043725 32554 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.024412 32050 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:09.029264 31987 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:09.047818 32595 consensus_meta.cc:287] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 12:19:09.021185 32509 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.046098 32418 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:09.054183 32050 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:09.065359 32418 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.071250 32418 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:09.057605 32595 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.072930 32468 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.081247 32600 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:09.102849 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2205) took 1410 ms. Trace:
I20260709 12:19:09.081408 32612 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:09.104830 28675 rpcz_store.cc:276] 0709 12:19:07.692886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.694877 (+  1991us) service_pool.cc:224] Handling call
0709 12:19:07.755792 (+ 60915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.756032 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.756069 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:07.756124 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:07.756177 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.756246 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:09.102662 (+1346416us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b5400272750. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:09.102788 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139195136}
I20260709 12:19:09.102581 32537 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:09.108245 32444 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:09.108973 32433 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:09.104460 32600 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.117937 32537 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.122504 32600 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:09.122644 32537 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:09.122735 32593 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.797s	user 0.002s	sys 0.000s
I20260709 12:19:09.123968 32509 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:09.124269 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2207) took 1118 ms. Trace:
I20260709 12:19:09.106290 32050 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.124712 28674 rpcz_store.cc:276] 0709 12:19:08.006152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.006328 (+   176us) service_pool.cc:224] Handling call
0709 12:19:08.006756 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:08.072072 (+ 65316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:08.072119 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:08.095613 (+ 23494us) log.cc:844] Serialized 26 byte log entry
0709 12:19:08.196615 (+101002us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:08.196651 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:08.196732 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:09.122161 (+925429us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:09.123948 (+  1787us) raft_consensus.cc:1685] finished
0709 12:19:09.123971 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:09.124201 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18551,"raft.queue_time_us":25818,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":18065,"spinlock_wait_cycles":61704960,"thread_start_us":98209,"threads_started":2,"wal-append.queue_time_us":196407}
I20260709 12:19:09.109404 32612 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.129531 32595 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:09.129983 32612 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:09.133554 32482 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:09.138379 32574 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:09.139611 32624 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
W20260709 12:19:09.142141 32599 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.792s	user 0.001s	sys 0.002s
I20260709 12:19:09.145205 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2031) took 1290 ms. Trace:
I20260709 12:19:09.145592 28604 rpcz_store.cc:276] 0709 12:19:07.855264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.855448 (+   184us) service_pool.cc:224] Handling call
0709 12:19:07.855804 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:08.493880 (+638076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:09.144966 (+651086us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b5400092254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:09.145146 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465835392}
I20260709 12:19:09.147213 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:09.148085 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:09.144228 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.149530 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:09.150265 28756 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:09.161295 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2015) took 1875 ms. Trace:
I20260709 12:19:09.161839 28600 rpcz_store.cc:276] 0709 12:19:07.285853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.285965 (+   112us) service_pool.cc:224] Handling call
0709 12:19:07.315613 (+ 29648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:08.654420 (+1338807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:09.160998 (+506578us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003d2a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:09.161219 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077305728}
I20260709 12:19:09.163697 29322 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:09.167934 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:09.168740 29323 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:09.169893 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:09.177291 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:09.177806 29321 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:09.178767 29318 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:09.179891 28601 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:09.175388 32574 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:09.183518 32230 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:09.197108 32497 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.197218 32230 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.197736 32497 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.199432 32230 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.199683 32497 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:09.200157 32497 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.200577 32567 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:09.201268 28572 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:09.202626 28675 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:09.228878 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.229889 28675 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:09.229914 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.202979 32147 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.204843 32564 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:09.188414 32451 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:09.209573 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.210714 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.211360 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:09.213441 32629 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:19:09.215327 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.217229 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:09.217976 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.324039 28678 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:09.219063 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:09.325232 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 106293us
I20260709 12:19:09.326637 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:09.288849 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.302533 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.134619 32433 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.327487 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:09.184057 32468 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.336839 28601 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
W20260709 12:19:09.330143 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 112996us
I20260709 12:19:09.204785 32048 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.354673 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2361) took 1243 ms. Trace:
I20260709 12:19:09.231014 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:09.355252 28601 rpcz_store.cc:276] 0709 12:19:08.110854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.111043 (+   189us) service_pool.cc:224] Handling call
0709 12:19:09.165007 (+1053964us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b58006248d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39db0aa 00007f6fe3a5d447 00007f6fe3a75fe7 00007f6fe3a777de 00007f6fe3a8327c 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c
0709 12:19:09.354608 (+189601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274857856}
W20260709 12:19:09.335361 28720 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 2.172s (SENT) [suppressed 39 similar messages]
I20260709 12:19:09.328996 28675 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:09.329298 32355 raft_consensus.cc:2764] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:09.356482 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:09.385653 28648 leader_election.cc:400] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:09.386206 28648 leader_election.cc:403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:09.352133 32466 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:09.358819 32586 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:09.390061 32586 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.224607 32615 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:09.328954 32536 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.010s
I20260709 12:19:09.318048 32324 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.426563 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.435686 29327 raft_consensus.cc:2410] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:09.354414 32574 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:09.359117 32517 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.385541 32600 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.385190 32606 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.430092 32557 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:09.353775 32444 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:09.384733 32318 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:09.392387 32586 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.319633 32497 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.452492 32557 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.464819 32557 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:09.466162 32497 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.467422 32318 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:09.468531 32318 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.427402 32346 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:09.443683 32588 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:09.318512 32567 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.398065 32468 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.430732 32615 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.353012 32451 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.437206 32324 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:09.437875 32629 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:19:09.384337 32048 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.476581 32586 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.324714 32331 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 12:19:09.454156 32517 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.454838 32606 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.455016 32600 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.318084 32242 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:09.495538 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 264571us
I20260709 12:19:09.460947 32444 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:09.484735 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 129310us
W20260709 12:19:09.491957 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 156625us
W20260709 12:19:09.517624 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.581619 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:09.508800 28681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1936) took 2247 ms (client timeout 2172 ms). Trace:
I20260709 12:19:09.553596 28605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:09.583621 28604 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:09.583829 28605 raft_consensus.cc:606] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:09.584306 28605 raft_consensus.cc:614] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:09.582943 28681 rpcz_store.cc:269] 0709 12:19:07.247452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.247616 (+   164us) service_pool.cc:224] Handling call
0709 12:19:09.495077 (+2247461us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540019ee54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:09.495174 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877941632}
W20260709 12:19:09.560043 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.585786 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.586416 28603 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:09.586520 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.587518 28603 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:19:09.589053 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.589829 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:09.591548 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:09.595163 28675 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:09.481892 32346 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:09.599942 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:09.603003 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:09.603957 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:09.605684 32451 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:09.550285 32634 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:09.591828 32466 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:09.616451 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.617843 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:09.626489 28606 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:09.572378 28494 maintenance_manager.cc:419] P 8e0de7eff4a840c28e4ee5b7f8b98182: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033338
I20260709 12:19:09.592110 32242 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.516933 32050 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.600843 32509 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:09.527494 32583 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:09.618113 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.630122 32242 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:09.661643 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 57680.2us
I20260709 12:19:09.617031 32564 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:09.606678 32640 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:09.661785 28598 raft_consensus.cc:2410] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:19:09.516515 32147 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:09.628779 32541 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:09.644990 32505 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.618333 32554 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:19:09.667083 28606 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:09.596148 32586 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:09.680682 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 92783.4us
W20260709 12:19:09.659128 32418 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.001s
I20260709 12:19:09.686640 32541 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.689742 32541 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.690483 32505 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.693368 32505 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:09.664028 32642 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:09.694617 32642 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:09.695118 32642 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:09.698302 32517 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.699061 32517 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:09.700824 32615 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:09.663208 32344 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:19:09.702696 32567 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.704387 32324 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.617300 32644 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:19:09.705708 32466 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.708643 32586 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.623883 32641 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:19:09.712903 32048 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:09.716099 32468 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.716890 32468 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:09.717350 32468 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:09.721573 28599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2365) took 1599 ms (client timeout 1622 ms). Trace:
W20260709 12:19:09.722170 28599 rpcz_store.cc:269] 0709 12:19:08.121856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.122004 (+   148us) service_pool.cc:224] Handling call
0709 12:19:09.721306 (+1599302us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b540004b854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:09.721490 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222610176}
I20260709 12:19:09.663323 32346 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:09.727769 32632 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.640s	user 0.000s	sys 0.003s
I20260709 12:19:09.674396 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:09.679179 32583 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.730386 28602 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
W20260709 12:19:09.735592 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 332029us
I20260709 12:19:09.661013 32509 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:09.734375 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60077us
I20260709 12:19:09.737728 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:09.663522 32564 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:09.660631 32050 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.747139 28607 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:19:09.779016 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.751711 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:09.779906 28606 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:09.743192 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.774158 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:09.775614 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:09.758241 28604 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:09.744992 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.781562 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.782150 28599 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:09.782795 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.777540 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:09.783047 32509 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:09.741139 32490 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:09.805567 28598 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:09.787542 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:09.782850 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:09.801318 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:09.810123 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:09.803052 28680 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:19:09.812567 28606 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:19:09.735810 32517 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.849401 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:09.850247 28681 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 7: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:09.852722 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:09.787124 32597 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:09.854171 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66735us
I20260709 12:19:09.777346 32564 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:09.773208 32541 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.773459 32615 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:09.857563 32606 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:09.858999 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:09.804859 32174 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.866817 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:09.881758 28598 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:09.867435 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 66178.9us
I20260709 12:19:09.804474 32324 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:09.795413 32641 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:09.859637 32147 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:09.884697 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:09.898406 29321 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:09.898711 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.885567 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:09.806483 32583 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:09.811913 32566 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:19:09.810130 32505 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:19:09.894913 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.895174 28749 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:09.895402 28756 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:09.905901 28673 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:09.891830 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.810356 32490 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.895987 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.901382 28599 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:09.889839 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:09.906996 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:09.891813 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:09.907599 28748 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:09.908125 28750 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.896858 32613 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:09.912739 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.887496 32606 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:09.916739 28599 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:09.867921 32517 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:09.916685 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 99385.5us
I20260709 12:19:09.972108 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:09.920524 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:09.973489 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48602.8us
I20260709 12:19:09.973863 28749 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:09.808806 32468 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:09.969520 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:09.868743 32646 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:19:09.909014 32650 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.918536 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:09.909533 32490 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:09.925355 28598 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:09.887063 32541 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.895483 32174 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.882917 32615 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:09.999747 28748 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:10.086789 28599 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:10.070415 28749 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:10.087821 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:10.087736 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.090719 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:10.091545 28598 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:10.098663 28750 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:09.926764 32444 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:10.111147 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 139144us
I20260709 12:19:10.112954 28598 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:19:10.121080 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.127889 28599 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
W20260709 12:19:10.030256 32482 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.896s	user 0.009s	sys 0.006s
I20260709 12:19:09.973371 32583 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.132743 28606 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:10.134049 28604 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:09.967293 32606 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.145382 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:10.151515 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 231041us
I20260709 12:19:10.142861 32660 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:19:10.157054 32660 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:10.157507 32660 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:10.157627 32638 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.685s	user 0.001s	sys 0.000s
I20260709 12:19:10.157912 32660 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:10.129702 32444 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:10.165488 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.166237 28673 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:10.049842 32657 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 12:19:10.169833 28681 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:19:10.169688 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 150929us
I20260709 12:19:10.115000 32650 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:10.170221 32067 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.135s	user 0.010s	sys 0.005s
I20260709 12:19:10.159968 32600 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:10.143620 32583 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.160590 32050 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:10.163836 32641 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.155349 32482 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:19:10.224186 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70155.8us
I20260709 12:19:10.226765 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:10.205042 32613 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:10.169929 32444 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:10.248487 32658 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:19:10.249320 32653 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:19:10.249563 32444 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:10.211205 32471 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.246157 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.253232 32471 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.246479 32174 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:10.247118 32613 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.237947 32482 consensus_queue.cc:1243] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:19:10.262380 32444 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:19:10.278206 32583 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:10.280730 32517 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:10.282800 29319 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:10.288278 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.292018 29323 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:10.293599 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:10.295617 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 149682us
W20260709 12:19:10.303113 32242 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.001s
I20260709 12:19:10.290213 32665 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:10.303604 32242 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.260895 32657 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:10.265538 32557 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.000s
W20260709 12:19:10.433615 32588 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.002s
I20260709 12:19:10.309226 32471 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:10.444680 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 470037us
I20260709 12:19:10.370023 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.440511 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.457984 29319 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:10.458164 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:10.436019 32642 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.003s
W20260709 12:19:10.427335 32597 consensus_meta.cc:287] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.001s
W20260709 12:19:10.431496 32637 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.904s	user 0.001s	sys 0.000s
I20260709 12:19:10.324671 32615 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:10.459148 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.394114 29321 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:10.383865 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.444363 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:10.368948 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.459343 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.469921 29325 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:10.307814 29322 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:19:10.488006 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:10.488561 29322 pending_rounds.cc:85] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 8
I20260709 12:19:10.471479 28753 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:19:10.472143 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.489081 29322 pending_rounds.cc:107] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:19:10.488075 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.489753 29322 raft_consensus.cc:2889] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:10.490319 28752 raft_consensus.cc:2410] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:19:10.395603 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 237427us
I20260709 12:19:10.491044 28751 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:10.384574 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 272351us
I20260709 12:19:10.472251 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.459676 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:10.438247 29326 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:10.492748 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:10.494056 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:10.496503 28599 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:19:10.430339 32564 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.000s
I20260709 12:19:10.497905 29323 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:19:10.281414 32517 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:10.460073 32597 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:10.501962 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:10.510993 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:10.428555 32591 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 1.962s	user 0.009s	sys 0.004s
I20260709 12:19:10.513101 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:10.514087 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54461.4us
I20260709 12:19:10.522526 29290 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:10.524191 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:10.433872 32541 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:10.384346 32665 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.459095 32588 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:10.515422 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:10.453104 32659 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:19:10.586139 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:10.608224 32668 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.608940 32668 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.612574 32671 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:10.613482 32671 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.613955 32671 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.528182 32471 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:10.618657 28753 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:10.519625 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:10.519804 28598 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:10.633198 28598 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:10.521051 28748 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:10.665362 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:10.377497 32654 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:19:10.379303 32673 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:10.544258 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:10.706115 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 161951us
I20260709 12:19:10.292608 32641 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.583688 28754 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.552944 32656 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:10.558600 32541 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:10.740199 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.740533 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.504045 32557 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.740768 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:10.744369 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.746037 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.517161 32564 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.749279 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.755367 28676 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:10.460732 32613 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:10.558184 32505 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:10.747614 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.459748 32642 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.796582 32067 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:10.830756 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.520798 32517 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.504387 32657 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:10.755065 32606 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:10.828147 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 356485us
I20260709 12:19:10.585690 32665 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:10.868639 28754 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:10.828991 32671 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:10.885573 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.868112 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:10.842020 32600 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.884532 28752 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:10.886489 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:10.888841 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.840063 32505 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:10.891677 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.844077 32242 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:10.896654 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.898674 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.899955 28754 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:10.901077 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:10.859205 32067 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:10.902957 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.916007 28680 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:10.916090 32677 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.829882 32541 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:10.918444 28754 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:10.919116 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:10.921168 28678 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:19:10.926419 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 76960.1us
I20260709 12:19:10.925639 28747 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:10.795984 32673 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.923434 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.927501 28748 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:10.927994 28598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:10.932145 28598 raft_consensus.cc:606] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:10.932543 28598 raft_consensus.cc:614] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:10.894147 32505 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:10.934026 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:10.934659 28680 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:10.846722 32675 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:19:10.916698 32669 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:10.897332 32600 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.941301 28680 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:11.046038 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:19:11.518131 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 472136us
I20260709 12:19:11.519601 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:11.520674 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:11.021006 29325 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:19:10.969489 32674 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:11.522187 29325 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:10.945048 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:11.074350 32660 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.909s	user 0.010s	sys 0.000s
I20260709 12:19:11.523831 28754 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:11.523949 32660 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.045925 32147 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.479s
I20260709 12:19:11.524839 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:11.525525 28754 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:11.526047 32147 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:11.527189 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 1962) took 1056 ms. Trace:
W20260709 12:19:11.168121 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.969142 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:11.070861 32686 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.499s
I20260709 12:19:10.986567 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:10.968636 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:11.526700 32669 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:11.522982 29325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 942) took 1235 ms (client timeout 1521 ms). Trace:
I20260709 12:19:11.229717 32656 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:11.583582 29325 rpcz_store.cc:269] 0709 12:19:10.287481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.295390 (+  7909us) service_pool.cc:224] Handling call
0709 12:19:11.522911 (+1227521us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:11.510372 32509 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.652s	user 0.004s	sys 0.008s
I20260709 12:19:11.528920 32517 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.583973 32656 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.584745 32509 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.585886 29320 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:11.586470 32656 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:11.505570 32685 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:11.587559 32509 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:11.587430 32685 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:10.923226 32067 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:11.509188 32687 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.589794 32685 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.020421 32588 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.573s
I20260709 12:19:11.529663 32557 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:11.590291 28570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.013s	sys 0.017s
I20260709 12:19:11.503695 32564 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:10.929774 32677 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:11.299777 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:11.224954 32581 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:11.510093 32683 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:11.509420 32696 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:11.604743 28570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.013s	sys 0.017s
I20260709 12:19:11.527688 28673 rpcz_store.cc:276] 0709 12:19:10.471153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.471261 (+   108us) service_pool.cc:224] Handling call
0709 12:19:10.471552 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:10.851384 (+379832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:10.851430 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:10.869238 (+ 17808us) log.cc:844] Serialized 26 byte log entry
0709 12:19:10.926079 (+ 56841us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:10.926130 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:10.926223 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:11.046212 (+119989us) raft_consensus.cc:1685] finished
0709 12:19:11.046246 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:11.527123 (+480877us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83371,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":35138,"thread_start_us":435746,"threads_started":2,"wal-append.queue_time_us":175117}
W20260709 12:19:11.073105 32630 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 2.009s	user 0.003s	sys 0.015s
I20260709 12:19:11.528538 28598 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:11.610652 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:11.593217 32685 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:11.199949 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 72305.9us
I20260709 12:19:11.589285 32687 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.591566 28748 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:11.606520 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.526676 32147 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:11.613703 32509 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.622336 32509 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.224182 32497 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:11.611578 28598 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:11.614364 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.601095 32676 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:11.636255 28681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.000s	sys 0.013s
W20260709 12:19:11.644814 28681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.000s	sys 0.014s
I20260709 12:19:11.607030 32642 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.638950 28680 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:11.607630 32606 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.613147 32588 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:11.526804 32660 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.645826 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.609419 32686 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:11.646638 32497 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:11.623315 32147 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:11.654040 32680 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:11.654119 32509 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:11.666455 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:11.685513 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.007s	sys 0.016s
W20260709 12:19:11.693941 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.007s	sys 0.017s
I20260709 12:19:11.601366 32597 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:19:11.643978 32676 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:11.687403 32588 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:11.688607 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.008s	sys 0.016s
W20260709 12:19:11.726445 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.008s	sys 0.016s
W20260709 12:19:11.727174 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 859137us
I20260709 12:19:11.728050 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:11.696377 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:11.701114 32676 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:11.711469 32557 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:11.721735 28598 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:11.700057 32680 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:11.686899 32606 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.692154 32686 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.762056 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:11.611256 32696 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:11.628885 32685 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.702627 32660 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.730823 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.810319 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.810868 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:11.811834 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 83602.5us
I20260709 12:19:11.609349 32683 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:11.812541 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2045) took 1307 ms. Trace:
I20260709 12:19:11.713510 32541 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:11.840965 28599 rpcz_store.cc:276] 0709 12:19:10.505338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.505465 (+   127us) service_pool.cc:224] Handling call
0709 12:19:10.505789 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:10.804232 (+298443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:10.804283 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:10.833969 (+ 29686us) log.cc:844] Serialized 26 byte log entry
0709 12:19:10.939019 (+105050us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:10.939069 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:10.944057 (+  4988us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:11.765964 (+821907us) raft_consensus.cc:1685] finished
0709 12:19:11.766002 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:11.812411 (+ 46409us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":338834,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":22914,"thread_start_us":331233,"threads_started":2,"wal-append.queue_time_us":828222}
I20260709 12:19:11.842981 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:11.843380 28599 raft_consensus.cc:2376] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7. Re-sending same reply.
I20260709 12:19:11.843900 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:11.813194 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:11.815362 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 294748us
I20260709 12:19:11.846035 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:11.847800 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 142781us
I20260709 12:19:11.756213 32564 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:11.864277 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.857867 28598 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:11.859238 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.868841 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.869894 28681 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:11.778545 32703 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:11.873661 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.813167 32657 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:11.845357 32706 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.813568 32673 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:11.881183 32454 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.884382 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:11.849637 32641 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.873335 32541 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:11.952384 28599 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:11.956826 28599 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:11.777335 32557 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.950464 28678 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:11.849476 32660 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:11.855399 32642 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:11.961129 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 111582us
I20260709 12:19:11.977437 32710 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:11.977908 32684 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.973425 32541 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.981529 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:11.981098 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 106717us
I20260709 12:19:11.982125 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:11.983536 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:11.978057 32710 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.957836 28599 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:11.876588 32564 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:11.988998 28599 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:11.996088 32541 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.996259 32660 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:11.998495 32702 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:19:11.998698 32505 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.027s	user 0.011s	sys 0.000s
I20260709 12:19:11.999743 32564 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.999279 32505 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.005338 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 925) took 1259 ms. Trace:
I20260709 12:19:12.005738 29326 rpcz_store.cc:276] 0709 12:19:10.741505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.741650 (+   145us) service_pool.cc:224] Handling call
0709 12:19:10.742068 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:10.883210 (+141142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:10.883240 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:10.883804 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 12:19:11.273466 (+389662us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:11.810501 (+537035us) log.cc:844] Serialized 14 byte log entry
0709 12:19:11.842339 (+ 31838us) log.cc:844] Serialized 14 byte log entry
0709 12:19:11.846546 (+  4207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:11.846619 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:12.000712 (+154093us) raft_consensus.cc:1685] finished
0709 12:19:12.000731 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.000887 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17915,"prepare.queue_time_us":646932,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":49,"raft.queue_time_us":143535,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":31771,"spinlock_wait_cycles":14952192,"thread_start_us":970378,"threads_started":3,"wal-append.queue_time_us":844749}
I20260709 12:19:11.981099 32669 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.982285 32642 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:11.988922 32687 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:11.991878 32600 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:11.997087 32660 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:12.015739 32711 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.023203 32687 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:12.026690 32687 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.027053 32687 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:12.010143 32677 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.009812 32606 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:11.952081 32706 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:12.033015 32490 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.917s	user 0.003s	sys 0.011s
I20260709 12:19:12.018435 32669 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:19:12.031952 32696 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:11.993701 32684 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:12.016573 32711 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:12.043809 32588 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.051839 32713 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.101s
W20260709 12:19:12.054289 32699 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 12:19:12.054973 32704 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:19:12.042472 32698 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:19:12.048861 32718 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:19:11.986028 32680 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:12.056638 32683 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:12.139587 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 155944us
I20260709 12:19:12.188100 32642 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:12.056957 32701 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:19:12.079957 32684 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:12.136804 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 152463us
W20260709 12:19:12.157989 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.100230 32687 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.214891 32687 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.215988 32700 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:12.206925 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2071) took 1735 ms. Trace:
I20260709 12:19:12.218056 32723 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:12.218614 32723 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:12.090425 32706 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:12.056587 32686 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.065851 32710 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.217192 28755 rpcz_store.cc:276] 0709 12:19:10.471094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.472348 (+  1254us) service_pool.cc:224] Handling call
0709 12:19:10.515756 (+ 43408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:10.922817 (+407061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:10.922862 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:10.937558 (+ 14696us) log.cc:844] Serialized 52 byte log entry
0709 12:19:11.330057 (+392499us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:11.706294 (+376237us) log.cc:844] Serialized 14 byte log entry
0709 12:19:11.762848 (+ 56554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:11.762948 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:12.206304 (+443356us) raft_consensus.cc:1685] finished
0709 12:19:12.206343 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.206679 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56273,"prepare.queue_time_us":647812,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":353708,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":63853,"thread_start_us":813702,"threads_started":3,"wal-append.queue_time_us":665408}
I20260709 12:19:12.220181 32723 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:12.221252 32713 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:12.222604 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:12.222317 32713 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.048295 32490 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.171000 32505 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:12.141666 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:12.234774 32711 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:12.235865 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:12.087991 32676 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.239440 32676 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.239874 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:12.242470 32713 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.242707 32711 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:12.243238 32711 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.243652 32711 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:12.244755 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.246417 28681 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:12.249895 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.251044 28678 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:12.253674 28755 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:19:12.255957 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:12.256692 28755 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:12.257236 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:12.258143 28750 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:19:12.259310 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.260119 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2089) took 1397 ms. Trace:
I20260709 12:19:12.261777 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2081) took 1704 ms. Trace:
I20260709 12:19:12.268698 28753 rpcz_store.cc:276] 0709 12:19:10.557345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.557492 (+   147us) service_pool.cc:224] Handling call
0709 12:19:10.557839 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:10.619130 (+ 61291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.261179 (+1642049us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b54001c5a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.261564 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138886912}
I20260709 12:19:12.269585 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2082) took 1674 ms. Trace:
I20260709 12:19:12.270601 28753 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:19:12.270147 28752 rpcz_store.cc:276] 0709 12:19:10.595112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.597698 (+  2586us) service_pool.cc:224] Handling call
0709 12:19:10.884181 (+286483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:10.890661 (+  6480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.269086 (+1378425us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400337f50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:12.269390 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320482688}
I20260709 12:19:12.271394 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 682) took 1407 ms. Trace:
I20260709 12:19:12.271782 28753 rpcz_store.cc:276] 0709 12:19:10.864093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.269767 (+1405674us) service_pool.cc:224] Handling call
0709 12:19:12.270281 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:12.271139 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.271342 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:12.262251 32490 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:12.263820 32067 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.005s
I20260709 12:19:12.273016 28750 rpcz_store.cc:276] 0709 12:19:10.863043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.258737 (+1395694us) service_pool.cc:224] Handling call
0709 12:19:12.259279 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.259728 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.259756 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.259826 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:12.259867 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.259935 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.260047 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:12.267369 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.264115 32557 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.287998 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 691) took 1420 ms. Trace:
I20260709 12:19:12.293257 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 950) took 1996 ms. Trace:
I20260709 12:19:12.296258 28750 rpcz_store.cc:276] 0709 12:19:10.867670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.284470 (+1416800us) service_pool.cc:224] Handling call
0709 12:19:12.287162 (+  2692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.287564 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.287604 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.287674 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:12.287751 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.287819 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.287916 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:12.298308 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77106.4us
I20260709 12:19:12.301038 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.296594 29320 rpcz_store.cc:276] 0709 12:19:10.296305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.296569 (+   264us) service_pool.cc:224] Handling call
0709 12:19:10.296951 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:11.586258 (+1289307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.292586 (+706328us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54007a0154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.292964 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2963728128}
I20260709 12:19:12.300623 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 690) took 1433 ms. Trace:
I20260709 12:19:12.302003 28753 rpcz_store.cc:276] 0709 12:19:10.867360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.278567 (+1411207us) service_pool.cc:224] Handling call
0709 12:19:12.297873 (+ 19306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.300120 (+  2247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.300159 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.300239 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:12.300295 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.300371 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.300533 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:12.303980 32713 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.304817 32713 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:12.310742 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:12.312897 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.312991 28755 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:12.313549 32344 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:12.314042 32344 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:12.314178 28674 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:12.315965 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.317266 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:12.318225 29320 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:19:12.318686 29320 pending_rounds.cc:85] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 7
I20260709 12:19:12.318994 29320 pending_rounds.cc:107] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:19:12.319285 29320 raft_consensus.cc:2889] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:12.315608 32344 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.321004 32344 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:12.322026 29326 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:19:12.322500 29326 pending_rounds.cc:85] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 8
I20260709 12:19:12.322825 29326 pending_rounds.cc:107] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:19:12.323082 29326 raft_consensus.cc:2889] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:12.318379 28674 raft_consensus.cc:2368] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10.
I20260709 12:19:12.326833 29325 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:19:12.327273 29325 pending_rounds.cc:85] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 7
I20260709 12:19:12.327584 29325 pending_rounds.cc:107] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:19:12.327850 29325 raft_consensus.cc:2889] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:12.329669 32355 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:12.330549 32355 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.333712 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:12.284524 32067 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.338591 28598 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:12.339514 32433 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:12.339903 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 949) took 2050 ms. Trace:
I20260709 12:19:12.340330 29321 rpcz_store.cc:276] 0709 12:19:10.289614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.290564 (+   950us) service_pool.cc:224] Handling call
0709 12:19:10.290901 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:10.486951 (+196050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.339464 (+1852513us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540036abd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.339742 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236774784}
I20260709 12:19:12.341758 32713 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:12.345798 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62012.8us
I20260709 12:19:12.350620 32497 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:12.351276 32174 raft_consensus.cc:993] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:12.351935 32174 raft_consensus.cc:1081] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:12.352475 32355 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.352599 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.372869 32242 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:12.373682 32242 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.381021 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.381919 28674 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:12.383080 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:12.383405 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.384425 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:12.384613 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.385262 28674 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:12.385617 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 618) took 2803 ms. Trace:
I20260709 12:19:12.386163 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.386073 28600 rpcz_store.cc:276] 0709 12:19:09.582547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.582658 (+   111us) service_pool.cc:224] Handling call
0709 12:19:09.606562 (+ 23904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:09.606764 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:09.651159 (+ 44395us) log.cc:844] Serialized 14 byte log entry
0709 12:19:12.245623 (+2594464us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18003a4f80. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a 00007f6fe3a89a2a
0709 12:19:12.338177 (+ 92554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.347973 (+  9796us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:12.349367 (+  1394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.370696 (+ 21329us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.385414 (+ 14718us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44219,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2498,"raft.queue_time_us":18099,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":197,"spinlock_wait_cycles":4718336,"thread_start_us":38248,"threads_started":1}
I20260709 12:19:12.388756 32471 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:12.389592 32471 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.390501 28599 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:19:12.390918 28599 pending_rounds.cc:85] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 5
I20260709 12:19:12.391183 28599 pending_rounds.cc:107] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:19:12.391424 28599 raft_consensus.cc:2889] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:12.393064 32685 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.394980 32471 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:12.395249 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.397820 28674 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:12.403139 28674 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:19:12.405722 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2196) took 4909 ms. Trace:
I20260709 12:19:12.406265 28682 rpcz_store.cc:276] 0709 12:19:07.495769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.495902 (+   133us) service_pool.cc:224] Handling call
0709 12:19:07.496197 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:08.490082 (+993885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.405088 (+3915006us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54003755d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.405466 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142737280}
I20260709 12:19:12.404253 32723 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:12.426806 32174 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:12.432906 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.434231 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2383) took 2645 ms. Trace:
W20260709 12:19:12.440398 28747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2078) took 1927 ms (client timeout 1996 ms). Trace:
W20260709 12:19:12.440944 28747 rpcz_store.cc:269] 0709 12:19:10.512662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.512805 (+   143us) service_pool.cc:224] Handling call
0709 12:19:12.439981 (+1927176us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54001b35d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:12.440198 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879795584}
I20260709 12:19:12.442497 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:12.443295 28747 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:12.444631 32703 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:12.445420 32703 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:12.437733 28604 rpcz_store.cc:276] 0709 12:19:09.788865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.796721 (+  7856us) service_pool.cc:224] Handling call
0709 12:19:09.796996 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:10.134569 (+337573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.433702 (+2299133us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54000a8054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.434021 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774047104}
I20260709 12:19:12.453382 28754 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:12.454352 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.455089 29325 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:12.456686 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:12.457149 29318 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:12.458494 29318 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:12.465420 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:12.479167 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2407) took 1597 ms. Trace:
I20260709 12:19:12.478850 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:12.483340 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:12.486238 28602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 624) took 2850 ms (client timeout 1806 ms). Trace:
I20260709 12:19:12.486464 29318 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.487671 29318 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:12.486742 28602 rpcz_store.cc:269] 0709 12:19:09.586472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.586590 (+   118us) service_pool.cc:224] Handling call
0709 12:19:12.413056 (+2826466us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000a6c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:12.436944 (+ 23888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243922304}
I20260709 12:19:12.480176 28750 rpcz_store.cc:276] 0709 12:19:10.875551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.299256 (+1423705us) service_pool.cc:224] Handling call
0709 12:19:12.308908 (+  9652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.309451 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:12.342403 (+ 32952us) log.cc:844] Serialized 14 byte log entry
0709 12:19:12.472344 (+129941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.472422 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:12.472502 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.472592 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.472734 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32520,"prepare.queue_time_us":34384,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":12908,"thread_start_us":117499,"threads_started":1}
I20260709 12:19:12.497637 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:12.505038 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 687) took 1639 ms. Trace:
I20260709 12:19:12.488701 32703 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:12.512655 32731 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:19:12.513309 32729 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260709 12:19:12.518782 32346 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.520550 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2387) took 2609 ms. Trace:
I20260709 12:19:12.520907 28606 rpcz_store.cc:276] 0709 12:19:09.891340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.899668 (+  8328us) service_pool.cc:224] Handling call
0709 12:19:09.899954 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:10.133357 (+233403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.465386 (+2332029us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54000bf254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.501092 (+ 35706us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534213888}
I20260709 12:19:12.521494 32711 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.523414 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:12.524739 32711 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.525136 32541 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:12.525785 32541 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:12.489287 32174 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:12.527043 32541 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.506603 28752 rpcz_store.cc:276] 0709 12:19:10.866079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.271487 (+1405408us) service_pool.cc:224] Handling call
0709 12:19:12.271966 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.275023 (+  3057us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:12.344969 (+ 69946us) log.cc:844] Serialized 14 byte log entry
0709 12:19:12.504682 (+159713us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.504739 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:12.504798 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.504864 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.504980 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45885,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":10923,"thread_start_us":147642,"threads_started":1}
I20260709 12:19:12.530982 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:12.531762 28752 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:12.533728 28752 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:12.521528 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:12.520308 29322 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:12.536957 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:12.510607 32713 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:12.536449 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:12.537788 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:12.528199 32174 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:12.545656 32574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.862s	user 0.018s	sys 0.020s
W20260709 12:19:12.546100 32574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.921s	user 0.019s	sys 0.021s
I20260709 12:19:12.540782 32713 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:12.573311 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51938us
I20260709 12:19:12.553773 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:12.578743 29325 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:12.579141 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:12.602029 29323 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:12.582122 32713 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:12.583559 32554 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:19:12.621598 28750 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:12.620911 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:12.628831 32554 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:12.628715 32589 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:12.629329 32554 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:12.630391 32554 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.631803 32554 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:12.631863 32418 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:12.633723 32418 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:12.634836 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:12.637610 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58744.5us
I20260709 12:19:12.639386 29290 leader_election.cc:400] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10.
I20260709 12:19:12.639695 29290 leader_election.cc:403] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:12.640515 29318 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:19:12.641049 29318 pending_rounds.cc:85] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 7
I20260709 12:19:12.641485 29318 pending_rounds.cc:107] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:19:12.641731 29318 raft_consensus.cc:2889] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:12.643234 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.636328 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.640872 32688 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:12.608883 32574 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:12.649611 29318 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:12.650998 29325 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:12.656965 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:12.650368 32574 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:12.669927 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.655792 32471 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10.
W20260709 12:19:12.675065 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.676828 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.671664 32574 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:12.688341 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.694802 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.695266 32668 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:12.696420 32607 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:19:12.698294 32665 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:12.702152 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2046) took 2196 ms. Trace:
I20260709 12:19:12.704833 29318 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:12.714025 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:12.715797 28676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1947) took 2912 ms (client timeout 1521 ms). Trace:
W20260709 12:19:12.731559 29327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 863) took 3919 ms (client timeout 2186 ms). Trace:
I20260709 12:19:12.731969 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 869) took 3588 ms. Trace:
I20260709 12:19:12.732884 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 626) took 3145 ms. Trace:
I20260709 12:19:12.734570 32067 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:12.736778 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:12.674803 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:12.678373 28674 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:12.746901 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:12.755441 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.758859 29326 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
W20260709 12:19:12.761472 28676 rpcz_store.cc:269] 0709 12:19:09.802814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.802969 (+   155us) service_pool.cc:224] Handling call
0709 12:19:12.715429 (+2912460us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540019ee54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:12.715580 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698147712}
I20260709 12:19:12.762890 29317 rpcz_store.cc:276] 0709 12:19:09.143773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.143902 (+   129us) service_pool.cc:224] Handling call
0709 12:19:09.144203 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:09.427761 (+283558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:09.427790 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:09.427828 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:09.427860 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.731425 (+3303565us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540010a754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.731503 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.731742 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651658624}
W20260709 12:19:12.762279 29327 rpcz_store.cc:269] 0709 12:19:08.811921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.812221 (+   300us) service_pool.cc:224] Handling call
0709 12:19:12.731081 (+3918860us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54006801d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:12.731324 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395692416}
I20260709 12:19:12.774281 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:12.744426 32650 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:12.783888 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 110600us
W20260709 12:19:12.747535 32633 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 3.528s	user 0.011s	sys 0.017s
I20260709 12:19:12.787285 32679 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:12.790963 29323 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:12.795648 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:12.796208 32737 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:19:12.802881 32536 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:12.803314 29320 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:12.804778 32669 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:12.805554 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.676110 32688 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.808238 32242 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.810206 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2084) took 2010 ms. Trace:
I20260709 12:19:12.816557 28754 rpcz_store.cc:276] 0709 12:19:10.799550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:11.526198 (+726648us) service_pool.cc:224] Handling call
0709 12:19:12.452584 (+926386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.453822 (+  1238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.810018 (+356196us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54001b35d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:12.810150 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118270208}
I20260709 12:19:12.827037 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:12.828685 32640 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:12.830073 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.831148 32679 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:12.832010 32488 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:12.832412 32665 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:12.832207 32679 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.832473 32488 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.833412 32488 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.833079 32665 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:12.835309 32665 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:12.824879 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 2246) took 1154 ms. Trace:
I20260709 12:19:12.840588 28680 rpcz_store.cc:276] 0709 12:19:11.664660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:11.668206 (+  3546us) service_pool.cc:224] Handling call
0709 12:19:12.713676 (+1045470us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:19:12.818679 (+105003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3214720}
I20260709 12:19:12.841460 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.842271 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:12.759817 28601 rpcz_store.cc:276] 0709 12:19:10.505684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.505864 (+   180us) service_pool.cc:224] Handling call
0709 12:19:10.506162 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:12.410626 (+1904464us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b1800414dc0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a77bfb 00007f6fe3a8264b
0709 12:19:12.471872 (+ 61246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.471911 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:12.487604 (+ 15693us) log.cc:844] Serialized 26 byte log entry
0709 12:19:12.602272 (+114668us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:12.602313 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.619869 (+ 17556us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:12.701651 (+ 81782us) raft_consensus.cc:1685] finished
0709 12:19:12.701673 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.701965 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37571,"raft.queue_time_us":364090,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5167,"spinlock_wait_cycles":3410688,"thread_start_us":450728,"threads_started":2,"wal-append.queue_time_us":184217}
I20260709 12:19:12.825248 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.850814 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:12.861347 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49220.2us
I20260709 12:19:12.864531 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.890105 29321 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:12.915311 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:12.922416 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:12.923933 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93012.3us
I20260709 12:19:12.925004 32640 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:12.926996 32640 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:12.929175 32418 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:12.932683 32714 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.933386 32714 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:12.936721 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.937181 32714 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:12.941056 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:12.942444 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:12.943483 32324 raft_consensus.cc:2764] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:19:12.943609 32418 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:12.764029 28603 rpcz_store.cc:276] 0709 12:19:09.587153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.588319 (+  1166us) service_pool.cc:224] Handling call
0709 12:19:09.588617 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:09.787443 (+198826us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:09.847998 (+ 60555us) log.cc:844] Serialized 14 byte log entry
0709 12:19:12.238170 (+2390172us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b1800493180. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a 00007f6fe3a89a2a
0709 12:19:12.328812 (+ 90642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:12.328905 (+    93us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:12.329036 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.732507 (+403471us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400122fd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.732550 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.732721 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9862,"prepare.queue_time_us":60333,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":10107,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"spinlock_wait_cycles":468275456,"thread_start_us":63811,"threads_started":1,"wal-append.queue_time_us":2592972}
I20260709 12:19:12.944825 32418 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:12.945865 32418 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.946408 28753 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:12.951581 28674 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:12.952392 28673 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:12.951609 28753 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:19:12.959041 28753 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:19:12.964725 29326 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 6.
I20260709 12:19:12.967614 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:12.966348 29323 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:12.918742 32668 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.970017 32668 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:12.973582 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.975207 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:12.972165 32668 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:12.917932 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:12.943701 32564 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:12.994426 32650 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:12.994503 32665 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:12.997468 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 926) took 2254 ms. Trace:
I20260709 12:19:13.022816 29325 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:13.042357 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.026291 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:13.048530 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 195061us
I20260709 12:19:13.053316 32468 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:13.054039 32614 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:13.054749 32614 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:13.001613 32564 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:13.057520 32564 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.059055 32688 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:12.997932 29319 rpcz_store.cc:276] 0709 12:19:10.743029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.743171 (+   142us) service_pool.cc:224] Handling call
0709 12:19:10.754845 (+ 11674us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:10.840848 (+ 86003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:10.840890 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:10.879550 (+ 38660us) log.cc:844] Serialized 52 byte log entry
0709 12:19:11.014391 (+134841us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:11.014447 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:12.996868 (+1982421us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54006531d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:12.996959 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:12.997019 (+    60us) raft_consensus.cc:1685] finished
0709 12:19:12.997036 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:12.997267 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39611,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10483,"spinlock_wait_cycles":196622080,"thread_start_us":91950,"threads_started":1,"wal-append.queue_time_us":807708}
I20260709 12:19:13.050748 28647 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:13.055991 32614 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.042254 32668 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:19:12.997464 32650 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:13.081938 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:13.089707 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.065785 32669 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.094576 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.104552 29321 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:13.062117 32713 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.105902 32665 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:13.107019 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:13.107954 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:13.103857 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 1968) took 1096 ms. Trace:
I20260709 12:19:13.115403 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:13.113436 28603 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:13.114390 28681 rpcz_store.cc:276] 0709 12:19:12.002529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.251106 (+248577us) service_pool.cc:224] Handling call
0709 12:19:13.094387 (+843281us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:19:13.098350 (+  3963us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3450112}
I20260709 12:19:13.120704 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:13.117383 32646 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:13.126379 28601 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:13.127135 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:13.127895 28606 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:13.128994 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.128535 28602 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:13.133293 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:13.136946 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:13.137529 28602 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:13.137607 32650 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:13.147949 29320 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:13.113340 32574 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.159369 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:13.119084 32488 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:13.158100 29319 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:13.162341 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.108954 32669 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:13.160190 28602 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:13.166733 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:13.167761 29320 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:13.171103 32566 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:13.171375 28603 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:13.175843 29325 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
W20260709 12:19:13.181653 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 255313us
I20260709 12:19:13.184737 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:13.224402 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:13.226640 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 202583us
I20260709 12:19:13.228399 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:13.209117 32668 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.236936 29320 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:19:13.233924 32344 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:13.254913 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:13.239245 32713 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.249228 32566 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:19:13.256722 32344 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:13.277779 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49978.5us
I20260709 12:19:13.281699 32344 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:13.284567 28573 leader_election.cc:336] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.636s (SENT)
I20260709 12:19:13.286829 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.287398 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2415) took 1414 ms. Trace:
W20260709 12:19:13.287510 32634 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:13.288942 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2416) took 1397 ms. Trace:
W20260709 12:19:13.290336 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.288197 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.288748 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:13.290529 28750 rpcz_store.cc:276] 0709 12:19:11.891960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.654012 (+762052us) service_pool.cc:224] Handling call
0709 12:19:12.677643 (+ 23631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:12.806232 (+128589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.806261 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:12.806853 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:19:13.094095 (+287242us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:13.094143 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.094309 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:13.288731 (+194422us) raft_consensus.cc:1685] finished
0709 12:19:13.288755 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:13.288880 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5064,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3769,"thread_start_us":282683,"threads_started":1,"wal-append.queue_time_us":449116}
I20260709 12:19:13.288154 32665 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:13.287874 28752 rpcz_store.cc:276] 0709 12:19:11.873153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.541059 (+667906us) service_pool.cc:224] Handling call
0709 12:19:12.582865 (+ 41806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:12.624802 (+ 41937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.624847 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:12.670206 (+ 45359us) log.cc:844] Serialized 26 byte log entry
0709 12:19:13.090010 (+419804us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:13.090049 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.090117 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:13.287141 (+197024us) raft_consensus.cc:1685] finished
0709 12:19:13.287159 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:13.287306 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12743,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":16640,"thread_start_us":399648,"threads_started":1,"wal-append.queue_time_us":563695}
I20260709 12:19:13.288942 32672 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:13.309530 32672 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:13.309953 32672 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.299029 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:13.287431 32566 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.288618 32640 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:13.322173 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:13.334674 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.268375 32668 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.321013 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.298362 32574 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.309249 32488 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:13.351429 28751 raft_consensus.cc:2410] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:19:13.312863 32665 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:13.354828 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:13.356233 32755 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:13.351760 32324 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:19:13.323617 32669 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:13.359484 32581 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:13.358808 32747 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:19:13.369709 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 167790us
I20260709 12:19:13.375357 29320 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:13.348865 32650 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:13.374577 32645 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:13.379920 28756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.064s
I20260709 12:19:13.381404 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:13.381832 28756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.065s
I20260709 12:19:13.343639 32566 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:13.381083 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:13.388536 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.389799 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:13.390535 29320 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:19:13.398749 28751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2079) took 2880 ms (client timeout 2161 ms). Trace:
W20260709 12:19:13.399226 28751 rpcz_store.cc:269] 0709 12:19:10.518507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.519291 (+   784us) service_pool.cc:224] Handling call
0709 12:19:13.398443 (+2879152us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b5400306454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:13.398634 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6111429504}
I20260709 12:19:13.385452 32645 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:13.400547 32713 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:13.401037 32713 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.401394 32713 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:13.401708 32517 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:13.402102 32517 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:13.403230 32566 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:13.403020 32517 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.395186 32669 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:13.375177 32581 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:13.373371 32640 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.401243 32645 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.407292 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.446539 29317 raft_consensus.cc:2410] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:19:13.425002 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45117.9us
I20260709 12:19:13.426338 28748 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 12:19:13.436069 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:13.441581 28573 leader_election.cc:336] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.550s (SENT)
I20260709 12:19:13.405977 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:13.411162 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.449205 28748 pending_rounds.cc:85] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 5
I20260709 12:19:13.458052 28748 pending_rounds.cc:107] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:19:13.458374 28748 raft_consensus.cc:2889] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:13.411470 32067 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:13.438823 32640 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.461097 32067 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:13.461213 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.407519 32536 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.462109 32536 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:13.467609 28674 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:19:13.426982 32754 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:13.474362 29326 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:13.404426 32517 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:13.473429 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.474254 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.404496 32668 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:13.498364 28754 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:13.479923 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:13.498368 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:13.502579 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53955.2us
I20260709 12:19:13.503587 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:13.505156 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.506537 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.507264 28674 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:13.499614 28751 raft_consensus.cc:2376] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11. Re-sending same reply.
I20260709 12:19:13.532151 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:13.533480 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.535151 28750 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:13.476125 32541 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.538353 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:13.544541 32672 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.549247 28677 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:13.550330 32672 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.553210 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.553159 32344 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.554450 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:13.555403 32344 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.558739 32067 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.561329 29326 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:19:13.565606 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62146.9us
I20260709 12:19:13.566074 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.568637 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.585551 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.439298 32665 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.548213 32541 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.542219 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:13.593268 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.593640 32672 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.593745 32581 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:13.596879 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:13.584558 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:13.600800 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.595027 32242 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:19:13.602149 32672 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.589968 32067 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:13.605293 29321 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:13.606840 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.606194 28747 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:13.552034 32713 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:13.617367 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 268885us
I20260709 12:19:13.604393 32672 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.627390 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:13.629242 29320 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:13.636497 28674 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:13.632424 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.612540 32242 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:13.646275 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.647146 28753 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:13.653755 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:13.654366 29321 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.654735 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.655113 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2411) took 1802 ms. Trace:
I20260709 12:19:13.655565 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.656312 29318 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:13.654098 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.648873 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.654037 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.661026 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.661535 29320 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:13.664580 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:13.665700 28679 raft_consensus.cc:2410] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:13.655560 28755 rpcz_store.cc:276] 0709 12:19:11.852725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.316666 (+463941us) service_pool.cc:224] Handling call
0709 12:19:12.332926 (+ 16260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:12.333536 (+   610us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:12.607276 (+273740us) log.cc:844] Serialized 14 byte log entry
0709 12:19:13.269910 (+662634us) log.cc:844] Serialized 14 byte log entry
0709 12:19:13.654781 (+384871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:13.654834 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:13.654888 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.654950 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:13.655062 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19473,"prepare.queue_time_us":75547,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":31111,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":27549,"thread_start_us":1225456,"threads_started":4,"wal-append.queue_time_us":476484}
I20260709 12:19:13.666268 28675 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:19:13.666865 28675 pending_rounds.cc:85] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 4
I20260709 12:19:13.667099 28675 pending_rounds.cc:107] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 12:19:13.668033 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 77202.6us
I20260709 12:19:13.669085 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:13.667344 28675 raft_consensus.cc:2889] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:13.675150 28676 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:13.675293 28678 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:13.676326 28682 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:13.671829 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:13.655160 32669 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:13.680783 28754 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:13.681452 32669 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:13.673534 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:13.683070 32588 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:13.683454 32588 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.683816 32588 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:13.685834 32710 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:13.687779 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.688465 28753 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:13.415817 32714 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Committing config change with OpId 10.10: config changed from index 4 to 10, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:13.689320 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.690433 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.691438 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.662678 32468 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:13.697454 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:13.699515 32468 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:13.701541 32541 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.701851 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2405) took 3782 ms. Trace:
I20260709 12:19:13.705233 32695 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:13.706419 32695 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:13.707324 32668 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:13.707753 32668 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:13.672397 28749 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:19:13.708777 32668 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.710096 32668 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.710042 28505 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 6 to 7, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.713132 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.713454 32713 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.714015 28750 raft_consensus.cc:2410] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 12 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:19:13.713606 28505 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.648905 32581 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:19:13.717384 32581 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:13.717746 32581 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:13.718621 32581 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.719806 32581 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:13.721436 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2087) took 2876 ms. Trace:
I20260709 12:19:13.721820 28748 rpcz_store.cc:276] 0709 12:19:10.844917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:11.622633 (+777716us) service_pool.cc:224] Handling call
0709 12:19:13.404632 (+1781999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:13.501687 (+ 97055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.658526 (+156839us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b5400306454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:13.721259 (+ 62733us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400306450. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:13.721379 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4145620096}
I20260709 12:19:13.723671 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.721812 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:13.724697 28751 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.709332 28749 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:13.725272 28749 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:13.729945 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:13.733755 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:13.737080 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.741744 29321 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:13.743103 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:13.649542 32672 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:19:13.744910 29320 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:13.749718 29318 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:13.738540 28505 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 8 to 9, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:13.751086 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:13.761402 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 380058us
I20260709 12:19:13.735877 28756 rpcz_store.cc:276] 0709 12:19:09.919900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:09.920159 (+   259us) service_pool.cc:224] Handling call
0709 12:19:10.088538 (+168379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:12.726051 (+2637513us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18003e0e60. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a77bfb 00007f6fe3a8264b
0709 12:19:12.726225 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:12.726248 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:12.726822 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:19:13.382239 (+655417us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:13.396029 (+ 13790us) log.cc:844] Serialized 14 byte log entry
0709 12:19:13.649282 (+253253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:13.658979 (+  9697us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:13.659033 (+    54us) raft_consensus.cc:1685] finished
0709 12:19:13.701608 (+ 42575us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:13.701784 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58939,"prepare.queue_time_us":18132,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":282784,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":11366,"spinlock_wait_cycles":2729344,"thread_start_us":996326,"threads_started":3,"wal-append.queue_time_us":664546}
W20260709 12:19:13.764828 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 193931us
W20260709 12:19:13.765244 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 96271.9us
I20260709 12:19:13.768044 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:13.770121 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:13.771292 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:13.777724 28747 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:13.778856 28750 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:13.758504 32713 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:13.785255 32147 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:13.789193 28754 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:13.763010 32640 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:13.791205 32640 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.784556 32713 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:13.793994 32713 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:13.783090 32710 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:13.782969 32564 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:13.795467 32564 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:13.795603 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.795903 32564 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:13.796418 32344 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:13.797596 32344 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:13.797991 32536 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.798417 32344 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:13.765224   302 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:13.798938 32344 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.795305 28749 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:13.800414 28573 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.996s (SENT)
I20260709 12:19:13.783389 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:13.785434 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:13.782249 28751 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:13.801013 32468 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:13.805593 32710 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:13.818912 28749 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:13.821197 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 242671us
I20260709 12:19:13.852972 28571 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:13.825906 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:13.816871 32468 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:13.819712 32679 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:13.820716 32536 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:13.822224 32541 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.877180 32710 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:13.880739 32710 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:13.881148 32710 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:13.878445 32242 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:13.883342 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:13.894912 29321 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:13.896785 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:13.898764 29321 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:13.842134 32344 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.901404 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:13.858812 32640 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.901655   303 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:19:13.842410 32650 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:19:13.926054 32468 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.927601 32650 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:13.911870   307 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:19:13.898949 32147 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:19:13.931268 32588 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.872071 32679 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:13.933355 32679 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:13.933777 32588 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:13.880311 32541 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:13.847824 32564 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:13.938127 32541 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:13.938731 32564 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:13.904057 32488 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:13.926076 32466 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:19:13.915310 32589 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:13.915838 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:13.919265 32242 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:13.897583 32672 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:19:13.858319 32581 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:13.879877 32713 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:13.928203 32468 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:13.968202 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.947275 28505 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:13.946518 32242 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.000826 32242 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:13.976260 32581 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.005241 32581 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:14.006366 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.977176 32589 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:14.008003 32589 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:14.067900 28504 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 229) took 13960 ms (client timeout 15000 ms). Trace:
I20260709 12:19:14.066278 28505 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:14.068384 28504 rpcz_store.cc:269] 0709 12:19:00.132016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.142293 (+ 10277us) service_pool.cc:224] Handling call
0709 12:19:01.573085 (+1430792us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540002c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e9090 00007f6fe3a87f3a 00007f6fe983de9c 00007f6fe993c04e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc 00007f6fe7dfc392 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:14.067663 (+12494578us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:06.549275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:06.680295 (+131020us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:06.680369 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:19:06.680410 (+    41us) tablet.cc:662] Decoding operations
0709 12:19:06.848053 (+167643us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:06.848140 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:06.848178 (+    38us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:19:06.849640 (+  1462us) tablet.cc:701] Row locks acquired
0709 12:19:06.849695 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:19:06.849887 (+   192us) write_op.cc:270] Start()
0709 12:19:06.850047 (+   160us) write_op.cc:276] Timestamp: P: 1783599546849814 usec, L: 0
0709 12:19:06.850071 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:19:06.850857 (+   786us) log.cc:844] Serialized 6420 byte log entry
0709 12:19:07.486975 (+636118us) op_driver.cc:464] REPLICATION: finished
0709 12:19:07.692530 (+205555us) write_op.cc:301] APPLY: starting
0709 12:19:07.692628 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:07.692971 (+   343us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:07.693088 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:07.778905 (+ 85817us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:07.779366 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:19:07.779433 (+    67us) write_op.cc:312] APPLY: finished
0709 12:19:07.780002 (+   569us) log.cc:844] Serialized 113 byte log entry
0709 12:19:07.780185 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:07.780346 (+   161us) write_op.cc:454] Released schema lock
0709 12:19:07.780399 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:07.815388 (+ 34989us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:07.815436 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":899020,"reported_tablets":37,"spinlock_wait_cycles":3033016064,"child_traces":[["op",{"apply.queue_time_us":189644,"apply.run_cpu_time_us":5577,"apply.run_wall_time_us":122787,"num_ops":16,"prepare.queue_time_us":587714,"prepare.run_cpu_time_us":147195,"prepare.run_wall_time_us":579170,"raft.queue_time_us":307277,"raft.run_cpu_time_us":3864,"raft.run_wall_time_us":102479,"replication_time_us":624483,"thread_start_us":676579,"threads_started":4,"wal-append.queue_time_us":256757,"wal-append.run_cpu_time_us":27742,"wal-append.run_wall_time_us":1720166}]]}
I20260709 12:19:14.085326 32713 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:14.093528 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 340626us
W20260709 12:19:14.096072 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 207365us
W20260709 12:19:14.100090 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 187698us
W20260709 12:19:14.095369 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 198644us
I20260709 12:19:14.119306 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:14.121408 28675 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.122131 28505 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 5 to 7, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:14.131984 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:14.134760 28675 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:14.136690 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:14.134613 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:14.131456 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.124619 32669 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:14.145469 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 326782us
I20260709 12:19:14.152967 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.156211 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:14.138761 32324 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.126631 32541 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 12:19:14.138794 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 265919us
I20260709 12:19:14.163069 29320 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:14.165450 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:14.166124 29317 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:14.166375 32767 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:14.166954 32767 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:14.167191 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.147396 28505 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 7 to 9, pending config changed. New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:14.167924 32767 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.168695   308 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:14.169365 28505 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 6, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 6 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:14.170521   307 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:14.170985   307 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:14.170030   308 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.173273 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:14.178546 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.179548 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:14.180348 32344 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.181106 32344 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:14.181432 32344 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.181831 32344 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.182080 32679 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.163691 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:14.187633 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.171851 28505 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 4 to 7, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:14.171873   307 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:14.193233 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 61820.5us
I20260709 12:19:14.198426 28679 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:14.199628 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:14.141934 32665 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:19:14.196640 28505 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:14.203672 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:14.204510 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.230058 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:14.232224 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.229700 28505 catalog_manager.cc:5697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 5 to 6, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 6 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:14.236529 32418 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:14.237373 28677 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:14.149642 32581 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:19:14.235813 32344 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.206368 32324 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:14.247100 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 115837us
I20260709 12:19:14.247505 32242 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.160854 32669 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.253643 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.204816   308 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:14.255072 29292 leader_election.cc:336] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.647s (SENT)
W20260709 12:19:14.257231 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 69667.5us
I20260709 12:19:14.257987 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.212384 32640 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:14.267210 28756 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:14.268204 28748 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:14.211251 32672 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:14.268577 28751 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:19:14.271698 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.272915 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.268746 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.288398 28753 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:14.282131 32679 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:14.290122 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 137228us
I20260709 12:19:14.291047 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:14.294872 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48687.2us
I20260709 12:19:14.295769 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:14.299851 32640 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:14.292049 32710 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.301316 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.301092 32640 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.302470 32710 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:14.277941 32714 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.201339   310 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:19:14.207791   325 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:19:14.259254   307 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:14.258857 32589 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:19:14.310582 32589 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:14.310940 32589 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:14.311753 32589 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.312911 32589 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.314235 32418 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.316201 32672 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:14.299968   326 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.319828 29317 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:14.266899 32669 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:14.266748 32242 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:14.330117 28756 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:14.337399 28756 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:14.335423 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:14.347327 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49612.1us
I20260709 12:19:14.351989 32488 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:14.324592 32536 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.354336 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.352399 32713 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:14.363299 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:14.363958 29320 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:14.366400 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 111352us
I20260709 12:19:14.369024   306 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.336266 32714 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.369685 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:14.346709 32679 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:19:14.373217   323 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:14.373659   323 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:14.374481   323 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.356395 32488 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:14.375892   323 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:14.317183 32672 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:14.381349 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58218.7us
I20260709 12:19:14.386781 28751 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
W20260709 12:19:14.367411 29292 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.660s (SENT) [suppressed 46 similar messages]
I20260709 12:19:14.398516 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.398576 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.399494 28751 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:14.399657 28753 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:19:14.400972 28648 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.976s (SENT)
I20260709 12:19:14.406554 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.407971 28756 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:14.414553 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 47178us
I20260709 12:19:14.407868 29320 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:14.365975   325 consensus_queue.cc:1243] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:19:14.420122 28748 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:14.422261 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 121028us
W20260709 12:19:14.413455 32765 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:19:14.426821 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.428952 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.376148 32488 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:14.423743 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 132792us
I20260709 12:19:14.445240 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.446446 28748 raft_consensus.cc:2410] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:19:14.419731 32713 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 12:19:14.449595 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.426448 32566 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.452014 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:14.471098 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:14.453368   309 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.396s	user 0.003s	sys 0.001s
I20260709 12:19:14.448578 32650 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:14.425120 32679 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:19:14.424286 32714 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:19:14.485569 32714 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:14.486070 32714 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:14.487336 29320 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:19:14.487053 32714 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.490559 32650 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.491106 32650 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:14.496943 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:14.464774 32566 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.500397 32566 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:14.469129 32344 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:14.470445 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 949) took 1763 ms. Trace:
I20260709 12:19:14.501272 29323 rpcz_store.cc:276] 0709 12:19:12.707515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.838158 (+130643us) service_pool.cc:224] Handling call
0709 12:19:12.838558 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:12.966047 (+127489us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:13.155838 (+189791us) log.cc:844] Serialized 14 byte log entry
0709 12:19:14.099095 (+943257us) log.cc:844] Serialized 14 byte log entry
0709 12:19:14.283164 (+184069us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18001c4020. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:19:14.283434 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 12:19:14.283799 (+   365us) log.cc:844] Serialized 14 byte log entry
0709 12:19:14.283966 (+   167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:14.287825 (+  3859us) log.cc:844] Serialized 26 byte log entry
0709 12:19:14.288019 (+   194us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:14.296697 (+  8678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.296803 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:14.470237 (+173434us) raft_consensus.cc:1685] finished
0709 12:19:14.470258 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:14.470386 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137310,"prepare.queue_time_us":222673,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":105,"raft.queue_time_us":138477,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":14688,"spinlock_wait_cycles":4301056,"thread_start_us":827868,"threads_started":2,"wal-append.queue_time_us":654748}
W20260709 12:19:14.471549 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45568.5us
I20260709 12:19:14.503787 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:14.504972 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.505198 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.505896 28747 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:14.506675 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.507668 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.504053 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.508677 28753 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:14.508774 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.509292 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.508204 28747 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:14.509660 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.510411 28753 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:14.511144 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.472641 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.510284 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.513008 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.513119 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.513295 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.514286 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.514340 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.515251   346 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:14.472532   343 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:14.509506 28751 raft_consensus.cc:2368] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10.
I20260709 12:19:14.517163   342 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:14.514165   326 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:14.523694 28753 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
W20260709 12:19:14.523633 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51084.7us
I20260709 12:19:14.560125 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.561134 28677 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:14.562546 28674 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:14.524504   325 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:14.526995 32541 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:14.514191 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.581501 28752 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
W20260709 12:19:14.531127   332 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 12:19:14.514698 28748 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:14.557164   326 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:14.567404 28749 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:14.574523 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.576247 28606 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:14.552116   343 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:14.588373 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 156175us
W20260709 12:19:14.589375 28648 leader_election.cc:336] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.028s (SENT)
I20260709 12:19:14.556836 32714 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.599946 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:14.602279 28756 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:14.611856 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.577842   325 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.615790 28602 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:14.616479 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.617225 28748 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.580897 32682 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.618790 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.583159 32242 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:19:14.621424 32242 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:14.621794 32242 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:14.622718 32242 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.623433 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.623914 32242 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:14.624969 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.625186 28606 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:14.625566 28603 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:14.626179 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.626399 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.627257 28601 raft_consensus.cc:2410] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:19:14.629103 28648 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.076s (SENT)
I20260709 12:19:14.630242 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.618726   302 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:14.631583 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.633607 28602 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:14.592922   310 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:19:14.556869   346 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.633514 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.632524 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:14.637164 28599 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:14.637481 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.637923   346 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:14.604176 32679 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:19:14.636689 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:14.642001   343 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.643443   343 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:14.645011   326 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:14.646806   326 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:14.647353 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.648478 28600 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:19:14.639482 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.620123   325 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.639549 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.650082 28752 raft_consensus.cc:2410] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:19:14.652137 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.652395 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.653800   310 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:14.657387 28603 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:19:14.633183 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.657930 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:14.658640 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48054.2us
I20260709 12:19:14.658725 28600 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:14.658116 28604 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
W20260709 12:19:14.660281 29292 leader_election.cc:336] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.981s (SENT)
I20260709 12:19:14.660768 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:14.661885 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.663025 32713 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:14.670636 32713 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:14.679152 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:14.680972 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.681445 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:14.681805 28604 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:19:14.685122 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:14.685861 28749 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:14.686641 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:14.687320 29321 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
I20260709 12:19:14.685902 29318 raft_consensus.cc:2368] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11.
I20260709 12:19:14.690572 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:14.691126 29321 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:14.691282 28600 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:14.693872 28748 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:14.700634 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.700696 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:14.708590 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.713132 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:14.713436 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.713793 29322 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.714933 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.715238 28756 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:19:14.715782 28749 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:14.690435 32536 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.731503 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.731788 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.732993 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.733160 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:14.733798 28607 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:14.734319 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:14.734565 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.732187 28599 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:14.735266 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.735917 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.736574 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.736825 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.736946 28599 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:14.738498 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.740890 28599 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:14.745292 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.746624 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.747892   346 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:14.694265 32650 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.748739   346 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:14.749079 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.749836 28598 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:14.749589   346 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:14.749660 32537 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:14.750213   346 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:14.750329 32650 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:14.750696 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:14.751513 28598 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:14.751524   346 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:14.752653 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.752856   346 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.719401   342 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:14.720054 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.721246 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.738440 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.721387 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.754040 28602 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
W20260709 12:19:14.724609 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 95513.8us
I20260709 12:19:14.718346 28756 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:19:14.692773   328 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.737295 28604 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:14.737373 28605 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:14.752521 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.720533 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:14.752262 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:14.759949 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.749189 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.766920 28603 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:14.763572 28598 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 7: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:14.770313 28603 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:19:14.771611 32668 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.774201   325 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:14.775314 28600 raft_consensus.cc:2368] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:14.778791 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.779469 28749 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:14.726966 28721 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:14.783650 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56784.3us
I20260709 12:19:14.784332 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.784703 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:14.790308 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.800729 29322 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:14.802013 28606 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:14.803018 32665 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.803350 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.804173 32581 raft_consensus.cc:2764] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:19:14.804629 28721 leader_election.cc:400] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11.
I20260709 12:19:14.804949 28721 leader_election.cc:403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:14.805440 28755 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:14.806388 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:14.811523 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.812803 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:14.776275   325 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:14.813495 28602 raft_consensus.cc:2376] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11. Re-sending same reply.
W20260709 12:19:14.838021 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46539.4us
I20260709 12:19:14.838723 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:14.808059   307 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:14.855458 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 50937.3us
I20260709 12:19:14.859189 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:14.860914 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.861112 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:14.861724 28602 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:14.865658 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 81008.9us
I20260709 12:19:14.867355 29292 leader_election.cc:400] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10.
I20260709 12:19:14.868266 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.880714 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:14.881327 32537 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.882450 32537 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:14.882828 32537 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.883152 32537 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:14.845579   353 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.885216 32695 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:14.894569 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 55949.5us
I20260709 12:19:14.895566 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:14.766180 32650 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 12:19:14.872258   354 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:19:14.852210 32581 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11.
I20260709 12:19:14.915372 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.903457 32640 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:19:14.916507 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 57435.8us
I20260709 12:19:14.906888   308 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:14.930032 28607 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:14.937839 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:14.920189 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:14.920946   346 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.921406 32755 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:14.919898 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.946614 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.948567 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.934540   308 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:14.956684 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:14.958323 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:14.960711 28752 raft_consensus.cc:2376] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9. Re-sending same reply.
I20260709 12:19:14.965147 28599 raft_consensus.cc:2410] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:19:14.965131 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:14.974279 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54487.2us
I20260709 12:19:14.948529 32581 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:14.980422 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.984213 28601 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:14.975255 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:14.948467 32536 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.986500 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:14.963002   308 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:14.961156   342 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.961567   337 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.981877 32672 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:14.983738 32713 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:15.004321 28602 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:15.016777 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:15.002324 32672 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.017997 32672 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:15.018126 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:15.004410   353 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:15.021070   353 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:15.070708 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:15.089682 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 127805us
I20260709 12:19:15.045258 32640 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:15.127838 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 134817us
I20260709 12:19:15.131414 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.132205 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:15.132548 28602 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:15.123736 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 150017us
I20260709 12:19:15.022253   353 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.139227 32755 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:15.149796 28648 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.558s (SENT)
I20260709 12:19:15.150228 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.134188 32714 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:15.135949 32650 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.152704 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.165194 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.166254 28602 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:15.170836 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.152232 32242 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.149744   326 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.151909   369 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:15.202257 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 55441.4us
I20260709 12:19:15.158775 32581 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:15.204319 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.173270   343 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.211107 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:15.171458   310 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.168021   371 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:15.219265 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 67183.9us
I20260709 12:19:15.221050 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:15.221781 28602 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:15.171698 32650 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.169274 32714 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:15.246768 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 100434us
I20260709 12:19:15.215999   346 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:15.216099   369 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:15.259021 28602 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:15.261654 32581 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.263592 32650 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:15.235056   371 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.209550 32640 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.266619   371 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:15.206821 32242 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.266563 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.208169   326 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.277729 28598 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:15.280656 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:15.283722 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.294016 28605 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 7.
I20260709 12:19:15.222327 32537 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.296541 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:15.296761 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48987.6us
I20260709 12:19:15.303115 28602 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:15.307251 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:15.307725 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:15.313360 32242 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:15.218791   310 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.219061   343 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.314453 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:15.318552 28602 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:15.301815   365 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
I20260709 12:19:15.314401 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.321805 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.327373 28598 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:15.337499 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:15.345744   369 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.348789 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:15.349624 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.350364 28598 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:15.350244 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.351011 28599 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13.
I20260709 12:19:15.351212 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.351738 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.353124 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:15.354334 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:15.355312 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:15.356078 32710 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:15.356348 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:15.356757 32710 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:15.356657   378 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:15.356962 28753 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:15.357394   378 consensus_queue.cc:1243] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:19:15.357653 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.264127 32755 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.352304 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.361374 28599 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:15.361399 28598 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:15.370792 28599 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:19:15.314184   390 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:19:15.375494 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49724.2us
I20260709 12:19:15.381323 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.381943 28598 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:15.388391 28602 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
W20260709 12:19:15.389485 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:15.392655 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.418282 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:15.422667 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.398700 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.432808 28599 raft_consensus.cc:2410] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:19:15.453693 28604 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:15.458819 28605 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:15.461755 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:15.462579 28598 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:15.464259 29323 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:19:15.417157 32536 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:15.465764 32536 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.471553 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:15.472116 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 53912.9us
W20260709 12:19:15.456482   360 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.454s	user 0.008s	sys 0.000s
I20260709 12:19:15.491003 28607 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:19:15.476161 32679 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:15.499377 28607 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:19:15.499874 28607 pending_rounds.cc:85] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 7
I20260709 12:19:15.500134 28607 pending_rounds.cc:107] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:19:15.501139 28607 raft_consensus.cc:2889] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:15.493021 32588 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:19:15.531407 28607 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:19:15.534811 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 312879us
I20260709 12:19:15.510334 32714 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:15.540253 32589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.022s
I20260709 12:19:15.554106 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:15.557740 28607 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:19:15.558918 28751 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:15.559804 28607 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:15.561172 28607 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:15.579622 28751 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:19:15.546473 32672 consensus_meta.cc:287] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.004s
W20260709 12:19:15.562080 32589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.001s	sys 0.023s
I20260709 12:19:15.553959 32536 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:15.540620   371 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:19:15.599400 28607 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:15.571437 32537 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:15.599388   343 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:15.635411 32713 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:15.636042 32713 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:15.636155 28607 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:15.637611 28607 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:15.586315 32672 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.638805 28607 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:19:15.639652 28674 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:15.644066 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 80646.9us
I20260709 12:19:15.651201 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:15.637825   308 consensus_meta.cc:287] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 12:19:15.654297 28603 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:19:15.705367 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 47214.4us
W20260709 12:19:15.757436 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.661914   369 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:19:15.650324 32537 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:19:15.654884   353 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:15.656903   308 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.773387 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:15.766793   405 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:19:15.810741 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:15.806088   399 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:19:15.821283 32679 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:15.821506   308 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:15.800767   406 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:15.827147 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.804744   303 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:15.830197   303 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:15.831041   303 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.832105   303 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:15.836786 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:15.839515 28673 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:15.837585 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:15.840605 28679 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:15.843286 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:15.849880 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:15.817067   353 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:15.810760 32537 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:19:15.842424   379 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:15.870205 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67614us
I20260709 12:19:15.868656 32581 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:15.853915 32714 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:19:15.875507   367 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.745s	user 0.001s	sys 0.004s
I20260709 12:19:15.875650 32581 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.876034   310 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:15.877892 32581 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:15.876706   395 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:15.876770   373 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.880584 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:15.878765   395 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.883055   395 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:15.883875   380 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.542s	user 0.001s	sys 0.015s
I20260709 12:19:15.879271 32714 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.886013 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.890275 32714 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:15.895854 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.869645   379 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.894007 32537 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:15.903366 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:15.907819 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.908993 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.906282 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.914427 28602 pending_rounds.cc:85] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 3
I20260709 12:19:15.914706 28602 pending_rounds.cc:107] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:19:15.914928 28602 raft_consensus.cc:2889] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:15.888085   373 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.917287 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.917416 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:15.915997   407 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:19:15.899371   369 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:15.900563 32672 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:15.919422 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2419) took 1078 ms. Trace:
I20260709 12:19:15.915956 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:15.920792 28603 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:15.921132 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:15.921643 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:15.924070 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.923760 28606 rpcz_store.cc:276] 0709 12:19:14.841103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.368575 (+527472us) service_pool.cc:224] Handling call
0709 12:19:15.368897 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:15.376712 (+  7815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:15.376754 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:15.453158 (+ 76404us) log.cc:844] Serialized 26 byte log entry
0709 12:19:15.663636 (+210478us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:15.663672 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:15.663741 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:15.919207 (+255466us) raft_consensus.cc:1685] finished
0709 12:19:15.919227 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:15.919355 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":16453,"thread_start_us":173113,"threads_started":1,"wal-append.queue_time_us":392526}
I20260709 12:19:15.925235 28607 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:15.925751 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.925410 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:15.927496   395 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:15.927721   302 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.928092   395 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:15.923817   308 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:15.928714 32537 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:15.928267   302 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.929008   381 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:15.915514 32710 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:15.901947 32713 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:15.942579 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.950044 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:15.920744 32581 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:15.946835   381 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:15.937907   325 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:15.961776 32713 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:15.963156   379 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:15.942370   369 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:15.967077   302 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:15.944648 32710 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.968863 32710 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:15.969201   395 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:15.957235   381 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:15.972425   373 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:15.972913   419 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:19:15.949432   402 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:15.957722 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:15.978575 32537 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:15.978962 32537 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:15.979466 32537 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:16.009851 32537 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:16.027599   369 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:16.017642 32714 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:16.041705 32714 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:16.041945 32537 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:16.043439   381 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:16.045603   381 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:16.046135 32710 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:16.049042 32710 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:15.978840 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:16.222941 32537 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:19:16.223095 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 244282us
I20260709 12:19:16.223407 32537 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:16.223801 32537 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:16.223959 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:16.224800   369 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:16.225737 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:16.227205 29317 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:16.228132 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:16.230981 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:16.232664 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:16.233476 29317 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:16.233434 32537 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:16.234534 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:16.235204 29317 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:16.235737 32537 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:16.261593   326 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:16.291801 32668 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:16.292313 32668 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:16.293322 32668 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:16.294584 32668 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:16.316736   368 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:16.317243   368 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:16.317916   368 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:16.319041   368 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:16.344794   417 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.502s	user 0.004s	sys 0.000s
I20260709 12:19:16.347352 32668 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:16.348119 32668 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:16.351081 32668 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:16.359493 29317 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:16.367596 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:16.375433 29317 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:16.377251 29317 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:16.427807 29321 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:19:16.428866 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.429742 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:16.430876 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:16.432775 28602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.017s	sys 0.000s
W20260709 12:19:16.433161 28602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.017s	sys 0.000s
I20260709 12:19:16.433714 29325 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:16.433539 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:16.436795 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:16.440040 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:16.442042 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:16.446163 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:16.447043 28602 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:16.448338 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:16.449354 28602 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:16.451414 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:17.184588 29291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.006s	sys 0.005s
W20260709 12:19:17.185142 29291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.006s	sys 0.005s
W20260709 12:19:17.185609 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.321476   432 raft_consensus.cc:2764] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:19:17.322531   432 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.323177   432 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.325872   432 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.361847   432 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.391346   432 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.415897   432 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:17.611470 28572 connection.cc:256] RPC call timeout handler was delayed by -1.0473362969999016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:19:17.622048 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.007s	sys 0.003s
W20260709 12:19:17.622108 28607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.005s	sys 0.009s
W20260709 12:19:17.622601 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.007s	sys 0.003s
W20260709 12:19:17.622783 28607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.006s	sys 0.010s
I20260709 12:19:17.623225   434 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:17.623740 32714 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:17.624979   432 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.625530   432 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.626096   433 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:17.626523 29348 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9f80 after lost signal to thread 27449
I20260709 12:19:17.627818   432 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.630404   432 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.630193   433 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.631011   432 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.624552   434 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.633378   434 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:17.634192   432 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.634153   434 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:17.634797   432 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.635293   432 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.636034   434 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.624629 32714 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.636861 32714 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.637331 32714 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.639197 32714 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.639569 28602 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:17.639663 32714 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.641309 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:17.641938 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.642086 28602 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 7.
I20260709 12:19:17.643725   434 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.644624 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:17.645170 28602 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:17.650230 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.650851 29321 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:17.653658   433 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:17.654342   433 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.654737   433 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.656776   433 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.657234   433 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.664225   435 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.666240   437 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.669234 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 660) took 1225 ms. Trace:
I20260709 12:19:17.669214   432 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.640322 32714 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.657621   433 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.675414   433 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.676060   433 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:17.676645   433 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.679066   433 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.680182   433 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:17.670210 28607 rpcz_store.cc:276] 0709 12:19:16.443880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.470589 (+ 26709us) service_pool.cc:224] Handling call
0709 12:19:16.471078 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:16.471489 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:16.471527 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:16.472142 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:19:17.623309 (+1151167us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:17.623359 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.623427 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:17.668898 (+ 45471us) raft_consensus.cc:1685] finished
0709 12:19:17.668931 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:17.669130 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1164423,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1150737,"threads_started":1,"wal-append.queue_time_us":1150053}
I20260709 12:19:17.681747   433 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.666394   435 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.694929   435 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.695593   435 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:17.696913 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 1.7468e+06us
I20260709 12:19:17.697455   434 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.698194   434 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:17.698588   434 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:17.698705 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:17.666873   437 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.704375   437 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.700354 28722 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13.
I20260709 12:19:17.704927   437 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.705000 28722 leader_election.cc:403] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:17.705418   437 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:17.706323 28605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.776s	user 0.002s	sys 0.031s
W20260709 12:19:17.706777 28605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.776s	user 0.002s	sys 0.031s
I20260709 12:19:17.700842   433 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.707296 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:17.682039 32714 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.681751   439 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.696146   435 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.699640   434 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.712684   438 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.720963 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:17.723781   438 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.724345   432 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:17.724766   432 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.725134   432 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:17.726194   438 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.714464   439 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.728005   435 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.728788 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.715350   433 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:17.716159 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:17.729348   435 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.729385 29321 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:17.729872   435 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.718271 32589 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:17.730480 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:17.740998 32589 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.741287 32242 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.741616 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:17.741853 32242 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.743006 32589 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.707505   437 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.744918   442 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.745538   442 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.724100 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2089) took 1807 ms. Trace:
I20260709 12:19:17.722658 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:17.736878 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.737782 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.748420 29317 raft_consensus.cc:2410] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:19:17.738368 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.739816   433 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:17.749363 29325 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 7.
I20260709 12:19:17.755453 32242 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.755254   433 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.756003 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:17.756142 32242 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.756652 28601 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:17.740486   434 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:17.745040   437 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.732601   438 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.733660 32714 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.753329 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.759361 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.759969 29325 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
W20260709 12:19:17.760775 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.746755 28605 rpcz_store.cc:276] 0709 12:19:15.916332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.916568 (+   236us) service_pool.cc:224] Handling call
0709 12:19:15.916877 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.917033 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:17.707126 (+1790093us) log.cc:844] Serialized 14 byte log entry
0709 12:19:17.723759 (+ 16633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:17.723818 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:17.723867 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:17.723932 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:17.724040 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21797,"prepare.queue_time_us":115948,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":1780862,"threads_started":2}
I20260709 12:19:17.752352 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:17.729480   439 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.764923 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:17.765942 28607 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:17.766868   439 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:17.756686 32242 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.767303   439 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.767700   439 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:17.772895 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.774173 29327 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
W20260709 12:19:17.775110 29327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 904) took 1547 ms (client timeout 1722 ms). Trace:
W20260709 12:19:17.775602 29327 rpcz_store.cc:269] 0709 12:19:16.227331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.763516 (+1536185us) service_pool.cc:224] Handling call
0709 12:19:17.775042 (+ 11526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:17.763754 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:17.766860   442 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.783473 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:17.784245 28601 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:17.763260   438 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.763075   437 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.763720 32714 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.790220   444 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:17.791241   444 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13.
I20260709 12:19:17.793273   444 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.794061   444 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:17.794811   444 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:17.795221   444 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.795660   444 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:17.797240   435 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.800256   435 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:17.800869   435 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.797984   450 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:17.808712   435 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:17.808882   450 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.809620   450 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.805263   451 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:17.813766 32242 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.791070   448 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.782487   432 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.827245 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:17.852909 29321 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:17.829607 32242 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:17.864945 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:17.865628 28601 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:17.867096   452 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.867625   452 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.869831   452 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.870371   452 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:17.860613 32242 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:17.872772 32242 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:17.877374   438 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.877769 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:17.878360 28601 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.879319   437 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.880766   432 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:17.882264   432 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:17.882048   444 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.882741   432 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.884127   444 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:17.872215   439 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.876199   435 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.887095   303 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:17.887635   303 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.886741 32714 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:17.884532   446 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:19:17.889539   303 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.889947   446 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:17.890000   450 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:17.890566   303 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:17.891083   303 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.891383   446 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:17.891660 28601 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:17.892033   450 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:17.893193   446 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.893761   446 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.895569   370 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:17.896128   370 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:17.886725   444 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:19:17.929597   448 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.968288   446 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.992980   435 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:17.871984   452 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:18.032361   450 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.033306   450 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:18.257234 32714 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.278975   452 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:18.279085 32714 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:18.279647   452 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:18.302067 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:18.302996 29327 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:18.255429   448 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.254515   326 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:18.314599   326 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:18.282372   444 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:18.317494   444 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:18.321133   452 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:18.322783   452 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:18.338215   448 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:18.341607   448 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:18.367277   448 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:18.367385 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:18.367825   448 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:18.368250 29317 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
W20260709 12:19:18.374621 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.433315   438 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.434151   438 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:18.434749 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:17.894049 32242 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:18.734365 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.959903 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:18.965767   455 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:18.966459   455 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:18.994321 29318 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 7. Current term is 8. Ops: []
W20260709 12:19:18.999047 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:18.999243 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 901) took 2772 ms. Trace:
I20260709 12:19:18.999809 29318 rpcz_store.cc:276] 0709 12:19:16.226492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:18.993769 (+2767277us) service_pool.cc:224] Handling call
0709 12:19:18.994121 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:18.998870 (+  4749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:18.999162 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:18.958706   439 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:18.369076   448 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:18.968653   450 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:18.994253   432 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:19.032624   453 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.033296   453 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:19.010538   303 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.034891 32679 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:19.035105   303 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.035468 32679 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:19.010977   434 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.036790   434 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:19.039080   434 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.005504   450 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.040472   450 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:19.035557   303 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:19.049592 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:19.050581   450 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.051137   450 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.051501   303 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:19.051592   450 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:19.010056 32242 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:19.000883   451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.149s	user 0.028s	sys 0.051s
I20260709 12:19:19.054406 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:19.004019   370 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.005053   448 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:19.021351   444 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.057446 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:19.059604   370 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.059655 28679 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:19.060213 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:19.061615   370 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:19.062175 28598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 662) took 2617 ms (client timeout 1907 ms). Trace:
W20260709 12:19:19.062573 28598 rpcz_store.cc:269] 0709 12:19:16.444551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.061982 (+2617431us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:19.062093 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:19.063731   370 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:19.066087 29321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 918) took 1331 ms (client timeout 1743 ms). Trace:
W20260709 12:19:19.066490 29321 rpcz_store.cc:269] 0709 12:19:17.734941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:17.735076 (+   135us) service_pool.cc:224] Handling call
0709 12:19:19.065863 (+1330787us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540042a9d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:19.066003 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240805632}
I20260709 12:19:19.068810   328 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.069365   328 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:19.071432   328 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.073033   450 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:19.074863 32710 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.075387 32710 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:19.076812 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:19.077430 28673 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:19.082978   435 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.083556   435 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:19.086186   435 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:19.086825   435 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.061147   326 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.091609 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:19.093113 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:19.094002   455 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:19.095315 28606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 661) took 2651 ms (client timeout 1925 ms). Trace:
I20260709 12:19:19.093313   454 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.013036   438 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.087479   435 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:19.058182   451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.028s	sys 0.052s
W20260709 12:19:19.095883 28606 rpcz_store.cc:269] 0709 12:19:16.444213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.095043 (+2650830us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:19.095200 (+   157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:19.151301 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:19.153237 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:19.152256 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.178591 28674 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
W20260709 12:19:19.169137 29320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 900) took 2942 ms (client timeout 1865 ms). Trace:
I20260709 12:19:19.149436 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:19.180135 29320 rpcz_store.cc:269] 0709 12:19:16.226248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.168870 (+2942622us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:19.169044 (+   174us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:19.139967 29290 connection.cc:256] RPC call timeout handler was delayed by -1.9765832630000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 12:19:19.113500 29319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 899) took 2887 ms (client timeout 1990 ms). Trace:
W20260709 12:19:19.184118 28720 connection.cc:256] RPC call timeout handler was delayed by -1.7738726499999302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 12:19:19.184800 28720 connection.cc:256] RPC call timeout handler was delayed by -1.7737988120002228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:19:19.185315 28720 connection.cc:256] RPC call timeout handler was delayed by -1.2393155400000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 12:19:19.185809 28721 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.039s	sys 0.069s
W20260709 12:19:19.186215 28721 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.039s	sys 0.069s
I20260709 12:19:19.167603 28673 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
W20260709 12:19:19.186568 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 904723us
I20260709 12:19:19.089690   328 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.129408   452 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.000s
I20260709 12:19:19.188474 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:19.336452   326 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.189951 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:19.237877 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:19.275115 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:19.258401 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:19.141299   432 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.098033   453 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:19.190299 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:19.106741 32679 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:19.966481 28748 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:19.424175 28493 thread.cc:641] dir /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent creating pthread: real 3.491s	user 0.014s	sys 0.031s
I20260709 12:19:19.116200   433 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:19.784739 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.026s	sys 0.046s
W20260709 12:19:19.968734 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.027s	sys 0.047s
I20260709 12:19:19.969590 28749 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:19.967633   452 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:19.971522   453 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.972090   453 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:19.260679   438 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.272763 32714 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:19.182835   454 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:19.975920   453 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:19.835865 29291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.003s	sys 0.016s
I20260709 12:19:19.974447   438 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:19.976694 29291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.004s	sys 0.016s
W20260709 12:19:19.977799 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:19.979243 28748 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:19.141270 32537 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:19.137603   444 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:19.138496   448 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.970628 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:19.951014   328 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:19.137431 32581 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.138739   450 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:19.142200   369 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:19.952457 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 642696us
I20260709 12:19:19.160089   346 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.141098 32668 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:19.953084 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 635750us
I20260709 12:19:19.137820   308 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:19.954751 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.007462 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.010316 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:19.139154   434 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:19.270961   451 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.096271   455 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.274276   459 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.271328   457 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:19.151479   381 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:20.044625   381 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.046247 29321 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:20.046383 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.046875   381 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:19.184453 29319 rpcz_store.cc:269] 0709 12:19:16.225997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.113195 (+2887198us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:19.113369 (+   174us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:19.262640 28600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.022s	sys 0.053s
W20260709 12:19:20.048342 28600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.028s	sys 0.055s
I20260709 12:19:19.159579   406 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:19:19.957221 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 757844us
I20260709 12:19:19.958217 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:19.960040 28720 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.651s (SENT) [suppressed 25 similar messages]
W20260709 12:19:20.055521 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 95506.5us
I20260709 12:19:20.055639 28679 raft_consensus.cc:2410] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:19:20.054236 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:20.056577 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.056703 29319 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:19.961499   326 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:19.962924   432 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:19.964414 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2413) took 5228 ms. Trace:
I20260709 12:19:19.959010   395 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:19.964460 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:19.965375   435 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:20.058279   453 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:19:19.965469 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:19.965629 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:19.961102 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:19.100476 32710 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:19.971256   452 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:19.974476 28493 thread.cc:608] dir /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent starting thread: real 4.041s	user 0.015s	sys 0.031s
I20260709 12:19:19.975313   433 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:19.899435 29289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.010s	sys 0.006s
W20260709 12:19:20.077368 29289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.010s	sys 0.006s
I20260709 12:19:20.077206 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.075609 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.078620 28753 raft_consensus.cc:2410] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:19:19.160701   373 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:20.080101   373 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.080556 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.081301   433 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.082643   373 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.083431   433 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:20.083266   373 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:20.083959   433 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.977787   303 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:20.084738   303 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:20.087100   303 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:20.087716   303 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:20.015743 29318 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:20.089939   452 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.015345   451 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.090224   446 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:20.016065   434 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.017310 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.018808 28674 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:20.091894 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.092087 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.092682 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.093039 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.093421 28673 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:20.093302 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.094059 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.094298 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.094743 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.095108 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.020305 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.019484 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.022313   438 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.024457 32668 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.109697 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.110579 29318 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:20.110792 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.111624 32668 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:20.111979 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.112118 32668 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:20.114643 32668 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.026543 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.116066 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.117077 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.118010 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.119103 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.120725 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.121742 28682 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:19:20.121917 32668 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:20.101955   433 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.032572   461 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:20.093323   432 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:20.123277   461 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.123844 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.027297 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.124615   433 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:20.124748 28676 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:20.125795 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.004276 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.127296 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.127926 28748 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:20.128753 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.129321 28748 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:20.130119 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.130693 28748 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:20.034020   369 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.132427 29317 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:20.134097   369 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:20.136242 29326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 907) took 3908 ms (client timeout 1786 ms). Trace:
I20260709 12:19:20.120198 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:20.034969 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.137916   438 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:20.001382   450 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:19.976718   387 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:20.138635   438 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.139356   387 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.035475 28749 raft_consensus.cc:2410] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:19:20.049142   459 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.053339   454 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.058586 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.061156 28604 rpcz_store.cc:276] 0709 12:19:14.735851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:14.766360 (+ 30509us) service_pool.cc:224] Handling call
0709 12:19:15.453515 (+687155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.468749 (+ 15234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:19.964186 (+4495437us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b5400217350. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:19.964321 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579632896}
I20260709 12:19:20.065888 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.067062 28754 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:19:20.068089 28721 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:20.069128 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2425) took 5153 ms. Trace:
I20260709 12:19:20.070709 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.039978   462 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:20.073808 28747 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:19.982030 32537 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.090765   446 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:20.095255 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.020576   325 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:20.096597 29325 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:20.054236   406 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:19.983528   448 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.025007 28675 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:20.229112 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.229600 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.230459 28675 raft_consensus.cc:2410] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:20.073561   395 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.113044 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.232673 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.113950 28677 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:20.233549 28607 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:19:20.025928 28678 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:20.122611 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:19.983461 32581 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.137952 32710 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:19.983371   444 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:20.141459 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.241981 28748 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:20.242511 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2149) took 1051 ms. Trace:
I20260709 12:19:20.242957 28748 rpcz_store.cc:276] 0709 12:19:19.190821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.131270 (+940449us) service_pool.cc:224] Handling call
0709 12:19:20.242450 (+111180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:20.136802 29326 rpcz_store.cc:269] 0709 12:19:16.228169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.135987 (+3907818us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:20.136135 (+   148us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:20.230367 32344 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:20.244691 32344 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.244617 32710 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.144397 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:20.142514 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:20.166034 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:20.145357 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 91942.3us
I20260709 12:19:20.166270 28600 rpcz_store.cc:276] 0709 12:19:14.915915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.446140 (+530225us) service_pool.cc:224] Handling call
0709 12:19:18.536670 (+3090530us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b5800003398. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:19:18.536971 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:18.537425 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:18.537463 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:18.538053 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:19:20.048727 (+1510674us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:20.048768 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:20.048834 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:20.048863 (+    29us) raft_consensus.cc:1685] finished
0709 12:19:20.048870 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:20.069040 (+ 20170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":466506,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":19282816,"thread_start_us":1510249,"threads_started":1,"wal-append.queue_time_us":1412690}
W20260709 12:19:20.166085 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 98068.8us
I20260709 12:19:20.246975 28604 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:20.204846 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2153) took 1013 ms. Trace:
I20260709 12:19:20.207571 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2152) took 1016 ms. Trace:
I20260709 12:19:20.197520 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:20.246093 29323 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:20.231302 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.247412 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:20.232831 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:20.014219   308 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:20.237577 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.237214 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2156) took 1032 ms. Trace:
I20260709 12:19:20.265483 28747 rpcz_store.cc:276] 0709 12:19:19.197377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.965400 (+768023us) service_pool.cc:224] Handling call
0709 12:19:20.229977 (+264577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:20.266517 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:20.268674 28721 connection.cc:256] RPC call timeout handler was delayed by -1.2112093700000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:19:20.239646 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 94336.8us
I20260709 12:19:20.235163 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.261155 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.273351 28753 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:20.273411 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.274273 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.275156 28677 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:20.276227 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.267108 28747 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:20.278177 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.245246 32344 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:20.246328 28602 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:20.041039   346 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:20.246284 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 101967us
I20260709 12:19:20.248524 28754 rpcz_store.cc:276] 0709 12:19:19.191598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.165616 (+974018us) service_pool.cc:224] Handling call
0709 12:19:20.207090 (+ 41474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.207254 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:20.207276 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:20.207314 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:20.207342 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:20.207389 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:20.207517 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:20.249461 28606 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:20.249003 28674 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:20.250275 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.251262   395 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.251967   460 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:20.252177   444 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:20.237136   325 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.253645   406 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:20.255837 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.255736 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.301982 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.302971 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.258307 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2159) took 1060 ms. Trace:
I20260709 12:19:20.247848 28749 rpcz_store.cc:276] 0709 12:19:19.191874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.970377 (+778503us) service_pool.cc:224] Handling call
0709 12:19:20.204783 (+234406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:20.049602   455 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.279847 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.308900 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.309557 29326 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:20.309908 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.310389 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.280931 29318 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:20.312141 29318 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:19:20.312486 29318 pending_rounds.cc:85] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 7
I20260709 12:19:20.312762 29318 pending_rounds.cc:107] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:19:20.312989 29318 raft_consensus.cc:2889] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:20.281368 32566 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:20.285831 28647 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:20.286621   464 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.259848   402 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:20.289140 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.290494 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.291307 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.055851   457 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.294783 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.320851 28747 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:20.321280 29317 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:19:20.283344 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:20.300933 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.305895 28748 rpcz_store.cc:276] 0709 12:19:19.198241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.244154 (+1045913us) service_pool.cc:224] Handling call
0709 12:19:20.257785 (+ 13631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.257985 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:20.258015 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:20.258058 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:20.258089 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:20.258146 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:20.258253 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:20.307761 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:20.283320 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.322074 28607 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:20.326715 28682 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:19:20.327106 28682 pending_rounds.cc:85] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 8
I20260709 12:19:20.327307 28682 pending_rounds.cc:107] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:19:20.327558 28682 raft_consensus.cc:2889] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:20.229931   462 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.326123 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:20.329684 29318 raft_consensus.cc:2376] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8. Re-sending same reply.
I20260709 12:19:20.330260 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.309995   395 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:20.333595 29321 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:20.339622 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.341125 28748 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:20.309185   433 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:20.339599 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.342931 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.323779   406 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:20.326464   402 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.350118 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.354503   326 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.260087   454 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:19:20.324559 32566 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.325371   464 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.315277   446 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.374034 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:20.662946 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.419225 28602 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:20.328998   373 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:20.373768 28599 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 4.442s	user 0.006s	sys 0.049s
I20260709 12:19:20.649596 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.392729 28606 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:20.666322 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.663170 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.357223 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:20.668020 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 408317us
I20260709 12:19:20.391665 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.350543   470 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:19:20.625027 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 309142us
I20260709 12:19:20.380889 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.357857 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.663410 28607 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
W20260709 12:19:20.670971 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:20.735365 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.746809 29318 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
W20260709 12:19:20.687430 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.747884 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:20.747234 28603 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:20.749433 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.749799 29317 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:20.750139 28603 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:20.699823 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2142) took 1511 ms. Trace:
I20260709 12:19:20.698351 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.752728 28602 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:20.749433 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.753901 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.754500 28751 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:20.755399 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2148) took 1564 ms. Trace:
I20260709 12:19:20.756266 28751 rpcz_store.cc:276] 0709 12:19:19.190518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.649252 (+1458734us) service_pool.cc:224] Handling call
0709 12:19:20.755332 (+106080us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:20.432580   414 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 4.546s	user 0.026s	sys 0.027s
I20260709 12:19:20.346956   370 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:20.765056 28679 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
W20260709 12:19:20.764264 28648 connection.cc:256] RPC call timeout handler was delayed by -3.2187156200000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
I20260709 12:19:20.344748   328 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:20.765955 28750 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.001s	sys 0.051s
I20260709 12:19:20.356724   402 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:20.406183   381 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.356253   438 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.752269 28752 rpcz_store.cc:276] 0709 12:19:19.188713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.698741 (+1510028us) service_pool.cc:224] Handling call
0709 12:19:20.699137 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.699374 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:20.699423 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:20.699483 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:20.699535 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:20.699606 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:20.699748 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:20.758111 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.426910   434 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.825320 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.766973 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.410351   462 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:20.434075   346 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:20.795432 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.393596 32679 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.402s
I20260709 12:19:20.420403   461 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:20.661330   459 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.409502   387 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:20.796274 28599 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 4.869s	user 0.014s	sys 0.077s
I20260709 12:19:20.797545 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:20.802321   373 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:20.812661 28648 connection.cc:256] RPC call timeout handler was delayed by -3.1249226050001653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 12:19:20.843047 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:20.843313 28648 connection.cc:256] RPC call timeout handler was delayed by -3.1249226050001653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:19:20.843827 28648 connection.cc:256] RPC call timeout handler was delayed by -3.1143156200000703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 12:19:20.844027 28601 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:20.844241 28648 connection.cc:256] RPC call timeout handler was delayed by -3.00451562000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 12:19:20.844733 28648 connection.cc:256] RPC call timeout handler was delayed by -2.9919156200001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 12:19:20.845048 28648 connection.cc:256] RPC call timeout handler was delayed by -2.9919156200001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 12:19:20.845402 28648 connection.cc:256] RPC call timeout handler was delayed by -2.84521562000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 12:19:20.845685 28648 connection.cc:256] RPC call timeout handler was delayed by -2.84521562000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 12:19:20.767062   453 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:19:20.848968 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:20.797556 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49746.1us
I20260709 12:19:20.849680 28606 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:20.813259   370 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.751960   451 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.342670 32672 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.423s
W20260709 12:19:20.816237 28750 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.001s	sys 0.051s
I20260709 12:19:20.344762   395 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:20.830657 28602 raft_consensus.cc:2410] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:19:20.830298 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.856137 28752 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:20.820513 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.856688 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.857112 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.857259 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.857750 28602 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:20.857935 29317 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:20.858738 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.858847 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.622707 32344 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.829437 28751 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:20.847874   434 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:20.841787 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44371.1us
I20260709 12:19:20.863375 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2444) took 4949 ms. Trace:
I20260709 12:19:20.846215 32710 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.766197   446 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:20.846014 28648 connection.cc:256] RPC call timeout handler was delayed by -2.8308156200000667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
I20260709 12:19:20.843096   373 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:20.849336   457 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.758808   460 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:20.859742 32672 consensus_queue.cc:1243] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:20.887697 32679 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:20.891592   328 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:20.891976   328 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:20.892542 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.893136 29325 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:20.892818   328 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.893981 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.894098   328 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:20.894568 29325 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:20.766341   454 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:20.832690 32537 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:20.820813   464 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.826601   472 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:20.859314 28752 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:20.759564   470 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:20.861657 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.908017 28751 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:20.347316   433 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:20.862468 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.853372   370 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:20.865877 28648 connection.cc:256] RPC call timeout handler was delayed by -2.6904156200000671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 12:19:20.864830 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:20.955152 28606 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:20.866565 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:20.956032 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 91284.4us
I20260709 12:19:20.956364 29317 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:20.957036 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:20.863759 28599 rpcz_store.cc:276] 0709 12:19:15.914144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.914246 (+   102us) service_pool.cc:224] Handling call
0709 12:19:15.914519 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:15.914736 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:20.838235 (+4923499us) log.cc:844] Serialized 14 byte log entry
0709 12:19:20.862998 (+ 24763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:20.863052 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:20.863117 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:20.863189 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:20.863300 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":532,"prepare.queue_time_us":116250,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":647,"raft.queue_time_us":92,"thread_start_us":4935527,"threads_started":2}
I20260709 12:19:20.822510 32566 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.848829 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.959060 28601 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
W20260709 12:19:20.958511 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 105013us
W20260709 12:19:20.956229 28648 connection.cc:256] RPC call timeout handler was delayed by -2.682315620000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
I20260709 12:19:20.837061   381 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:20.868876   373 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:20.965144 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:20.875001 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.969040 29317 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:20.877065   395 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:20.868515   460 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:20.877756 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:20.974243 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 96554.7us
W20260709 12:19:20.974960 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.878206 28748 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:20.975407 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:20.878741   471 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:20.878676 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.976136 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:20.976397 28598 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:19:20.880632 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:20.910930 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:20.847398 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 490226us
I20260709 12:19:20.957861 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:20.959815 28648 connection.cc:256] RPC call timeout handler was delayed by -2.3889156200000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25110000000000005s for a response
I20260709 12:19:20.955243 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:20.961877 28601 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:19:20.977864 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:20.900142   454 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:20.963804 32344 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.960700   437 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:20.863235 32242 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:20.982067 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.007767 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.008216 28601 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:21.008502 28598 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:21.009341 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.009857 28606 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:21.010280 28601 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:20.981962 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:21.011210 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.962247 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.002529 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:21.012310 29317 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:21.012483 28599 raft_consensus.cc:2410] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:19:21.014086 28599 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:21.003439 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:21.005251 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.015949 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:21.016181 29325 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:20.959335   442 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:21.009990 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:21.011116 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:20.964320   381 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:21.017016 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:21.020046 28598 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:21.020983 28606 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:21.022508 28606 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:19:20.984724   387 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:20.977670   471 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:21.005641   434 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:21.041631   434 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:21.009364 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:21.043314 29292 connection.cc:256] RPC call timeout handler was delayed by -3.0890427340000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 12:19:21.048146 29292 connection.cc:256] RPC call timeout handler was delayed by -3.0791015689999313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 12:19:21.048813 29292 connection.cc:256] RPC call timeout handler was delayed by -2.7786074709999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 12:19:21.049237 29292 connection.cc:256] RPC call timeout handler was delayed by -2.1908015690000866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2912s for a response
W20260709 12:19:21.049671 29292 connection.cc:256] RPC call timeout handler was delayed by -1.9012831579998419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 12:19:21.006275   395 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:21.050016 29292 connection.cc:256] RPC call timeout handler was delayed by -1.8527829249999286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 12:19:21.050498 29292 connection.cc:256] RPC call timeout handler was delayed by -1.7774549719999868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 12:19:21.050911 29292 connection.cc:256] RPC call timeout handler was delayed by -1.7696935710000616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 12:19:20.981190 28648 connection.cc:256] RPC call timeout handler was delayed by -2.3889156200000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25110000000000005s for a response
W20260709 12:19:21.051522 28648 connection.cc:256] RPC call timeout handler was delayed by -1.9164156199999525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30360000000000004s for a response
I20260709 12:19:21.023655 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:20.910133   472 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:21.052330 29292 connection.cc:256] RPC call timeout handler was delayed by -1.7140831579997666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 12:19:21.026165   310 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:21.026414 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.017757 32242 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.027334   433 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:21.029747 32566 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:21.031708   486 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:21.057253   486 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:21.053830   303 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:19:21.057662   486 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:21.058146   303 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:21.058539   303 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:21.059296   303 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.032058   325 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:20.984637   444 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:21.032932 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.065717 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.066534 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.066605   472 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:21.066870 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.033012 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.007668   437 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:21.067864   484 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:19:21.067569 32566 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.068033   437 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:21.042110   406 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:19:21.069417 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.069741 32566 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:21.066018   310 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:21.070565   310 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.071547   343 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:21.041412   470 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.072719   325 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:21.073168   325 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.073504   325 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:21.039687   480 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:21.051607   395 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:21.042147   434 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:21.076619   303 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.076882   395 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:21.076658   444 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:21.078032   444 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.076732   480 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:21.080912   480 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:20.978092 28752 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
W20260709 12:19:21.051966 28648 connection.cc:256] RPC call timeout handler was delayed by -1.9164156199999525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30360000000000004s for a response
I20260709 12:19:21.011513 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.083649 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:21.024827 28606 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:21.051816 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:21.084820 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:21.053262 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 73239.6us
I20260709 12:19:21.053318 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.018532   442 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:21.055837 29292 connection.cc:256] RPC call timeout handler was delayed by -1.5905935709999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 12:19:21.104636 29292 connection.cc:256] RPC call timeout handler was delayed by -1.5905935709999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 12:19:21.104974 29292 connection.cc:256] RPC call timeout handler was delayed by -1.5752935709999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 12:19:21.105260 29292 connection.cc:256] RPC call timeout handler was delayed by -1.5212935709998874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 12:19:21.105566 29292 connection.cc:256] RPC call timeout handler was delayed by -1.4384935709999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:19:21.105834 29292 connection.cc:256] RPC call timeout handler was delayed by -1.4384935709999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:19:21.106118 29292 connection.cc:256] RPC call timeout handler was delayed by -1.4357935709999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 12:19:21.106381 29292 connection.cc:256] RPC call timeout handler was delayed by -1.4357935709999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 12:19:21.106650 29292 connection.cc:256] RPC call timeout handler was delayed by -1.4195935709999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
W20260709 12:19:21.106910 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3898935709999023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 12:19:21.107172 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3747831579999001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 12:19:21.107434 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3747831579999001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 12:19:21.107702 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3585831579998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 12:19:21.107955 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3585831579998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 12:19:21.108210 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3520935710000686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 12:19:20.984611   457 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 12:19:21.111620 29292 connection.cc:256] RPC call timeout handler was delayed by -1.3304935710000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 12:19:21.111974 29292 connection.cc:256] RPC call timeout handler was delayed by -1.099193570999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2417s for a response
W20260709 12:19:21.112257 29292 connection.cc:256] RPC call timeout handler was delayed by -1.099193570999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2417s for a response
W20260709 12:19:21.112890 29292 connection.cc:256] RPC call timeout handler was delayed by -1.0829935710000882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24350000000000002s for a response
W20260709 12:19:21.055305   482 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:19:21.042667 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:21.114430 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71836.4us
I20260709 12:19:21.045642 29317 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:21.042484   471 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:21.109237 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.087013 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:21.109659 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.117681 28752 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:21.118607 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:21.109992 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 58277.3us
I20260709 12:19:21.110662 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:21.119400 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.119789 28598 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:21.120647 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:21.104019 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.121374 28606 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
W20260709 12:19:21.087437 28648 connection.cc:256] RPC call timeout handler was delayed by -1.7625156200001584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3207s for a response
W20260709 12:19:21.121934 28648 connection.cc:256] RPC call timeout handler was delayed by -1.1361156200000551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.39030000000000004s for a response
W20260709 12:19:21.122246 28648 connection.cc:256] RPC call timeout handler was delayed by -1.1361156200000551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.39030000000000004s for a response
I20260709 12:19:21.122193 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:21.113205 29292 connection.cc:256] RPC call timeout handler was delayed by -1.0829935710000882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24350000000000002s for a response
I20260709 12:19:21.123100 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.115500 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:21.125545 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.126652 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:21.127665 28752 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:21.128481 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.129047 28752 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:21.120000 28601 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:21.129781 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:21.130115 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.130646 28601 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:21.131172 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.131527 28601 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:21.132232 28601 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:21.128145 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.134301 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.135516 28606 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:21.135872 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:21.140470 28598 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:21.140470 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.109674   442 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:21.114135 32566 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:21.171072 28598 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:21.134112   406 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:21.177392 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:21.039371   460 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.186033   496 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:21.169878 32566 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.141615 32537 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:21.141876   433 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:21.145820   451 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:21.125257   479 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:21.144346   459 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:21.145620   369 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:19:21.193722 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 72199.4us
W20260709 12:19:21.193281 29322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 905) took 4965 ms (client timeout 3061 ms). Trace:
I20260709 12:19:21.199179 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:21.196108 29322 rpcz_store.cc:269] 0709 12:19:16.227611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.192127 (+4964516us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:21.193017 (+   890us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:19:21.189601 32566 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.172816   457 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:21.141758   328 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:19:21.145565 32672 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:19:21.145005   486 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.398145 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.377682 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.342615 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 2472) took 1043 ms. Trace:
I20260709 12:19:21.211678 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.420902 29317 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:19:21.421115 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43573.6us
W20260709 12:19:21.208561 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 81969.2us
I20260709 12:19:21.398813 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.269819 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2143) took 2080 ms. Trace:
I20260709 12:19:21.424909 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.345255 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.420482 28748 rpcz_store.cc:276] 0709 12:19:20.298970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.349772 (+ 50802us) service_pool.cc:224] Handling call
0709 12:19:21.342350 (+992578us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54000348d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:21.342536 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199697664}
I20260709 12:19:21.429291 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2447) took 1125 ms. Trace:
I20260709 12:19:21.234037 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.425232 28750 rpcz_store.cc:276] 0709 12:19:19.188995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.425321 (+236326us) service_pool.cc:224] Handling call
0709 12:19:19.950795 (+525474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.140873 (+190078us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:20.855169 (+714296us) log.cc:844] Serialized 14 byte log entry
0709 12:19:20.970984 (+115815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:20.971038 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:20.971069 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.269516 (+298447us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54001c4b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:21.269576 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.269742 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":651431,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":2562,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":30678,"spinlock_wait_cycles":426171648,"thread_start_us":738330,"threads_started":2,"wal-append.queue_time_us":171170}
I20260709 12:19:21.316669 28747 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:21.398145 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.364615 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.209956 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:21.398519 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.199443   479 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:21.195190   433 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:21.198840   459 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:21.198493   369 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:21.439296 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:21.454821 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 2475) took 1155 ms. Trace:
I20260709 12:19:21.461324 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.468729 28749 rpcz_store.cc:276] 0709 12:19:20.299780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.306251 (+  6471us) service_pool.cc:224] Handling call
0709 12:19:21.345069 (+1038818us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:19:21.454738 (+109669us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6183168}
I20260709 12:19:21.438233   406 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:21.469974   406 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:21.249312   370 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.462116   446 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:21.201830   346 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:21.206447   451 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:21.315697   442 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.351095   480 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.463393 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:21.341859   448 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.460784 28605 raft_consensus.cc:2376] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11. Re-sending same reply.
W20260709 12:19:21.210469   490 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:19:21.465680 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.466902 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.469753 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.470467   406 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:21.462136 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.499255 28748 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
W20260709 12:19:21.499305 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 383846us
I20260709 12:19:21.499809 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 2477) took 1183 ms. Trace:
I20260709 12:19:21.435539 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.471131 28677 raft_consensus.cc:2368] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:19:21.500214 28748 rpcz_store.cc:276] 0709 12:19:20.315970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.461862 (+1145892us) service_pool.cc:224] Handling call
0709 12:19:21.499756 (+ 37894us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:21.472385 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.502422 28750 raft_consensus.cc:2410] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 12 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:21.483398 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:21.473587 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 109069us
I20260709 12:19:21.209431   460 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:21.252875 32488 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:21.206312   457 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:21.522122 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.207470   381 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:21.473553   346 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:21.464562   479 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:21.494138 28680 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:21.249312   454 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:21.258215   373 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.317790   395 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.502936 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 738) took 1247 ms. Trace:
I20260709 12:19:21.526607 28750 rpcz_store.cc:276] 0709 12:19:20.255333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.472156 (+1216823us) service_pool.cc:224] Handling call
0709 12:19:21.502870 (+ 30714us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:21.259586   492 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:19:21.502946 28675 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
W20260709 12:19:21.503865 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.471143   433 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.471846   459 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:21.504695 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.474609   369 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.321136   450 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:21.505523 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.506585 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:21.473460   494 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:21.243707   310 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.469820 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.325111 32566 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.288419   325 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.529593   346 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:21.250842   437 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.310505   434 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.254654   402 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.524948 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.496102 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.500029 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:21.470906   446 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.531812 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 730) took 1279 ms. Trace:
I20260709 12:19:21.533620 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2160) took 2335 ms. Trace:
W20260709 12:19:21.565506 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 65546.5us
I20260709 12:19:21.565917 29322 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:21.536037 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.536592   448 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:21.524955   457 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:21.507030 32488 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:21.531474 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.527240 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:21.680594 28756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2155) took 2488 ms (client timeout 1527 ms). Trace:
W20260709 12:19:21.681039 28756 rpcz_store.cc:269] 0709 12:19:19.196983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:19.274757 (+ 77774us) service_pool.cc:224] Handling call
0709 12:19:21.680380 (+2405623us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54000361d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:21.680521 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089091840}
I20260709 12:19:21.682065 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.683054 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.684008 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.524387   381 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:21.684649   381 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.553975   451 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:21.695525 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.557564   325 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:21.558369 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:21.709358 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 745) took 1451 ms. Trace:
I20260709 12:19:21.709785 28747 rpcz_store.cc:276] 0709 12:19:20.257833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.964893 (+707060us) service_pool.cc:224] Handling call
0709 12:19:21.709224 (+744331us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54003fff54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:21.709301 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806856576}
I20260709 12:19:21.710934 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.712045 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.714263 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.429847 28599 rpcz_store.cc:276] 0709 12:19:20.303581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.014971 (+711390us) service_pool.cc:224] Handling call
0709 12:19:21.015281 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.015503 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:21.113588 (+ 98085us) log.cc:844] Serialized 14 byte log entry
0709 12:19:21.317479 (+203891us) log.cc:844] Serialized 14 byte log entry
0709 12:19:21.428980 (+111501us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:21.429033 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:21.429079 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.429139 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.429238 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111254,"prepare.queue_time_us":61439,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":8048,"raft.queue_time_us":113799,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":1204,"thread_start_us":202581,"threads_started":1,"wal-append.queue_time_us":206515}
I20260709 12:19:21.709794 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.724710 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:21.725250 29325 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:21.560499 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:21.729514 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:21.730595 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.731434 29319 raft_consensus.cc:2410] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:19:21.534101 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 104833us
I20260709 12:19:21.565747 28748 rpcz_store.cc:276] 0709 12:19:19.198519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.507966 (+2309447us) service_pool.cc:224] Handling call
0709 12:19:21.533280 (+ 25314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.533415 (+   135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.533430 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:21.533457 (+    27us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:21.533481 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.533513 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.533579 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:21.751590 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.752238 28748 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:21.753966 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.758327 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 2479) took 1433 ms. Trace:
I20260709 12:19:21.758832 28751 rpcz_store.cc:276] 0709 12:19:20.324662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.007158 (+682496us) service_pool.cc:224] Handling call
0709 12:19:21.758098 (+750940us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54002d69d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:21.758254 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986681728}
I20260709 12:19:21.759878 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.762216 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.769208 28598 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:21.774116 29323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1007) took 1704 ms (client timeout 1589 ms). Trace:
W20260709 12:19:21.774490 29323 rpcz_store.cc:269] 0709 12:19:20.070194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.070375 (+   181us) service_pool.cc:224] Handling call
0709 12:19:21.773929 (+1703554us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b54004bb4d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:21.774043 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183027968}
I20260709 12:19:21.775229 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 995) took 1458 ms. Trace:
I20260709 12:19:21.775636 29326 rpcz_store.cc:276] 0709 12:19:20.316696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.317633 (+   937us) service_pool.cc:224] Handling call
0709 12:19:21.774091 (+1456458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.774280 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.774302 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:21.774342 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:21.774391 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.774440 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.775074 (+   634us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54004bb4d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:21.775174 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3348821376}
I20260709 12:19:21.781008 32242 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:21.783324 29319 pending_rounds.cc:85] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 6
I20260709 12:19:21.783777 29319 pending_rounds.cc:107] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:19:21.784071 29319 raft_consensus.cc:2889] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:21.566691 28750 rpcz_store.cc:276] 0709 12:19:20.252722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.531043 (+1278321us) service_pool.cc:224] Handling call
0709 12:19:21.531319 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.531490 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.531515 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:21.531563 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:21.531594 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.531649 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:21.531756 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:21.567111 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:21.789247 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 222187us
I20260709 12:19:21.790011 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:21.567895 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.578907   480 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.571179   497 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:21.792976   497 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:21.792827   503 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.793473   497 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.577049   453 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:21.566208   310 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.575994 32488 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:21.803789 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:21.581108   442 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:21.584864 28754 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:21.590487   395 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.575472   446 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:21.812692 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:21.813762 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.814746 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.815704 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.807010 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:21.818393 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.819104 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:21.590818   486 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.592945   373 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:21.593905 32566 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.594533 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:21.596375   369 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.598155 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2010) took 1569 ms. Trace:
I20260709 12:19:21.600853   471 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.601527   457 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.576375   370 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.609094 28749 raft_consensus.cc:2410] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:21.613288   437 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:21.614329   402 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.615702   406 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:21.617986 29348 debug-util.cc:398] Leaking SignalData structure 0x7b080031a4c0 after lost signal to thread 28539
I20260709 12:19:21.618857   433 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.614367   308 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:21.620476   346 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.622262   479 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:21.623963   459 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:21.637225 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:21.637372   455 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:21.643600 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:21.645514 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2456) took 1331 ms. Trace:
W20260709 12:19:21.665997 28755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2144) took 2476 ms (client timeout 1940 ms). Trace:
W20260709 12:19:21.667322 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 483506us
I20260709 12:19:21.555441   434 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:21.802920 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:21.805641 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.806154   435 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:21.809854   448 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:21.810631 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:21.811568 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:21.811990 32488 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:21.819603 28748 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:21.821708 29325 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
W20260709 12:19:22.328629 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 402497us
I20260709 12:19:22.415061 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:22.416275 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1025) took 1400 ms. Trace:
W20260709 12:19:22.416684 29348 debug-util.cc:398] Leaking SignalData structure 0x7b0800243b80 after lost signal to thread 28631
W20260709 12:19:22.417001 29348 debug-util.cc:398] Leaking SignalData structure 0x7b0800243b40 after lost signal to thread 28632
I20260709 12:19:22.328280 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:22.418092 28675 raft_consensus.cc:2410] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:19:22.418289 29348 debug-util.cc:398] Leaking SignalData structure 0x7b08003c9de0 after lost signal to thread 28706
I20260709 12:19:21.857156 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:22.419440 29348 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1b20 after lost signal to thread 28780
I20260709 12:19:22.331099 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 929) took 1191 ms. Trace:
I20260709 12:19:22.414495 28679 rpcz_store.cc:276] 0709 12:19:20.028631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.248528 (+219897us) service_pool.cc:224] Handling call
0709 12:19:21.597982 (+1349454us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54000c7e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:21.598093 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017364864}
W20260709 12:19:22.420071 28755 rpcz_store.cc:269] 0709 12:19:19.189295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.665726 (+2476431us) service_pool.cc:211] Skipping call since client already timed out
0709 12:19:21.665895 (+   169us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:19:21.936020 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:22.340790 28753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2151) took 3149 ms (client timeout 1804 ms). Trace:
W20260709 12:19:22.327699 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 507090us
I20260709 12:19:22.416695 29319 rpcz_store.cc:276] 0709 12:19:21.015997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.732018 (+716021us) service_pool.cc:224] Handling call
0709 12:19:21.732375 (+   357us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:19:21.791454 (+ 59079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.791487 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:19:21.800579 (+  9092us) log.cc:844] Serialized 78 byte log entry
0709 12:19:22.407930 (+607351us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:22.407988 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.408088 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.416051 (+  7963us) raft_consensus.cc:1685] finished
0709 12:19:22.416068 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.416222 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":310116,"threads_started":1,"wal-append.queue_time_us":586952}
I20260709 12:19:22.424980 28676 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:22.415248 28602 rpcz_store.cc:276] 0709 12:19:20.314173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.858509 (+544336us) service_pool.cc:224] Handling call
0709 12:19:21.645309 (+786800us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400233a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:21.645454 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647366400}
W20260709 12:19:22.199662 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:22.413326 28673 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:22.426162 29348 debug-util.cc:398] Leaking SignalData structure 0x7b08003b75c0 after lost signal to thread 29351
W20260709 12:19:22.422307 28753 rpcz_store.cc:269] 0709 12:19:19.191312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.079404 (+888092us) service_pool.cc:224] Handling call
0709 12:19:22.340532 (+2261128us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400306954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:22.340691 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303976320}
I20260709 12:19:22.420749 29318 rpcz_store.cc:276] 0709 12:19:21.139594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.821270 (+681676us) service_pool.cc:224] Handling call
0709 12:19:22.330550 (+509280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.330764 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.330795 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:22.330836 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:22.330863 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.330921 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.331033 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.430269 28752 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:22.414611 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:22.429646   451 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:22.435554   457 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:22.436386 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:22.437753   479 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:22.438202 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 732) took 2184 ms. Trace:
I20260709 12:19:22.438599 28750 rpcz_store.cc:276] 0709 12:19:20.253287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.419820 (+2166533us) service_pool.cc:224] Handling call
0709 12:19:22.437698 (+ 17878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.437884 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.437913 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:22.437956 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:22.437994 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.438046 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.438146 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.439572   346 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:22.439692   433 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:22.334390   497 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 12:19:22.440282 29323 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:22.440804 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:22.440709   497 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:22.441636 28676 raft_consensus.cc:2410] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:22.442176   369 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:21.830178   503 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:22.442752   497 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:22.444294 28755 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:22.444697 28681 raft_consensus.cc:2410] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:19:22.444908 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 734) took 2191 ms. Trace:
I20260709 12:19:22.437748   406 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:22.445250 28755 rpcz_store.cc:276] 0709 12:19:20.253889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.422051 (+2168162us) service_pool.cc:224] Handling call
0709 12:19:22.444116 (+ 22065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.444689 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.444858 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:22.294103   381 consensus_meta.cc:287] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.000s
I20260709 12:19:22.449004 28753 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:22.449110   381 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:22.449638 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 736) took 2195 ms. Trace:
I20260709 12:19:22.450074 28753 rpcz_store.cc:276] 0709 12:19:20.254523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.427740 (+2173217us) service_pool.cc:224] Handling call
0709 12:19:22.448715 (+ 20975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.449406 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.449590 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.454013 28747 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:22.455022 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2469) took 2157 ms. Trace:
I20260709 12:19:22.455339 28753 rpcz_store.cc:276] 0709 12:19:20.298093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.454265 (+2156172us) service_pool.cc:224] Handling call
0709 12:19:22.454545 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.454730 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.454757 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:22.454795 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:22.454831 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.454881 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.454973 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.455850   459 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:22.450915 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:22.412505 32581 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:22.451131   381 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:22.451749 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:22.458292 29325 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:22.452490 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:22.452612 28755 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:22.452710   471 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:22.453399 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:22.462669 29318 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:22.461341 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:22.459409 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 371523us
I20260709 12:19:22.440224 28750 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:21.834100   480 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:22.463802 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:22.465004 28602 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:22.469879 28603 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:19:22.458566   451 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:22.467082 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 737) took 2212 ms. Trace:
I20260709 12:19:22.467167 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:22.463178 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:22.467797 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:22.471454 28750 rpcz_store.cc:276] 0709 12:19:20.255001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.439646 (+2184645us) service_pool.cc:224] Handling call
0709 12:19:22.439916 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.466821 (+ 26905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.467023 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.472249 28604 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:22.473040 28753 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:22.473093 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:22.473951 28600 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:22.474046 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2473) took 2174 ms. Trace:
I20260709 12:19:22.474403 28753 rpcz_store.cc:276] 0709 12:19:20.299249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.456224 (+2156975us) service_pool.cc:224] Handling call
0709 12:19:22.471152 (+ 14928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.473825 (+  2673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.473996 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.476496 28673 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:22.474457 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:22.480007 28720 leader_election.cc:400] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:19:22.482648 29325 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:22.483915 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:22.430285   435 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:22.488155 28753 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:22.488590 29318 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:22.485571   451 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:22.484912   381 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:22.489758 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2481) took 2111 ms. Trace:
I20260709 12:19:22.486040   480 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:22.490593 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:22.490796 29318 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:22.485289 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:22.492533 29325 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:22.491057 28753 rpcz_store.cc:276] 0709 12:19:20.378409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.484560 (+2106151us) service_pool.cc:224] Handling call
0709 12:19:22.487841 (+  3281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.489507 (+  1666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.489702 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:22.493597 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 161239us
I20260709 12:19:22.493978 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:22.491127   381 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:22.503157 29325 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:22.504149 29325 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:22.491232   480 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:22.496209   455 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:22.505398   381 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:22.506043   479 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:22.495941   459 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:19:22.512089   435 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:22.508749   480 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:22.514748   479 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:22.515560   479 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:22.522603   479 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:22.524760   479 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:22.561780 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:22.565209 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 150882us
I20260709 12:19:22.499698 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:22.567150 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:22.569315 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:22.570735 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71041us
I20260709 12:19:22.571852 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:22.593724 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:22.594482 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:22.574472 28752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 740) took 2318 ms (client timeout 2918 ms). Trace:
W20260709 12:19:22.596607 28752 rpcz_store.cc:269] 0709 12:19:20.255984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.140204 (+884220us) service_pool.cc:224] Handling call
0709 12:19:22.573932 (+1433728us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540003e654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:22.574215 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2951564160}
I20260709 12:19:22.598542 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:22.599920 29321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1009) took 2525 ms (client timeout 2185 ms). Trace:
I20260709 12:19:22.600189 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:22.600402 29321 rpcz_store.cc:269] 0709 12:19:20.074732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.074889 (+   157us) service_pool.cc:224] Handling call
0709 12:19:22.599504 (+2524615us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54007a5b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:22.599680 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585912064}
I20260709 12:19:22.601323 28752 raft_consensus.cc:2410] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:19:22.602344 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:22.606772 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 2478) took 2288 ms. Trace:
I20260709 12:19:22.607259 28749 rpcz_store.cc:276] 0709 12:19:20.318122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.469592 (+1151470us) service_pool.cc:224] Handling call
0709 12:19:22.606303 (+1136711us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b54002d50d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:22.606597 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158988032}
I20260709 12:19:22.610244 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:22.611321 29321 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:22.611662 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 844) took 1415 ms. Trace:
I20260709 12:19:22.612804 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:22.614120 28749 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:22.615094 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:22.615365 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:22.616791 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:22.617810 28749 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:22.618759 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:22.575475 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:23.643270 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 1.06793e+06us
I20260709 12:19:22.584224 28601 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:23.647507   402 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.648175   402 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:23.649536 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2453) took 3344 ms. Trace:
I20260709 12:19:23.649933 28601 rpcz_store.cc:276] 0709 12:19:20.305490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.138703 (+833213us) service_pool.cc:224] Handling call
0709 12:19:21.138951 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:23.647624 (+2508673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.649169 (+  1545us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000bde54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:23.649436 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3321984256}
I20260709 12:19:23.650872   402 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:23.651573 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:23.655197   402 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:22.612210 28682 rpcz_store.cc:276] 0709 12:19:21.196362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.196560 (+   198us) service_pool.cc:224] Handling call
0709 12:19:21.196901 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:21.197292 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.197332 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:21.200135 (+  2803us) log.cc:844] Serialized 26 byte log entry
0709 12:19:21.524697 (+324562us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:21.524755 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.524858 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.610926 (+1086068us) raft_consensus.cc:1685] finished
0709 12:19:22.610973 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.611332 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58416,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":324177,"threads_started":1,"wal-append.queue_time_us":338587}
I20260709 12:19:22.626204 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:22.630765 28600 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:23.659498 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2132) took 1188 ms. Trace:
I20260709 12:19:22.633045 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:23.659758 28703 debug-util.cc:398] Leaking SignalData structure 0x7b0800162780 after lost signal to thread 27446
I20260709 12:19:23.659807 28600 rpcz_store.cc:276] 0709 12:19:22.471171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.471275 (+   104us) service_pool.cc:224] Handling call
0709 12:19:23.659389 (+1188114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:22.631246 28754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 742) took 2374 ms (client timeout 1783 ms). Trace:
I20260709 12:19:22.621917 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 927) took 1483 ms. Trace:
I20260709 12:19:23.738222 29326 rpcz_store.cc:276] 0709 12:19:21.139087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.792252 (+653165us) service_pool.cc:224] Handling call
0709 12:19:22.619351 (+827099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.619825 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.619850 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:22.619890 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:22.619957 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.620042 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.621566 (+  1524us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54007a5b50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:22.621707 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901194112}
I20260709 12:19:23.739998 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:22.629724 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1026) took 1584 ms. Trace:
I20260709 12:19:22.596293 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:23.838030 28753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2180) took 1260 ms (client timeout 1527 ms). Trace:
W20260709 12:19:23.838536 28753 rpcz_store.cc:269] 0709 12:19:22.577357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.595879 (+ 18522us) service_pool.cc:224] Handling call
0709 12:19:23.837948 (+1242069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.621914 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 731) took 2368 ms. Trace:
I20260709 12:19:23.840647 28748 rpcz_store.cc:276] 0709 12:19:20.253016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.414706 (+2161690us) service_pool.cc:224] Handling call
0709 12:19:22.443451 (+ 28745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.469518 (+ 26067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.469555 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.470031 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:19:22.491614 (+ 21583us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:22.620786 (+129172us) log.cc:844] Serialized 14 byte log entry
0709 12:19:22.621298 (+   512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.621451 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:22.621520 (+    69us) raft_consensus.cc:1685] finished
0709 12:19:22.621531 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.621707 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24371,"prepare.queue_time_us":35845,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":969002,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":313,"thread_start_us":143496,"threads_started":2,"wal-append.queue_time_us":40830,"wal-append.run_cpu_time_us":2993,"wal-append.run_wall_time_us":1317415}
I20260709 12:19:22.631313 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:22.660403 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:22.662065 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:22.662561 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:22.621187 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:23.866209   533 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:23.866801 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 938) took 1259 ms. Trace:
I20260709 12:19:23.867189 29325 rpcz_store.cc:276] 0709 12:19:22.607075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.620666 (+ 13591us) service_pool.cc:224] Handling call
0709 12:19:23.866715 (+1246049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.867015   533 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:23.868345 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:23.869170 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 940) took 1246 ms. Trace:
I20260709 12:19:23.869482 29325 rpcz_store.cc:276] 0709 12:19:22.622603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.868072 (+1245469us) service_pool.cc:224] Handling call
0709 12:19:23.869102 (+  1030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.870325 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:23.870369   534 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:23.871248 29325 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:23.871675 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 945) took 1235 ms. Trace:
I20260709 12:19:23.871964 29325 rpcz_store.cc:276] 0709 12:19:22.636664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.870073 (+1233409us) service_pool.cc:224] Handling call
0709 12:19:23.871628 (+  1555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:22.663977 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:23.872860 28598 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:23.873315 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 693) took 1211 ms. Trace:
I20260709 12:19:23.873623 28598 rpcz_store.cc:276] 0709 12:19:22.662196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.663487 (+  1291us) service_pool.cc:224] Handling call
0709 12:19:23.873263 (+1209776us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.874048   533 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:23.874483 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:23.874712   533 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:23.875190 28598 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:23.875221   533 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:22.587117 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:22.574779 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:23.880149 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 1.30556e+06us
I20260709 12:19:23.881145 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:22.808284 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:22.622934 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:23.883574   479 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:23.883956 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 939) took 1262 ms. Trace:
W20260709 12:19:22.811794 28680 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.286s	user 0.016s	sys 0.013s
I20260709 12:19:22.659425 28493 maintenance_manager.cc:643] P 8e0de7eff4a840c28e4ee5b7f8b98182: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 12.962s	user 0.205s	sys 0.116s Metrics: {"bytes_written":30666,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":98210,"dirs.run_cpu_time_us":553,"dirs.run_wall_time_us":7497,"drs_written":1,"lbm_read_time_us":54216,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":247532,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":4247243,"threads_started":2,"update_count":11,"wal-append.queue_time_us":161095,"wal-append.run_cpu_time_us":433,"wal-append.run_wall_time_us":1000443}
I20260709 12:19:23.884606 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:23.884470   533 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:22.837788   515 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:19:23.885402 28680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2029) took 2485 ms (client timeout 1997 ms). Trace:
I20260709 12:19:23.885432   516 raft_consensus.cc:2764] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:19:22.838812   518 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:19:23.885810 28680 rpcz_store.cc:269] 0709 12:19:21.399882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.463153 (+ 63271us) service_pool.cc:224] Handling call
0709 12:19:23.885279 (+2422126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.886565   518 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:23.887017   518 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:23.887984 28494 maintenance_manager.cc:419] P 8e0de7eff4a840c28e4ee5b7f8b98182: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11049 bytes on disk
I20260709 12:19:23.888320   518 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:22.863034 32242 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:23.069285   497 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:22.856171 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:23.325271 28571 leader_election.cc:336] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.527s (SENT)
W20260709 12:19:23.554255 29320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.045s	user 0.015s	sys 0.011s
W20260709 12:19:23.557032 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.576498 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:23.582690 32581 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.584862   457 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.586862   435 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.588353   525 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.908937   525 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:23.909739 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:23.910648 29325 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:23.601166 28747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 754) took 2027 ms (client timeout 2094 ms). Trace:
W20260709 12:19:23.911338 28747 rpcz_store.cc:269] 0709 12:19:21.573997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.714053 (+140056us) service_pool.cc:224] Handling call
0709 12:19:23.600675 (+1886622us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54003e8854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:23.600974 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699190016}
W20260709 12:19:23.615551 29319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.006s	sys 0.014s
I20260709 12:19:23.905162 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:23.912981 29319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.007s	sys 0.015s
I20260709 12:19:23.913565 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:23.914227 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1012) took 2346 ms. Trace:
I20260709 12:19:23.915079 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:23.617496 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:23.917423 28756 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:23.655993   402 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:23.660422 28703 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad4c0 after lost signal to thread 27449
I20260709 12:19:23.661501 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:23.916217 28674 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:23.921247 28600 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:23.921458 28703 debug-util.cc:398] Leaking SignalData structure 0x7b080016b220 after lost signal to thread 28539
I20260709 12:19:23.921671 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 701) took 1086 ms. Trace:
I20260709 12:19:23.922053 28600 rpcz_store.cc:276] 0709 12:19:22.835651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.661220 (+825569us) service_pool.cc:224] Handling call
0709 12:19:23.921597 (+260377us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:23.922958 28703 debug-util.cc:398] Leaking SignalData structure 0x7b0800381f60 after lost signal to thread 28631
I20260709 12:19:22.623921 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2468) took 2326 ms. Trace:
I20260709 12:19:23.928881 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:23.657270 28604 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:23.929255 28755 rpcz_store.cc:276] 0709 12:19:20.297764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.446027 (+2148263us) service_pool.cc:224] Handling call
0709 12:19:22.446275 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.459338 (+ 13063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.623362 (+164024us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b540012f554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:22.623731 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14186368}
I20260709 12:19:23.931097 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:23.662827 28754 rpcz_store.cc:269] 0709 12:19:20.256622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.297442 (+ 40820us) service_pool.cc:224] Handling call
0709 12:19:22.630778 (+2333336us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540003e154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:22.631004 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2948263680}
I20260709 12:19:23.665808 28601 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:23.932964 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 699) took 1098 ms. Trace:
I20260709 12:19:23.933235 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:23.683652 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 820) took 3652 ms. Trace:
W20260709 12:19:23.690650   454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.881s	user 0.011s	sys 0.027s
W20260709 12:19:23.934624   454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.125s	user 0.012s	sys 0.027s
I20260709 12:19:23.934489 28678 rpcz_store.cc:276] 0709 12:19:20.030651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.325067 (+294416us) service_pool.cc:224] Handling call
0709 12:19:21.740120 (+1415053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:21.740334 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:21.740362 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:21.740411 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:21.755225 (+ 14814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:21.755296 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.683261 (+1927965us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000c7e50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:23.683466 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3253628160}
I20260709 12:19:23.692648   373 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:23.936215   373 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:23.695207   381 consensus_meta.cc:287] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.179s	user 0.013s	sys 0.014s
I20260709 12:19:23.937304   381 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:23.938776   373 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:23.697302   527 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:23.939460   527 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:23.939845   527 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:23.895161 29320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.389s	user 0.016s	sys 0.012s
W20260709 12:19:23.697922 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50943.1us
I20260709 12:19:23.942087 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1016) took 2357 ms. Trace:
I20260709 12:19:23.942888 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:23.726629   455 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.216s	user 0.006s	sys 0.021s
I20260709 12:19:23.729925   369 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:22.624367 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1015) took 2343 ms. Trace:
I20260709 12:19:23.943966   369 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:23.946350   369 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:23.944605 29327 rpcz_store.cc:276] 0709 12:19:20.280308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:20.280555 (+   247us) service_pool.cc:224] Handling call
0709 12:19:20.283618 (+  3063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:20.313932 (+ 30314us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:20.377277 (+ 63345us) log.cc:844] Serialized 14 byte log entry
0709 12:19:20.795439 (+418162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:20.795512 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:20.795576 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.623838 (+1828262us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b54004a92d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:22.623935 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:22.624150 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28209,"prepare.queue_time_us":518792,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":51577,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8819,"spinlock_wait_cycles":69236608,"thread_start_us":442046,"threads_started":2,"wal-append.queue_time_us":442303,"wal-append.run_cpu_time_us":1169,"wal-append.run_wall_time_us":1010821}
I20260709 12:19:23.947721 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:23.746613   453 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:23.759537 29318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.176s	user 0.010s	sys 0.027s
W20260709 12:19:23.949095 29318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.011s	sys 0.028s
I20260709 12:19:23.948870   453 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:23.949608   370 raft_consensus.cc:2764] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:23.950187 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1033) took 1527 ms. Trace:
I20260709 12:19:23.950476   370 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:23.761698 28502 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 7 to 9, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 9 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:23.951359   453 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:23.905539   529 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.958132   529 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:23.770095   480 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.255s	user 0.028s	sys 0.000s
I20260709 12:19:23.960892   480 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:23.963915   480 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:23.770237 28751 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:23.797521   532 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.964087   527 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:23.964869   532 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:23.827559 29323 rpcz_store.cc:276] 0709 12:19:21.044814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.775410 (+730596us) service_pool.cc:224] Handling call
0709 12:19:21.775757 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.440828 (+665071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:22.629191 (+188363us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400790254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:22.629508 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527804288}
I20260709 12:19:23.901785 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:23.857187 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:23.856173 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:23.858383 28752 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:23.860816 28605 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
I20260709 12:19:23.864130 28599 raft_consensus.cc:2376] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8. Re-sending same reply.
I20260709 12:19:23.907725   457 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:23.865689   346 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.865799   531 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:23.877377 29317 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:23.862911 28603 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:23.882145   503 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:23.882901 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 694) took 1075 ms. Trace:
W20260709 12:19:22.836273 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:23.889099 29326 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:23.551124 28606 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:23.884393 29321 rpcz_store.cc:276] 0709 12:19:22.622041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.622614 (+   573us) service_pool.cc:224] Handling call
0709 12:19:23.883879 (+1261265us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:23.895140 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 570100us
I20260709 12:19:23.895548 28493 maintenance_manager.cc:643] P 8e0de7eff4a840c28e4ee5b7f8b98182: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.006s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":539,"lbm_reads_lt_1ms":4}
W20260709 12:19:23.895684 29322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 951) took 1257 ms (client timeout 1509 ms). Trace:
I20260709 12:19:23.898754 28682 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:23.905092   518 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:23.906039 32581 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:23.905222 28680 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:23.923250 28703 debug-util.cc:398] Leaking SignalData structure 0x7b0800157360 after lost signal to thread 28632
I20260709 12:19:22.852931 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:23.968221 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2194) took 1350 ms. Trace:
I20260709 12:19:24.025583 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2459) took 3679 ms. Trace:
I20260709 12:19:24.025974 28748 rpcz_store.cc:276] 0709 12:19:22.617651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.850989 (+1233338us) service_pool.cc:224] Handling call
0709 12:19:23.968144 (+117155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.664492 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 689) took 1039 ms. Trace:
I20260709 12:19:23.933339 28601 rpcz_store.cc:276] 0709 12:19:22.834841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.651270 (+816429us) service_pool.cc:224] Handling call
0709 12:19:23.932860 (+281590us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:23.678061   451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.164s	user 0.013s	sys 0.025s
I20260709 12:19:23.936486 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:23.943367 28749 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:19:23.970326 29317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 933) took 2798 ms (client timeout 2029 ms). Trace:
I20260709 12:19:23.943840   455 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:23.729297   406 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:23.952569   435 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:23.952378 28502 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 7 to 8, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 8 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:23.953830   496 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:17.828014 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:23.942615 29320 rpcz_store.cc:276] 0709 12:19:21.585082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.437837 (+852755us) service_pool.cc:224] Handling call
0709 12:19:22.438129 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.438325 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:22.505717 (+ 67392us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.941510 (+1435793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:23.941610 (+   100us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:23.941676 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.941794 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.942004 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":87545,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":132,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":197,"thread_start_us":1502420,"threads_started":2,"wal-append.queue_time_us":340661,"wal-append.run_cpu_time_us":1411,"wal-append.run_wall_time_us":1004817}
I20260709 12:19:23.950591 29318 rpcz_store.cc:276] 0709 12:19:22.422697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.494333 (+ 71636us) service_pool.cc:224] Handling call
0709 12:19:22.494572 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:22.494751 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:22.582670 (+ 87919us) log.cc:844] Serialized 14 byte log entry
0709 12:19:23.949635 (+1366965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:23.949712 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:23.949810 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.949920 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.950126 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31355,"prepare.run_cpu_time_us":20,"prepare.run_wall_time_us":21,"thread_start_us":1443581,"threads_started":2,"wal-append.queue_time_us":226589,"wal-append.run_cpu_time_us":1945,"wal-append.run_wall_time_us":1012272}
I20260709 12:19:23.954749   370 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:23.899770 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:23.898995 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:23.899747 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:23.922205   402 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:23.932157 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 759) took 1433 ms. Trace:
W20260709 12:19:24.044131 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 84914.5us
I20260709 12:19:24.044390 28755 rpcz_store.cc:276] 0709 12:19:22.498357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.930665 (+1432308us) service_pool.cc:224] Handling call
0709 12:19:23.932091 (+  1426us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:23.966423 28751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 753) took 2392 ms (client timeout 2435 ms). Trace:
I20260709 12:19:23.967100 28750 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:24.014865 28598 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:24.045665 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:24.046268 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 700) took 1211 ms. Trace:
I20260709 12:19:24.046648 28598 rpcz_store.cc:276] 0709 12:19:22.835203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.874236 (+1039033us) service_pool.cc:224] Handling call
0709 12:19:24.046206 (+171970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.940079   381 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:23.968576 28753 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:24.015522 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 64822.8us
W20260709 12:19:23.968833 28752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2186) took 1359 ms (client timeout 1804 ms). Trace:
I20260709 12:19:23.968966 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 691) took 1307 ms. Trace:
I20260709 12:19:23.969177 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 690) took 1336 ms. Trace:
W20260709 12:19:24.047890 28752 rpcz_store.cc:269] 0709 12:19:22.609832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.625289 (+ 15457us) service_pool.cc:224] Handling call
0709 12:19:23.968774 (+1343485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.967372 28604 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:24.049512 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 688) took 1425 ms. Trace:
I20260709 12:19:23.970587 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 692) took 1308 ms. Trace:
I20260709 12:19:23.900977 28675 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:23.914723 29319 rpcz_store.cc:276] 0709 12:19:21.568090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.424044 (+855954us) service_pool.cc:224] Handling call
0709 12:19:22.424342 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:22.507396 (+ 83054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:22.507416 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:22.509016 (+  1600us) log.cc:844] Serialized 26 byte log entry
0709 12:19:23.913647 (+1404631us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:23.913739 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:23.913850 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:23.913912 (+    62us) raft_consensus.cc:1685] finished
0709 12:19:23.913932 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:23.914138 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16054,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":1413515,"threads_started":2,"wal-append.queue_time_us":259368,"wal-append.run_cpu_time_us":2620,"wal-append.run_wall_time_us":1003160}
I20260709 12:19:23.967211   532 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:23.971915   503 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:19:24.023561 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:24.023905 28703 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf660 after lost signal to thread 28706
I20260709 12:19:23.970026   531 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:23.969524   346 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.054598   525 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:23.923213 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:24.027362 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 158411us
I20260709 12:19:23.968405 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:24.057220 28676 raft_consensus.cc:2376] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13. Re-sending same reply.
I20260709 12:19:24.057395 28600 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:19:24.057932 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 696) took 1249 ms. Trace:
I20260709 12:19:24.058221 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.058507 28676 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:24.058912 28676 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.059898 28676 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:24.060256   535 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:24.061100 28676 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:24.062117   535 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:24.058254 28600 rpcz_store.cc:276] 0709 12:19:22.808398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.922975 (+1114577us) service_pool.cc:224] Handling call
0709 12:19:24.057871 (+134896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.011178 29325 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:19:24.059926 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:24.064858 29325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 941) took 1441 ms (client timeout 1786 ms). Trace:
W20260709 12:19:24.065308 29325 rpcz_store.cc:269] 0709 12:19:22.622972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.890661 (+1267689us) service_pool.cc:224] Handling call
0709 12:19:24.064771 (+174110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.065425   369 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:24.066461 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.067412 29325 raft_consensus.cc:2410] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:24.067833 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 948) took 1430 ms. Trace:
I20260709 12:19:24.068166 29325 rpcz_store.cc:276] 0709 12:19:22.637579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.066186 (+1428607us) service_pool.cc:224] Handling call
0709 12:19:24.067769 (+  1583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.069147 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.068795   406 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:24.011603 29326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 950) took 1373 ms (client timeout 1547 ms). Trace:
W20260709 12:19:24.070231 29326 rpcz_store.cc:269] 0709 12:19:22.638365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.739680 (+1101315us) service_pool.cc:224] Handling call
0709 12:19:24.011350 (+271670us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54006531d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:24.011517 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302074112}
I20260709 12:19:24.071264 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:24.038130   451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.524s	user 0.013s	sys 0.026s
I20260709 12:19:24.072130 29326 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:19:24.073041 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.073639 29326 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:23.971129   457 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:24.048606 28599 rpcz_store.cc:276] 0709 12:19:22.632887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.659808 (+ 26921us) service_pool.cc:224] Handling call
0709 12:19:23.969118 (+1309310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.051152 28605 rpcz_store.cc:276] 0709 12:19:22.661367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.661626 (+   259us) service_pool.cc:224] Handling call
0709 12:19:23.968905 (+1307279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.050567 28603 rpcz_store.cc:276] 0709 12:19:22.661782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.662007 (+   225us) service_pool.cc:224] Handling call
0709 12:19:23.970519 (+1308512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:23.969635 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:24.076738 28673 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 7.
W20260709 12:19:24.027767 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 145604us
I20260709 12:19:23.967795 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.081002 29323 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:24.081199   503 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:24.081527 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 943) took 1457 ms. Trace:
I20260709 12:19:24.081636   503 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.081912 29323 rpcz_store.cc:276] 0709 12:19:22.623766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.967520 (+1343754us) service_pool.cc:224] Handling call
0709 12:19:24.081450 (+113930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.083004 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.083285 28681 raft_consensus.cc:2376] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11. Re-sending same reply.
I20260709 12:19:24.082827   503 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.083838 29323 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 8: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:23.970793 28607 rpcz_store.cc:276] 0709 12:19:22.807613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.807827 (+   214us) service_pool.cc:224] Handling call
0709 12:19:23.882839 (+1075012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.085395 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.085976 29323 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:24.049932 28604 rpcz_store.cc:276] 0709 12:19:22.624651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.625704 (+  1053us) service_pool.cc:224] Handling call
0709 12:19:24.049434 (+1423730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.089015 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.096897   451 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:24.097373   496 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:24.097466   451 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.098030   496 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.099001   451 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:24.099306   496 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:24.026933 28602 rpcz_store.cc:276] 0709 12:19:22.632507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.632652 (+   145us) service_pool.cc:224] Handling call
0709 12:19:23.664383 (+1031731us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.031795 29317 rpcz_store.cc:269] 0709 12:19:21.171540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.494443 (+322903us) service_pool.cc:224] Handling call
0709 12:19:22.586662 (+1092219us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ae9c 00007f6fe095aa5b 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:19:23.970238 (+1383576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40496512}
I20260709 12:19:24.034930 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:24.118078 28748 raft_consensus.cc:2410] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:24.026198 28606 rpcz_store.cc:276] 0709 12:19:20.346155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.145629 (+799474us) service_pool.cc:224] Handling call
0709 12:19:21.145910 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.007207 (+2861297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.008587 (+  1380us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b540022f954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:24.025515 (+ 16928us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5530281728}
W20260709 12:19:24.010056 29322 rpcz_store.cc:269] 0709 12:19:22.638763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.575930 (+937167us) service_pool.cc:224] Handling call
0709 12:19:23.895565 (+319635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.034060 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:24.035864 28749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2185) took 1426 ms (client timeout 1750 ms). Trace:
W20260709 12:19:24.119081 28749 rpcz_store.cc:269] 0709 12:19:22.609320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.618446 (+  9126us) service_pool.cc:224] Handling call
0709 12:19:24.035690 (+1417244us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54001b49d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:24.035811 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690529536}
W20260709 12:19:24.053089 28703 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab600 after lost signal to thread 28780
W20260709 12:19:24.121798 28703 debug-util.cc:398] Leaking SignalData structure 0x7b080037ffe0 after lost signal to thread 29351
W20260709 12:19:24.122146 28703 debug-util.cc:398] Leaking SignalData structure 0x7b08003956c0 after lost signal to thread 29352
I20260709 12:19:24.064030   529 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:24.064126 28600 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:24.034183 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62475.2us
I20260709 12:19:24.050668 28675 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.045282 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:24.104206 29323 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:24.109301 29327 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:24.102701 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:24.113253 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.082753   533 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.051805 28747 raft_consensus.cc:2376] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11. Re-sending same reply.
W20260709 12:19:24.045274 28751 rpcz_store.cc:269] 0709 12:19:21.573856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.761999 (+188143us) service_pool.cc:224] Handling call
0709 12:19:23.966199 (+2204200us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54001c5a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:23.966359 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4615935872}
I20260709 12:19:24.118546 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:24.130800 28748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2189) took 1519 ms (client timeout 1986 ms). Trace:
I20260709 12:19:24.130918 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:24.131311 28748 rpcz_store.cc:269] 0709 12:19:22.611088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.034682 (+1423594us) service_pool.cc:224] Handling call
0709 12:19:24.130737 (+ 96055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.131964 28756 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:24.033743   479 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:24.133715 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 108593us
W20260709 12:19:24.136065 28747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2188) took 1515 ms (client timeout 1964 ms). Trace:
I20260709 12:19:24.135596 28678 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
W20260709 12:19:24.141388 28747 rpcz_store.cc:269] 0709 12:19:22.610645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.973501 (+1362856us) service_pool.cc:224] Handling call
0709 12:19:24.126445 (+152944us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.142184 28756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2175) took 1557 ms (client timeout 1844 ms). Trace:
I20260709 12:19:24.136109 29326 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:24.138502 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 695) took 1317 ms. Trace:
I20260709 12:19:24.142982 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.143265 28600 rpcz_store.cc:276] 0709 12:19:22.808056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.063606 (+1255550us) service_pool.cc:224] Handling call
0709 12:19:24.063969 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.124885 (+ 60916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.125092 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.112751   503 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:23.966266   527 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:24.144039 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:24.142572 28756 rpcz_store.cc:269] 0709 12:19:22.575136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.617121 (+1041985us) service_pool.cc:224] Handling call
0709 12:19:24.132500 (+515379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.153023 29320 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:24.153548 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.154006 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.154677 28756 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:24.145012 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.155242 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 762) took 1536 ms. Trace:
W20260709 12:19:24.145478 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.145782 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.155740 28756 rpcz_store.cc:276] 0709 12:19:22.618729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.153214 (+1534485us) service_pool.cc:224] Handling call
0709 12:19:24.155170 (+  1956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.149960 28676 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:19:24.150741 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.130714 32242 raft_consensus.cc:2764] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:24.156608 29326 raft_consensus.cc:2368] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:24.145879 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.151726 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2480) took 3799 ms. Trace:
I20260709 12:19:24.132400   525 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:19:24.159422 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.178570 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 944) took 1538 ms. Trace:
W20260709 12:19:24.179230 28755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 760) took 1545 ms (client timeout 2043 ms). Trace:
W20260709 12:19:24.171031 28571 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.635s (SENT)
I20260709 12:19:24.173230 29317 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:24.171151 29318 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:24.165370 29321 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:24.173239 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.157215 28754 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:24.155743 29323 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:19:24.151281 28598 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:24.159991 29319 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 9: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:24.154704 29320 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:24.160313 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:24.182548 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 698) took 1373 ms. Trace:
I20260709 12:19:24.183005 28598 rpcz_store.cc:276] 0709 12:19:22.809048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.047250 (+1238202us) service_pool.cc:224] Handling call
0709 12:19:24.182476 (+135226us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.168917 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 1.3198e+06us
W20260709 12:19:24.181622 28755 rpcz_store.cc:269] 0709 12:19:22.618029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.138047 (+1520018us) service_pool.cc:224] Handling call
0709 12:19:24.163211 (+ 25164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.179067 29326 rpcz_store.cc:276] 0709 12:19:22.624174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.145494 (+1521320us) service_pool.cc:224] Handling call
0709 12:19:24.162869 (+ 17375us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.165535 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 76653.7us
I20260709 12:19:24.164404 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.165501 28601 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:24.186033 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 697) took 1377 ms. Trace:
I20260709 12:19:24.186549 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 947) took 1549 ms. Trace:
I20260709 12:19:24.186439 28601 rpcz_store.cc:276] 0709 12:19:22.808728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.034397 (+1225669us) service_pool.cc:224] Handling call
0709 12:19:24.185959 (+151562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.186900 29319 rpcz_store.cc:276] 0709 12:19:22.637256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.051323 (+1414067us) service_pool.cc:224] Handling call
0709 12:19:24.186503 (+135180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.169757 28505 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 306) took 30800 ms (client timeout 15000 ms). Trace:
I20260709 12:19:24.167335   539 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:19:24.165138   479 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:24.197053 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.197130 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:24.167192   435 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:24.198177 28602 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:24.199313 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:24.200235 28600 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:24.165732 28750 rpcz_store.cc:276] 0709 12:19:20.344204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:22.472541 (+2128337us) service_pool.cc:224] Handling call
0709 12:19:23.966593 (+1494052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.045816 (+ 79223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.119456 (+ 73640us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001c5a50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:24.143164 (+ 23708us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3397013760}
I20260709 12:19:24.201231 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.201869 28750 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:24.202286   496 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:24.202348 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 764) took 1583 ms. Trace:
I20260709 12:19:24.202812 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:24.202924 28750 rpcz_store.cc:276] 0709 12:19:22.619379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.200928 (+1581549us) service_pool.cc:224] Handling call
0709 12:19:24.202292 (+  1364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.203989 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.204716   535 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:24.205144   535 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:24.205523   535 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.205626 32581 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:24.170323 28502 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 7 to 8, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 8 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:24.207132 29321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 946) took 1570 ms (client timeout 2064 ms). Trace:
W20260709 12:19:24.207538 29321 rpcz_store.cc:269] 0709 12:19:22.636983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.008786 (+1371803us) service_pool.cc:224] Handling call
0709 12:19:24.207072 (+198286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.209201 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:24.209860 28753 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
W20260709 12:19:24.210436 28753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2176) took 1634 ms (client timeout 1856 ms). Trace:
I20260709 12:19:24.212702 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:24.212177 29327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 942) took 1588 ms (client timeout 1865 ms). Trace:
I20260709 12:19:24.208938 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.212803 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.210283 28750 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:24.213531 28748 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:24.213088 28753 rpcz_store.cc:269] 0709 12:19:22.575594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.850904 (+1275310us) service_pool.cc:224] Handling call
0709 12:19:24.210383 (+359479us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:19:24.213476 29327 rpcz_store.cc:269] 0709 12:19:22.623344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.947374 (+1324030us) service_pool.cc:224] Handling call
0709 12:19:24.212003 (+264629us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400610154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:24.212118 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311910784}
I20260709 12:19:24.215343 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.217862 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 765) took 1594 ms. Trace:
I20260709 12:19:24.218113 28750 rpcz_store.cc:276] 0709 12:19:22.619748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.203720 (+1583972us) service_pool.cc:224] Handling call
0709 12:19:24.213951 (+ 10231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.220247 28751 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
W20260709 12:19:24.220834 28751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2190) took 1609 ms (client timeout 2088 ms). Trace:
W20260709 12:19:24.221164 28751 rpcz_store.cc:269] 0709 12:19:22.611872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.142956 (+1531084us) service_pool.cc:224] Handling call
0709 12:19:24.220781 (+ 77825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.221336   406 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:24.172657   527 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:24.222105   527 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.221952 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.223188   527 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.224965 29320 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:24.225646 29322 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:24.227164 29322 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:24.227869 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 78971.8us
I20260709 12:19:24.228641 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.228852   370 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:24.229408   370 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.230082 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:24.230243 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:24.230461   370 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.231276 28647 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:24.231714   540 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.231838   539 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:24.232925   540 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:24.233042   471 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:24.233580   540 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.234347   471 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:24.234767   471 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.234822   435 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:24.235410   435 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.234885   540 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.235809   435 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.165055 28675 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:24.236851 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.224965   437 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:24.238062 28675 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:24.238415 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.240574   525 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:24.240701   497 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.241039   525 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.241786   497 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.242091   525 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:24.189152 28505 rpcz_store.cc:269] 0709 12:18:53.427489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:53.434460 (+  6971us) service_pool.cc:224] Handling call
0709 12:19:24.169486 (+30735026us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:14.473289 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:14.528330 (+ 55041us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:14.528387 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:19:14.528404 (+    17us) tablet.cc:662] Decoding operations
0709 12:19:14.529697 (+  1293us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:14.529785 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:14.529825 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:19:14.530944 (+  1119us) tablet.cc:701] Row locks acquired
0709 12:19:14.531002 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:19:14.531190 (+   188us) write_op.cc:270] Start()
0709 12:19:14.531317 (+   127us) write_op.cc:276] Timestamp: P: 1783599554531124 usec, L: 0
0709 12:19:14.532110 (+   793us) op_driver.cc:348] REPLICATION: starting
0709 12:19:14.532866 (+   756us) log.cc:844] Serialized 4749 byte log entry
0709 12:19:15.206300 (+673434us) op_driver.cc:464] REPLICATION: finished
0709 12:19:15.640302 (+434002us) write_op.cc:301] APPLY: starting
0709 12:19:15.640397 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:15.811738 (+171341us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:15.812966 (+  1228us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:15.818033 (+  5067us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:15.818405 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:19:15.818460 (+    55us) write_op.cc:312] APPLY: finished
0709 12:19:15.818879 (+   419us) log.cc:844] Serialized 83 byte log entry
0709 12:19:15.819067 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:15.819222 (+   155us) write_op.cc:454] Released schema lock
0709 12:19:15.819290 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:15.819757 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:15.819790 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3563122,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":425307,"apply.run_cpu_time_us":5445,"apply.run_wall_time_us":184792,"num_ops":11,"prepare.queue_time_us":199777,"prepare.run_cpu_time_us":72052,"prepare.run_wall_time_us":243604,"raft.queue_time_us":278614,"raft.run_cpu_time_us":17566,"raft.run_wall_time_us":323674,"replication_time_us":673949,"thread_start_us":769745,"threads_started":4,"wal-append.queue_time_us":273720,"wal-append.run_cpu_time_us":29750,"wal-append.run_wall_time_us":2921277}]]}
I20260709 12:19:24.240185 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.236588 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:24.250084 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.223934 28571 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:24.267381 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.267647 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.217495 29319 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:24.270140 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:24.270347 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 54837.6us
W20260709 12:19:24.270853 28755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 763) took 1651 ms (client timeout 2160 ms). Trace:
W20260709 12:19:24.271258 28755 rpcz_store.cc:269] 0709 12:19:22.619015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.187877 (+1568862us) service_pool.cc:224] Handling call
0709 12:19:24.270792 (+ 82915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.272403 28756 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:19:24.274253 28754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2187) took 1664 ms (client timeout 1940 ms). Trace:
W20260709 12:19:24.274890 28754 rpcz_store.cc:269] 0709 12:19:22.610241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:23.932861 (+1322620us) service_pool.cc:224] Handling call
0709 12:19:24.274060 (+341199us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54003e9754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:24.274180 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357140352}
W20260709 12:19:24.276543 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46465.9us
W20260709 12:19:24.277876 28756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2178) took 1701 ms (client timeout 2165 ms). Trace:
W20260709 12:19:24.278786 28756 rpcz_store.cc:269] 0709 12:19:22.576404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.163362 (+1586958us) service_pool.cc:224] Handling call
0709 12:19:24.277820 (+114458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.280676 29327 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:24.280735 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 56962.2us
W20260709 12:19:24.281598 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49187.3us
I20260709 12:19:24.281644 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:24.282747 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:24.284224 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 766) took 1664 ms. Trace:
I20260709 12:19:24.284719 28753 rpcz_store.cc:276] 0709 12:19:23.549627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.214510 (+664883us) service_pool.cc:224] Handling call
0709 12:19:24.284143 (+ 69633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.279811 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.287317 29321 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:24.269603 28502 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:24.287930 29317 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
W20260709 12:19:24.289758 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 73883.9us
I20260709 12:19:24.289862 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:24.290788 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:24.291651 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 191857us
I20260709 12:19:24.243431   525 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:24.290992 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:24.299045 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.235769   471 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.299170 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.297111 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:24.301272 28755 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:24.277771   346 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:24.302552 29326 raft_consensus.cc:2410] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:19:24.302448 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:24.301723 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.304510 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:24.289728   402 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.306015 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:24.307709 28756 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:24.298764 32581 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:24.297140   527 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:24.309007 28754 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:24.289330   539 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.312032 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:24.316845 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 76762.4us
I20260709 12:19:24.317435 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:24.318246 28752 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 9: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:24.318434 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:24.318657 28752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2174) took 1744 ms (client timeout 2174 ms). Trace:
W20260709 12:19:24.319046 28752 rpcz_store.cc:269] 0709 12:19:22.574631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.178750 (+1604119us) service_pool.cc:224] Handling call
0709 12:19:24.317322 (+138572us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aeee 000000000036eb39 00007f6fe89ce1e0 00007f6fe8a970c4 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:19:24.318580 (+  1258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65671936}
I20260709 12:19:24.320648 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:24.322072 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.323414 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.323611 28601 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:24.324560 28604 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:24.323410 28598 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:24.324610   537 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:24.326045 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:24.331358 28675 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:19:24.340718 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48792.5us
I20260709 12:19:24.346334 28753 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:24.347795 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2171) took 2770 ms. Trace:
I20260709 12:19:24.328564   451 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:24.348676 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:24.348104 28752 rpcz_store.cc:276] 0709 12:19:21.571310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.319902 (+2748592us) service_pool.cc:224] Handling call
0709 12:19:24.320307 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.331919 (+ 11612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.331960 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:24.332022 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:24.341047 (+  9025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.341142 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.341257 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.338970   346 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:24.346380 28606 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:24.339202   532 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:24.337790   537 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:24.355952 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44827.4us
I20260709 12:19:24.356848 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2169) took 2786 ms. Trace:
I20260709 12:19:24.357422 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2172) took 2785 ms. Trace:
I20260709 12:19:24.339699 32581 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.360606   550 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:24.360651 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 89626.6us
I20260709 12:19:24.364820 28755 raft_consensus.cc:2410] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 12 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:24.365576 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:24.354610 28502 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:24.330873   402 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:19:24.367868 28754 rpcz_store.cc:276] 0709 12:19:21.571563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.332139 (+2760576us) service_pool.cc:224] Handling call
0709 12:19:24.356866 (+ 24727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.357090 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.357120 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:24.357171 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:24.357212 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.357267 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.357366 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.369719 29318 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:24.344209   406 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:24.367801 28756 rpcz_store.cc:276] 0709 12:19:21.570778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.330957 (+2760179us) service_pool.cc:224] Handling call
0709 12:19:24.356253 (+ 25296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.356512 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:24.356537 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:24.356598 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:24.356631 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.356683 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:24.356779 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.345948   551 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:19:24.373945 32242 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:24.374199   550 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:24.375507   406 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:24.375337   550 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:24.375999   406 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:24.372604 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:24.378171   536 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:24.379935   457 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:24.380317   457 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.381254   457 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.382141 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 949) took 1744 ms. Trace:
I20260709 12:19:24.382457   457 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.383049   471 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:24.384025 28754 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:24.384814 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:24.386200   532 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:24.387073 32242 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.387198   532 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.388105 28753 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:19:24.388463 28753 pending_rounds.cc:85] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 4
I20260709 12:19:24.388685 28753 pending_rounds.cc:107] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:19:24.388968 28753 raft_consensus.cc:2889] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:24.389053   497 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:24.389708 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2173) took 2817 ms. Trace:
I20260709 12:19:24.389993   531 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:24.390095   480 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:24.382584 29327 rpcz_store.cc:276] 0709 12:19:22.637997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.217249 (+1579252us) service_pool.cc:224] Handling call
0709 12:19:24.280493 (+ 63244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.281209 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.381913 (+100704us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b5400533ed0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:24.382052 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70218496}
I20260709 12:19:24.390635   480 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.391204 28749 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:24.391614   480 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.392351 32581 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.393164 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:24.395859 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:24.386214 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:24.398630 28748 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
W20260709 12:19:24.399477 28748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2177) took 1823 ms (client timeout 2255 ms). Trace:
W20260709 12:19:24.401911 28748 rpcz_store.cc:269] 0709 12:19:22.576029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.212388 (+1636359us) service_pool.cc:224] Handling call
0709 12:19:24.399425 (+187037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.399822 29325 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:24.390031 28753 rpcz_store.cc:276] 0709 12:19:21.571806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.350485 (+2778679us) service_pool.cc:224] Handling call
0709 12:19:24.372124 (+ 21639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.389463 (+ 17339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.389655 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64128}
I20260709 12:19:24.403462 28750 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
W20260709 12:19:24.413184 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45499.3us
W20260709 12:19:24.417104 28749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 761) took 1798 ms (client timeout 2061 ms). Trace:
W20260709 12:19:24.417636 28749 rpcz_store.cc:269] 0709 12:19:22.618351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.138421 (+1520070us) service_pool.cc:224] Handling call
0709 12:19:24.416876 (+278455us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54002d5ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:24.417017 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499946752}
I20260709 12:19:24.419610 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.424086 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:24.426749 28752 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:24.427951 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 129529us
I20260709 12:19:24.370332   537 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:24.430168 28502 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:24.433831 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.422246   453 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:24.422104   455 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:24.421895   454 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:24.438488 28751 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:24.438505 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 73021.4us
I20260709 12:19:24.435256   533 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:24.435702 32242 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:24.447731 28502 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 4 to 9, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 9 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:24.448675 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2193) took 1828 ms. Trace:
I20260709 12:19:24.478006 28751 rpcz_store.cc:276] 0709 12:19:22.617098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.354332 (+1737234us) service_pool.cc:224] Handling call
0709 12:19:24.408972 (+ 54640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.442549 (+ 33577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.445781 (+  3232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:24.437263   453 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.451869   553 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:24.455741   406 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.435498   346 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:24.446887   503 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:24.459966 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:24.503384 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.444975   539 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.436867   480 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:24.464341 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2192) took 1847 ms. Trace:
I20260709 12:19:24.439100   454 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:24.473321 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.445233   373 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.457393 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:24.502139 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 68371us
I20260709 12:19:24.470803   549 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:24.505537 28752 rpcz_store.cc:276] 0709 12:19:22.616677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:24.353800 (+1737123us) service_pool.cc:224] Handling call
0709 12:19:24.372099 (+ 18299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:24.428678 (+ 56579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:24.463996 (+ 35318us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b5400338954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:24.464263 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121556096}
I20260709 12:19:24.449520   533 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:24.487318   453 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:24.509752 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 163587us
I20260709 12:19:24.510411 28502 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
W20260709 12:19:24.512580 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 115505us
W20260709 12:19:24.515439 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 173395us
I20260709 12:19:24.518496 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.520881 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.521530 28675 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:24.520922 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:24.509799   454 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.511530   503 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.512025   549 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:24.529809   455 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:24.530383 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57162.7us
I20260709 12:19:24.518867   525 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.546066 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.546782   346 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.547318 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.531831 28679 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:19:24.532671 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 75370.6us
I20260709 12:19:24.524464 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:24.551491 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.533962 28502 catalog_manager.cc:5697] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 5 to 9, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:24.516652   533 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.516817   534 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:24.553570 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.549757   529 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:19:24.570055 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.571816 29327 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:24.550681   373 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:24.574739 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:24.580722 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:24.585254 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:24.550612   455 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.587616 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.588246 28677 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:24.588632 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:24.587950 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.590436 28676 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:24.591449 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.592876 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.593631 28676 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:24.594621 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.595485 28676 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:24.596935 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:24.542039   479 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:24.598665 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:24.636243 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 117808us
I20260709 12:19:24.637336 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.599457 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.599607 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.601260 28502 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:24.596830   373 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.635411 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:24.604624   559 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:19:24.604892   346 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:24.604840   549 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.575471 32581 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:24.568604   551 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:19:24.574035   515 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:24.584755   553 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:24.614146 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:24.614413   406 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:24.614713 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.612320   455 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.702863   455 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:24.617763 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:24.704619   550 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:24.706845   563 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.116s	user 0.003s	sys 0.000s
I20260709 12:19:24.617707 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:24.574326   369 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:24.709213   553 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.709668   553 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:24.712626   515 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:24.713531   515 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.620677   535 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:24.717027 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 103039us
I20260709 12:19:24.718400   535 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:24.718593 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:19:24.613103   518 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 12:19:24.621191   503 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.720065   537 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.721287 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.575742 32242 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:24.655239 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 85319.6us
I20260709 12:19:24.640515 28502 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 3 to 9, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 9 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:24.673123 28680 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:24.672369 28681 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
W20260709 12:19:24.679541 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 98622.9us
I20260709 12:19:24.680500   479 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.681361 32581 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:24.684716   560 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:24.682947   454 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.696889 28600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:24.697484   549 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:24.674881   451 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:24.720199   373 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.626190   453 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.589057   435 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:24.632045   562 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:19:24.722992 29320 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:24.724027 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.742669 29327 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.727521 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.731957 28600 raft_consensus.cc:606] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:24.744778 28600 raft_consensus.cc:614] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:24.718199   533 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.722499   551 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:24.740528 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.731037   540 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:24.736333   496 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:24.736713 28502 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 10 to 12, now has a pending config: VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129), VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130), VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131), VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 12 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:24.765087   529 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:24.739123   451 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:24.768369 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 194401us
I20260709 12:19:24.771515   529 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:24.804991   496 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:24.804191 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 126754us
I20260709 12:19:24.759027   551 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:24.765946 28673 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:24.761632   540 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:24.813956 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.769852 28502 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 3 to 4, term changed from 9 to 11, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to <none>, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129), VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130), VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131), VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:24.858269 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 96833.7us
I20260709 12:19:24.818897 29327 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
W20260709 12:19:24.836114 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 198836us
I20260709 12:19:24.863086 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:24.822479 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 101258us
I20260709 12:19:24.809742 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.865882 29320 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:24.868755 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 128345us
I20260709 12:19:24.869760   381 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:24.835991   529 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:24.877126   381 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.877619   435 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:24.878105   381 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:24.881095 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.884126   573 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.772606   402 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:19:24.886040   402 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:24.886304 32581 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:24.886406   402 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.887044 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.887934 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:24.888706   479 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:24.888605 28502 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 6 to 9, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 9 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:24.890712 28502 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 6 to 9, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 9 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:24.891287   454 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:24.867758 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:24.893344 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.893966 29325 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.896476 28600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:24.897117 28600 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.897310   369 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:24.898985   529 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:24.897482 28600 raft_consensus.cc:614] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:24.808864   451 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:24.902565 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.919900 29327 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:24.921168 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:24.934123 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.921691   533 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:24.943428   454 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:24.923170   369 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:24.923374 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:24.812824   537 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:24.861788   551 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:24.925631   529 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:24.926966 29325 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:24.946453 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.975183 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:24.976747 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:24.977418 29317 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:24.771809   480 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:24.921412   453 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:24.947403   369 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:24.941860 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.942628   435 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:24.924742 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.866025   540 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:24.944674   497 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:24.977790 29327 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:24.977502   503 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:24.941247   402 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.981688   533 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:24.960240   531 raft_consensus.cc:2764] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:19:24.992981 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46603.4us
I20260709 12:19:24.975622 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:24.902789 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.988065 28600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:24.994355 28600 raft_consensus.cc:606] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:24.985101   369 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:24.989405   515 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:24.987383 28502 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:24.994783 28600 raft_consensus.cc:614] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:24.988070   497 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.999644 28502 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 7 to 8, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 8 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.001114   533 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:25.001587   496 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:25.002198   533 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.002849 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:19:25.004681 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 80017.2us
W20260709 12:19:25.004992 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63242.9us
I20260709 12:19:25.005759 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:25.006104 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:25.006527 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:25.006381   553 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.007630   406 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:25.004309 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:25.008983 29318 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:25.008862   497 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:24.991645   550 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:25.009773   402 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.010100   529 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:25.010175   497 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.011376   457 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:25.011778   457 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:25.012143   457 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:25.012979   480 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:25.013012 29323 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:25.008131 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:25.015753 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 114173us
I20260709 12:19:24.994172   503 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:24.996189   515 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.026301 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:25.028160 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:24.990784   453 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 12:19:25.032291   576 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:19:25.033401 28606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:25.030884 29323 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:19:25.034004 28606 raft_consensus.cc:606] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:25.034808   503 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.035667 29326 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:25.039472 29319 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:25.043763 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:25.027912   455 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:19:25.032275   480 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:25.035272 29323 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:25.032891   531 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:25.060062   531 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:25.060547   531 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.031875   573 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:25.044819 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.040108 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.044588   496 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:19:25.053120 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:25.070998 29317 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:25.072870 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:25.054915   457 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.056859   549 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:25.058236 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:25.058915 29325 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:25.080076 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 72009.8us
I20260709 12:19:25.028841   550 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:25.083947 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 221079us
I20260709 12:19:25.031464   515 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.087397 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.077344   518 raft_consensus.cc:2764] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:19:25.077178   549 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.091279 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.095973 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.096885 28682 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:25.102715 28682 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:25.104478 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46301us
I20260709 12:19:25.098244 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.106472 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.106617 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:25.085598   455 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:25.083470   550 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:25.065059   453 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 12:19:25.109467 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.109629 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.085333   454 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:25.088564   573 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:25.088352   539 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:25.118348 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.118556 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.091246   496 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:25.149606 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:25.107697   529 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:19:25.158138   540 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.159168 28681 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:25.117842   454 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:25.160339 28673 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:25.108776   373 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.101231   369 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.116629   550 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.135628   437 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:25.137413   553 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:25.105300   549 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:25.127526 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 87521.1us
I20260709 12:19:25.102741 32242 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:25.126056 28682 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.176878 28682 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.178941 28677 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:25.179298 28677 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.179670   369 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:25.141574   551 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.173710   536 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:25.143715   457 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:25.170301   373 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.132018   370 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:19:25.182411 28680 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:25.182914   373 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:25.185882 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.122644   527 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:19:25.147302 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:25.147873 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:25.151734 29320 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:25.130733   525 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:19:25.154554   568 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:25.156181   496 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:25.160734   454 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.197397 28572 leader_election.cc:400] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:25.197268   451 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.131223   539 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.199083   539 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.199923   534 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:19:25.131080   455 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:25.200330   539 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:25.200881 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.201159   455 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.202026   346 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:25.202189 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.203378 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:25.172535 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 63023.9us
I20260709 12:19:25.171824 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:25.173987 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:25.189352 29326 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.169394 28673 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:25.170403   531 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.194949   551 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:25.195967   435 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:25.196357 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.192152   553 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:25.197840 28572 leader_election.cc:403] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:25.199538   451 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:25.203157   550 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.180101 28677 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.160215   540 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:25.241119 28600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:25.186602 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:25.204174   568 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:25.242851 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.245114 28681 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:25.204510 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.242027 28600 raft_consensus.cc:606] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:25.250660 28600 raft_consensus.cc:614] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:25.249325 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60542.5us
I20260709 12:19:25.251834 28676 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:25.255177 29321 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:25.259302 29322 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:25.227303   346 raft_consensus.cc:2764] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:19:25.266976   437 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.267532 28674 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:19:25.268035   567 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:19:25.259963   535 raft_consensus.cc:2764] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:19:25.268646 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:25.269182 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:25.269749 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.270269 28679 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.271066 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:25.271294   550 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:25.271981   534 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:25.273058   534 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:25.273386   534 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:25.274194   534 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.275331   534 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.276140   437 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:25.267011 28677 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:25.276769 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 79560.3us
I20260709 12:19:25.277575 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.256366   497 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:25.241140   553 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:25.285061 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:25.285251 28677 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:19:25.285356 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 111436us
I20260709 12:19:25.291061 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.293256 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:25.286034 28682 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:25.286716   571 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:19:25.295612 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.313594 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 127054us
I20260709 12:19:25.308830   529 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:25.325090   529 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:25.308019   435 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:25.328315   435 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:25.328855   435 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:25.331204 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53727.2us
I20260709 12:19:25.307986   571 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:25.332813   571 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.334410   571 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.313669   497 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:25.336396   497 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:25.337404   497 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.312150   451 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:25.344050   553 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.346980 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.351073   539 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:25.351426   471 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:25.357578 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:25.364570 28756 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:25.358882 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:25.365379 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 160939us
I20260709 12:19:25.361196 29322 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:25.360528 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:25.359810 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:25.367034 28754 raft_consensus.cc:2410] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:19:25.367501 29319 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:25.358196 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:25.359315 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.369316 28747 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:19:25.371176 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.378014 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.377676 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.315090   550 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:25.384954 29327 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:25.352504   471 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:25.389320   471 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.389741 29325 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:25.390173   471 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.391548   471 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.360769   496 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:25.379799   480 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:19:25.368793   535 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:19:25.357934   589 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:25.394325 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:25.362104 32242 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:19:25.359455   451 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:19:25.411669 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:25.355945   373 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 12:19:25.416067 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 173274us
I20260709 12:19:25.411960   525 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:19:25.423781   525 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:25.424010   531 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:25.424793   540 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:25.425186   540 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.425992   540 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.427138   540 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.415073   589 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.412631   572 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:25.428992   589 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.430308   589 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:25.420171 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54019.5us
I20260709 12:19:25.433012 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.377813   437 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:19:25.410519   529 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:19:25.433277 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.359005   503 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:19:25.395527   573 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:25.437453   535 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:25.395777   496 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.444048 28756 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.445458 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:25.436311 28572 connection.cc:256] RPC call timeout handler was delayed by -1.1887554600000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260709 12:19:25.447664   529 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:25.449049   525 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:25.449806   479 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:19:25.453521 28572 connection.cc:256] RPC call timeout handler was delayed by -1.1394064309999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 12:19:25.453544 28752 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:25.454912 28679 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:25.352415   539 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:25.454622   529 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.459091   529 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.460991 28753 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:19:25.461234   370 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.461721   370 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.462910   539 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.473702 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:25.464170 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:25.467038 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:25.474342 28682 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:25.470058 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:25.463318 28750 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.474545 28748 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:25.469105 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:25.476202 29317 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:19:25.477761 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.466033 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:25.480419 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.480751 29327 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:25.460264   529 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:25.481389 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.476467 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:25.477555   549 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:25.487776 28572 leader_election.cc:336] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.865s (SENT)
I20260709 12:19:25.488358 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.490087 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:25.492400 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:25.440253   531 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:19:25.463795   370 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:25.498366 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.484277   346 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:25.443161   454 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:25.501680 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 68465.5us
I20260709 12:19:25.507277 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:25.507499 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.484803   550 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:25.507822 28755 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:25.464078   551 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:19:25.514858 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:25.520571 28750 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:19:25.520917 28750 pending_rounds.cc:85] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 7
I20260709 12:19:25.521155 28750 pending_rounds.cc:107] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:19:25.521358 28750 raft_consensus.cc:2889] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:25.521634   549 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:25.522682 28747 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:25.523669   454 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:25.524765   568 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:25.525177   568 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:25.525539   568 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.501217   573 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:19:25.536134   593 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
W20260709 12:19:25.540735 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60078.2us
I20260709 12:19:25.555447 28752 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:25.556809 28755 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:25.540711   496 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.566565 28756 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:25.591676 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.598924 28756 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:25.602617 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.548094   346 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:25.559374   573 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:25.569300   550 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:25.604755 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.603490 28606 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:25.607242 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.608022 28600 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:25.609335 28601 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:25.558974   539 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.610225   539 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:25.621119 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.626036 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.634732 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.642328 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.626533 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:25.654052 28756 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:25.655119 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 156859us
I20260709 12:19:25.655294 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:25.602046   572 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:25.713745 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.752514 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.777015 28603 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:25.756050 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:25.779371 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 264565us
I20260709 12:19:25.780200 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.603014 32242 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:25.791438 28602 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 13. Ops: []
I20260709 12:19:25.793634 28600 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:25.801048 29322 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.801077 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:25.802155 29317 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.817349 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:25.817886 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.818055 28755 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:25.589367   435 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.818724 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:25.826627 28607 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:25.781297   455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.004s	sys 0.016s
I20260709 12:19:25.769702   573 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:25.830811 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:25.833266 28755 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:25.791409   567 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.838807 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.839481 28602 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:25.840272 29317 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
W20260709 12:19:25.841969 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.842599 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:25.828598   455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.004s	sys 0.016s
I20260709 12:19:25.843309 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.845491 28606 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:25.846616 28756 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:25.848676 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.849418 28602 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:25.850559 28751 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:25.850713 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.852008 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:25.850638 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:25.862496 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.863456 28603 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:25.866832 28756 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:25.828472 32242 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:25.830031   553 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:25.837105   496 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.897307 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:25.853406   454 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.853286   471 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:25.869252   549 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:25.902175 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.873167   406 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:25.915555 28605 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
W20260709 12:19:25.915910 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.881537   455 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:25.916878   406 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:25.922063   451 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:25.923317 28755 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: [7.5-8.6]
W20260709 12:19:25.925163   598 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:19:25.888716   604 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:25.846692   567 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.935953 28601 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:25.937654 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:25.946651 28756 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.943733 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:25.944952   549 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:25.947957 28607 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.949785 28602 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:19:25.951133 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 108606us
W20260709 12:19:25.953034 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:25.940291 28600 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:25.940514   406 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:25.914990   471 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.904335   454 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.993407   549 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.995076   471 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:25.873752   346 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.996755 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:25.997126 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54434.6us
I20260709 12:19:25.998365 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:25.999536 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:25.999944   471 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:26.000377   471 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.000761   471 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.888368   550 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.003969   600 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:26.005311   587 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:25.945462   451 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.005757   587 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:26.006675   587 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.007321   451 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:26.007905   451 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:25.989647   529 consensus_meta.cc:287] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.502s	user 0.003s	sys 0.008s
I20260709 12:19:25.990339   560 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:19:25.991166   605 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:19:25.991557   568 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:25.940138   455 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:25.969062   608 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:25.939961   370 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:19:25.992771   567 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:26.004215   525 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:26.005163   600 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:25.987498 29323 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:25.985080 28756 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:25.967870   527 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.025079 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:25.945613   551 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:19:26.052784 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.053140 28606 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:26.054215 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:25.987320   604 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.007921   587 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:26.052459   597 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.451s	user 0.001s	sys 0.000s
I20260709 12:19:26.063220   527 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.058776 28677 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:26.077101   611 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:19:26.077579   435 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:26.058863 28676 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:26.058858 28673 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:26.059926 29325 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:26.063000 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 211053us
W20260709 12:19:26.065239 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.083889   454 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:26.087797 28677 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:26.021371   560 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:26.073661   455 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:26.063043   370 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:26.063194   525 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:26.008352   451 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.025010 32242 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:26.076005 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.125483 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.067238   604 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.117511 28607 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:25.949704   573 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.059180   553 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:26.135118   618 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:26.130507 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.134680   435 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:26.123225   437 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:26.118713   370 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:26.136348 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 302179us
I20260709 12:19:26.151399 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.141626 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:26.152284 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.134759   525 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.153367 28602 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:26.153838   550 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:26.133817 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.176908 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.135890   451 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:26.178879 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.183641 28607 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:26.186842 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.187659 28605 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:26.135946   618 consensus_queue.cc:1243] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:19:26.185984 28722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.538s (SENT) [suppressed 77 similar messages]
I20260709 12:19:26.174865   454 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.179289   567 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:26.185317   535 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:26.207432   613 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:26.209367   568 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:26.193485 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:26.206555   589 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.000s
I20260709 12:19:26.216739   454 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.220739   604 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:26.222538   592 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.710s	user 0.005s	sys 0.000s
I20260709 12:19:26.192476 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:26.223237   515 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.121s	user 0.011s	sys 0.001s
W20260709 12:19:26.224109   540 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.797s	user 0.003s	sys 0.009s
I20260709 12:19:26.224392   618 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:19:26.225083 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.136011   553 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:26.226490 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.251989 28606 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
W20260709 12:19:26.244730 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52375.8us
I20260709 12:19:26.255120 28681 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:26.266120 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.267001 28606 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:26.266875 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:26.254731   381 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:26.275848 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:26.277729 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:26.256577   618 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:26.267947   619 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:19:26.266925 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.197736   560 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.304975 28606 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:26.233127   613 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.289930   381 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:26.319819 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 259903us
I20260709 12:19:26.259651   515 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.326346 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:26.320243 28601 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:19:26.325683 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:26.301203   571 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:26.327345 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.331882 28604 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:26.329713 28673 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:19:26.333060 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.339495 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.340219 28601 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.264079   370 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.326254   381 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.329857   560 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.355079 28676 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:26.356894 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:26.358861 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 172904us
I20260709 12:19:26.362895 28677 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:26.367954 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:26.360170 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 90296.3us
I20260709 12:19:26.328872   471 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.376531 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:26.335255   531 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:19:26.379961 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:26.382992 28676 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:26.383805 28604 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:19:26.385201 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 91295.3us
I20260709 12:19:26.385114 28601 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:26.367972   621 raft_consensus.cc:993] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:26.349189   567 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:19:26.387789 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:26.388614 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.389765 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:26.391016 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70231.4us
I20260709 12:19:26.391634 28603 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:26.391919 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.343019   406 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.394084 28601 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:26.398321 28604 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:26.386260   540 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:26.406625 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.393747 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:26.440719 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.389833   551 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:26.446436 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:26.446884 29317 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:26.447077 28754 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:26.448625 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:26.395143 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:26.441938 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.442606 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.398443   572 raft_consensus.cc:1081] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:26.365218   618 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.448662   624 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:26.465068   533 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:26.465965 28677 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:26.397858   454 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:26.450387 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55294.6us
W20260709 12:19:26.463869   627 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:19:26.499423 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:26.501526 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.504091   515 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:26.464269   437 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:26.536595   437 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:26.509366   471 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:26.511675   534 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.236s	user 0.011s	sys 0.004s
I20260709 12:19:26.441125   540 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:26.499058   551 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.513703   535 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:26.553406   540 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.556669   647 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.557075   653 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:26.557598   653 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:26.557260   647 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.558485   653 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.559532   647 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:26.561226   608 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:26.561658   608 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:26.562572   608 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.462081   630 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.206s
I20260709 12:19:26.563647   608 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:26.462970   634 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.202s
I20260709 12:19:26.568357   634 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:26.568825   634 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:26.569852   634 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.571599   634 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.531744   604 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:19:26.549909   567 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.529170   533 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:26.573762   567 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.574958   533 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:26.514415   496 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.005s
I20260709 12:19:26.518126 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:26.520558   623 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:19:26.461822   644 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:19:26.522184 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2073) took 1056 ms. Trace:
I20260709 12:19:26.499290   525 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Committing config change with OpId 10.10: config changed from index 4 to 10, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:26.602077 28676 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:26.523685   613 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:26.524608 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:26.524736 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 66914.7us
I20260709 12:19:26.603204 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.525319   529 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:26.525686 28601 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:26.444422   617 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:26.462875   628 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:19:26.459976 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66463us
I20260709 12:19:26.530807 28604 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:26.531422 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:26.578411 29318 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
W20260709 12:19:26.576649   636 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.131s	user 0.001s	sys 0.002s
I20260709 12:19:26.610261 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:26.583317 28681 rpcz_store.cc:276] 0709 12:19:25.465722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.467619 (+  1897us) service_pool.cc:224] Handling call
0709 12:19:25.485094 (+ 17475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.264696 (+779602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.521970 (+257274us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b5400299854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:26.522127 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750289280}
I20260709 12:19:26.597204 28600 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:26.585119 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:26.613893 28679 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:26.605569 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 64245.7us
I20260709 12:19:26.615860 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:26.616556 29325 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:26.609091   534 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:19:26.620703   437 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.623032 28601 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:26.607457 28605 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:26.606217   567 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:26.609956   571 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:26.638943 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:26.612241   568 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:26.645592 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 114246us
I20260709 12:19:26.614113   589 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.649848 28679 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:26.621999   613 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:26.651526 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:26.659859   642 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:19:26.660547   654 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:26.658308   479 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:26.661134   527 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:26.661346   479 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:26.661800   479 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:26.662403   437 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:26.663321 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.663103   589 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.657366   568 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.667403 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:26.669090 29323 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:26.674366 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:26.643141   644 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:26.675128 29327 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:26.642994   571 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:26.683058 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.666018   531 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:26.685168   531 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:26.686579   618 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.686247   531 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.661151   654 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:19:26.693655 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 154996us
I20260709 12:19:26.676745   587 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:26.708197 28572 leader_election.cc:336] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 2.064s (SENT)
I20260709 12:19:26.708848 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:26.709721   437 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:26.710820 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.711230 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.651298   557 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:19:26.714540 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.715351 28599 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:26.720201   651 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:26.722535   551 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:26.730605 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.693377   624 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:26.733193 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.734218 28600 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:26.691365   644 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:26.746872 28604 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:19:26.749655 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:26.680092   381 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.751848 28600 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:26.704888   643 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:26.753227 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:26.753360 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 75522.9us
W20260709 12:19:26.752250   549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.003s	sys 0.008s
I20260709 12:19:26.757908 28598 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:26.766660 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.759433   626 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:19:26.766793 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.765275 28601 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:26.764701 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.770474 28598 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:26.775745 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 83919.2us
W20260709 12:19:26.769140   549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.004s	sys 0.008s
I20260709 12:19:26.764271   604 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:26.780761 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.781011 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.780375 28603 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:26.783246 28600 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:26.785485 28605 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:26.785383 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.767297   589 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:26.776206   497 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:26.798601   602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.022s	sys 0.022s
W20260709 12:19:26.799016   602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.022s	sys 0.022s
W20260709 12:19:26.799305 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.798880   646 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:26.799899   646 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.802376   646 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:26.805900   644 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.781467   557 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:26.813088 28598 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:19:26.784394   604 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.816403 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:26.818210   657 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:26.818989   381 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:26.792568   647 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:26.822594 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.798105   626 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:26.824376 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.824970 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.826170   649 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:26.826347   451 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:26.826606   646 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:26.827414   646 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.764508   571 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.797230   654 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.827853   646 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:26.829384   615 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.571s	user 0.000s	sys 0.003s
I20260709 12:19:26.825476   657 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:26.855335 29322 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:26.800652   652 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:19:26.858119 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:26.865188 29322 raft_consensus.cc:2410] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:19:26.859972   534 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:26.860167   646 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:26.863230 29327 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:26.816622   604 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:26.867416 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:26.876813 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:26.877306 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:26.875905 28600 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
W20260709 12:19:26.878131 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 53223.3us
I20260709 12:19:26.878805 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:26.811144   497 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.883710 28599 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:26.883849 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:26.884074 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.886126 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:26.862636   634 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:26.886864 28751 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:26.887804 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:26.888075 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.889072 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:26.890347 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:26.891644 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.891970 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.883143   589 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:26.893736 29322 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:26.895514 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.895952 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.896342 28603 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:26.896715 28598 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:26.875380   515 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:26.896907 28752 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:26.899538 28756 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:26.897730 28754 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:26.834761   381 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:19:26.898283 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.821513   557 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.900427 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:26.903903 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.904276 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2492) took 1450 ms. Trace:
I20260709 12:19:26.904425 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:26.902367 28603 raft_consensus.cc:2376] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10. Re-sending same reply.
I20260709 12:19:26.906078 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.906771 28607 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:26.906872 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.907322 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.907682 28605 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.907836 28600 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:26.899499   644 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:26.890303   549 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:26.910264   549 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.910120   635 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:19:26.910683   549 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.912582   540 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:26.913224   540 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:26.910538 28754 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:26.906255 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:26.915216 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:26.915179 28755 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:26.915952 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:26.919886 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.896826   589 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:26.904706 28749 rpcz_store.cc:276] 0709 12:19:25.454120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.454273 (+   153us) service_pool.cc:224] Handling call
0709 12:19:25.475649 (+ 21376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:25.491600 (+ 15951us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:25.786031 (+294431us) log.cc:844] Serialized 14 byte log entry
0709 12:19:26.012319 (+226288us) log.cc:844] Serialized 14 byte log entry
0709 12:19:26.012416 (+    97us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.060241 (+ 47825us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.060608 (+   367us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:26.061699 (+  1091us) log.cc:844] Serialized 14 byte log entry
0709 12:19:26.061867 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.061935 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:26.828734 (+766799us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:26.904086 (+ 75352us) raft_consensus.cc:1685] finished
0709 12:19:26.904107 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:26.904222 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":403377,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":4713,"raft.queue_time_us":26554,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":11292,"spinlock_wait_cycles":4846336,"thread_start_us":331511,"threads_started":2,"wal-append.queue_time_us":369833}
I20260709 12:19:26.890523   646 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:19:26.927927   540 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.922681   649 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:26.933566   616 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.933931   589 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:26.934094   616 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.904865   515 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:26.941282 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:26.938994 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.939725 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.944132 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:26.944840 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:26.945235 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:26.944876 28753 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:26.947165 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.947726 28598 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:26.947916 28603 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:19:26.945812 28750 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:26.909718   655 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:19:26.952631 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:26.960332 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 76398.3us
I20260709 12:19:26.957928 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.960999 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.961179 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:26.942389 28751 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 4 to 10, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:26.922463   451 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:26.963503 28605 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:26.953308 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:26.964536 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:26.969825 28752 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:26.965368 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:26.970642 28600 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:26.966121 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:26.967648 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:26.932313   497 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:26.966454 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:26.937319   618 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:26.942902   635 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.982492 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:26.984380 28755 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:26.986411 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:26.959456   527 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:26.958957   626 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:26.989332 28749 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:19:26.926432   479 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:26.973520   451 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:26.976099   644 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:26.979192   534 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:26.971664   646 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:26.988674   635 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.020715   644 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.020884   646 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.014467   451 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:26.978468   529 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:27.022527   635 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.022790   644 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.022913   529 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.024832   557 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.025060   529 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:26.987576   630 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:27.026574   630 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.026937   630 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:27.030947 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.016235 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:27.033135 28749 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:26.976464   531 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:19:27.029634   646 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:26.992389   497 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:26.993014   527 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.037799   604 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.045297   647 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.048691   680 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.045696   451 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.050081 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:27.051645 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:27.059123 28755 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:27.061292 28750 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:27.004777   549 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.052723   654 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:27.066579 28748 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:27.033354   674 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:27.069834 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:27.041752   534 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:27.074129 28599 raft_consensus.cc:2368] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9.
I20260709 12:19:27.037262   479 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:27.063865   527 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:26.994756   626 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.070081   646 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:27.074172   624 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:27.068518   680 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.089851   646 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.090981   549 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.092624   674 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:27.093863   674 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.094780   646 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:27.096046   616 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.070264 28752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:19:27.102176 28752 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.102725 28752 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.105373   626 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:27.109656 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:27.111157 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:27.111347   540 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.112004   540 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.113831   589 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.061851   652 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:19:27.116719 28675 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:27.063637   649 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:19:27.066656   647 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.092197   680 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.132390   589 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:27.136754 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 120572us
I20260709 12:19:27.078557   654 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.114624   540 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.166095 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:27.170091   647 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:27.165516   616 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:27.163017   608 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.000s
I20260709 12:19:27.171298   616 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.172909 28604 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:27.170644   647 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:27.138417   626 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:27.173830 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 193750us
I20260709 12:19:27.187829 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.190128 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.192587 28750 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:27.185906 28752 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.191808   647 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:27.212102   635 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:27.181687   626 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.231902   635 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.231957   647 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.232723   626 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:27.234145   635 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.218139   670 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:27.237608 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:27.202117 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.240582   680 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.240837 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:27.222662 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:27.241119   680 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:27.216424   682 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:27.241966 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:27.242158 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:27.219566 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2140) took 1217 ms. Trace:
I20260709 12:19:27.221652 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:27.211437 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:27.214241 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:27.212322   529 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:19:27.243918 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:27.243213 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:27.244758 29327 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:27.224928 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:27.211679   496 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:27.224092 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:27.256393 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1072) took 1303 ms. Trace:
I20260709 12:19:27.256946 29317 rpcz_store.cc:276] 0709 12:19:25.952954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.953104 (+   150us) service_pool.cc:224] Handling call
0709 12:19:25.953461 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.447301 (+493840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.256079 (+808778us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540042c054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:27.256318 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134249728}
I20260709 12:19:27.258550 28604 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:27.259155 28752 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:27.230130 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:27.226550 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:27.263315 28603 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:27.263361 29326 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:27.232424 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.190769   515 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.243386 28602 rpcz_store.cc:276] 0709 12:19:26.002392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.230518 (+228126us) service_pool.cc:224] Handling call
0709 12:19:26.253575 (+ 23057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:26.902582 (+649007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.902614 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:26.902659 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:26.902692 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:27.219279 (+316587us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b5400216e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:27.219341 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.219498 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2080,"raft.queue_time_us":600,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10200,"spinlock_wait_cycles":1480201472}
W20260709 12:19:27.216730   631 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.706s	user 0.000s	sys 0.005s
I20260709 12:19:27.278604 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:27.282744 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:27.284713 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:27.225343   406 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.209401   451 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:27.288565 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77210us
I20260709 12:19:27.289206 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:27.299769 28674 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:27.214294   568 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.222275   654 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.229456   616 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.258388   535 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.295060 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:27.243132   680 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.296027 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:27.316263 28604 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:27.316673 28604 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:27.313766 28601 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:27.305190 28676 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:19:27.229611   572 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:19:27.172648   630 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.210402   527 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.308387 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.308753   685 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.303934 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:27.312572   551 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:27.293586   652 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:27.327272   652 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.327666   652 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:27.228506   651 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:19:27.330243   527 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.332645 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:27.333200 28605 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:27.273598   496 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.338171 28680 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:27.188947   534 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.292611   589 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.293370   381 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:27.318691 28676 pending_rounds.cc:85] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 5
I20260709 12:19:27.362561 28676 pending_rounds.cc:107] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:19:27.362877 28676 raft_consensus.cc:2889] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:27.322625 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:27.337230 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:27.364553 28607 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:27.277853   624 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:19:27.302351   635 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:19:27.356393 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54111.9us
I20260709 12:19:27.360466 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2074) took 1339 ms. Trace:
I20260709 12:19:27.362883 28604 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:27.390940 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:27.374130 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 296381us
I20260709 12:19:27.402256 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:27.402606 28604 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.403158 28607 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:27.321357   535 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.407162 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:27.407763 29323 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:27.361914   657 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:27.362353   381 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.402156 28678 rpcz_store.cc:276] 0709 12:19:26.021189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.021332 (+   143us) service_pool.cc:224] Handling call
0709 12:19:26.021769 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:26.022150 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.022190 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:26.025964 (+  3774us) log.cc:844] Serialized 26 byte log entry
0709 12:19:26.321185 (+295221us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:26.321232 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:26.321297 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:27.188715 (+867418us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b24002c2f58. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08189c4 00007f6fe0816acb 00007f6fe09d1dc9 00007f6fe09d1a55 00007f6fe09d109d 00007f6fe360310e 00007f6fe361a88c 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221
0709 12:19:27.337963 (+149248us) raft_consensus.cc:1685] finished
0709 12:19:27.337993 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:27.360381 (+ 22388us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4466,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":23588,"spinlock_wait_cycles":53657472,"thread_start_us":236440,"threads_started":1,"wal-append.queue_time_us":379828}
I20260709 12:19:27.426281 28605 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:27.394402   614 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:27.427214 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 115745us
I20260709 12:19:27.358917   685 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.423327   381 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:27.412181   657 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:27.367098   589 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.435679 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:27.568681 28747 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:27.466632 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.467042 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.434207 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.433359 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.433629 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.504536   657 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:27.430652   689 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:19:27.533303   691 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:19:27.447788   614 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.575093 28755 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:27.561112 28750 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:27.560920   626 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.427611   705 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.135s
I20260709 12:19:27.562212   496 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.562389   535 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.431305 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:27.428663 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:27.564903 28604 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:27.422971   557 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:27.565115 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 128856us
I20260709 12:19:27.427477 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:27.573762 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:27.621909 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:27.561970   690 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.008s
I20260709 12:19:27.593334 28607 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:27.615520 28676 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:19:27.614866   697 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.088s	user 0.001s	sys 0.003s
W20260709 12:19:27.631742 29318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1057) took 2378 ms (client timeout 2023 ms). Trace:
I20260709 12:19:27.631923 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:27.628206 28747 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
W20260709 12:19:27.632158 29318 rpcz_store.cc:269] 0709 12:19:25.253158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:25.260215 (+  7057us) service_pool.cc:224] Handling call
0709 12:19:27.631564 (+2371349us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400680e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:27.631676 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2898639232}
W20260709 12:19:27.635262 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 204012us
I20260709 12:19:27.636612 28607 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: [7.9-8.10]
I20260709 12:19:27.637564 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:27.602433   649 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:27.648913 28677 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:27.649360 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:27.655359 28750 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:27.659518 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:27.660230 28677 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:27.666210 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:27.631556   624 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:27.671792 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:27.669981 28607 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:27.673465 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:27.672418 28755 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:27.633901   454 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:27.654137   649 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:27.696250 28677 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:27.671854   529 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.632556   557 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.712658 28607 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:27.672226   624 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:27.721616   624 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:27.724880 28600 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:27.726213 28600 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:19:27.691846   497 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.729156   685 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.777731 28679 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:27.734272   624 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.735379   614 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:27.737143   684 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.648s	user 0.002s	sys 0.001s
I20260709 12:19:27.741663 28678 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:27.743083   635 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.750226   626 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.761526 28603 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:27.762466 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:27.762779   701 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:19:27.763710 28599 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:27.693640   454 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.764041   587 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:27.765254   649 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:27.766546   696 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:19:27.766995   515 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:27.767319   707 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:19:27.720614   529 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:27.778772 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 117046us
I20260709 12:19:27.715358   630 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.722774   496 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:27.837505   496 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.780481 28755 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:27.763759   589 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.830967 28603 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:27.808571   635 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.808864   587 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:27.769269   652 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.779381   497 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:27.901292   695 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.245s	user 0.002s	sys 0.000s
I20260709 12:19:27.902034   497 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.760427   381 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.905097   381 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:27.846684   649 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:27.839238   515 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:27.879748   710 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:19:27.882983   529 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.884161   557 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:27.897104   587 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.899852   624 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.855538 28599 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:27.848744 28603 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:27.923477 28603 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:27.888337   657 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:27.992208   515 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:27.994150   657 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:27.946556   587 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:27.985855   496 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:28.003225 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 167658us
I20260709 12:19:28.007050 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:28.012687   624 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:28.029640   635 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:28.043021 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 195950us
W20260709 12:19:28.064816 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57859.5us
I20260709 12:19:28.035338   533 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:28.069626 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 260797us
I20260709 12:19:28.076309 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:28.077168 28749 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:28.080935 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.081678 28749 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:28.087019 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.074602   652 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:28.087747 28749 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:28.088122   699 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:28.099887 28756 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:28.081135   635 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:28.107336   635 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:28.109809   635 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:28.088291 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:28.116030 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.123008 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:28.124913   525 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:28.125341   525 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.125696   525 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:28.130349 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.131078 28755 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:28.131685   454 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:28.132182 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.133463 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:28.135592 28647 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:28.118108   531 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:28.121255   496 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:28.137341 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.120863   557 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.141023 28603 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:19:28.137354 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:28.140734   529 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:28.144762 28603 pending_rounds.cc:85] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 6
I20260709 12:19:28.143364 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.145751 28603 pending_rounds.cc:107] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:19:28.146209 28603 raft_consensus.cc:2889] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:28.142989 28749 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
W20260709 12:19:28.144133   724 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:19:28.144222   531 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.138068   731 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:28.149832   531 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:28.150453   557 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.142642   496 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:28.152365   635 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:19:28.155337 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.152173   515 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:28.157938 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:28.166507 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:28.166945 28677 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:19:28.161944   496 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:28.170665 28677 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:28.164160   635 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.165150   731 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:28.173409 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.187218 28673 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:28.171681   534 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:28.174108   716 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.183723   373 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.193812 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.164981   515 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.163991   718 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:19:28.196017   373 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.172916   635 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:28.221050 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.221623 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.222236 28749 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:28.197343   534 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.209455 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:28.211308 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:28.217133 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.217506 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.229408 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:28.230495 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:28.218523 28751 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:28.200135 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.223018 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.231331 28677 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:28.196151   716 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:28.226034   531 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:28.224929 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.193385   451 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.237135 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:28.232285   647 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:28.243391   451 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.244099   647 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:28.244642 28748 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:28.244998   647 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:28.245554   451 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:28.234723   373 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:28.241539 28679 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:28.228049 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:28.255527 28722 leader_election.cc:336] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.629s (SENT)
I20260709 12:19:28.256067 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:28.259698 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.262367 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.231988 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.264065 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:28.241173   718 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:28.289420 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 915782us
I20260709 12:19:28.268213   451 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:19:28.298535 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.298799 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 870126us
I20260709 12:19:28.299640 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:28.300904 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:28.301047   654 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.301592   654 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.236812   557 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:28.304077 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2494) took 1341 ms. Trace:
I20260709 12:19:28.306257 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2185) took 1127 ms. Trace:
W20260709 12:19:28.306694 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51211.2us
I20260709 12:19:28.306840 28607 rpcz_store.cc:276] 0709 12:19:27.178420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.729628 (+551208us) service_pool.cc:224] Handling call
0709 12:19:27.729879 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:27.730221 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:27.735472 (+  5251us) log.cc:844] Serialized 14 byte log entry
0709 12:19:28.305821 (+570349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:28.305884 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:28.305961 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.306045 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.306183 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293408,"prepare.queue_time_us":4641,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":276536,"threads_started":1,"wal-append.queue_time_us":338921}
W20260709 12:19:28.232764   706 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.577s	user 0.003s	sys 0.000s
I20260709 12:19:28.305860 28598 rpcz_store.cc:276] 0709 12:19:26.949327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.961855 (+ 12528us) service_pool.cc:224] Handling call
0709 12:19:26.962274 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:26.962686 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:26.962712 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:26.975066 (+ 12354us) log.cc:844] Serialized 52 byte log entry
0709 12:19:27.191253 (+216187us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:27.360975 (+169722us) log.cc:844] Serialized 14 byte log entry
0709 12:19:27.364170 (+  3195us) log.cc:844] Serialized 14 byte log entry
0709 12:19:28.262449 (+898279us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b1800410ec0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a89716 00007f6fe3a9a287 00007f6fe3a9a208
0709 12:19:28.262679 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.262781 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:28.290846 (+ 28065us) raft_consensus.cc:1685] finished
0709 12:19:28.290875 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:28.291068 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":909967,"prepare.queue_time_us":92927,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":925901,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":10828,"spinlock_wait_cycles":72815104,"thread_start_us":251795,"threads_started":2,"wal-append.queue_time_us":311233}
I20260709 12:19:28.251813   731 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:19:28.341500 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:28.353354 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.290079   373 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:28.261843   587 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:28.235445   716 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:28.315977   657 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:28.240103   531 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.319463   616 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:28.321417   435 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:28.270741   739 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:28.426169 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 135804us
I20260709 12:19:28.398658   731 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:28.407060   373 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:28.439819 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:28.433001   604 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:28.428784   525 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:28.445808   649 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.002s
W20260709 12:19:28.461809 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.462845 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:28.436858   616 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:19:28.431789   739 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.469151 28603 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:28.442087   435 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 12:19:28.464920 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.477510 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:28.477475 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 213477us
I20260709 12:19:28.481197 28678 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:28.450347   654 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:28.482297 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.484427 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:28.486366 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:28.486617 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.487385 28673 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:28.490851 28599 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:28.492969 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:28.510797 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:28.511936 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.514804 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:28.494902 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:28.516808 28606 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:28.477820   515 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:28.600560 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 88647.5us
I20260709 12:19:28.465965   604 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:28.479676   618 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:28.515426 28602 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:28.611703 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:28.612932 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.486384   534 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:28.486299   471 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:28.482235   744 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:28.510314   654 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:28.601426   718 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:28.615347   738 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:19:28.612568   435 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.487641   716 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 12:19:28.688832 32242 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:28.470692   455 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 12:19:28.620110   699 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:28.697741 28606 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:28.656572   654 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:28.623728   745 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.672123   573 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.619722   529 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:19:28.616340   604 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.710425 32242 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.617647   618 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.676854   647 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.655125   534 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
W20260709 12:19:28.713564   437 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:19:28.625262   471 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.695631   744 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:28.614389   731 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.679090   435 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.615674   373 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:28.769804 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 468927us
I20260709 12:19:28.843333 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:28.845628 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:28.846839   571 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:28.813239 28602 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:28.848627   657 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:28.716125   654 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:28.751744 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:28.741052 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:28.850144 28606 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:28.851166 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:28.848090 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:28.853474 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:28.852249 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:28.494227   539 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.246s
I20260709 12:19:28.856014 28599 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:28.711004   649 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:28.734437   745 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.715415   549 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:28.841972   435 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:28.714332   531 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:28.860950 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:28.868971 28573 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:28.768930   557 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:28.832073   744 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:28.881743 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.741581   742 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:28.887024 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 407616us
I20260709 12:19:28.853015   685 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:28.861760   525 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:28.866508   451 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:28.863958   549 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:28.716745   699 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:28.864122   747 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:19:28.927524 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 59168.3us
I20260709 12:19:28.927641 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:28.971339 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:28.896453 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:28.972026 28599 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:28.972275 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 75912.8us
I20260709 12:19:28.973145 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:28.875862   437 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:28.881059   503 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:28.971693 28607 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:29.124812 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:28.883222   557 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:29.126482 28602 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:29.127278 28646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.017s	sys 0.016s
W20260709 12:19:29.127746 28646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.017s	sys 0.016s
I20260709 12:19:28.862546   647 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:28.874503   616 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:19:29.162843 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:28.737648   573 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:28.869606   649 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:29.159796   740 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.535s	user 0.001s	sys 0.000s
W20260709 12:19:29.158829 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.029s	sys 0.058s
W20260709 12:19:29.189677 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.029s	sys 0.058s
W20260709 12:19:29.190147 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 671918us
W20260709 12:19:29.193114 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.124743   525 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:29.188699 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:28.922135   685 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.194512 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:29.200752 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:29.164737   533 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.092s	user 0.010s	sys 0.002s
W20260709 12:19:29.147027   634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.015s	sys 0.021s
I20260709 12:19:29.158300   503 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.149883   370 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:29.203130   617 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:29.207733 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:29.212697   747 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:29.146186   739 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:28.904727   743 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.284s
I20260709 12:19:29.218696 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:29.220294 28603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:29.172191   748 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.227741 28598 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:29.188179   437 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:28.923677   742 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:29.216033   635 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.966s	user 0.011s	sys 0.000s
I20260709 12:19:29.223114   515 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.234886 28607 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:29.230569   617 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:19:29.271051   751 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:19:29.272878 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 725) took 2297 ms. Trace:
I20260709 12:19:29.273378 28604 rpcz_store.cc:276] 0709 12:19:26.975204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.630033 (+654829us) service_pool.cc:224] Handling call
0709 12:19:27.630352 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.304915 (+674563us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:28.304958 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.305526 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:19:28.670207 (+364681us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:28.670265 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.206675 (+536410us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400121bd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:29.206729 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.272488 (+ 65759us) raft_consensus.cc:1685] finished
0709 12:19:29.272518 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.272800 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317088,"raft.queue_time_us":418133,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":55,"spinlock_wait_cycles":820822912,"thread_start_us":224447,"threads_started":1,"wal-append.queue_time_us":599075}
I20260709 12:19:29.278613 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 727) took 2232 ms. Trace:
I20260709 12:19:29.279177 28605 rpcz_store.cc:276] 0709 12:19:27.046314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.636750 (+590436us) service_pool.cc:224] Handling call
0709 12:19:27.657389 (+ 20639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.461501 (+804112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.461531 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:28.466415 (+  4884us) log.cc:844] Serialized 26 byte log entry
0709 12:19:28.688675 (+222260us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:28.688713 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.696713 (+  8000us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.278316 (+581603us) raft_consensus.cc:1685] finished
0709 12:19:29.278348 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.278535 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":644103,"raft.queue_time_us":668773,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14042,"thread_start_us":320230,"threads_started":2,"wal-append.queue_time_us":678825}
I20260709 12:19:29.283082 28604 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:19:29.270115 28607 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:29.253546   739 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:29.246157 28603 raft_consensus.cc:606] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:29.233819   655 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:29.223044   634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.016s	sys 0.021s
W20260709 12:19:29.290982 28674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.021s	sys 0.029s
I20260709 12:19:29.259092 32242 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:29.291330 28674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.021s	sys 0.029s
I20260709 12:19:29.230901   451 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.226801   533 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.219062   525 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.290297 28603 raft_consensus.cc:614] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:29.145606   750 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.254s
I20260709 12:19:29.257121   437 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:29.268499   618 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.299856 28599 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:29.301128   503 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:29.290158   604 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.293234   655 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.290302   616 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:29.291903   739 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.259208   635 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:29.299582   587 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.008s	sys 0.079s
I20260709 12:19:29.260725   515 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:29.363328 28601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.029s	sys 0.084s
W20260709 12:19:29.367620 28601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.029s	sys 0.084s
I20260709 12:19:29.255260   557 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.232923   549 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:29.377058 29291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.026s	sys 0.066s
W20260709 12:19:29.377396 29291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.026s	sys 0.066s
W20260709 12:19:29.368453   587 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.008s	sys 0.079s
I20260709 12:19:29.302798   451 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.379917   451 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:29.381484   525 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.305105   533 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.382423 28602 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:29.383741   533 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:29.374742   657 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:29.393129 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:29.393411   437 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.394133 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.394959 29322 raft_consensus.cc:2410] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:29.395913 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.396672 29319 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:29.401595   759 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.402204   759 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.406699   635 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.407285   635 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:29.407613   635 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.407938   635 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:29.408668 28679 raft_consensus.cc:2368] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:29.410749 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.411963 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.413111   647 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:29.414885   742 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.416590   699 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.417515   573 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.360831   617 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.363987   739 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:29.423424   685 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:29.423936 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 1.19778e+06us
I20260709 12:19:29.426177   451 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:29.427980   571 consensus_meta.cc:287] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 12:19:29.430306   553 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:29.430706   553 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:29.431533   553 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.361822   655 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:29.437639   718 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:29.438087   718 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:29.438963   718 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.439961   718 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:29.367748   616 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.441783   649 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.337390   455 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:29.442488   616 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.442850   455 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.445070   455 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.446969   471 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.393129   657 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.455305   657 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.448786   749 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:29.455952   749 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:29.449823   745 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:29.457422   496 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.269s	user 0.003s	sys 0.009s
I20260709 12:19:29.457862   496 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.460296   496 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.461691   553 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:29.462087   719 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.464701   719 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.282728   748 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:29.492552 29290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.012s	sys 0.016s
W20260709 12:19:29.493029 29290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.012s	sys 0.016s
W20260709 12:19:29.493372 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 1.045e+06us
I20260709 12:19:29.494704 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:29.476105   654 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.002s
W20260709 12:19:29.509159 28677 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.005s	sys 0.022s
W20260709 12:19:29.509698 28677 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.005s	sys 0.023s
W20260709 12:19:29.474392 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.369680   757 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.528366 29320 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:29.542825 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.543905 29319 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:29.479060   680 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.549592 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.550572 29319 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:29.558475 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:29.546444   757 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.561038   757 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.533715   759 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.528070   557 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:29.561954   742 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:29.566171   515 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.567210   680 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.550086 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:29.508713   571 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:19:29.509016   567 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:29.570580 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:29.578541 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:29.579771 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:29.592687 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.597100 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.527832   531 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.610116 29317 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:29.587730   515 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:29.569775   571 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:29.633921 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.634199 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:29.633972 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.634248   346 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:19:29.636425   515 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:29.646507   680 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.640532 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:29.647805 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.653986 29319 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:29.634006   567 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:29.646422   515 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:29.655256   567 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.655754   567 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:29.533746   654 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.662386   654 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.670138   719 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.634557   759 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.673592   759 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.677925   635 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.638475   571 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:29.690729   635 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.678763   749 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.589387   647 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:29.686098 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2522) took 2033 ms. Trace:
I20260709 12:19:29.686713   617 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:29.687767   739 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.690258   571 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.611099   624 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:19:29.698108 28600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.014s	sys 0.024s
W20260709 12:19:29.717084 28600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.014s	sys 0.024s
W20260709 12:19:29.699182 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.006s	sys 0.032s
I20260709 12:19:29.698534 28747 rpcz_store.cc:276] 0709 12:19:27.652841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.652939 (+    98us) service_pool.cc:224] Handling call
0709 12:19:27.653246 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:27.653578 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:27.653605 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:27.655773 (+  2168us) log.cc:844] Serialized 26 byte log entry
0709 12:19:28.437014 (+781241us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b1800463780. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:19:28.881316 (+444302us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:28.881358 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:28.881427 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.685765 (+804338us) raft_consensus.cc:1685] finished
0709 12:19:29.685783 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.686033 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1668,"raft.queue_time_us":2118,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":8998,"spinlock_wait_cycles":10782976,"thread_start_us":443293,"threads_started":1,"wal-append.queue_time_us":1981771}
I20260709 12:19:29.704202 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:29.676234   759 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:29.719596 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.007s	sys 0.032s
I20260709 12:19:29.722124 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.722790 29321 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:29.726861 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2184) took 2549 ms. Trace:
I20260709 12:19:29.729454 29325 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:29.698997   647 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:29.729997 28647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.036s	sys 0.070s
W20260709 12:19:29.730314 28647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.036s	sys 0.070s
W20260709 12:19:29.722467 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 862088us
I20260709 12:19:29.732705 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:29.733541 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.647027   531 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.715222   624 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:29.736601 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:29.742990 28674 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
W20260709 12:19:29.736099 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.740515 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:29.744251 28679 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
W20260709 12:19:29.745345 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.746682 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:29.747582 28679 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
W20260709 12:19:29.736270   373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.012s	sys 0.028s
I20260709 12:19:29.754823 29317 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:29.734687   571 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:29.737982   549 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:29.735673   647 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:29.738138   553 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.755658 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:29.762240 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.745420   624 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:29.767066 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.012s	sys 0.026s
W20260709 12:19:29.767475 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.012s	sys 0.026s
W20260709 12:19:29.767803 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 794671us
I20260709 12:19:29.768930 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:29.769737 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:29.752159   373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.012s	sys 0.028s
W20260709 12:19:29.764829 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.016s	sys 0.021s
W20260709 12:19:29.789004 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.016s	sys 0.021s
W20260709 12:19:29.789394 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 818077us
W20260709 12:19:29.789908 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.790450 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:29.791343 28571 leader_election.cc:400] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:29.791944 28571 leader_election.cc:403] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:29.792477 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.806917 28673 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:19:29.822795 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47580.6us
I20260709 12:19:29.823582 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:29.824747 28675 raft_consensus.cc:2410] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:29.784694   744 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.835049   604 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:29.861191 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:29.845567   748 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.834100 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:29.881088 28678 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:29.811741 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:29.793913   680 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:29.818372   654 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:29.814325   759 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:29.784456   553 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:29.827757   573 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:29.794397   655 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.827702   749 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:29.813704   534 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:19:29.842921 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:29.908931 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 66113.6us
I20260709 12:19:29.910084 28571 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:29.833956   618 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:29.828523 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.825933   657 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 12:19:29.914029 29289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.022s	sys 0.035s
W20260709 12:19:29.915763 29289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.022s	sys 0.035s
I20260709 12:19:29.863927 29317 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:29.831125 28674 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:29.867055   515 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.872599   739 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.874764   745 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.844139   750 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:29.889804 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 78147.8us
I20260709 12:19:29.931468 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:29.898799 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:29.932513 29325 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:29.727382 28600 rpcz_store.cc:276] 0709 12:19:27.177191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.726870 (+549679us) service_pool.cc:224] Handling call
0709 12:19:27.727160 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:28.457381 (+730221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:28.457419 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:28.464929 (+  7510us) log.cc:844] Serialized 52 byte log entry
0709 12:19:28.885153 (+420224us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:29.717651 (+832498us) log.cc:844] Serialized 14 byte log entry
0709 12:19:29.718259 (+   608us) log.cc:844] Serialized 14 byte log entry
0709 12:19:29.726446 (+  8187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.726549 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:29.726601 (+    52us) raft_consensus.cc:1685] finished
0709 12:19:29.726619 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.726791 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586772,"prepare.queue_time_us":369814,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":2205,"raft.queue_time_us":673843,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":33559,"spinlock_wait_cycles":17770496,"thread_start_us":1220317,"threads_started":3,"wal-append.queue_time_us":813452}
I20260709 12:19:29.863795 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:29.893700   346 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:29.928629 29318 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:29.928582 28678 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:29.933210 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.938846 29321 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:29.934603 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:29.939967 28680 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:29.860908   744 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.941956 29317 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:29.942787 28675 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:29.943907   655 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.882282   604 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.945501   616 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:29.946134   718 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 12:19:29.946498   572 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:29.946974   553 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:29.936388   750 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.914722   765 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:29.982007 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 50613.3us
I20260709 12:19:29.983850 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:29.985276 28598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.025s	sys 0.045s
W20260709 12:19:29.985780 28598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.025s	sys 0.045s
I20260709 12:19:29.986563 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2195) took 1513 ms. Trace:
I20260709 12:19:29.989259 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:29.936105   608 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.948253   531 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:29.985122 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:29.999989 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:30.004905 28680 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:29.933951   654 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:19:29.976223   616 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:30.010641 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.006991 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:29.987277   534 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:29.900542   759 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.022341   767 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:30.024269   759 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.987854   765 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.024919 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:29.986920 28598 rpcz_store.cc:276] 0709 12:19:28.473176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.248341 (+775165us) service_pool.cc:224] Handling call
0709 12:19:29.249676 (+  1335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.249947 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:19:29.250271 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:19:29.986233 (+735962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:29.986290 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:29.986340 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:29.986402 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:29.986511 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53560,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"thread_start_us":735614,"threads_started":1}
I20260709 12:19:30.028702   531 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:29.992802 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.027s	sys 0.051s
W20260709 12:19:30.029804 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.028s	sys 0.051s
W20260709 12:19:30.030131 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 835605us
I20260709 12:19:30.030745 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.007855 29325 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:30.015167 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:30.021591   744 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:29.928499   618 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:30.037294 28572 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.018s	sys 0.030s
W20260709 12:19:30.037588 28572 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.018s	sys 0.030s
I20260709 12:19:30.032984 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:29.980262   572 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:29.939488   745 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:29.991182   739 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:30.041556 29326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.015s	sys 0.006s
W20260709 12:19:30.042874 29326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.016s	sys 0.006s
I20260709 12:19:30.011428   655 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:30.030551   616 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:30.037845 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 671084us
I20260709 12:19:30.044561 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.055222 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:30.060374 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.034971   531 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:30.056129 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.062851 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.036881   560 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:30.064448 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.067437 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:30.061358 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.038784   572 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:30.035597 29323 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.006s	sys 0.016s
W20260709 12:19:30.069336 29323 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.006s	sys 0.016s
W20260709 12:19:30.070184 28677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.010s
W20260709 12:19:30.070621 28677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.007s	sys 0.010s
W20260709 12:19:30.065157 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 430336us
I20260709 12:19:30.077703 29320 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:30.067112   437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.003s	sys 0.013s
I20260709 12:19:30.088550 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.062007   549 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:30.086256 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:30.079993 28605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.006s
I20260709 12:19:30.062103   766 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:30.011013   608 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:30.065696   731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.013s	sys 0.004s
I20260709 12:19:30.091081 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.066887   759 raft_consensus.cc:2764] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:19:30.090785 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57876.8us
I20260709 12:19:30.080070   479 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:30.097213 28605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.010s	sys 0.006s
I20260709 12:19:30.098592 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.073099   503 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:30.079586   649 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:30.091699   531 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:30.102430   719 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:30.041626   587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.008s	sys 0.022s
I20260709 12:19:30.102448 28600 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:30.040539   753 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 12:19:30.102900   731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.014s	sys 0.005s
I20260709 12:19:30.103178   549 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:30.087407   557 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:30.080411   744 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:30.113746   503 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:30.092051 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.119810   719 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:30.095906   437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.004s	sys 0.014s
I20260709 12:19:30.127895 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.105355 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:30.132876 28604 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:30.124725 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:30.127403   587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.008s	sys 0.022s
I20260709 12:19:30.126564   649 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:30.130976   617 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.131280   557 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.111431   766 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.148576 29322 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:30.130211   515 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:30.178741 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.179032   765 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.184470 28600 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:30.186852   649 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.188179 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.189544 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.192833 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:30.190801 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.194041 29321 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:30.195478 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.152123 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.200534   617 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.148010 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.201967 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 880) took 1723 ms. Trace:
I20260709 12:19:30.202497 29317 raft_consensus.cc:2368] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:30.202697   617 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.203620 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.138775   719 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:30.202363 28677 rpcz_store.cc:276] 0709 12:19:28.478916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:28.479040 (+   124us) service_pool.cc:224] Handling call
0709 12:19:28.510447 (+ 31407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:28.821938 (+311491us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:29.529642 (+707704us) log.cc:844] Serialized 14 byte log entry
0709 12:19:30.081488 (+551846us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:30.081537 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:30.081577 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.201753 (+120176us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54000c8354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:30.201800 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.201910 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23952,"prepare.queue_time_us":822348,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":14922,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":12014,"spinlock_wait_cycles":715721472,"thread_start_us":1228921,"threads_started":2,"wal-append.queue_time_us":605259}
W20260709 12:19:30.168978   774 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:19:30.169239 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.209371 29318 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:30.210032 29322 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:30.169770   618 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.148697   567 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.213107 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.213400   567 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.213740 29317 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:30.221815   503 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.225190   451 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.225874   451 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.229522   451 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.139421   549 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.233734   608 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.149526   604 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.124223   531 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.237116   531 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:30.238512 29319 raft_consensus.cc:2368] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11.
I20260709 12:19:30.157884   771 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.242293   572 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.242702   771 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.243706 28603 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:30.244872   624 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.221098   719 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.247296   719 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.247470   624 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.110563   479 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.174647 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.251910 29325 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:30.156639   557 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:30.152989   437 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:30.176931 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:30.262071 29320 raft_consensus.cc:2368] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:30.177837   647 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.178354   766 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.185904 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.198544 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.199136   731 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:19:30.268960 29327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.015s	sys 0.018s
I20260709 12:19:30.172581   750 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.143357   770 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:30.256750 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.134339   744 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.270814 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:30.271405 29327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.016s	sys 0.018s
W20260709 12:19:30.288590 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 375183us
I20260709 12:19:30.336583 28600 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:30.340449 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.338912 28603 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:30.343701 28603 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:30.268050   573 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:30.239176 29318 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:30.362258 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.363130 28675 raft_consensus.cc:2410] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:19:30.363864 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:30.364394 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 165917us
I20260709 12:19:30.373063 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:30.374730 28680 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:30.379496   759 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:30.380385 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.384263 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.384938 28673 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:30.386312 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.387041 28679 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:30.394122 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.394966 28604 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:30.396011 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.397761 28604 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:30.398761 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:30.399441 28604 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:30.379966   759 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.267194   437 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.417888 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:30.419894 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.427763 29319 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:30.375821   745 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.422821 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.424080 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.424615 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.380275   718 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.429015 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.441082 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.441424 29319 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:30.441721 28680 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:30.421484 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.430502 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.443840 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.444947 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:30.436904 29317 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:19:30.438320 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:30.446606   573 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:19:30.447021 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.447713 28682 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:30.391778   773 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:30.449287 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.450866 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.462915 28600 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:30.463121 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.463863 28682 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:30.426970   759 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:30.470043 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.468051 28604 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:30.472272 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.473119 28604 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:30.476953 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:30.458350   764 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.369s	user 0.002s	sys 0.002s
I20260709 12:19:30.457140   608 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:30.463192   604 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:30.447474   373 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:30.456719   572 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.485648 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:30.501129 28682 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:30.501242 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.487861 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.466719   784 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:30.462949   455 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.486269   750 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:30.463382   480 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.499727 28747 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:30.485564   560 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:30.505890 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:30.516121 28604 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:30.508378 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.510318 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.525771 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.526201 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1089) took 1135 ms. Trace:
I20260709 12:19:30.485122   765 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:19:30.499058   785 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 12:19:30.514408 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:30.487521   608 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.542825 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.542587 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:30.526502 28749 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:30.510620 28606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:30.545169 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:30.499632 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 370255us
I20260709 12:19:30.463142   766 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:19:30.494553   604 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.466539   773 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.456722   718 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.529819 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.496279   771 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.468340   783 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:19:30.530922 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.531443 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:30.531812 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 158454us
I20260709 12:19:30.532001 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.532874 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.503580   657 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:19:30.535346   647 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.503899   784 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.528995   655 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:30.580919   775 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 12:19:30.545217 28682 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:30.547205 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.642361 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:30.545377 28606 raft_consensus.cc:606] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:30.643306 28606 raft_consensus.cc:614] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:30.643257 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 177243us
I20260709 12:19:30.546525 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.639680 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.499543   731 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.501820   451 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:19:30.528697   560 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:30.659190 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:30.502104   373 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.598636 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.662972 29317 raft_consensus.cc:2368] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
W20260709 12:19:30.644426   785 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:30.598217 29320 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:30.628538 28752 raft_consensus.cc:2410] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:19:30.597322 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:30.676332 29325 raft_consensus.cc:2368] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
W20260709 12:19:30.539155 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.635018 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.636456 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:30.537235 28750 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:30.578562 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.513110   455 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.515523   480 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:30.683951 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47577.4us
I20260709 12:19:30.647508 28754 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:30.549585   608 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:30.540201   765 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.648607 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.710716 28749 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 12:19:30.635834   787 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:19:30.656386 28680 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:19:30.726346   783 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:30.683295   549 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:30.728602   749 consensus_meta.cc:287] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.820s	user 0.012s	sys 0.000s
I20260709 12:19:30.728935   549 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.731158   549 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.732040 28599 raft_consensus.cc:2410] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:19:30.584589   745 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:30.585407   604 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:30.548169   573 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:30.631060 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 83375.7us
I20260709 12:19:30.740263 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:30.547730 29323 rpcz_store.cc:276] 0709 12:19:29.390888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.397435 (+  6547us) service_pool.cc:224] Handling call
0709 12:19:29.397714 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:29.397922 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:30.069753 (+671831us) log.cc:844] Serialized 14 byte log entry
0709 12:19:30.525809 (+456056us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:30.525859 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:30.525906 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.525993 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.526129 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":794040,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":25232,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10451,"thread_start_us":1101333,"threads_started":2}
I20260709 12:19:30.668393 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.741778 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.638099   784 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:30.671653 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 70133.6us
I20260709 12:19:30.673892 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.681434 28572 leader_election.cc:400] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
W20260709 12:19:30.755947 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 74643.4us
I20260709 12:19:30.687565   479 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.662191   560 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:30.687809   789 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:19:30.669559   373 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:30.688843   480 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:30.689456   790 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260709 12:19:30.690390   616 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.003s
I20260709 12:19:30.770954   624 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:30.771943   624 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:30.771731   616 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.772303   624 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:30.773296   549 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:30.773128   624 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.773949   616 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:30.670985   779 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260709 12:19:30.774273   624 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:30.775352 28606 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
W20260709 12:19:30.691401   778 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 12:19:30.685546 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:30.776983 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 91493.8us
I20260709 12:19:30.778458 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:30.779503 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1092) took 1374 ms. Trace:
I20260709 12:19:30.761461   553 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.692853 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.780948 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.695411   773 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.781934   773 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:30.782433   773 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:30.783371   773 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.736845   765 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:30.699029   808 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:30.785959   808 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:30.786919   808 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:30.787405   808 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:30.705096   791 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:19:30.707872 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2186) took 3528 ms. Trace:
I20260709 12:19:30.788861 28601 rpcz_store.cc:276] 0709 12:19:27.179165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:27.755508 (+576343us) service_pool.cc:224] Handling call
0709 12:19:27.755830 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:28.681837 (+926007us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:29.368293 (+686456us) log.cc:844] Serialized 14 byte log entry
0709 12:19:30.002328 (+634035us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:30.035606 (+ 33278us) log.cc:844] Serialized 26 byte log entry
0709 12:19:30.035751 (+   145us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:30.035787 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.035898 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:30.707682 (+671784us) raft_consensus.cc:1685] finished
0709 12:19:30.707701 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.707814 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":546599,"prepare.queue_time_us":493602,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":710742,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":19949,"thread_start_us":1466409,"threads_started":3,"wal-append.queue_time_us":590741}
I20260709 12:19:30.790938 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.791476 28601 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:30.707726 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.716095   437 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.708690   744 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.660204   731 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.779930 29326 rpcz_store.cc:276] 0709 12:19:29.405494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.407739 (+  2245us) service_pool.cc:224] Handling call
0709 12:19:29.408054 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:29.408384 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:29.408413 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:29.408870 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:19:30.043367 (+634497us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:30.043423 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.045102 (+  1679us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:30.779287 (+734185us) raft_consensus.cc:1685] finished
0709 12:19:30.779309 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.779443 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1027,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":634059,"threads_started":1,"wal-append.queue_time_us":926043}
I20260709 12:19:30.793679 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.794392 29323 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:30.788386   808 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.794992   731 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.795670   731 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:30.795975   731 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:30.720526   813 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.722904   649 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:30.796723   813 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.736397 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2518) took 1540 ms. Trace:
W20260709 12:19:30.798623   557 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.002s
I20260709 12:19:30.797664 28605 rpcz_store.cc:276] 0709 12:19:29.195884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.281376 (+ 85492us) service_pool.cc:224] Handling call
0709 12:19:29.285118 (+  3742us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:29.563803 (+278685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:29.563846 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:29.564595 (+   749us) log.cc:844] Serialized 52 byte log entry
0709 12:19:30.130292 (+565697us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:30.255209 (+124917us) log.cc:844] Serialized 14 byte log entry
0709 12:19:30.255465 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:30.272671 (+ 17206us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54003d3954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:30.272737 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:30.720220 (+447483us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b18003fe8c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:30.736156 (+ 15936us) raft_consensus.cc:1685] finished
0709 12:19:30.736182 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:30.736330 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119849,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":21208,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81703,"spinlock_wait_cycles":618947200,"thread_start_us":557270,"threads_started":1,"wal-append.queue_time_us":707575}
I20260709 12:19:30.799044   557 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.742146 28755 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:19:30.759635 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 85793.7us
I20260709 12:19:30.748929   455 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:30.802657 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:30.803272 28571 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.766521 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:30.804258   435 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:30.804801   435 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:30.805712 28600 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:30.805675   435 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.762794   657 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:30.809278   657 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:30.809765   657 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:30.761281   719 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:30.812645   719 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:30.813082   719 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:30.742058   573 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.814687   573 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:30.815228 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:30.749409   772 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.819031   772 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.820533 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:30.762207   346 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.004s
I20260709 12:19:30.821518   346 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:30.821753 28604 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:19:30.771031   618 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:30.822419   618 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:30.823298   608 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.824939 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.826287 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:30.827031 28675 raft_consensus.cc:2368] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12.
I20260709 12:19:30.828028 28602 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:30.831310 29327 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:30.831617 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.832334 29319 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:30.792197 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:30.834408 28571 leader_election.cc:400] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12.
I20260709 12:19:30.848037 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:30.852250 28571 leader_election.cc:403] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:19:30.836372 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.853214 28605 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:19:30.839933 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:30.854666 29326 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:30.827785   765 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.859440 28607 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:30.811884   604 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.867091 29317 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:30.867700 28572 leader_election.cc:400] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10.
I20260709 12:19:30.870921 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.871794 29325 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
W20260709 12:19:30.887253 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52973.4us
I20260709 12:19:30.891021 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.891960 28752 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:30.893038   745 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:30.891989 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44072.7us
I20260709 12:19:30.894927 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:30.896108   617 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:30.897204   617 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.898043   617 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:30.895490 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:30.901531 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:30.902269 29326 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:30.902477   788 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:30.903962 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.905642 28752 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:30.907174 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.902284 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:30.889750   616 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:19:30.918413 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:30.910583 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.910897 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.891191 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.911571 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:30.913252 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:30.918886 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:30.920517 28747 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:30.922572 28752 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:30.780205   553 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:30.919627 28753 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:30.924650 28754 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:30.916719 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:30.927685 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.929858 29319 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:30.926667 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:30.932776 28598 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:30.935456 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:30.936182   649 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.936566 28599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:30.936651   649 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.937254 28599 raft_consensus.cc:606] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:30.799460   813 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.979730 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:30.910367   747 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:30.848740   346 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 12:19:30.981065 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63941.7us
I20260709 12:19:30.982067 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:30.979416 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 201005us
I20260709 12:19:30.930063 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:30.939385 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.893901   608 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:30.942505 28747 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:19:30.866567   567 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:19:30.917544   797 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:30.995072 28750 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:19:30.999065 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:30.997073 28754 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:30.823314   618 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:30.978948   811 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:30.936597   816 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.992643   747 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:30.994482   750 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.994252   772 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:30.992820   455 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:19:30.910362   793 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:30.930627 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:31.028713 29322 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:30.943796 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.032171 28747 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:31.004513 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:31.033985 28603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.013s	sys 0.007s
W20260709 12:19:31.034310 28603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.013s	sys 0.007s
W20260709 12:19:31.032091 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52499.5us
I20260709 12:19:31.037024 28647 leader_election.cc:400] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11.
I20260709 12:19:31.037344 28647 leader_election.cc:403] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:31.038718 29326 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:31.039449 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.040105 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.040861 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.041451 28682 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:31.042220 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.045297 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:31.046725 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 120162us
I20260709 12:19:31.048345 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:31.049572 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.049893 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:31.043392   618 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:31.019955   816 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:31.051407 28681 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:31.052462 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.053510 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.054308 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.015388   649 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.057235 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.058388 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.058692 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.058951 28680 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:31.059350 28677 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 8.
W20260709 12:19:31.061070 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 306834us
I20260709 12:19:31.056227 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.063850 28678 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:31.067147 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:31.035251   503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.019s
I20260709 12:19:31.062639 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:31.074066 28755 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:19:31.074846 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 394374us
I20260709 12:19:31.075258 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.079030 28752 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:30.926810   796 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.072146 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.069288 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:30.929397   788 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:31.081986 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:30.890043   749 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 12:19:31.077560 28753 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:31.006296   797 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.078338 28750 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:31.052907   816 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:31.044077   635 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:31.089169 28754 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:31.089926 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.075505 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.090070 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:30.938880   766 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:31.033424   718 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.053485   608 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:31.096516 29290 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:31.094187 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.097419 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:31.062633   744 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:31.017982   750 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:31.084358   503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.000s	sys 0.020s
I20260709 12:19:31.101841 28676 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:31.081001   771 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:31.101663   560 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.088166   813 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:31.136540 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.138077 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:31.145152 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:31.093521   616 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:31.147384 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71943.5us
I20260709 12:19:31.136817 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:31.146332 29323 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:30.927659   731 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.080422   796 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.102468   744 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:31.136945   587 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:31.122301   718 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:31.086673   810 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:19:31.121933   567 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:31.136894   560 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.101367   451 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:19:31.154889   816 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:31.121574   824 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:31.217864 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:31.135440   346 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
W20260709 12:19:31.250764   759 consensus_meta.cc:287] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.766s	user 0.007s	sys 0.011s
I20260709 12:19:31.266139 28752 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:31.266584 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 177731us
I20260709 12:19:31.379884 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:31.358407 29322 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:31.219681   731 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:31.249500 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 199974us
W20260709 12:19:31.247394 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 172181us
I20260709 12:19:31.252826   553 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.167675   604 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:31.257246   821 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:31.098497   747 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:31.224289 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 123794us
I20260709 12:19:31.401440 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.256526   784 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.254568   719 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:31.219765   567 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.259231   617 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.262161   573 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.199409   744 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:31.367440 28601 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:31.259747   373 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.411019 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.411021 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:31.460072 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49166.3us
I20260709 12:19:31.460767 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.415894   567 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.417536   784 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:31.418887   823 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 12:19:31.448333   657 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.000s
W20260709 12:19:31.419816   826 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:19:31.421842   822 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:19:31.423118   796 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:31.445073 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44249.1us
I20260709 12:19:31.445081 28756 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:31.450148   617 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:31.485080 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.485826 28673 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
W20260709 12:19:31.486178 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 75265.7us
I20260709 12:19:31.458336 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:31.461270 28676 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:31.461449 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.489619 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:31.462502 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.491192 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.394094   773 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:31.419320   719 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.465278   772 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:31.471797   831 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:19:31.476890 28600 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:31.481168 28749 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:31.454027   346 raft_consensus.cc:2764] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:19:31.489666 28601 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:31.540244 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:31.541769 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:31.542721 28601 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:31.543694 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:31.412693   788 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:19:31.465684   837 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:31.545073   837 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:31.545634   837 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:31.547955 28601 raft_consensus.cc:2410] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:19:31.560783   373 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.573890 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:31.573802 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 85388.7us
I20260709 12:19:31.575599 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.398666   759 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.559006   772 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.500763   451 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:31.581037 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 120360us
I20260709 12:19:31.581784 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 749) took 1080 ms. Trace:
I20260709 12:19:31.582835 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.582163 28604 rpcz_store.cc:276] 0709 12:19:30.501139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.822592 (+321453us) service_pool.cc:224] Handling call
0709 12:19:30.822855 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:30.823217 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:30.823246 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:30.823674 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:19:31.082879 (+259205us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:31.082924 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.082988 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:31.581569 (+498581us) raft_consensus.cc:1685] finished
0709 12:19:31.581590 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.581727 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9748,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":24331,"thread_start_us":258876,"threads_started":1,"wal-append.queue_time_us":391007}
I20260709 12:19:31.531876   836 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:31.532102   617 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:31.482573   657 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:31.669812 28604 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:19:31.670760   657 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.616168   810 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:31.586930   649 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:31.671213   759 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.671939 28682 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:31.671660   649 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:31.672712   793 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.003s
I20260709 12:19:31.673127   793 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12.
I20260709 12:19:31.574223   750 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.579474   797 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.606611 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.534581   818 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:31.627966   772 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:31.616926 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.679445 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:31.680896 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:31.681604 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:31.580667   503 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.608665 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.580379   784 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:31.641695   839 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:19:31.649497   573 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.649871 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2216) took 1149 ms. Trace:
I20260709 12:19:31.578087   346 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:31.651001   816 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:31.694761 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.653923 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2524) took 1306 ms. Trace:
I20260709 12:19:31.531585   773 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.665364   557 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.667733   783 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:31.668622   617 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.674376 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 742) took 1193 ms. Trace:
W20260709 12:19:31.675650 28719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.023s	sys 0.054s
I20260709 12:19:31.677491 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2226) took 1142 ms. Trace:
I20260709 12:19:31.677253 28673 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:31.682723 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:31.683350 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.706863 28753 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:31.705866 28600 rpcz_store.cc:276] 0709 12:19:30.480812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.806583 (+325771us) service_pool.cc:224] Handling call
0709 12:19:30.806883 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.538366 (+731483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.674088 (+135722us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54003d2054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:31.674302 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540327168}
W20260709 12:19:31.706020 28719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.024s	sys 0.054s
W20260709 12:19:31.686014 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 77445.4us
I20260709 12:19:31.615840   817 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.706061 28751 rpcz_store.cc:276] 0709 12:19:30.534630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.534756 (+   126us) service_pool.cc:224] Handling call
0709 12:19:30.535123 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:30.625183 (+ 90060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:30.625219 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:30.632779 (+  7560us) log.cc:844] Serialized 52 byte log entry
0709 12:19:30.737264 (+104485us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:31.076337 (+339073us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.656821 (+580484us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b18003dc8a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:19:31.657079 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.670287 (+ 13208us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b18003dc8a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:31.677166 (+  6879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.677253 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:31.677297 (+    44us) raft_consensus.cc:1685] finished
0709 12:19:31.677308 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.677433 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":574613,"prepare.queue_time_us":924729,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":5054,"raft.queue_time_us":276292,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":3896,"spinlock_wait_cycles":22557696,"thread_start_us":488046,"threads_started":3,"wal-append.queue_time_us":260880}
I20260709 12:19:31.691481 28756 rpcz_store.cc:276] 0709 12:19:30.500635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.505127 (+  4492us) service_pool.cc:224] Handling call
0709 12:19:31.649602 (+1144475us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54001c4154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:31.649788 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830002048}
I20260709 12:19:31.708845 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:31.650729 28750 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:19:31.692574 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.710804 28754 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:31.689616   836 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:31.699558 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.696796 28603 rpcz_store.cc:276] 0709 12:19:30.347372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.348937 (+  1565us) service_pool.cc:224] Handling call
0709 12:19:30.349464 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.462710 (+113246us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:30.483126 (+ 20416us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.035434 (+552308us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:31.035498 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:31.035538 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:31.653607 (+618069us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003d3454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:31.653670 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:31.653841 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22918,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":9344,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":13729,"spinlock_wait_cycles":259854080,"thread_start_us":551178,"threads_started":1,"wal-append.queue_time_us":716425}
I20260709 12:19:31.696197 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.716733 28682 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:31.665439   850 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:31.701905   783 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:31.711674 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.699384   816 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:31.702462   818 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:31.713454 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.725523 28673 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:31.713570 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.714147 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:31.716061 28648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.528s (SENT) [suppressed 20 similar messages]
I20260709 12:19:31.716065 28748 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:31.718343 28603 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:31.721928 28754 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:19:31.680302   635 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 12:19:31.722698 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.729712 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.730003 28682 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:31.730283 28673 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:31.700320   834 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:31.723981 28600 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:31.739521   635 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11.
I20260709 12:19:31.739890 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:31.740396 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.680042   567 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.726555 28751 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:31.740880   617 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.733261 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:31.741607 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.741721 28754 raft_consensus.cc:2376] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13. Re-sending same reply.
I20260709 12:19:31.734213 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.691021   503 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:31.730755 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.716204   817 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.740782 28748 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:31.757437 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.758332 28680 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:31.758464   567 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.759128   503 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:31.759483 28680 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:19:31.740787 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.760715 28681 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:19:31.750679 28675 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:31.716116   557 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:31.725231   818 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.749070 28679 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:19:31.757408 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:31.762885 28681 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:31.782217 28679 pending_rounds.cc:85] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 7
I20260709 12:19:31.782608 28679 pending_rounds.cc:107] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:19:31.782919 28679 raft_consensus.cc:2889] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:31.783073 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.763759 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:31.784516 28753 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.747138 28751 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:31.716238   772 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:31.791886 28673 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
W20260709 12:19:31.745878   803 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 1.091s	user 0.004s	sys 0.000s
I20260709 12:19:31.798454 28753 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:31.734810   834 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.704083   346 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.799364   834 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.723822   759 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:19:31.779906   557 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.789829   818 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:31.805434 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 89344.8us
W20260709 12:19:31.803010 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 94550.6us
I20260709 12:19:31.800351   772 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:31.767352   836 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:19:31.813704 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.815086 28673 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:31.805150   557 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:31.814460   567 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:31.818773   567 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.819777 29322 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:31.820858   567 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.823997   783 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:31.825035   783 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.826864   765 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:31.828140 28598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 743) took 1347 ms (client timeout 1685 ms). Trace:
W20260709 12:19:31.828692 28598 rpcz_store.cc:269] 0709 12:19:30.481121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.546299 (+ 65178us) service_pool.cc:224] Handling call
0709 12:19:31.827891 (+1281592us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54000bd954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:31.828066 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651438848}
I20260709 12:19:31.832805   731 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.833313   731 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:31.835491   731 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.836319   837 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.837517   739 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:31.838050   739 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:31.838557   837 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.839118   739 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.841288 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.841861 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:31.842383 28748 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.842435 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:31.844877 28607 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:31.845454   817 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:31.850847 28755 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:31.853328   346 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.806442 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:31.858975 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 52610.7us
I20260709 12:19:31.854135   744 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:31.870434   744 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:31.860993 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:31.879029 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:31.881104 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:31.882308 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:31.883714   731 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:31.802588   816 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.886986   846 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:19:31.889925   816 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:31.877774   549 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:31.896489   825 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:31.884819 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.912019   825 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:31.900264   739 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:31.908910   772 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:31.892719 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:31.910866   649 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:31.916921 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:31.922749 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:31.932070 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 49881.7us
I20260709 12:19:31.933872 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.933894 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:31.933763 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.938293 28748 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:31.941398 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:31.941912 28673 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:31.946108 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.939569 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:31.966387 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:31.896029   557 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:31.938045   549 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:19:31.963606 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 583754us
I20260709 12:19:31.965377 29325 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:31.967183 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:31.968392 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:31.967199 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:31.973227 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:31.975098 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:31.977079 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.977177 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.954667   749 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.942791   346 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:31.986728   719 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:31.966632   759 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:31.947248   846 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:19:31.990598 28680 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:19:31.995294 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:31.969053 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:31.999100 28604 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.996753 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:31.995867 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:31.995934 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:31.985970 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.973873   855 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:31.969455   553 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.973340   840 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:31.973667   549 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.000026 28600 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:31.990792   808 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:31.947862   836 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:19:32.005004 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:31.987202   503 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:31.982095   731 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:31.988979   817 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:31.987380   843 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:31.981489   783 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:32.025341   719 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:32.029435 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 752) took 1498 ms. Trace:
I20260709 12:19:32.059510 28601 rpcz_store.cc:276] 0709 12:19:30.531452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.550682 (+1019230us) service_pool.cc:224] Handling call
0709 12:19:31.551895 (+  1213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.552700 (+   805us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:31.716691 (+163991us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.029087 (+312396us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.029155 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:32.029208 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.029276 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.029383 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":248358,"prepare.queue_time_us":257278,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":250474,"spinlock_wait_cycles":20172672,"thread_start_us":226670,"threads_started":2,"wal-append.queue_time_us":137239}
I20260709 12:19:32.031688 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:32.063256 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 92083.2us
I20260709 12:19:32.001379   835 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:32.034432 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:32.037007 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:31.998194   608 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:32.003142   346 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:32.049866 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 751) took 1520 ms. Trace:
W20260709 12:19:32.028949 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68071.2us
W20260709 12:19:32.049844 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44942.3us
I20260709 12:19:32.052917 28604 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:32.073066 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:32.052855 28598 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:32.073526 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.057731 28673 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:31.992149   749 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.074570 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:32.076485 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 75238.7us
I20260709 12:19:32.077127 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:32.077845 28748 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:32.077742 28747 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260709 12:19:32.078514 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.078855 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:32.079380 28751 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.079663 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:32.080394 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.079113 28755 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:32.076148 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:32.081295 29290 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:32.027876   549 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.087177 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.001801   759 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.082536 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:32.081220 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.078225 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:32.050454   731 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.026623   840 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:32.094686 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57800.7us
I20260709 12:19:32.022593   834 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.088585 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:32.053366   841 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:32.056324   817 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.119585   817 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:32.120085 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 124292us
I20260709 12:19:32.117411   346 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:19:32.027323   813 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:19:32.120934 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:32.121786   813 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:32.122154   813 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:32.122638 28751 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:32.026456   796 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:19:32.122943   657 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:32.123395   657 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:32.123503   796 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:19:32.082176 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54439.4us
I20260709 12:19:32.123852   657 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:32.027371   553 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.125938   553 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.126235   616 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:32.127117   854 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
I20260709 12:19:32.065199   843 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.128752   843 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:32.130051 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 899) took 1048 ms. Trace:
I20260709 12:19:32.130419 28675 rpcz_store.cc:276] 0709 12:19:31.081591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.081746 (+   155us) service_pool.cc:224] Handling call
0709 12:19:32.129877 (+1048131us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54000c7954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:32.129989 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517137792}
I20260709 12:19:32.081638   856 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:32.027215   812 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:19:32.110533 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.102990   731 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:32.087865   567 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:32.086246   655 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:32.086395   837 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:32.120747 28632 heartbeater.cc:646] Failed to heartbeat to 127.26.205.190:43093 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.205.190:43093 timed out after 15.000s (SENT)
I20260709 12:19:32.027200   845 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 12:19:32.109220 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.134282 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.211768 28751 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
W20260709 12:19:32.134845 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 56671.5us
I20260709 12:19:32.100876   745 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:19:32.133877 28573 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:32.218058 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 84277.5us
I20260709 12:19:32.143709 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:32.218832 28675 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:32.109912   840 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:32.150542   455 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:32.152763 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.225713 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.226992 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:32.222157 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 135329us
I20260709 12:19:32.189327 28681 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:32.164280 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.161636 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.229084 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:32.229348 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.116523   849 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:32.085150   608 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:32.197541 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 73327.5us
I20260709 12:19:32.199180 28604 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:32.196326   618 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:32.199980   861 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:19:32.200381   869 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:32.201471   759 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:32.202553   860 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:19:32.204828   783 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:32.208973   864 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:19:32.260703 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:32.209735   865 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:19:32.261463   792 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:32.261891   792 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.262260   792 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:32.097963   617 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:32.210947   863 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:19:32.255359   557 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.265179   749 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.254707   748 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:19:32.222958   719 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.267302 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.267561   719 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.225454   793 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:32.226334   811 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:32.123860   796 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:32.269809   719 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.270183   796 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.270834   618 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:32.271471   796 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:32.093289   560 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:32.222551 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 78961.4us
I20260709 12:19:32.152320   875 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:32.218700   655 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:32.154196   573 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.228374 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.229815 28751 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 8: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:32.243139 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.122957   813 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.253611 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.234557   766 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:32.221933   567 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:32.259225 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.234282   819 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:32.271799   618 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.217846   553 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:32.274616 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:32.245468   808 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:32.283418 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:32.318297 28682 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 8.
I20260709 12:19:32.320230 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:32.254096 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 167015us
I20260709 12:19:32.275740   856 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:32.285391 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2221) took 1124 ms. Trace:
I20260709 12:19:32.287070   834 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:32.247982   835 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.259178   880 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:19:32.294579   549 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.295840   866 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:19:32.306689   616 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:32.375329 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.375792 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.307665   879 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:32.290437   818 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.309767 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.315179   773 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:32.322736 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.381999 29317 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:19:32.318195 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 89874.5us
I20260709 12:19:32.303751   817 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:32.329497 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.393477 28676 raft_consensus.cc:2368] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9.
I20260709 12:19:32.393963   817 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:32.395473 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:32.396997   346 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:32.397174 28601 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:32.397521   346 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.398145 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.398739 28601 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:32.399495 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:32.364214 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 89660.6us
I20260709 12:19:32.396301 28676 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:19:32.402277 29290 leader_election.cc:400] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9.
I20260709 12:19:32.402621 29290 leader_election.cc:403] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:19:32.403187   875 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.403250 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:32.368446 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48310.1us
I20260709 12:19:32.405972 28676 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:32.406756   812 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:32.407137   812 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:32.072289 28602 rpcz_store.cc:276] 0709 12:19:30.529377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.829243 (+299866us) service_pool.cc:224] Handling call
0709 12:19:30.829519 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:30.829724 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:19:30.830002 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.147743 (+317741us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.848782 (+701039us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b18003d1ce0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:31.905174 (+ 56392us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b18003d1ce0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:31.939996 (+ 34822us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b18003d1ce0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a89716 00007f6fe3a9a287 00007f6fe3a9a208
0709 12:19:31.940358 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 12:19:31.940733 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.049535 (+108802us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.049600 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:32.049646 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.049710 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.049813 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":964665,"prepare.queue_time_us":24431,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":3410,"raft.queue_time_us":933241,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":27557,"spinlock_wait_cycles":110853888,"thread_start_us":300061,"threads_started":1,"wal-append.queue_time_us":340584}
I20260709 12:19:32.407536   812 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:32.407994 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.325641 29321 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:32.374616 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.375221 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.376166 29323 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:19:32.308298 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.289932   837 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:32.380492 28605 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:32.381846 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.325764 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:32.373631   813 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.428874 28682 raft_consensus.cc:2376] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11. Re-sending same reply.
I20260709 12:19:32.429817 28598 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:32.429973 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.430784 29327 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 8.
I20260709 12:19:32.431262 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.374904   793 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:32.382762 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:32.414556 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.384593   840 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.384769   657 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.387739   855 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:19:32.437625 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54946.1us
I20260709 12:19:32.388641   792 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.389820   549 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:32.377750   437 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:32.391816   560 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:32.290889   573 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.409750 28679 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:32.410331 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.410746   818 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:32.366564   765 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:32.363392 28606 rpcz_store.cc:276] 0709 12:19:31.161288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.646641 (+485353us) service_pool.cc:224] Handling call
0709 12:19:31.647081 (+   440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:31.998363 (+351282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:31.998396 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:32.007492 (+  9096us) log.cc:844] Serialized 52 byte log entry
0709 12:19:32.273984 (+266492us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:19:32.274029 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.274099 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:32.284995 (+ 10896us) raft_consensus.cc:1685] finished
0709 12:19:32.285023 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.285175 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390016,"raft.queue_time_us":378949,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":13274,"thread_start_us":202085,"threads_started":1,"wal-append.queue_time_us":253719}
I20260709 12:19:32.445698 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:32.432385 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.451627 29317 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:32.433276 29318 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:32.432333 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.441983 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:32.311412   567 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:32.383149   870 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.167s
I20260709 12:19:32.379215   845 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:32.439199 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.457360 28751 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:32.457780 28756 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:32.439858 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.388587   873 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:32.446460 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.447278   881 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:32.433931   655 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.371980   553 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.431551   451 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:19:32.465241 28603 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:32.437642   855 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:32.448350   815 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:32.317051   819 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.455861 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.436695   793 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.452396 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.466446 28606 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:32.456310   841 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:32.456156   849 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:32.449242   866 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:32.447391   856 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.382094   879 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.372399   835 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.483421 28605 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:32.457062   845 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.437369   771 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:19:32.489809 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.461361   765 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:32.522498   765 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.516193   845 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:32.495075 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.414664   843 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.503834 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:32.505721   881 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:32.506480   608 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:32.509207 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.450778   817 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:19:32.538048 28682 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:32.490418   849 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.490711   866 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.511142 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.492883   841 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:32.566686 28606 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:19:32.511772 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.567417 29318 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:32.453910   811 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:19:32.515766 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.576954 28605 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:32.516779   771 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:32.516839 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37386 (request call id 37) took 1627 ms. Trace:
I20260709 12:19:32.489634   793 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:32.577384 28599 rpcz_store.cc:276] 0709 12:19:30.889843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.891059 (+  1216us) service_pool.cc:224] Handling call
0709 12:19:32.296634 (+1405575us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b54004a0720. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39fc520 00007f6fe3a79652 00007f6fe8a4760a 00007f6fe1fcd7d4 00007f6fe1fcd762 00007f6fe1fcd691 00007f6fe1fcd60c 00007f6fe1fcc8c2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:32.516507 (+219873us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54004a0720. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39fa5e7 00007f6fe3a79c68 00007f6fe3a7984a 00007f6fe8a4760a 00007f6fe1fcd7d4 00007f6fe1fcd762 00007f6fe1fcd691 00007f6fe1fcd60c 00007f6fe1fcc8c2 00007f6fe1dba48c
0709 12:19:32.516753 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317464832}
I20260709 12:19:32.454088   437 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.554368 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.555823 28752 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:32.580405 28751 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:32.557916 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.581275 28753 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:32.558632 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:32.564116 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.435735 28601 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:32.573063   856 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.575744 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1114) took 1481 ms. Trace:
I20260709 12:19:32.530927   572 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:32.453169   808 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.536305 28756 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:32.399513   346 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.579272 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:32.593873 28754 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:32.585580 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.595516 28601 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:32.584300 29326 rpcz_store.cc:276] 0709 12:19:31.094695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.100992 (+  6297us) service_pool.cc:224] Handling call
0709 12:19:31.101321 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:31.363562 (+262241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:31.363605 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:31.411988 (+ 48383us) log.cc:844] Serialized 26 byte log entry
0709 12:19:31.481711 (+ 69723us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:31.717028 (+235317us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.532850 (+815822us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b18004362a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a89716 00007f6fe3a9a287
0709 12:19:32.532981 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.533052 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:32.533104 (+    52us) raft_consensus.cc:1685] finished
0709 12:19:32.575550 (+ 42446us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.575691 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207,"prepare.queue_time_us":318142,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1513,"raft.queue_time_us":353360,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":59497,"spinlock_wait_cycles":18909056,"thread_start_us":578241,"threads_started":4,"wal-append.queue_time_us":231806}
I20260709 12:19:32.483220   549 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:19:32.586620 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:32.597589 28752 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.598031   373 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:32.599221   783 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:32.599680   783 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:32.575294   866 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:32.600716   783 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.602356   783 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:32.576334   841 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:32.614480 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:32.617254 28752 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:32.565685   849 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:32.621440 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.578325   771 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:32.589675   862 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:19:32.623059 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.624478 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:32.490481   815 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.638106 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.631651 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.587536   572 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:32.511235   837 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.465198   873 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.642225 28599 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:32.643615 29323 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:19:32.645200 29323 pending_rounds.cc:85] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 10
I20260709 12:19:32.645491 29323 pending_rounds.cc:107] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:19:32.645768 29323 raft_consensus.cc:2889] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:32.626839   838 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:32.629072   719 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:19:32.627112   549 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:19:32.637292   870 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:32.640296   843 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.574841   881 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.610899   856 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.578166   855 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.651414   838 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:32.678877 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 809) took 1774 ms. Trace:
I20260709 12:19:32.742304 28749 rpcz_store.cc:276] 0709 12:19:30.904889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:30.905023 (+   134us) service_pool.cc:224] Handling call
0709 12:19:30.905299 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.538727 (+633428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.678636 (+1139909us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54001b3fd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:32.678809 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323734400}
W20260709 12:19:32.721812 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.721431 28605 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:32.676395 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.703219 28674 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:19:32.747824 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71509.4us
I20260709 12:19:32.753180 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:32.680651   884 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:19:32.682691   883 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:19:32.687693   553 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.689183   792 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:32.708128   731 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.002s
I20260709 12:19:32.684129   815 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:32.676950   617 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:32.713449   840 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:32.798830 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.805526 29323 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:32.800377 28599 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:32.798224 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.806963 28605 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:32.757171   838 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:32.764413   455 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:32.756446   657 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:32.706866   882 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 12:19:32.724800   572 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.797459   573 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.683463   793 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:32.797713   796 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 12:19:32.820251 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:32.830403 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:32.804458   731 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.804184   617 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:32.836769 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.846905 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.847674 28605 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:32.850778 29325 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:19:32.850998 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.853693 28602 raft_consensus.cc:2368] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:32.862272 29323 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:19:32.867179 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.836026   887 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:32.849788   836 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:32.868752 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:32.848718   572 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:32.854403   812 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:32.872242 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 88063us
I20260709 12:19:32.888494 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:32.889613   886 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:19:32.890940   893 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:19:32.891763   783 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:32.873142 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.892409 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:32.874476 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:32.894670 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.895434   573 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:32.896147   573 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:32.878187 28605 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:32.896654   573 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:32.896720 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:32.897668   573 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.898794   553 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:32.901536 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:32.902055   881 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:32.863493   346 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:19:32.871356   825 consensus_meta.cc:287] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.959s	user 0.011s	sys 0.000s
I20260709 12:19:32.887106 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:32.921386 29323 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:32.888775   873 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.874577 28607 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:32.928540 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:32.867452   879 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.912891 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2114) took 1452 ms. Trace:
I20260709 12:19:32.930001   856 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.929769 28678 rpcz_store.cc:276] 0709 12:19:31.460836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:31.461669 (+   833us) service_pool.cc:224] Handling call
0709 12:19:31.476818 (+ 15149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:31.714681 (+237863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:31.714718 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:31.714757 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:31.714787 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:32.912599 (+1197812us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54001dfe54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:32.912672 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:32.912819 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546551552}
I20260709 12:19:32.930999   845 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.933139   845 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:32.933298 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:32.935128   856 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:32.938792   793 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.949774   655 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:32.951794   731 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:32.952736 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:32.953493 28606 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:32.954000   875 consensus_meta.cc:287] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.005s
I20260709 12:19:32.954257   346 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:32.954495   875 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 8. Current term is 9.
I20260709 12:19:32.955265   346 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.956545   825 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:32.959123   747 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:32.926755   849 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.870678   887 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:32.891791   885 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:19:32.927838   841 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:32.969185   838 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.973227 29323 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:32.977790   455 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.869400   866 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:32.978127   655 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:19:32.978358   793 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.912400   836 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:32.975510   887 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.029825 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:33.030452 29323 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:32.997138   455 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.020963 29319 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:32.966687   845 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.907128   617 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:33.024511   813 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.004s
I20260709 12:19:33.028800   849 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:33.043429 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.050021   837 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:33.050571   834 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:33.050968   834 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:33.051779   834 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.031755   793 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.053081   834 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:33.061036   573 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:33.062183   771 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.061838   573 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.064350   759 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:33.064926   759 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:33.066680   793 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.066123   759 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.067919   759 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:33.068480 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:33.070447 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:33.071769   573 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.050549   837 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:33.063560   771 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:33.045570   845 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.088410 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 907) took 1197 ms. Trace:
I20260709 12:19:33.085044 29323 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:33.088954 28674 rpcz_store.cc:276] 0709 12:19:31.891467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.097630 (+206163us) service_pool.cc:224] Handling call
0709 12:19:32.702867 (+605237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:32.756457 (+ 53590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.088099 (+331642us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400251050. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:33.088330 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391019776}
I20260709 12:19:33.085639   866 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.084291   838 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.101954 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:33.096287   812 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:33.104956   845 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.107599 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:33.108618 28749 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:19:33.111496 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.113334 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.114869 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.121976 28754 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:33.110786 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.095368   841 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.131130 28756 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:19:33.141319 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:33.127863   877 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:19:33.142491   455 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.101246   837 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.095584   836 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.157573   819 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:33.158228   837 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:33.163563   910 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 12:19:33.169982   887 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.172251   887 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:33.210147 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.215389 28604 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:33.223500 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:33.226686 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.228597 28682 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:33.231359 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:33.232896 28599 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:33.236503 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:33.236409 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:33.240056 28682 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:19:33.247114   604 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:33.247133   560 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:33.254530   604 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:33.255002   560 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.249960   635 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:33.257082   604 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.257107   635 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.263429 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.265136 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:33.266503 28681 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:33.265125   635 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.268554   560 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.270437 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.271401 28747 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:33.271829 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:33.273514 28755 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260709 12:19:33.274776 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:33.275950 28748 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:33.276772 28750 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:33.270506 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:33.275830 28501 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 7 to 9, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 9 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.290071 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:33.291002 28673 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:33.293533 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:33.294176 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.295131   887 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:33.292919 28501 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:33.297190 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:33.299041 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:33.298552 28501 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.301123 28748 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:33.301452 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:33.302706 28750 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:33.301262 28501 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 7, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 7 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.274848 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2235) took 1088 ms. Trace:
I20260709 12:19:33.320402 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.312824 28501 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 7 to 10, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 10 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:33.322198 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.324702 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.328347 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1116) took 1024 ms. Trace:
I20260709 12:19:33.328800 29320 rpcz_store.cc:276] 0709 12:19:32.304372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.304545 (+   173us) service_pool.cc:224] Handling call
0709 12:19:32.304843 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.373707 (+ 68864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:32.373735 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.373778 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:32.373808 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.327889 (+954081us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b54004bb4d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:33.327958 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.328192 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157941632}
W20260709 12:19:33.336532 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:33.337070 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.338922 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:33.339190   793 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.340528   747 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:33.341418 28598 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:33.342536 28673 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:33.321395 28682 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:33.313724 28603 rpcz_store.cc:276] 0709 12:19:32.186166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.229125 (+ 42959us) service_pool.cc:224] Handling call
0709 12:19:33.274367 (+1045242us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000bed54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:33.274651 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537353088}
I20260709 12:19:33.347126 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.349160   437 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.340251   793 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.370318   855 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.372987 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:33.377096   346 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:33.380468   617 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:33.381843   816 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:33.382299   816 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:33.383522   816 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.387079   835 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:33.391209 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.393242 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:33.395074   567 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.397866   557 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:33.398348   557 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:33.398702   572 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:33.399197   572 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.399643   572 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:33.396026 28573 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:33.405388 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:33.411003 28673 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:19:33.415021 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2533) took 1156 ms. Trace:
I20260709 12:19:33.415465 28602 rpcz_store.cc:276] 0709 12:19:32.258411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.407766 (+149355us) service_pool.cc:224] Handling call
0709 12:19:33.414616 (+1006850us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b5400233a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:33.414831 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976688512}
I20260709 12:19:33.416424 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.417058 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2240) took 1163 ms. Trace:
I20260709 12:19:33.417287 28679 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:33.417510 28604 rpcz_store.cc:276] 0709 12:19:32.253308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.253372 (+    64us) service_pool.cc:224] Handling call
0709 12:19:33.416804 (+1163432us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b5400092254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:33.416965 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145386752}
I20260709 12:19:33.418519 28680 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:33.418655 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2540) took 1046 ms. Trace:
I20260709 12:19:33.419037 28598 rpcz_store.cc:276] 0709 12:19:32.372234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.434951 (+ 62717us) service_pool.cc:224] Handling call
0709 12:19:32.435189 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:33.343354 (+908165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.418362 (+ 75008us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54002c0454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:33.418572 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082762496}
I20260709 12:19:33.412938   567 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.429950 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:33.437378 28681 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:33.439131 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2234) took 1274 ms. Trace:
I20260709 12:19:33.439244 28678 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:33.440965 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:33.430696   816 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:33.446908 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:33.445200 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:33.415912   557 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.471017 28673 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:19:33.474404   346 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:33.459144 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 63338.2us
I20260709 12:19:33.479960 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.478807   437 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:33.486809   819 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:33.486958   437 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:33.487116 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.487468   819 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:33.488627   887 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:33.492517   437 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.507541 28598 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:19:33.510509   793 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.512518 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:33.512914 28501 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 11 to 12, leader changed from <none> to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 12 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.515995   718 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:33.520454 28598 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:33.439778 28600 rpcz_store.cc:276] 0709 12:19:32.185758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.230663 (+ 44905us) service_pool.cc:224] Handling call
0709 12:19:32.231109 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:32.493671 (+262562us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:32.493903 (+   232us) log.cc:844] Serialized 14 byte log entry
0709 12:19:32.611849 (+117946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:32.611897 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:32.611939 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:33.438547 (+826608us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400122ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:33.438629 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:33.438888 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15804,"prepare.queue_time_us":407,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":16335,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":603330432,"thread_start_us":101316,"threads_started":1,"wal-append.queue_time_us":100125}
I20260709 12:19:33.524128   718 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:33.525185 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.522979 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:33.497723   819 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.533855 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 2444) took 1313 ms. Trace:
I20260709 12:19:33.534368 28675 rpcz_store.cc:276] 0709 12:19:32.215517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:32.254692 (+ 39175us) service_pool.cc:224] Handling call
0709 12:19:33.528311 (+1273619us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54001be754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:33.528533 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754521472}
I20260709 12:19:33.543653 29319 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:33.544570 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:33.545760   834 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:33.552564 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 110441us
I20260709 12:19:33.556774 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:33.557833 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.562414 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.566171 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.567586   635 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:19:33.571094 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:33.579223 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:33.584321 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:33.585331 28601 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:33.590754   771 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:33.591938   900 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:33.596627 28673 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:33.534690   718 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.626994   812 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:33.628839 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 154943us
I20260709 12:19:33.631357 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:33.616070 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:33.637014 28501 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.638007   887 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:33.638440   887 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.638839 28501 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 10, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 10 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:33.646922   557 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:33.649050 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:33.651078 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:33.652042 28756 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:33.646951 28600 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:33.652822 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.653664 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:33.654297 28598 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:33.640020 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:33.658939   567 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:19:33.643869   923 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:19:33.645094   845 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:33.650965 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:33.652949 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:33.627852   812 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:33.643687   924 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:19:33.664400 28754 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:33.638839   887 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:33.668624   572 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.669775   567 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:19:33.641465 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.665946   812 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:33.676357 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:33.679430 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:33.676450 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:33.710317 28754 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:33.647028 28501 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 8, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 8 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.679082 28752 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:33.702994 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.679557 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:33.693481 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:33.672402 28502 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 334) took 28073 ms (client timeout 15000 ms). Trace:
I20260709 12:19:33.721297 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:33.677357   635 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.733566 28604 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:19:33.728772 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:33.677099   834 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.737659 28755 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:33.676795   841 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:33.722064   793 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:33.745507 28682 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:19:33.754913 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 123617us
I20260709 12:19:33.738397 28501 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:33.760826 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 162142us
I20260709 12:19:33.764178 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:33.766089 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:33.769392 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
W20260709 12:19:33.776749 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45518.8us
I20260709 12:19:33.775405 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.752593   635 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:33.799151 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 64195.3us
I20260709 12:19:33.778499   835 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:33.809197 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 53508.1us
I20260709 12:19:33.809489 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:33.809186 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:33.782128   845 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.798897   617 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.818096 29326 raft_consensus.cc:2410] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 14 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:33.820050 28755 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:33.819547 28501 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.795933   437 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:33.825273   719 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:33.826694   573 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.827356   573 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.830325   880 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:33.831138   880 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:33.836534 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:33.837898   572 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.822587   617 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.841490 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:33.849239 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 344838us
I20260709 12:19:33.805112   618 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:33.864205 28748 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:19:33.861894 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 182457us
I20260709 12:19:33.862929 28600 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:33.788746   841 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.901526   841 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.841219   573 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.880810 28604 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:33.903213   573 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:33.904656 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 83556.8us
I20260709 12:19:33.906224   866 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:33.903833   573 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.909626 28501 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.911825   573 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.882268   887 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.883419   618 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.886659   635 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.890967 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:33.892136 28753 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:33.822649   855 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.892850   649 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:19:33.720604 28502 rpcz_store.cc:269] 0709 12:19:05.598523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.600849 (+  2326us) service_pool.cc:224] Handling call
0709 12:19:33.672142 (+28071293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:25.838376 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:25.851764 (+ 13388us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:25.851820 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:19:25.851844 (+    24us) tablet.cc:662] Decoding operations
0709 12:19:25.892416 (+ 40572us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:25.892548 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:25.892595 (+    47us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:19:25.894625 (+  2030us) tablet.cc:701] Row locks acquired
0709 12:19:25.894685 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:19:25.894963 (+   278us) write_op.cc:270] Start()
0709 12:19:25.895167 (+   204us) write_op.cc:276] Timestamp: P: 1783599565894858 usec, L: 0
0709 12:19:25.895202 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:19:25.943141 (+ 47939us) log.cc:844] Serialized 7100 byte log entry
0709 12:19:26.608717 (+665576us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b
0709 12:19:26.892166 (+283449us) op_driver.cc:464] REPLICATION: finished
0709 12:19:26.942029 (+ 49863us) write_op.cc:301] APPLY: starting
0709 12:19:26.964326 (+ 22297us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:27.507926 (+543600us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:27.560929 (+ 53003us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:28.187110 (+626181us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5c000b6a8c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe9c71331 00007f6fe9c71221 00007f6fe9c6bf6c 00007f6fe73cc30b 00007f6fe73cbfd3 00007f6fe74cae34 00007f6fe74b697c 00007f6fe74bad61 00007f6fe74bad19 00007f6fe74baca9 00007f6fe74bac71
0709 12:19:30.015888 (+1828778us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:30.016261 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:19:30.016307 (+    46us) write_op.cc:312] APPLY: finished
0709 12:19:30.111168 (+ 94861us) log.cc:844] Serialized 156 byte log entry
0709 12:19:30.533323 (+422155us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:30.588818 (+ 55495us) write_op.cc:454] Released schema lock
0709 12:19:30.636189 (+ 47371us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:30.782887 (+146698us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b1800191500. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:30.783040 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:30.783076 (+    36us) write_op.cc:454] Released schema lock
0709 12:19:31.745341 (+962265us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
Metrics: {"mutex_wait_us":462066,"reported_tablets":47,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":1330,"apply.run_cpu_time_us":65470,"apply.run_wall_time_us":3742168,"cfile_cache_hit":66,"cfile_cache_hit_bytes":68805,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6212,"cfile_init":2,"lbm_read_time_us":63931,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":8,"num_ops":17,"prepare.queue_time_us":172482,"prepare.run_cpu_time_us":52031,"prepare.run_wall_time_us":983717,"raft.queue_time_us":81826,"raft.run_cpu_time_us":1554,"raft.run_wall_time_us":1609,"replication_time_us":996752,"spinlock_wait_cycles":96366208,"thread_start_us":1277213,"threads_started":5,"wal-append.queue_time_us":1311676,"wal-append.run_cpu_time_us":18131,"wal-append.run_wall_time_us":3312664}]]}
I20260709 12:19:33.896776 29317 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:33.898245   437 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:33.898627   845 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.899410   572 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:33.805614   834 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.911664 28501 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 8, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 8 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.912410   573 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:19:33.919862 28749 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:33.921195   618 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.923046   617 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.925918   880 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.926877 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:19:33.991761 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 119366us
I20260709 12:19:33.992722 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:33.939409   855 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:33.995834 28720 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:19:34.006281 28720 leader_election.cc:403] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:19:33.996703   812 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:34.001396 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.007304   819 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:33.951128   437 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:33.998210 28501 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:33.946393 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.955444   834 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:33.959955 28604 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:19:33.953188   845 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:33.966732   346 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:19:33.967468   836 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:19:33.969125 29317 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:34.032461   836 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:34.033215   836 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.034912 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.035734 28747 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:33.919099   887 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:33.940887 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:33.996428   816 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:34.037279   816 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.037657   816 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.037797 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:33.927968 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:34.038645 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:34.005220   855 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:34.039302 28748 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.040176   792 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:33.944551   567 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:19:33.955621 28673 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
W20260709 12:19:33.941218 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 111936us
I20260709 12:19:33.969900 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.045794 29326 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:19:33.939627   649 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:34.007628 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 144159us
I20260709 12:19:34.046945   617 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:34.047271   649 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.047806 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.006801   812 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.048519   812 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.986088 28598 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:19:34.022387   793 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:34.029016 28754 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:34.030644 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:34.034848 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.037998 28753 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:34.040591   792 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:33.983517   572 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.023219   771 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:34.051622 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:34.052537 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.025990 28604 pending_rounds.cc:85] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 9
I20260709 12:19:34.074527 28748 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:34.036093   836 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.082500 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:34.079710 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.086510 29320 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:34.081367 28756 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:34.084774   346 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:34.088231 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 182511us
I20260709 12:19:34.085256   617 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.080538 28602 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:34.092016 28600 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:34.088917 28604 pending_rounds.cc:107] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:19:34.098110 28604 raft_consensus.cc:2889] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:34.098737 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:34.086724   792 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.102914 28751 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:34.090283   346 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.109400 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:34.096175   845 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:34.107513 28501 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 4 to 9, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 9 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:34.087198   618 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:19:34.098259   841 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:34.115818   929 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:19:34.125391 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 234580us
I20260709 12:19:34.115572   346 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.126068 28501 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:34.132380   849 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:19:34.108912   572 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.126181   866 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:34.148902   866 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:34.152674 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63623.2us
I20260709 12:19:34.153537 28571 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:34.154840 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.155051   437 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.157908 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.153414 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:34.160660 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.160833   719 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:34.161339   719 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:34.161795   719 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:34.125777   836 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:34.164856   836 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.165133   841 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:34.110036   771 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.167241   836 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:34.167845   940 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:34.168232   771 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:34.170485   941 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.085s	user 0.000s	sys 0.004s
I20260709 12:19:34.171233   635 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:34.173882 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.175267   635 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:34.175972 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.114770   617 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.180562 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:34.183027 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.178912 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.152146   866 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:34.191753 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 93483.7us
I20260709 12:19:34.176842 28501 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 9, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 9 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.177616   793 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:19:34.209597 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.210161 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.211509   946 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.211776   567 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.212114   946 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.205193 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:34.214032 29320 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:34.205884   838 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:34.216462   928 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:34.207650   572 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.212257   567 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.187485   874 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:34.218035   874 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:34.218875   635 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:34.219343   567 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:34.219038   874 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.219354   635 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:34.221016   635 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:34.224296   946 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.225670 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.225955   835 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:34.226172 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.226468   835 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:34.226459 29320 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:34.227128   838 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:34.228102 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:34.188187   937 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:34.229013   946 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:34.204269 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.232894 29317 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:34.227667   835 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:34.236238 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 186349us
I20260709 12:19:34.235677 28753 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:34.229562   946 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.235553   866 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:34.238102 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.240130 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:34.240573 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.228986   937 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:34.243229 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.243618 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:34.244379 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 90924.3us
I20260709 12:19:34.245131 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:34.239758   946 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:34.187762   836 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:19:34.263406 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.264134 28681 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:34.267316   929 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.248502   346 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.267915   929 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.270407   346 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.250115   572 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:19:34.271663   929 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.247579   604 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:34.277015   835 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:34.277182   604 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.281157 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.281410   816 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.282081 29317 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:34.283710   816 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.284175   604 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:34.284499 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58475.7us
I20260709 12:19:34.284729 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:34.285145 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:34.246903   887 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.286170   816 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:34.286269   887 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.287235 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.287671   549 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:34.288846 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.289603 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:34.293666 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.285305 28674 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.242786   937 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.295589 28755 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:34.296517 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:34.301134 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:34.288602   841 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:34.338011 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:34.338114 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:34.293108   855 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:34.286682   816 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.339772 28682 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 8.
I20260709 12:19:34.343259 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:34.247430 28501 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 11 to 12, leader changed from <none> to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 12 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:34.341154 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 103039us
I20260709 12:19:34.377745 29317 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:34.361048 28673 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:34.355568 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.345120 28679 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:34.355403 28680 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:34.378618   949 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:34.259881   849 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.362414 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:34.360654 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 115606us
I20260709 12:19:34.272061   812 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.383410 28681 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
W20260709 12:19:34.406683 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 118268us
I20260709 12:19:34.387425 28674 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:34.411059 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:34.355026 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.338735   866 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:34.349828   838 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:34.343318   887 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:34.385764   949 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:34.385973   816 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:34.438728 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 185330us
I20260709 12:19:34.414141   880 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:34.432662   455 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:19:34.378146   819 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.434403   649 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.437171 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:34.438148 28749 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:19:34.344973   836 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:34.466501   836 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.468649   838 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:34.469050   836 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.354981   855 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.438974 28501 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:34.479588   816 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.480082   812 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.479866 28501 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:34.444852 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:34.485787   816 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.487107   771 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:34.449270 28648 leader_election.cc:400] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:34.488585 28648 leader_election.cc:403] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:19:34.489487 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51487us
I20260709 12:19:34.450193 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:34.450928   944 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.450865 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.496902 28679 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:34.481990 28501 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.449359 28600 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:34.386849   549 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.370173   792 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.458340   819 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.360118   617 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:34.469399   838 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:34.455649   887 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:19:34.370141   635 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.514571 29319 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:34.502151   793 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.523994 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:34.531579 28598 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.429451   849 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.525274 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:34.534068 28501 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:34.539408 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 88647.7us
I20260709 12:19:34.539937 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:34.517042   572 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.540596 28599 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:34.519558   836 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.549499 28501 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 9, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 9 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.535959   816 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:34.500407   937 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.502344   549 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:34.561491 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70697.5us
I20260709 12:19:34.533591   604 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.567890 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:34.568818 28748 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:34.568037 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.568993 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.563607 28501 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 10, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 10 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.554437   618 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.572966 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:34.574154 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.580075 28751 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 10: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:34.564947   346 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.582655 28648 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:34.583549 28501 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 9, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 9 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:34.568670   929 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:34.588748   937 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.588225   567 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:34.550129   572 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.557098   793 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.594172 28679 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:34.594338 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.597575 28678 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:34.598819 28598 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:34.557276   719 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.602475 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:34.605834 28748 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:34.606947 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.608661 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.589671   939 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:34.609815 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:34.613670 28678 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:19:34.614382 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 63796.9us
I20260709 12:19:34.576341   946 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.551772   949 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.577189   618 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.574043   836 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.578831   604 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.573424 28599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:34.622310 28599 raft_consensus.cc:606] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:34.622828 28756 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:34.610673   958 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:34.628808   955 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.611352   939 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:34.597343   567 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.634768 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:34.632942 28677 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:34.636921 28678 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:34.607985   346 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.636936 28677 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:34.641464   951 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.641688   927 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:34.642072   951 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.644026 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.590021   838 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.639056   855 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:34.649541 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.607066   929 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.641479   960 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.634661   939 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:34.634219   887 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:34.666442 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.675521 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:34.647876   635 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.651338   792 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.682174 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:34.660614   961 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:34.679661 28678 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:34.661476   949 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:34.681293   960 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.690596 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:34.691259 29325 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.692595   960 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.692826 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.693398   968 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.693554 28682 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:34.694046 28679 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:34.693914   968 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.694469 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:34.695194 28682 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:34.695410 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.695931 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:34.696146   968 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.716241 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.696892 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.706756   346 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:34.720006 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 121759us
I20260709 12:19:34.772367 28678 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:34.771780 28681 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:34.638715   958 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 12:19:34.775681 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55837.5us
I20260709 12:19:34.777271 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:34.698347   962 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:19:34.696516 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:34.729102 28682 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:34.638706   955 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.769474 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.689309   961 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.825353 28679 raft_consensus.cc:2410] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:19:34.697095   959 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:19:34.683743 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:34.674561 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:34.678992   719 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.831791 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:34.832572 28679 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
W20260709 12:19:34.774930 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 165194us
W20260709 12:19:34.827674 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 162699us
I20260709 12:19:34.692760   963 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:34.794214   792 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:34.846275 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:34.846899 28679 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.721817   887 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.847745 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:34.825138   549 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.859587 28681 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:34.829414   719 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.827455   961 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:34.863412 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 86222.1us
I20260709 12:19:34.864554 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:34.866250 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:34.867020 28682 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:34.870672 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:34.871672 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:34.874725 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:34.885181 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 302554us
I20260709 12:19:34.853760   849 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.846177   937 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:19:34.894615 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:34.873183   946 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.853709   792 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:34.858922   874 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:19:34.904958 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 221245us
I20260709 12:19:34.899209   573 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:34.907644   969 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:34.908617   937 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:19:34.963120   973 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:19:34.912958 28681 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:34.916986   792 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.917985   793 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.921368 29325 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:34.933645   604 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.938943   970 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:34.940775   955 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.899613   346 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:34.945077 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 102644us
I20260709 12:19:34.959743 28682 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:34.962103   954 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:34.962285   969 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:19:34.962466   972 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:19:34.895987   855 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:19:34.964290 28753 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:34.868381   719 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:34.976977   793 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:34.992848   969 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:34.992290   719 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.993991   969 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.000159 28679 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:35.002167   982 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:35.002779   982 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:34.966769 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 102323us
W20260709 12:19:34.975063 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 80763.6us
W20260709 12:19:34.984112 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 112512us
I20260709 12:19:34.968816   792 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:19:34.975724   346 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.986579   959 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:34.986765   945 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:35.033315   549 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.033454   945 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.033533 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:35.034365 28606 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.033942   549 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.034902   959 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:34.987244   978 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.035924   959 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.036718   978 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.037580 28677 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.038007   618 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.038910 28677 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:35.038938   978 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:34.987455 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.041071   567 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:35.041131 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 53761.6us
I20260709 12:19:35.042140 28722 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
W20260709 12:19:34.988188   966 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:19:34.982785   604 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:35.058553 28677 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:35.058732   604 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:35.059473   557 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:19:35.060978   604 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:34.985860   970 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.064669   970 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.031500   346 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:35.009089 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.033995   945 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.020031 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:35.083091 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63221.4us
I20260709 12:19:35.084328 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:35.085773   437 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:35.086176   437 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:35.086531   437 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.089075   792 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:35.021258 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.021922 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.032598   836 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.032406   975 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:19:35.008850   982 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.032763 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:35.044677 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.044708   845 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:35.046168   567 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:35.101495   567 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:35.102542 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 81359us
I20260709 12:19:35.102963   880 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:35.103400   880 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:35.103660   567 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.103760   880 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.047670 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:35.048316 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.105059 28603 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:35.036396   549 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.049489 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:35.049505   954 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:35.105351 29319 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:35.053610   929 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.055570   835 raft_consensus.cc:993] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:35.057153 28606 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:35.057983   819 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:35.092962 28601 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 9: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:35.098968 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.098129 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:35.106369 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58776.4us
W20260709 12:19:35.119720 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 245047us
I20260709 12:19:35.120523 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:35.118587 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:35.107494   954 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:35.126484 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.107438   982 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:35.128212 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.132771 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.133632 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.135177 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.135852 28748 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:35.139333 28753 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:35.107353   975 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:19:35.141899 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.142584 28602 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 9.
I20260709 12:19:35.143550   874 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:35.144591   975 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:35.145793   989 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:35.146205   989 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:35.147142   989 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.148545 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.148715   989 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:35.129004   939 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.149551 29325 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.151106 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.151897 28752 raft_consensus.cc:2410] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:19:35.152673 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.153421 28751 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:35.137873   836 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:35.154490   836 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:35.154891   836 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.155555   939 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.156646   951 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.122241   567 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:35.157384   567 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.159497   567 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:35.166805   944 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.003s
I20260709 12:19:35.167367   944 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:35.169154 29325 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:35.130856 29322 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:35.144737 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.123571   845 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:35.176203 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.178332 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.122097   985 raft_consensus.cc:1081] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:35.180637 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.131927   819 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:35.178625 29318 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:35.187244 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.186395 29319 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:35.191798 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.196780 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:35.189267 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 96097.9us
I20260709 12:19:35.204183 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.204555 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.201485 28751 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:35.206164 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.209843 28748 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:35.211416 29327 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:35.205192 28607 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:35.221488 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.175415   557 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:35.208037   816 consensus_meta.cc:287] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 12:19:35.223644 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:35.253212 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:35.265786 28752 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:19:35.266754 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62957.3us
I20260709 12:19:35.207883   819 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.258752 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:35.254114 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:35.271791 28605 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:35.271807 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:35.261291 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.177772   982 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:35.185336   937 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:35.253839 28750 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:35.268987 28751 raft_consensus.cc:2368] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:35.275893 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.210294   845 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:35.285384 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 61812.8us
I20260709 12:19:35.284559   988 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:35.274310   819 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.272821   816 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:35.297060 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.270257   649 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:35.298718 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.299150 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:35.279925   969 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:35.302670 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.305258 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.291960   557 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:35.293735   988 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.311158   649 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.307695 28755 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:35.309497 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.310520 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.316936 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.299149   618 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:35.319259 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:35.302518   946 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.303697   969 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.323344 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.307386   927 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:35.306996   835 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:35.308843   985 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.296625   961 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.318367   988 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.332392   455 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:35.334268   991 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:19:35.320955   838 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:35.337114 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.327523   969 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.326692   927 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.326500   986 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:35.329720   835 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:35.332821   549 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:35.354306 28676 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:19:35.358569   987 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:35.359057   987 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.359416   987 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.360563   938 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:35.346534   455 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.361080   938 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.361496   938 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.362782   455 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:35.347241   927 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:35.391739 28603 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:35.338581   604 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:19:35.326534   982 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.393085 28600 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:35.345000   845 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:35.398303  1001 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:19:35.399590   992 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:19:35.401381   994 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:35.401835   994 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:35.402206   994 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:35.405110   998 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:35.406647   649 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.407222   835 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.331827   937 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.392977   945 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:35.399665   990 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.365s	user 0.002s	sys 0.002s
W20260709 12:19:35.412766 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 75705.5us
I20260709 12:19:35.345798   838 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.391532   557 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:35.411274   945 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:35.391206   984 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:35.414610   835 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.441406 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:35.447836 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 119648us
I20260709 12:19:35.450765 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.440867   557 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:35.455174 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.360275   836 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.457273 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.457338 28605 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:35.448300   635 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:35.461206   346 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.463177   880 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.477376   437 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.480270 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.481716 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:35.442396   984 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.497268   346 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:35.501298   984 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.503087   572 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.505398   838 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.505739   437 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.493261   960 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:35.558543   960 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:35.558349   988 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.559484   960 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.560153   836 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:35.561576 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.562232 28680 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:35.563201 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:35.493773   816 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:35.564689 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.564911 29322 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:35.515026   855 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.565456 28681 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:19:35.565824   855 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.516333   977 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.518982 29318 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:35.509404   955 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:35.568727   977 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.569064   955 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.569137   994 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.570801   977 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.519620 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.518532   880 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:35.571520   994 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.521281 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:35.524221   979 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.500s	user 0.001s	sys 0.001s
I20260709 12:19:35.524659   961 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.571084   955 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:35.529765 28607 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:35.572127   557 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.530521 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.573036 28603 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:35.573377 28599 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:35.573614 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1144) took 1383 ms. Trace:
I20260709 12:19:35.574342 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.574028 29326 rpcz_store.cc:276] 0709 12:19:34.189887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.190037 (+   150us) service_pool.cc:224] Handling call
0709 12:19:34.196600 (+  6563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:34.550871 (+354271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:34.550921 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:34.579052 (+ 28131us) log.cc:844] Serialized 26 byte log entry
0709 12:19:34.860591 (+281539us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:34.860657 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.860749 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:35.523633 (+662884us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:35.573315 (+ 49682us) raft_consensus.cc:1685] finished
0709 12:19:35.573337 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:35.573533 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12063,"raft.queue_time_us":92396,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":87115648,"thread_start_us":498392,"threads_started":2,"wal-append.queue_time_us":383985}
I20260709 12:19:35.575620   855 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.575722 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.530764 28679 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:19:35.537873 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.539968 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.549561 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.578230 28674 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:35.579525 28674 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:35.489269   635 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:35.571497 28677 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:35.557452   987 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.566346 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.520622   887 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.525717   968 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:35.586680   968 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:35.587587   968 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.572358 28673 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:35.589087   968 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:35.589967   969 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.590759 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.591221 28598 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:35.592021 28749 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:35.592368 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.592739 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.593020 28748 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:35.595873 28752 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:35.596952 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.597592 28750 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:35.598752   987 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.584884 28681 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:35.596419 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.601397 29292 leader_election.cc:400] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:35.601820 29292 leader_election.cc:403] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:35.577232   819 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.606074   819 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:35.580111 28682 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:35.554824 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.607117 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.608127 28752 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:35.609144 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.609783 28606 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:19:35.610581 28751 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:35.610934 28606 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:35.611865 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.612741 28753 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:35.613265 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:35.614295   819 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:35.580577 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 495082us
I20260709 12:19:35.617527 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:35.584002   945 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.604120   939 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11.
I20260709 12:19:35.621174 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.487010   954 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:35.641785 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.614984   819 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.621315 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:35.646555 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.646931 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.647403 28755 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:35.646623 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.648994 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.649734 28753 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:35.658639 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.663462 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:35.662240 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:35.666131 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:35.667266 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.668679 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:35.672639 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:35.622093   959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.012s	sys 0.008s
I20260709 12:19:35.592021   969 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.676618 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.681435 28752 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:19:35.684837 28606 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:35.657943   928 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:35.647312   988 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:35.689432 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:35.628854   987 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:19:35.670358   944 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.729481 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.615239   635 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.734588 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:35.742527 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:35.742743 28755 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:35.665079   937 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.736264 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:35.736709 28601 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:35.676676   959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.012s	sys 0.008s
I20260709 12:19:35.684566   618 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:35.770238 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:35.770913 28753 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.685073   963 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.689254 28748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:19:35.776553 28748 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:35.755717 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.759464 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:35.777477 29318 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.764304 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:35.778113 28755 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.680747   945 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.776970 28748 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.774755 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:35.779441 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:35.781963 28682 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:35.782146   939 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:35.782603   939 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.782563 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:35.783198   939 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.783878   855 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:35.784224   887 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:35.784688   887 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:35.784813 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.785104   887 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:35.785751 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:35.786017 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:35.786463 29319 raft_consensus.cc:2368] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:35.788126 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.788617 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:35.789058   988 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:35.784696   874 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:19:35.770638   618 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.728847   961 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:19:35.817549 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:35.817749 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:35.814558 28748 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.906056 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:35.930019 28676 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:35.791409   928 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:35.791193   969 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:35.944734 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.791018   557 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:35.773207   960 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:35.815588   618 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.954546 28753 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:19:35.755028   938 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.933529 28751 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:35.943447 28682 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:35.959196   970 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:35.962648 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.962889 28602 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:35.945786 28756 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
W20260709 12:19:35.904018 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 87315.5us
I20260709 12:19:35.749716   927 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:35.752784   944 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:35.947398 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:35.950009   874 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.968046 29325 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.908635   812 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:19:35.969837 28682 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 9: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:35.969738 29318 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:35.971794 28647 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.955535   960 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.976624 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.981746   718 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:35.982334   718 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.982788   718 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:35.993528 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:35.994102 28750 raft_consensus.cc:2368] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:35.995174 29326 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:35.996927 28599 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:35.989331 28755 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:35.977070 28748 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:35.999027 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:35.994843   874 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.001960   940 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:36.002388   940 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.002655   874 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.002758   940 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:36.009881 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.012111 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.012796 28674 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:36.013489 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.013775 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.014143 28755 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:19:36.014775 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.015590 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.015806 28680 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:36.016930 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:35.985261  1021 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:19:36.025146 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:35.993142   960 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:36.036964 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:35.957330   969 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.032135 29325 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
W20260709 12:19:36.033051 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.039408 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.030789 29290 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:35.989780   944 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:36.040365 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.017738   988 raft_consensus.cc:2764] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:19:36.064568 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 72408.7us
I20260709 12:19:35.965492   557 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:36.074545 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 43886.4us
W20260709 12:19:36.075649  1018 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 12:19:36.075855  1015 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:19:36.021973   874 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:19:36.076174  1020 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:19:36.019554   955 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:36.081039  1017 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:19:36.086956 29323 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:36.040316   617 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:36.042053   954 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:36.099309 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:36.077282   880 raft_consensus.cc:2764] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:19:36.085397   719 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.077865   819 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:36.114033  1019 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:19:36.149070 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 157756us
I20260709 12:19:36.152581 28679 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:36.159574 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 218476us
I20260709 12:19:36.114383   970 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:19:36.109985   959 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:19:36.180920   938 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:36.186699 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:36.186524   968 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.001s
W20260709 12:19:36.191825   974 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.568s	user 0.004s	sys 0.011s
I20260709 12:19:36.145195   719 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.086202   928 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.202726   838 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:36.186542   970 consensus_queue.cc:1243] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:19:36.192255   945 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:36.197489   963 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:36.203637   900 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:36.220005   927 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:36.242650 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 156865us
I20260709 12:19:36.243351 28750 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:36.245357 29290 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:36.245712 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:36.225072   963 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:36.248261 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:36.209533   929 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:19:36.260326 28601 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:36.234460   900 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:36.292052 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:36.229058   838 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.297164 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.298442 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.260569   988 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:36.253455   969 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.305908 28682 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:36.285395   874 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:36.295475 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:36.284832   617 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:36.287341   949 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:36.301858 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 56253.7us
I20260709 12:19:36.314291 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:36.310882 28751 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:36.316751 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.240010   939 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.318912 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:36.295370   855 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:36.287853   816 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:19:36.260758   968 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:19:36.319787 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:36.320024 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:36.294987   834 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.321419 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:36.324134   928 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:36.311805   819 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:36.329875 29322 raft_consensus.cc:2410] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:19:36.332767 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 845) took 1781 ms. Trace:
I20260709 12:19:36.299641   945 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:19:36.330891 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:36.313493   617 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:36.312178   988 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:36.335785 29319 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:36.321012   969 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:36.336201 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:36.326378  1008 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.358623  1008 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.360937  1008 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:36.339390   819 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:36.362058   819 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.335101   834 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.356051  1030 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:36.369014  1030 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.370770   940 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.371407  1030 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.372097 28674 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:36.341641   887 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 12:19:36.343169   618 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.344844   719 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:36.345386   718 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.324720  1044 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:36.347570   960 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.348093   988 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:36.348547   874 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.389112 29323 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:36.389775   618 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.383391   887 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.395584   887 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.349440   838 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.396732 28680 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:36.332329  1027 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 12:19:36.389133   834 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.338430   900 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.398175   718 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:36.334535 28747 rpcz_store.cc:276] 0709 12:19:34.546536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:34.546756 (+   220us) service_pool.cc:224] Handling call
0709 12:19:34.547089 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:34.567823 (+ 20734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:34.567852 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:34.589756 (+ 21904us) log.cc:844] Serialized 52 byte log entry
0709 12:19:34.777407 (+187651us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:34.840233 (+ 62826us) log.cc:844] Serialized 14 byte log entry
0709 12:19:34.840446 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:34.840528 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:35.607175 (+766647us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b1800333520. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:36.107080 (+499905us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:36.328048 (+220968us) raft_consensus.cc:1685] finished
0709 12:19:36.328071 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.328223 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12948,"prepare.queue_time_us":63071,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4142,"raft.queue_time_us":18241,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":12223,"spinlock_wait_cycles":37267712,"thread_start_us":108690,"threads_started":1,"wal-append.queue_time_us":271708}
I20260709 12:19:36.356498   963 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:36.357579  1003 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.752s	user 0.001s	sys 0.002s
I20260709 12:19:36.354465   617 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:36.372939 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.380566 29320 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:36.332332   928 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:36.387379 29322 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:36.384371   557 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:36.434226 28676 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:36.381958   969 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:36.425462   928 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.443424 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:36.431381   849 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:36.444706  1022 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.358s	user 0.003s	sys 0.002s
I20260709 12:19:36.453213 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:36.457020   939 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:36.459390 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 792141us
I20260709 12:19:36.460268 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.462181   982 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:36.462615   982 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:36.463016   982 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:36.464524   984 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:36.468951 29318 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:36.471906 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 785) took 1020 ms. Trace:
I20260709 12:19:36.472808 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:36.476254 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:36.476869 28748 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:36.472270 28599 rpcz_store.cc:276] 0709 12:19:35.451706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.575474 (+123768us) service_pool.cc:224] Handling call
0709 12:19:36.471761 (+896287us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400233f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:36.471859 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930416000}
I20260709 12:19:36.477452 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:36.479337 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:36.479956 28752 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:36.465180   984 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.481894 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:36.489039 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:36.485769 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 537669us
I20260709 12:19:36.453190   940 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.483853   834 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:36.493464 28749 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:36.495687 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:36.491525 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:36.500087 28748 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:36.501902 29317 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:36.498631 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2252) took 1365 ms. Trace:
I20260709 12:19:36.479501   937 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:36.489761   994 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:36.491168   718 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:36.515904 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:36.518718   960 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.504220 28604 rpcz_store.cc:276] 0709 12:19:35.133602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.133729 (+   127us) service_pool.cc:224] Handling call
0709 12:19:35.141750 (+  8021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:35.177378 (+ 35628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:35.177412 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:35.200805 (+ 23393us) log.cc:844] Serialized 26 byte log entry
0709 12:19:35.300991 (+100186us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:35.323798 (+ 22807us) log.cc:844] Serialized 14 byte log entry
0709 12:19:35.409621 (+ 85823us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b48000d0158. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe89a8aa1 00007f6fe899fb37 00007f6fe899f9ca 00007f6fe8a9726f 00007f6fe8a96f37 00007f6fe8aab55c 00007f6fe8aab508 00007f6fe8aab488 00007f6fe8aab443 00007f6fe8aaa6ec 00007f6fe79d4a96
0709 12:19:35.447050 (+ 37429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:35.448517 (+  1467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:35.605582 (+157065us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b18003f1e40. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:36.356916 (+751334us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:36.498422 (+141506us) raft_consensus.cc:1685] finished
0709 12:19:36.498444 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.498568 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32518,"prepare.queue_time_us":22594,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":35245,"raft.run_cpu_time_us":2256,"raft.run_wall_time_us":238820,"spinlock_wait_cycles":70552064,"thread_start_us":149026,"threads_started":2,"wal-append.queue_time_us":127855}
W20260709 12:19:36.523468 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 53850.6us
W20260709 12:19:36.523516 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47148.2us
I20260709 12:19:36.524827 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.496470   874 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:36.509946   834 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:36.535701 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.527788 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.528759 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:36.483726   557 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:19:36.534566 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:36.537585 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.538223   835 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:36.539882 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:36.544314 28755 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:36.546411 28756 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:36.546671 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.546787 28673 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:36.547760 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.547822 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.548473 28673 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:36.551611 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.527232   940 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:36.552325 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 786) took 1099 ms. Trace:
I20260709 12:19:36.557963 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.555634 28572 leader_election.cc:400] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:36.558566 28681 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:36.558892 28572 leader_election.cc:403] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:19:36.559504 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.560019   618 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:36.552277   437 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.561466   437 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.563122   988 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.529569   838 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:19:36.534057   985 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:19:36.565060   838 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:36.560945 28681 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:36.566273 28752 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:36.556180 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.553609 28675 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:36.557889 28600 rpcz_store.cc:276] 0709 12:19:35.453124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.589707 (+136583us) service_pool.cc:224] Handling call
0709 12:19:35.590006 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:35.614842 (+ 24836us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:35.615155 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 12:19:36.218904 (+603749us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b180001f900. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:36.458857 (+239953us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b180001f900. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe795358f 00007f6fe0992571 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd
0709 12:19:36.479884 (+ 21027us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:36.484496 (+  4612us) log.cc:844] Serialized 26 byte log entry
0709 12:19:36.484695 (+   199us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:36.484748 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.484844 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:36.552122 (+ 67278us) raft_consensus.cc:1685] finished
0709 12:19:36.552140 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:36.552269 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":788696,"prepare.queue_time_us":5711,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":745667,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":45440,"spinlock_wait_cycles":21627008,"thread_start_us":141337,"threads_started":1,"wal-append.queue_time_us":359062}
I20260709 12:19:36.575035 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:36.576717 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.582392 28755 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:36.565558   838 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:36.585193 28600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:36.586229 28600 raft_consensus.cc:606] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.586686 28600 raft_consensus.cc:614] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:36.526873  1030 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:19:36.519618   937 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.530138  1036 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:19:36.595875 28747 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:36.564339   437 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.555109   939 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:36.591081 28752 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:36.599679 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.503338   969 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:36.604245 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48743.8us
I20260709 12:19:36.618454 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:36.604424 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.621393 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:36.601193   955 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:36.615815 28755 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:36.616981 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.583997   951 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.610157 28673 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:36.613125   618 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:36.613869   939 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.623414   437 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:36.636754  1025 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:36.637239  1025 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:36.645823 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 118085us
I20260709 12:19:36.625027   955 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:36.648874 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:36.650027   573 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:36.653187   573 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:36.655143   988 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:36.641587   939 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:36.668316 29323 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 4 to 10, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:36.671654 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.645540   987 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.631160   951 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.660982   955 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:36.660794   618 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:36.663465   988 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:36.726882 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 105572us
W20260709 12:19:36.730496 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 126144us
I20260709 12:19:36.633941   838 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.740181 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:36.740513 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:36.741053 28601 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:36.731510 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:36.739172 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:36.742841 28600 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:36.743800 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.744699 28682 raft_consensus.cc:2376] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12. Re-sending same reply.
I20260709 12:19:36.746160 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:36.746446 28599 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:36.748637   982 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.751008   982 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.751754 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:36.752393 28603 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:36.753403 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:36.754069 28607 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:36.756587 28600 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:36.757844 28598 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:36.718727   618 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:36.682528   987 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.770780 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:36.769182 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:36.743942   974 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:19:36.772794 28600 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.710626   994 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:19:36.780798 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:36.788159 28682 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:19:36.785938 28601 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:36.794309 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:36.747479   988 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:36.763093   985 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:36.681197  1025 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.780148   838 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.807049   618 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.801107   937 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:36.798043   985 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.808816 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:36.809105   985 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:36.810057 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:36.814019 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.814263   987 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.819164   928 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:36.823004 29292 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.632s (SENT) [suppressed 4 similar messages]
I20260709 12:19:36.822111 28600 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:36.826907 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:36.833585 28601 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:19:36.834769 28682 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:36.853588 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:36.855891 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:36.841929   437 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:36.861459 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.861721 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.862825 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:36.863587 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:36.864320 28752 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:36.866297 28648 leader_election.cc:400] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:36.866605 28648 leader_election.cc:403] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:36.868381   549 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:36.868799 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.868906   549 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:36.870051 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.870847 28750 raft_consensus.cc:2410] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:19:36.870719   963 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.871379  1036 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10.
I20260709 12:19:36.872076  1036 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:36.878351 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:36.880998 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:36.881454 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:36.881165 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:36.882711 28600 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:36.845597  1025 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:36.885100 28748 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:36.893671 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.894793 28748 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:19:36.871037   549 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.901393   955 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.902256 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.821398   988 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.849124   874 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:36.862900   617 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.914500 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:36.915282   946 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:36.918160   951 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.922049   939 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:36.955515 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:36.934372 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:36.940863 28681 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:19:36.949991 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 126992us
I20260709 12:19:36.958031 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:36.941731   955 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:36.888783  1036 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:36.943394   928 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:36.880499  1044 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:19:36.986871 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:36.989733 28598 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:36.962082 28600 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:36.950845 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:36.966895 28682 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:36.967721 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:36.950686   455 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:36.996209 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45440.2us
I20260709 12:19:37.001813 29317 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:19:37.001662 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.988989   987 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:36.982168   946 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:36.992617   951 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:36.991804   835 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.026227 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:37.018359   928 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.001219   719 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:37.009737  1067 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.012941  1044 consensus_queue.cc:1243] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:19:37.035771 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:36.991241   937 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:19:37.024960   455 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:37.034626   951 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:37.013840   949 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:19:37.013411  1060 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:19:37.038087  1065 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.077569   617 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:37.078437   455 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.081983 28600 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:37.082445 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.095047 28598 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:37.095777 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:37.096551 28600 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:37.083806 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.084105 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.084764 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.030560   835 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.086033 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.101330 28607 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:37.103317   835 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:37.104502  1070 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:19:37.038905   928 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.028113   874 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.113485 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2176) took 1100 ms. Trace:
I20260709 12:19:37.126967 28601 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:37.112713 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:37.071249  1044 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.104177   984 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:37.136338 28602 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:37.129237 28680 rpcz_store.cc:276] 0709 12:19:36.013298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.024823 (+ 11525us) service_pool.cc:224] Handling call
0709 12:19:37.113316 (+1088493us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54003e21d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:37.113430 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852525824}
I20260709 12:19:37.134927  1079 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:37.138895 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2166) took 1145 ms. Trace:
I20260709 12:19:37.139046 28679 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:19:37.050271  1067 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.111917  1012 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:37.139300 28676 rpcz_store.cc:276] 0709 12:19:35.999446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.019430 (+ 19984us) service_pool.cc:224] Handling call
0709 12:19:37.138682 (+1119252us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54003b7754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:37.138834 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828010880}
I20260709 12:19:37.155575 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:37.095355  1065 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.138396  1079 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.109028   939 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:37.094849   946 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.168924   557 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:37.170003 29317 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:37.173758 28681 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:37.130566   947 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:37.179406 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:37.175174 28604 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:37.191877 28682 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:19:37.171101  1012 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:37.205494  1069 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.129s	user 0.003s	sys 0.000s
I20260709 12:19:37.077605   951 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.205088  1067 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:37.213486 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:37.169386   928 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:37.223042 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2598) took 1591 ms. Trace:
I20260709 12:19:37.205499   838 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.221349 29327 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:37.219092 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:37.229628 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.221740 29323 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:37.222219 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:37.231007 28681 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:37.231997 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.232838 28601 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:37.223567 28749 rpcz_store.cc:276] 0709 12:19:35.631606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:35.631811 (+   205us) service_pool.cc:224] Handling call
0709 12:19:36.493138 (+861327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:36.497567 (+  4429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.222793 (+725226us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b540003e150. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:37.222965 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908022144}
I20260709 12:19:37.234781 29326 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:37.108364   985 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.190200   557 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:37.245908 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:37.246737 28750 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:37.252334 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.140822  1044 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.266932 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.272301 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.277411 28648 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.241040   984 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:37.197989   947 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:37.284744 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 97649.6us
I20260709 12:19:37.283211 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.289724 28752 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:37.292763  1045 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:37.292825   649 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:37.294744  1043 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:37.295219  1043 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:37.296309  1043 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.297736  1043 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:37.301163  1079 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:37.301507  1078 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:19:37.302531  1074 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:19:37.289186  1059 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:37.288998  1080 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:19:37.303323  1059 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:37.305210  1076 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:19:37.305753  1059 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:37.307596   985 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:37.308887  1044 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:37.309283 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:37.309963 28674 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:37.311710  1065 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:37.228116   944 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:19:37.261550   960 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:19:37.313517   719 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:37.237370   937 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:19:37.286232   549 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:19:37.315745 28755 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:37.288841   455 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:19:37.322192   947 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:37.286689  1041 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:37.256513   838 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.286834   984 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.333736 28674 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:37.289268   835 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:37.346639   455 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:19:37.347811  1085 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:19:37.352029 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.352727 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.355468 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.356060 28605 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:37.356221 28602 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:37.357474 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:37.358008 28605 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:37.358201 28599 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:37.358595 28600 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:37.360674 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.361261 28606 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:37.361174 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.364024 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.365999 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.339584   984 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:37.368827 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 91518.4us
I20260709 12:19:37.371410 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:37.372767 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.373852   838 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:37.344380   835 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.376485   838 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:37.377249 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:37.378093 28598 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:37.378772  1044 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:19:37.380556   838 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:37.382555 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.363930   982 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.385037   982 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.385499   838 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:37.387339   982 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:37.388352 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:37.389212 28674 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:19:37.393569 28605 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:37.397114 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.401628   838 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:37.402217 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:37.402801 28598 raft_consensus.cc:2376] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11. Re-sending same reply.
I20260709 12:19:37.403741   835 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:37.403869  1024 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:37.432976 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.432827 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:37.436247   963 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.006s
I20260709 12:19:37.435266   838 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:37.437493   549 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:37.463821 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.465519 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.467983 28675 raft_consensus.cc:2410] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:19:37.469312 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.470964 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.472502 28598 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:37.472887 28598 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:37.473753 28598 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.474928 28598 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:37.476598   819 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:37.477865 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.436794   949 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:19:37.479913 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.500821 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.501958 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.481025  1079 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:19:37.503545   939 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:37.504216   939 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:37.504233 28598 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:37.497880  1067 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:37.505100  1067 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:37.505582  1067 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:37.505314   939 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.465447   549 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:37.507519   549 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:37.472513   968 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:19:37.490334  1024 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:37.509708  1024 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.479128  1065 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:37.513614 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.500034  1045 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:37.520192   968 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:37.520823   968 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:37.521706   968 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:37.525190 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.529071 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:37.535275 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.536119 28752 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:19:37.529597 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:37.538462 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:37.538686 28607 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:37.542831 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:37.546267   954 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:37.534744  1045 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:37.548455  1045 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.549966  1081 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:37.551792  1065 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:37.553747  1079 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.554378  1079 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.557363 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:37.563503 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.543867 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.571909 28682 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:19:37.514581  1024 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:37.574170 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:37.575295 29318 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:37.542310  1082 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:37.583498 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:37.585528 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.587093 29318 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:37.571595  1065 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:37.594635 28754 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:37.595098 28754 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:37.594635 28752 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:37.596709 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:37.597373 28756 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:37.584024   940 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:37.587472  1082 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:37.617159 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:37.596849   549 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.638765   549 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:37.640280 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:37.646792 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:37.649055  1088 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:19:37.649853  1079 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:37.654055  1068 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.553s	user 0.005s	sys 0.002s
W20260709 12:19:37.665223  1093 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:19:37.668906   557 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.670745   557 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:37.670571   984 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.685101   635 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:37.687593 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2485) took 1146 ms. Trace:
I20260709 12:19:37.688184 28679 rpcz_store.cc:276] 0709 12:19:36.541381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.543318 (+  1937us) service_pool.cc:224] Handling call
0709 12:19:37.138819 (+595501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:37.139426 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.687285 (+547859us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54003b7750. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:37.687475 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1368879872}
I20260709 12:19:37.699069 28756 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
W20260709 12:19:37.701314  1087 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:19:37.702397  1042 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:37.702872  1042 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:37.703739  1042 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.630189 28754 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.714105 28571 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.725039 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.727327 28602 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:37.729135 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:37.729424 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:37.631251  1082 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:37.731405 28754 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:37.739187 29318 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:37.741732 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.745397 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.746424 28751 raft_consensus.cc:2410] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:19:37.749061 29325 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:37.753813  1008 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:37.753713   874 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:37.755132   437 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:37.762097  1065 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.781558 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:37.785573 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:37.787117 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:37.788301 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:37.733681   994 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:37.797520 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:37.798329 28571 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:37.723070   835 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:19:37.780683  1042 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:37.787485  1097 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:19:37.825631 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.826715  1052 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:37.827251  1052 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.829768  1052 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:37.809188 28754 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:37.783201   437 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.793206   982 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:37.841099 28756 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: [7.9-9.10]
I20260709 12:19:37.820351  1058 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:37.821177  1060 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:37.822048   944 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:37.794821   938 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:19:37.823365  1083 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.450s	user 0.005s	sys 0.000s
I20260709 12:19:37.824600  1025 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:37.840552 28754 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:37.843098 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2487) took 1301 ms. Trace:
W20260709 12:19:37.842939  1029 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:19:37.807382   793 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:37.863242 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93433.8us
I20260709 12:19:37.842909   455 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:37.852991  1060 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.908100 28756 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:37.854092   437 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.897993  1025 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:37.897480   944 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:37.913100 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 114080us
I20260709 12:19:37.898744 28677 rpcz_store.cc:276] 0709 12:19:36.541931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.543680 (+  1749us) service_pool.cc:224] Handling call
0709 12:19:36.559692 (+ 16012us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:36.584732 (+ 25040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:36.584780 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:36.601443 (+ 16663us) log.cc:844] Serialized 52 byte log entry
0709 12:19:36.989626 (+388183us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:36.989675 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:36.989736 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:37.653253 (+663517us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:37.839518 (+186265us) raft_consensus.cc:1685] finished
0709 12:19:37.839546 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:37.843028 (+  3482us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14547,"raft.queue_time_us":28834,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5927,"spinlock_wait_cycles":44436736,"thread_start_us":348813,"threads_started":1,"wal-append.queue_time_us":467213}
I20260709 12:19:37.906533  1060 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:37.930145 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:37.912485   938 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:19:37.934950 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:37.936342   939 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:37.933238  1067 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.959385   793 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:19:37.962239   455 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:37.962873   947 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:19:37.966251 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 64710.9us
I20260709 12:19:37.959309  1036 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:37.977800 29323 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 9.
I20260709 12:19:37.970116   455 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:38.015125 28677 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:37.971087   947 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:38.018446 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:38.019137 28598 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:37.959509  1111 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 12:19:38.016366  1101 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:19:37.955091  1025 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:37.955057   944 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:37.969751   939 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.032857 28598 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:38.032225   835 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:19:38.112629   834 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:38.113186  1107 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:19:38.115932 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.110610   949 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.022081  1036 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.043870   437 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.149477   949 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.151678   949 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.113245   834 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.117537  1025 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:38.165416  1036 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:38.169034  1103 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:19:38.172712 28679 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:38.163996  1105 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:19:38.190943  1067 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:38.194024  1113 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:19:38.197269   834 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:38.178473  1106 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:19:38.204818  1082 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.205524 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2619) took 1026 ms. Trace:
I20260709 12:19:38.205890 28753 rpcz_store.cc:276] 0709 12:19:37.178767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.178931 (+   164us) service_pool.cc:224] Handling call
0709 12:19:37.183285 (+  4354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:37.183774 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.183818 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:37.682607 (+498789us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b2c0001c1c8. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:19:37.683150 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:19:37.841366 (+158216us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:37.841402 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:37.842346 (+   944us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:38.205248 (+362902us) raft_consensus.cc:1685] finished
0709 12:19:38.205267 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.205464 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2181,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5806,"spinlock_wait_cycles":13611136,"thread_start_us":157768,"threads_started":1,"wal-append.queue_time_us":235715}
I20260709 12:19:38.139655   947 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.208377   947 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:38.214582 28598 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:19:38.215370 28604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 799) took 1471 ms (client timeout 1907 ms). Trace:
I20260709 12:19:38.215978 28606 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:19:38.215932 28604 rpcz_store.cc:269] 0709 12:19:36.744266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.744377 (+   111us) service_pool.cc:224] Handling call
0709 12:19:38.215149 (+1470772us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400217854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:38.215291 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800833920}
I20260709 12:19:38.214442 28679 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:38.218502 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:38.233110 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:38.239248 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:38.240087 28599 raft_consensus.cc:2376] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13. Re-sending same reply.
I20260709 12:19:38.238283  1079 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.230137   987 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 12:19:38.253034   557 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.582s	user 0.014s	sys 0.001s
I20260709 12:19:38.265523   635 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:38.266141   635 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.269945  1036 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.270457  1036 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.278573   984 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:38.279946 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.288748 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:38.289290 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:38.290069 28753 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:38.289636 28751 raft_consensus.cc:2410] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:19:38.290681 28750 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:38.268273   635 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.281733  1036 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.286638   939 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:38.248648  1012 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.315457 28753 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:19:38.261499  1079 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.292428  1042 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:38.320291  1042 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.321370  1079 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:38.322402  1042 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:38.325588   455 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:38.330868  1096 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.433s	user 0.010s	sys 0.000s
I20260709 12:19:38.313105  1127 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:38.333313  1127 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.329406  1012 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:38.335035   455 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:38.335424  1127 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:38.335631   455 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:38.336318   455 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:38.337393  1119 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.312s	user 0.004s	sys 0.000s
W20260709 12:19:38.344601 28601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.013s	sys 0.009s
W20260709 12:19:38.344874 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:38.344951 28601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.013s	sys 0.009s
W20260709 12:19:38.345598 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.344854 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:38.347846 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.349107  1045 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.312767  1082 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:38.351891 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:38.346165  1120 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:19:38.362159 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:38.363884   940 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:38.364460   940 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.364770 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:38.365373 29320 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:38.366501   940 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.367759 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.369726 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.371377 28682 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:38.371490 28680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54532
I20260709 12:19:38.372128 28680 raft_consensus.cc:606] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Received request to transfer leadership
I20260709 12:19:38.372488 28680 raft_consensus.cc:614] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:38.373951 28674 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:38.375361 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:38.378837 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 145833us
I20260709 12:19:38.379699 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:38.380553 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:38.381675 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:38.353065  1059 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:38.389276 28681 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:19:38.376623   618 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:19:38.385568 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.382244 29317 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:19:38.393024 29317 pending_rounds.cc:85] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 8
I20260709 12:19:38.393296 29317 pending_rounds.cc:107] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:19:38.393628 29317 raft_consensus.cc:2889] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:38.394260 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:38.346216  1060 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.382620 29326 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:38.395920 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:38.396399 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:38.396648 28676 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:38.398772 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:38.371793   455 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.349670  1045 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.399348 28674 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:38.399384 28680 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:38.405469 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.406204 28681 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:38.406427 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:38.391395  1012 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:38.407591   455 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:38.408102 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2605) took 1561 ms. Trace:
I20260709 12:19:38.409947 28676 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:38.412153 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:38.413143 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 65388.4us
I20260709 12:19:38.393492   938 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:38.392865  1127 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:19:38.425207  1130 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:19:38.427198 28681 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:38.460975 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:38.428915 29319 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:38.378631  1126 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:38.389142  1052 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:38.434334 28680 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
W20260709 12:19:38.438315 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.450659 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:38.412880  1122 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:19:38.452598 28755 rpcz_store.cc:276] 0709 12:19:36.846570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.847022 (+   452us) service_pool.cc:224] Handling call
0709 12:19:36.847368 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:37.316158 (+468790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.407871 (+1091713us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400337f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:38.408041 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076327808}
I20260709 12:19:38.389338  1111 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 12:19:38.475694 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.476816 28674 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:38.481015 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:38.477026 28753 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:38.478367 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:38.480700 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:38.480988 29322 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:19:38.485206 29322 pending_rounds.cc:85] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 10
I20260709 12:19:38.485452 29322 pending_rounds.cc:107] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:19:38.485723 29322 raft_consensus.cc:2889] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:38.490368 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 2495) took 1912 ms. Trace:
I20260709 12:19:38.490777 28675 rpcz_store.cc:276] 0709 12:19:36.578113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:36.598216 (+ 20103us) service_pool.cc:224] Handling call
0709 12:19:38.486424 (+1888208us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54001be754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:38.490308 (+  3884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936190336}
I20260709 12:19:38.476480   793 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:38.468492   455 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:38.481592  1056 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:38.477514   947 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.476415  1052 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:38.463738   987 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:19:38.502573 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:38.489831   984 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.483935  1131 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:38.491207   880 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:38.510313 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.475844  1128 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:19:38.513461 28675 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:38.506276  1052 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:38.502631  1060 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:38.525210 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.506155   793 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:38.522981   880 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:38.530241   793 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.515739  1131 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:38.530309   880 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.532975   455 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.533245  1131 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.535539 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2586) took 1453 ms. Trace:
I20260709 12:19:38.498533  1082 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:19:38.513942   951 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:38.535956 28603 rpcz_store.cc:276] 0709 12:19:37.082371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.082527 (+   156us) service_pool.cc:224] Handling call
0709 12:19:37.082852 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:37.083223 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:37.083250 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:38.313230 (+1229980us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b2c00058028. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:19:38.338519 (+ 25289us) log.cc:844] Serialized 52 byte log entry
0709 12:19:38.431745 (+ 93226us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:38.468016 (+ 36271us) log.cc:844] Serialized 14 byte log entry
0709 12:19:38.476910 (+  8894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.476999 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:38.535218 (+ 58219us) raft_consensus.cc:1685] finished
0709 12:19:38.535314 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:38.535475 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8619,"prepare.queue_time_us":31830,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":10022,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":10126848,"thread_start_us":78748,"threads_started":1,"wal-append.queue_time_us":127218}
I20260709 12:19:38.535442   968 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:38.506634   947 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.513031   984 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.563663 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.564370 28676 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:38.565299 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:38.565627 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:38.566392 28675 raft_consensus.cc:2368] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10.
I20260709 12:19:38.567430 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.569939 28680 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:38.568261 28677 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:38.571364 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:38.540659   951 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:38.574942 28681 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:38.578030 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.579581 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.552616  1081 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:38.583256 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:38.585222 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:38.582070 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.584337 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:38.585904 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:38.585923 28600 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:38.586879 28754 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:38.588843 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:38.589632 28747 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:38.592097 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:38.594195   944 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:38.597272 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:38.600726 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:38.603801 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:38.603902 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:38.617939 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.619168 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.619813   880 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:38.630503   880 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:38.637145 28747 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:38.641518 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:38.641649 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.585785 28749 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:38.642508 28682 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
W20260709 12:19:38.643914 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53179.3us
I20260709 12:19:38.645216 28605 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:38.645113 29322 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:38.638593 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.650415 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:38.651345 28601 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:38.651459 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.653638 28681 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:38.575295   987 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:38.578681  1060 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.581022  1045 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:38.641037  1012 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.578907  1133 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:38.641072   940 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:38.583173  1111 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:38.657024 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:38.708720 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 91238.7us
I20260709 12:19:38.645417   549 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:38.690367   880 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:38.721357 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:38.645334  1081 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:38.701084  1092 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:19:38.732815 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 156599us
I20260709 12:19:38.583022  1052 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.653545   960 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:19:38.740329 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:38.740368 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 83502.3us
I20260709 12:19:38.653717   834 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:19:38.713039   635 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:19:38.693339   937 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:19:38.742025 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:38.729827   557 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:38.702637   987 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.716988  1012 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.698163  1135 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:19:38.700667  1060 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.741585   940 raft_consensus.cc:2764] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:19:38.744076  1082 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:38.725365  1111 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.766078 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:38.779188 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.770828 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:38.788172   940 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:38.788709   940 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:38.789145   940 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:38.789805  1137 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:19:38.768755   834 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:19:38.717418  1133 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:38.795755 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 55502.8us
I20260709 12:19:38.797281 28602 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:38.764484  1030 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:19:38.773479  1141 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 12:19:38.807350 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 150397us
I20260709 12:19:38.755743  1029 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:19:38.755461   946 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:19:38.813675 28682 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:19:38.815274 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 66172.3us
I20260709 12:19:38.813830 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:38.817535 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:38.765748   557 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.824168 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.799098  1030 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:38.827250 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.810173  1024 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:38.830021  1060 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.831801  1133 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.810657   947 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:38.774065  1082 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.839927 28678 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 10: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:38.827051   984 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.823167   938 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:19:38.848039 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68979.1us
I20260709 12:19:38.841336   987 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:38.849347 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.842118  1012 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.823133  1144 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:19:38.860705 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:38.865588 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:38.868906 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:38.848750   938 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:38.862104  1052 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:38.852341  1151 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:38.885501 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 1036) took 1337 ms. Trace:
I20260709 12:19:38.871474  1081 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:38.873031  1045 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.886183 29323 rpcz_store.cc:276] 0709 12:19:37.542129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.542265 (+   136us) service_pool.cc:224] Handling call
0709 12:19:38.879142 (+1336877us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54006c0f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:38.879293 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965431552}
I20260709 12:19:38.902274 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:38.908806 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48221.8us
I20260709 12:19:38.909548 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.859459  1030 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.929091  1158 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:19:38.908172  1045 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.936676  1111 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:38.938953   940 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.911428  1154 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:38.946576  1154 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.947427  1170 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:38.949056  1154 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:38.952715 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:38.921617   938 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.911656   635 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:38.921152   947 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:38.958204 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.961083 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:38.970853 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:38.964810 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:38.989228 29290 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:38.991966 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:38.991016 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:38.992580 28674 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:38.996040  1169 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:38.996196  1152 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:38.965494  1156 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:19:38.996673   984 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.996646  1169 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.996693  1152 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:38.997371   984 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:38.997977  1152 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:38.998930  1169 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:38.999574   984 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.000095   984 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:38.942116   455 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:19:38.989863   557 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.001899  1160 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.002331   557 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.002398  1160 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.002830   557 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:38.924662  1144 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:19:39.004942   793 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.005858   557 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.005580   793 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.005033  1148 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:39.006345  1152 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.007822   793 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.014770   947 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:39.016207   947 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:39.016502 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:39.018020  1150 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:39.018280 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.020645  1081 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:39.021064 28679 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:19:39.022182  1082 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.021118  1081 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.025017  1081 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:39.025342 29290 leader_election.cc:400] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10.
I20260709 12:19:38.960933  1012 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:38.961300   635 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:38.995440  1079 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:39.006712  1148 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:39.025696 29290 leader_election.cc:403] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:39.030315 28682 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:39.032959 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.046732 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.047643 28682 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:38.991842  1158 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:39.054659  1152 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.026963  1134 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:39.056603 28753 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:38.991215  1067 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:39.026945   437 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:39.108320  1170 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:39.052989 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:39.068121 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.069445 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:39.076149 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:39.120299 28755 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:39.077123 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 805) took 1710 ms. Trace:
I20260709 12:19:39.038168   635 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.026053   940 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.104074 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.037150   982 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:39.075394  1079 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:19:39.121479 28606 rpcz_store.cc:276] 0709 12:19:37.366979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.367092 (+   113us) service_pool.cc:224] Handling call
0709 12:19:38.215572 (+848480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.216591 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.076877 (+860286us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b5400217850. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:39.077058 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950600576}
I20260709 12:19:39.075711  1042 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:39.044564   984 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.048607  1160 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.121881 28678 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:39.084194  1134 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.125629 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:39.129148 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69544.1us
I20260709 12:19:39.157874 28680 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:39.130813 28674 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:39.026537  1012 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.056593  1111 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.138739 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.173264 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:39.122500 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54504.2us
I20260709 12:19:39.175479 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.160795 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.165860 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:39.177532 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.169529 28680 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:39.110108   437 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:39.180867 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:39.183684 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:39.121552  1067 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:39.187332 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:39.141149  1082 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:39.166486  1134 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:39.137236  1152 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.173s
I20260709 12:19:39.140964   982 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.273284  1127 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:39.273315  1151 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:39.273494  1156 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:39.309846  1082 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.307473  1024 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:39.267606  1131 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:19:39.321633   968 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:39.315254  1143 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:39.350427 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 164759us
I20260709 12:19:39.358922 28678 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:39.270802  1111 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.274189   955 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:19:39.307957   937 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:19:39.344496   793 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:39.340306  1135 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:39.345798  1127 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:39.367849 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 180605us
I20260709 12:19:39.174131  1148 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:39.367542  1172 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:19:39.377736 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:39.373853 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 193051us
I20260709 12:19:39.357501  1082 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:39.395160 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.392175 29318 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:39.374936  1166 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.385s	user 0.001s	sys 0.001s
I20260709 12:19:39.392227 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:39.390450 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.399868 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:39.375449   793 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.404125 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.404556   944 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:39.404976   982 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.380107  1127 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:39.404072 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.363181  1024 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.410488 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.361150  1160 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:19:39.357311  1156 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.444583 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.398783   937 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:39.410723   793 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:39.410737   944 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.460940 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.382997  1135 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.397413  1154 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:19:39.377945  1143 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.456488  1148 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:39.449833   937 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.359126  1151 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.482105 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.483742 29318 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:39.466313   944 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:39.477320  1185 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:39.505769  1185 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.509829  1127 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.401573  1067 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.455850  1170 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:19:39.517659  1024 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.500722 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:39.502071  1182 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:19:39.510131  1143 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:39.526095 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.465582   557 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:39.485095  1173 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:39.495782  1144 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.497602   937 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:39.546332 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45723.5us
I20260709 12:19:39.512054  1160 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:39.548254 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.524317  1045 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:39.542239  1150 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 12:19:39.541266  1171 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:39.558511 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:39.565078  1188 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:19:39.566015  1135 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.566967  1111 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.573725  1151 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:39.575608  1147 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.765s	user 0.001s	sys 0.001s
I20260709 12:19:39.547616  1012 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.551087   984 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.554582   940 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:39.557343  1150 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:39.588824  1171 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:39.589884 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:39.590641  1030 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:39.587152  1185 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.591573  1156 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:39.547504  1144 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:39.593097  1184 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:19:39.609884   944 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.614001   944 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:39.615417  1081 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.001s
W20260709 12:19:39.595114  1162 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.657s	user 0.005s	sys 0.008s
I20260709 12:19:39.616633   455 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.616405  1171 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.617380  1156 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.618247  1144 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.595956  1127 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.655865 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:39.626348  1167 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.689s	user 0.000s	sys 0.009s
I20260709 12:19:39.659036   951 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:39.627597  1168 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.688s	user 0.008s	sys 0.000s
I20260709 12:19:39.660382   951 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:39.630196 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2603) took 1046 ms. Trace:
I20260709 12:19:39.660849 28598 rpcz_store.cc:276] 0709 12:19:38.583928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.584042 (+   114us) service_pool.cc:224] Handling call
0709 12:19:38.584269 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.799955 (+215686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.799982 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:38.800021 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:38.800060 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.629909 (+829849us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003d3954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:39.629964 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.630120 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495598848}
I20260709 12:19:39.647908  1081 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.658977  1156 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.665889  1156 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.672029  1081 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.672387 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.673170 29318 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:39.673913 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.674288  1052 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:39.636986  1185 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.637282   618 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:39.672034 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.675110 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.675583   618 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.677592  1185 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.679291   618 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.638041   635 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.638794   437 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.680073  1185 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.680176   437 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:39.640242   793 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.686705   793 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.631162   937 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:39.642000 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:39.652905 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.710871 28678 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:39.653841 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.711506 28673 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:39.622239  1042 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10.
I20260709 12:19:39.655934  1159 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.658207 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2324) took 1069 ms. Trace:
I20260709 12:19:39.673293 29320 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:39.674504 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.631354 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 817) took 1032 ms. Trace:
I20260709 12:19:39.639360  1082 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.720945 29323 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:39.718536 28751 rpcz_store.cc:276] 0709 12:19:38.588662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.592528 (+  3866us) service_pool.cc:224] Handling call
0709 12:19:38.592852 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.698381 (+105529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.698417 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:38.728557 (+ 30140us) log.cc:844] Serialized 26 byte log entry
0709 12:19:38.870313 (+141756us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:38.870375 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:38.870474 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:39.587951 (+717477us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:39.657918 (+ 69967us) raft_consensus.cc:1685] finished
0709 12:19:39.657941 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.658136 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51436,"raft.queue_time_us":139601,"raft.run_cpu_time_us":1074,"raft.run_wall_time_us":9412,"spinlock_wait_cycles":8957824,"thread_start_us":227767,"threads_started":2,"wal-append.queue_time_us":179994}
I20260709 12:19:39.630672  1134 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.714447 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.720883 28602 rpcz_store.cc:276] 0709 12:19:38.598513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.599087 (+   574us) service_pool.cc:224] Handling call
0709 12:19:38.599404 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:38.797655 (+198251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.631093 (+833438us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54000a6c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:39.631289 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450848128}
I20260709 12:19:39.717504 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.720199 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:39.727078 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:39.728005 28675 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:19:39.728873 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.729981 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:39.731921 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:39.732290 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:39.732748 28606 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:39.733173 28605 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:39.735821 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:39.712728  1126 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.713583  1156 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.761910 28605 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:39.742743 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:39.713297  1128 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.721158  1012 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:39.649583   455 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.782860 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:39.767858 29322 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:39.721009  1111 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:39.734408   987 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:39.790026 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:39.726212  1159 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.766646 28603 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:39.797340 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:39.798031 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 86794.8us
I20260709 12:19:39.801887 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:39.721194  1052 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:19:39.803740 28605 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:19:39.735925   982 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.736106  1173 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:39.782462  1079 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.813786 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:39.814173 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.814774 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:39.820886 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:39.822926 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:39.823171   982 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.825911 28605 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:39.827225 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:39.825639 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:39.828610 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:39.863761 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:39.865543 29326 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:39.866958 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:39.796047  1012 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.784168  1156 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.820078  1160 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.876961  1197 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:39.799355  1111 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:39.878278  1193 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:19:39.867120  1042 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:39.822887  1079 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.871070   955 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.826521  1081 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:19:39.881774   982 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.886458  1156 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.784411  1126 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.888756 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:39.890357 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:39.891762 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:39.795192  1128 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.826749  1067 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:39.829792   557 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:39.877702   455 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:39.928507  1052 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:39.904424   793 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:39.881266   635 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.909934 28676 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:39.922438   968 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:39.912170 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:39.822486  1173 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.965349  1159 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:39.966466  1210 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:19:39.967294  1173 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.905656   949 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:39.968492   949 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:39.968957   949 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:39.946708 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:39.973111  1164 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 1.035s	user 0.004s	sys 0.000s
I20260709 12:19:39.976576 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 819) took 1376 ms. Trace:
I20260709 12:19:39.976817  1067 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.863996  1131 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:39.977881  1131 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.977632  1067 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.978348  1131 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:39.978826   949 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.980168 28673 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:39.980546  1067 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:39.985869   834 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:39.986347   834 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:39.987231   834 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.992352  1111 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.994647   949 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.997018  1079 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:39.998361  1128 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:39.956753 28678 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:39.897468  1160 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:39.959975 28602 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 12:19:39.906311   437 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:19:39.963469 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51373.8us
I20260709 12:19:39.933347  1196 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:39.959085   937 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:39.999946 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 132040us
I20260709 12:19:39.930516   955 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:39.977056 28599 rpcz_store.cc:276] 0709 12:19:38.600616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.601559 (+   943us) service_pool.cc:224] Handling call
0709 12:19:38.601875 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:39.510893 (+909018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:39.510944 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:39.511003 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:39.511059 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.976289 (+465230us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54000a8054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:39.976344 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:39.976510 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089907072}
I20260709 12:19:39.905694  1197 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:40.001346   944 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:40.020665 28680 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:19:40.000136   793 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.013621   437 consensus_queue.cc:1243] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:19:40.012144  1134 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:39.964519  1052 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.063218  1126 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.063391  1052 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:40.003589  1082 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.046489 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.065022 28751 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:40.048800 28748 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:40.050144 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.051672  1173 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:40.052223  1202 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:19:40.042523   937 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:19:40.052769 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.053318 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.054487  1197 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.054688  1160 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.042948   944 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.018250  1196 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.057017   793 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.060878   955 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.068801 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:40.075351 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 208469us
I20260709 12:19:40.098506 28747 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:40.098883 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:40.095520 28755 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:40.044314   455 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:40.100734 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.109968 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.067360  1194 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:40.110487 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.134589  1194 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.102245 28751 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:19:40.135162  1194 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:40.138582 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.139981 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.129578  1127 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:40.114228 29319 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:19:40.079542   944 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:40.130414 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:40.041687  1187 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:19:40.112540 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:40.138825  1209 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:19:40.113453 29321 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:19:40.093950  1173 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:40.152465 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 129537us
I20260709 12:19:40.132107  1012 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:40.161068 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.138132  1082 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:19:40.163341 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:40.156926 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 128053us
I20260709 12:19:40.166061 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.166724 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.166955 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:40.167671 28679 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:40.171181 29320 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:40.114780   455 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.175758 28682 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:40.155539  1056 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:40.183641 28749 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:40.181444 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.184885 28676 pending_rounds.cc:85] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 8
I20260709 12:19:40.186923 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.187311 28676 pending_rounds.cc:107] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:19:40.187572 28676 raft_consensus.cc:2889] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:40.189599 28679 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:40.193280 28755 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:40.196089 28749 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:40.198563 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:40.199851 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:40.203893  1215 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:19:40.209280 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.211037  1173 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.202490  1156 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:40.212044  1219 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:19:40.212543  1156 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.214926  1156 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.218604 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.224545 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:40.225147   455 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.191464   982 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.226961   982 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.229192   982 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.233098 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2327) took 1340 ms. Trace:
W20260709 12:19:40.233393  1221 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:19:40.190953  1056 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.233530 28752 rpcz_store.cc:276] 0709 12:19:38.892461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.893429 (+   968us) service_pool.cc:224] Handling call
0709 12:19:38.893872 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:38.917884 (+ 24012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.917930 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:39.686333 (+768403us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b2c0001c1c8. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:19:39.686839 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:19:39.953378 (+266539us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:39.953432 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:39.953526 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:40.232753 (+279227us) raft_consensus.cc:1685] finished
0709 12:19:40.232774 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.233027 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36703,"raft.queue_time_us":23626,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3343,"spinlock_wait_cycles":2643328,"thread_start_us":266044,"threads_started":1,"wal-append.queue_time_us":352594}
I20260709 12:19:40.230300 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.236552  1056 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:40.241070  1207 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.281s	user 0.002s	sys 0.000s
I20260709 12:19:40.242574 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.250797 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.202539 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:40.231779  1196 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:40.255641   951 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.000s
W20260709 12:19:40.261771 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.257040  1145 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:40.262377  1227 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:40.259063   947 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:19:40.260468 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57452.6us
I20260709 12:19:40.264364 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.257606  1160 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:19:40.274505 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.261065   982 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:40.241398  1156 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:19:40.282619  1227 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.326125 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.330575 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.333312 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.335155 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.339128 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:40.340417 29320 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:40.261534  1131 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.348026  1131 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.350194 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.355890 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.356612 28603 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:40.352202 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.357630 28599 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:40.352859 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.354486 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.361882 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.362615 28604 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:40.364328 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.366840 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 896) took 1475 ms. Trace:
I20260709 12:19:40.367375 28754 rpcz_store.cc:276] 0709 12:19:38.891740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.892182 (+   442us) service_pool.cc:224] Handling call
0709 12:19:38.910726 (+ 18544us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:38.989793 (+ 79067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:38.989838 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:38.991633 (+  1795us) log.cc:844] Serialized 52 byte log entry
0709 12:19:39.350078 (+358445us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:39.350116 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.327359 (+977243us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b54001c4154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:40.327396 (+    37us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:40.327429 (+    33us) raft_consensus.cc:1685] finished
0709 12:19:40.327437 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.366747 (+ 39310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33095,"raft.queue_time_us":34993,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4337,"spinlock_wait_cycles":104379008,"thread_start_us":288066,"threads_started":1,"wal-append.queue_time_us":364769}
I20260709 12:19:40.279146  1160 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:40.327463   947 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:40.380319  1227 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.323848   937 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.325103  1128 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.324121   880 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.324095   982 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:40.323855   793 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.335340  1082 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.380918   947 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:40.399528 29320 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:40.373641  1145 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:40.404820 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:40.404209 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 147413us
I20260709 12:19:40.406495 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.408210 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.411396 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:40.414064 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.423357 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.424257 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.427120 28749 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:40.425216 28752 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:40.425263 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.425145 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.428791 28754 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:40.429174 28756 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:40.404901  1145 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:40.434358 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.431068 28747 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:19:40.411352  1058 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:40.433265  1127 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:19:40.416746  1228 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:40.420892  1059 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:40.404273   793 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.397497   937 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.396265  1128 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.406569  1082 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.405153  1194 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:40.442241  1145 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.443092 28598 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:19:40.456491  1216 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.401s	user 0.000s	sys 0.004s
I20260709 12:19:40.458158 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.463373 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.490679 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.464756 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:40.491562 28602 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:40.465389 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.465801 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1186) took 1066 ms. Trace:
I20260709 12:19:40.422712  1187 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:19:40.498978 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.432256 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.418010  1227 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:40.464159 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.476567 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.476953 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:40.500334 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 68195.1us
I20260709 12:19:40.505623 28605 raft_consensus.cc:2410] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:19:40.397729   880 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.481204 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.487757 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:40.469848  1058 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:40.492355 29325 rpcz_store.cc:276] 0709 12:19:39.399805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.008093 (+608288us) service_pool.cc:224] Handling call
0709 12:19:40.017725 (+  9632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:40.064845 (+ 47120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.064878 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:40.064920 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:40.064958 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.465580 (+400622us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b540042a9d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:40.465625 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:40.465743 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107909504}
I20260709 12:19:40.474912  1228 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.519074 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.501185 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:40.506903 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.509236 28607 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:40.514226 28603 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:38.221143 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.521822 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:40.427927   947 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.538792 28607 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:40.540383 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:40.542222 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:40.509828  1065 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:40.501138  1170 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:40.542868 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:40.520979  1058 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:40.546162  1236 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:40.472612  1160 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:40.571321 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:40.525146   874 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:40.530498  1145 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:40.548539  1156 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:40.543943  1227 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.562132  1236 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:40.566249  1082 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.525379  1228 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:40.570098 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.570638 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.477449   982 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.580602 29320 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:40.546581   960 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.581795 29319 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:40.559449  1030 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:40.540509   955 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:19:40.575284   947 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:40.576333  1056 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:40.598904 29320 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:40.581452  1160 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:19:40.580731  1198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.022s	sys 0.020s
I20260709 12:19:40.580981  1133 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.588680   960 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.603637  1133 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.605336   960 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.560637  1170 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.605592  1133 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:40.605901  1198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.022s	sys 0.024s
I20260709 12:19:40.613216 28602 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:40.615168   944 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:40.597605  1056 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.600476  1030 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:40.625382  1030 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.626820   880 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:40.627374 28553 auto_rebalancer.cc:893] Removing replace marker failed: Replica a8342e3fcab94ce89482df67988159ea is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:40.627826 28553 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:19:40.628095 28553 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:19:40.618698  1056 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:40.584175  1227 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.621232  1170 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.637825 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:40.618721 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.644066 28676 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
W20260709 12:19:40.646152 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 226635us
I20260709 12:19:40.649041 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.650096 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:40.583431  1211 consensus_queue.cc:1175] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" responder_term: 15 status { last_received { term: 15 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 15 index: 11 } }
W20260709 12:19:40.660615 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 113141us
I20260709 12:19:40.651734 28602 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:40.653810  1059 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:40.656982   793 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.657652  1194 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:40.659622 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.646390  1170 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:40.671242 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.556885  1224 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 12:19:40.678069 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:40.679477 29322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1179) took 1290 ms (client timeout 1687 ms). Trace:
I20260709 12:19:40.680717 29326 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:19:40.679944 29322 rpcz_store.cc:269] 0709 12:19:39.388967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:39.391438 (+  2471us) service_pool.cc:224] Handling call
0709 12:19:40.679263 (+1287825us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400780354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:40.679414 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742347648}
I20260709 12:19:40.684790   951 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:40.685240   951 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:40.685600   951 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:40.693967 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.695078 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:40.687536   984 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:19:40.705621  1194 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.706278  1194 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.707413  1227 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.709846   937 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.708396  1194 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:40.713692 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.715380 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.681648  1059 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:40.721161 28602 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:40.724623 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:40.726234  1194 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:40.726758  1194 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:40.726785  1042 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:40.727679  1042 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:40.727867  1194 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:40.728601  1042 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.729300   834 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:40.729957  1042 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:40.742280  1128 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.682417  1170 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:40.812876 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44728.2us
I20260709 12:19:40.834265 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.805608 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.838804  1198 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:40.848394 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.858702 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.859498 29318 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:40.804570  1012 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.794962  1079 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.873076 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.873845 28607 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:40.875818 28607 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:19:40.877830 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.878985 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:40.806420  1225 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:40.879678 28603 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 9.
I20260709 12:19:40.901175 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:40.902426  1238 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.285s	user 0.001s	sys 0.001s
I20260709 12:19:40.904393  1029 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:40.884644   984 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:40.906394   984 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.907701  1056 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:40.908375  1170 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:40.910065  1145 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:40.912384 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.913918 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.923359 29321 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:40.925702 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:40.926069 29317 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:40.918339 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:40.919844 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.920224 28606 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:19:40.920796 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:40.921756 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 249658us
I20260709 12:19:40.929307 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:40.931025 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.932925 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:40.933878 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.857498  1198 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.938393 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.939368 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:40.940938 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.951049 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.953171 28678 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:40.954077 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.954547 28678 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:40.955082 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:40.956661 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:40.958282 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.918408  1211 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:40.922353   984 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:40.982918 28675 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:40.913738  1225 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.980523 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:40.992718 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.981523 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:40.926961  1156 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:41.000869 28676 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
W20260709 12:19:41.001082 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:40.999946 28673 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:40.968372 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:40.924685  1127 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:19:40.868260  1012 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:40.962765 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.009305 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:41.011025 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:41.012080 29326 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:41.008087  1127 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:40.883338  1079 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:40.994130   987 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:40.980391   719 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:41.015565  1127 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:41.017051   618 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:41.001031  1156 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:40.989041  1226 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:40.994746  1244 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:41.019392 28607 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:41.001896  1211 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.041927 29327 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:41.050287  1079 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.052809 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:41.054347 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:41.061437  1211 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.023499  1243 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:41.056049 29326 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:41.028522   618 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:41.082566  1058 consensus_meta.cc:287] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
I20260709 12:19:40.950747  1242 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:41.085117 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 248720us
I20260709 12:19:41.052170  1059 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:41.047134   944 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.083321  1226 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:41.045394   455 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:19:41.085654   618 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:40.936949  1145 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:41.132748 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 170302us
I20260709 12:19:41.138082 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:41.140306 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.121176  1247 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:41.150197 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:41.124814  1059 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:41.095427  1058 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.105444  1228 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.210536 28599 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:41.211506  1058 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.211534  1228 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.161432  1225 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.169986   951 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.213850   951 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.214522 28601 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:41.172746 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.172535  1127 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.181488  1236 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:41.216689  1236 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.219055  1236 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:41.183213  1145 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.185051 28675 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:19:41.221966 28675 pending_rounds.cc:85] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 9
I20260709 12:19:41.222272 28675 pending_rounds.cc:107] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:19:41.222549 28675 raft_consensus.cc:2889] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:41.185833 28678 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:41.123147  1156 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.205704  1056 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.104652  1242 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.207911  1198 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.209131  1059 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.235302 28675 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:19:41.258548 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 298417us
I20260709 12:19:41.260258 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.251171  1156 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:41.264643 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.267591 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.268280 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.253021  1056 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:41.262568  1042 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:41.265825  1029 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:41.285077 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:41.288126 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:41.288192 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.300254  1194 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:41.302670 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:41.304786  1231 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.764s	user 0.008s	sys 0.005s
I20260709 12:19:41.305845  1160 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:41.306308  1160 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:41.306697  1160 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:41.303432   618 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.306311 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 901) took 1156 ms. Trace:
I20260709 12:19:41.309154  1059 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.310170   719 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:41.308928 28750 rpcz_store.cc:276] 0709 12:19:40.149771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.149953 (+   182us) service_pool.cc:224] Handling call
0709 12:19:40.150309 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:40.150843 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:40.150872 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:40.159866 (+  8994us) log.cc:844] Serialized 26 byte log entry
0709 12:19:40.387499 (+227633us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:40.387552 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:40.387659 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:41.247536 (+859877us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:41.305964 (+ 58428us) raft_consensus.cc:1685] finished
0709 12:19:41.305988 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:41.306247 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6980,"spinlock_wait_cycles":6620928,"thread_start_us":226396,"threads_started":1,"wal-append.queue_time_us":321603}
I20260709 12:19:41.296736  1042 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.311424 28674 raft_consensus.cc:2410] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:41.312497  1242 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.308904   618 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.283118  1252 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:41.318696  1127 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:41.318909  1160 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.323335  1255 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:41.297906  1145 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:41.324555  1029 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:41.347232 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.313189  1042 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:41.322032 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.283530  1056 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.366616 28675 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:41.368234 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.368920 28681 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:41.349428  1145 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.382711  1145 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:41.392603  1239 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:41.394858 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 72907.1us
I20260709 12:19:41.395699 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:41.399248 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:41.398241 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:41.401456 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:41.402060 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:41.402501 28675 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:41.404692   944 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:41.405210   944 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:41.405561   944 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:41.407110  1056 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.404621 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:41.408469 28673 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:41.349315  1029 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:41.416074  1029 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:41.418690  1252 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:41.421034  1042 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:41.423247  1134 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:41.426157 28503 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 6 to 9, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:41.427866 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:41.429592 28673 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:41.429668  1056 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:41.429978  1012 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.430214  1056 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.430650  1056 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:41.432773 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.436060 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.429445 28503 catalog_manager.cc:5697] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:41.438109 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.437127 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.441179 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:41.445068 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.448859 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
W20260709 12:19:41.450980 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 344222us
I20260709 12:19:41.451361 28674 raft_consensus.cc:606] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:41.451840 28674 raft_consensus.cc:614] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:41.452150 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:41.459432 29320 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:41.448729  1251 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:41.448617  1253 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:41.460556   947 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:41.460862  1253 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.447274  1242 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:19:41.461390  1253 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:41.461158   947 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.461910  1242 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:41.462267  1242 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:41.463315   947 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.435189  1030 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:41.466980 28501 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 230) took 19847 ms (client timeout 15000 ms). Trace:
I20260709 12:19:41.442768  1260 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:41.434494  1224 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:19:41.469410 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:41.444960   937 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:19:41.466403  1227 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:41.463160  1242 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.474464  1260 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:41.467507 28501 rpcz_store.cc:269] 0709 12:19:21.619582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.668420 (+ 48838us) service_pool.cc:224] Handling call
0709 12:19:41.466911 (+19798491us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:35.322366 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:35.341015 (+ 18649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:35.341063 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:19:35.341081 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:35.426372 (+ 85291us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:35.431031 (+  4659us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:35.439024 (+  7993us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:19:35.467302 (+ 28278us) tablet.cc:701] Row locks acquired
0709 12:19:35.467352 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:19:35.467549 (+   197us) write_op.cc:270] Start()
0709 12:19:35.467702 (+   153us) write_op.cc:276] Timestamp: P: 1783599575467484 usec, L: 0
0709 12:19:35.467723 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:19:35.515757 (+ 48034us) log.cc:844] Serialized 9928 byte log entry
0709 12:19:36.076224 (+560467us) op_driver.cc:464] REPLICATION: finished
0709 12:19:36.303859 (+227635us) write_op.cc:301] APPLY: starting
0709 12:19:36.304007 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:36.653990 (+349983us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:36.703159 (+ 49169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:37.383441 (+680282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:37.383880 (+   439us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 12:19:37.383931 (+    51us) write_op.cc:312] APPLY: finished
0709 12:19:37.434433 (+ 50502us) log.cc:844] Serialized 220 byte log entry
0709 12:19:37.542548 (+108115us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:37.583685 (+ 41137us) write_op.cc:454] Released schema lock
0709 12:19:37.591767 (+  8082us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:37.733138 (+141371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:37.737410 (+  4272us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":292,"mutex_wait_us":3410167,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":227311,"apply.run_cpu_time_us":44636,"apply.run_wall_time_us":1327415,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108377,"num_ops":25,"prepare.queue_time_us":200467,"prepare.run_cpu_time_us":48064,"prepare.run_wall_time_us":429879,"raft.queue_time_us":92056,"raft.run_cpu_time_us":112810,"raft.run_wall_time_us":171926,"replication_time_us":608300,"thread_start_us":535648,"threads_started":5,"wal-append.queue_time_us":447300,"wal-append.run_cpu_time_us":32104,"wal-append.run_wall_time_us":2305042}]]}
I20260709 12:19:41.505518 28753 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:41.505793  1198 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:41.509084  1198 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.474773  1030 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.516705 28607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:41.517453 28607 raft_consensus.cc:606] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.517802 28607 raft_consensus.cc:614] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:41.493373  1126 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:41.476462   947 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:19:41.528789 28753 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:41.493603  1227 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:41.536195 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:41.547350 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.502694  1260 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:41.498440   944 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.528043  1244 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.553232 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.568758  1244 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.538682  1126 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:41.554708 28607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6828c27180d54395aa62e49037e09909"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:41.569926 28607 raft_consensus.cc:606] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.570290 28607 raft_consensus.cc:614] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:41.544390  1242 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:41.570359  1126 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.571394  1244 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:41.554981 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.574347  1198 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.574911 28753 raft_consensus.cc:2410] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:19:41.575044 28607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:41.575709 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.576309 28753 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:41.577173 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.577697 28753 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:41.555238  1030 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.556495 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.557806 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.580296 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.580972 28751 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:41.581315 28751 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:41.535705  1227 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:41.559262 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.583585 28756 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:41.560700 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.584858 28754 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:41.562204   944 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.562317 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.562916 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:41.563972 28682 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:19:41.535161  1160 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.564751 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:41.582150 28751 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:41.598670 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 187924us
I20260709 12:19:41.600116 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.600911 28749 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:41.601805 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.550285  1243 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:41.588970 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.590622 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:41.604424 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:41.606341 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:41.613811 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:41.614579 29327 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:19:41.567600 28572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.000s	sys 0.021s
I20260709 12:19:41.581452  1029 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.626205  1029 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:41.627942 28747 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:41.628750 29323 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:19:41.629251 29323 pending_rounds.cc:85] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 11
I20260709 12:19:41.629526 29323 pending_rounds.cc:107] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:19:41.629812 29323 raft_consensus.cc:2889] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:41.612701  1243 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:41.633899 28572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.000s	sys 0.022s
I20260709 12:19:41.638356 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:41.643916 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.648023 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:41.621497  1127 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.664134 28752 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
W20260709 12:19:41.664395 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.648020 28674 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:41.671356 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:41.679517 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 670290us
W20260709 12:19:41.681588 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 114445us
I20260709 12:19:41.682559 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.683019 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:41.683218 28754 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:41.701282 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:41.702266 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:41.702903 29321 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:41.680570 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:41.701551 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.707185 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:41.708053 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:41.708952 29320 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:41.718411 28751 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:41.701097  1059 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:41.720705 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:41.721300 29323 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:41.664134  1243 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:41.723477 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:41.678126   982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.020s	sys 0.027s
I20260709 12:19:41.637123  1145 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.734829 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:41.724126 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:41.742237 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.670157  1127 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.767382 28752 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:41.731103  1273 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:41.735478  1042 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:41.738155  1239 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:41.774135 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 93726.5us
I20260709 12:19:41.778820 28607 raft_consensus.cc:606] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.746768  1198 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:41.779387 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:41.783218 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.783728 29323 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:41.790639 28752 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:41.788522 28751 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:41.749387  1265 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:41.762367  1244 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:41.735656  1030 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:19:41.773171   947 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:41.773305  1059 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:41.776364   987 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:41.808885 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:41.815162 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:41.798185  1265 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.789384  1198 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:41.832226 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.832384 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.817833 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.821262 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.835733 28673 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:41.799949  1244 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.824640 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:41.824716 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.826138 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.826645 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.843307 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:41.844233 28750 raft_consensus.cc:2410] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:41.841943 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:41.845909 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:41.848850 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:41.779067  1042 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.857682 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:41.865547 28752 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:41.811959   944 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:41.843308 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:41.850620  1133 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:41.870880 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.859752 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.844656  1198 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:41.867657  1242 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:41.845140  1244 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:41.845031  1226 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:41.834497  1265 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:41.780172  1273 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.863462 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.888573 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:41.910832 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47466.8us
I20260709 12:19:41.910879 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.855786  1058 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:41.803112  1243 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:19:41.871129  1251 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:41.938949  1251 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:41.939378  1251 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:41.907485 28752 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:41.940912 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.942276 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:41.943571 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:41.911653 28572 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.912091 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:41.945616 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:19:41.895443   549 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:41.868359  1126 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:19:41.923285  1281 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:19:41.923915  1270 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:19:41.933599  1243 consensus_queue.cc:1243] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:19:41.965481   834 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:41.966032   834 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.937072  1059 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.913499  1012 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:41.969264 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:41.969625  1127 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:41.970952  1160 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:41.971386  1160 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:41.971786  1160 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:41.958195 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46626.2us
I20260709 12:19:41.972630 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:41.961124  1271 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:19:41.955739   549 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:41.976280  1290 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:19:41.976830   549 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:41.977003  1256 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:41.977898  1253 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.002s
I20260709 12:19:41.978317  1253 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.978662   719 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:41.983209  1260 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.988658  1145 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.990381  1273 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:41.990556  1267 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 12:19:41.995152  1056 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260709 12:19:41.995731  1042 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.995639  1056 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:41.963353  1255 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:41.999141 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.015689 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:41.968065   834 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:41.940940  1133 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:41.955984  1250 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:41.957434  1242 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:42.029273 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.034703 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:42.035521 28604 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:42.036659 28606 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: [13.8-14.9]
I20260709 12:19:42.038404 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.040486 28755 raft_consensus.cc:2368] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12.
I20260709 12:19:42.025257 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:41.972718  1194 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:42.074661 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.081431 28605 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.081821 28599 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:19:42.082300 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 125273us
I20260709 12:19:42.022325  1056 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.022956  1256 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:42.177385 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:42.178290 28605 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.178524   549 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.014206  1255 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:42.180807  1255 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:42.030537  1079 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:42.184778   549 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.078285  1134 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:42.185416  1134 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:42.185806  1134 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:42.031634  1261 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:42.188732  1261 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.190822  1261 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:41.972890  1029 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 12:19:42.088631  1290 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.102372  1224 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:19:42.105187  1273 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:42.192008  1290 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.192682  1273 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.193344  1260 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:42.194245  1290 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.195295  1273 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:42.196087  1273 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:42.023722  1030 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:19:42.197527  1030 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:42.198009  1030 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:42.199101  1030 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:41.980312  1253 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:42.031064  1211 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 12:19:42.201153  1227 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.602s	user 0.005s	sys 0.004s
I20260709 12:19:42.039335  1127 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:19:42.173702 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:42.202484  1127 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.203253  1127 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.039623  1133 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.204532  1211 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:42.204679  1133 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.205070  1211 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:42.205935  1127 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:42.207597  1030 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.201596  1227 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.202561  1292 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:42.212881  1292 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:42.213750  1292 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.214963  1292 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:42.205981  1211 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.184868  1079 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.216828  1079 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.216979  1134 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.117347   987 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:42.214078  1227 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.208524  1273 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:42.237447 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:42.239408 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 238786us
I20260709 12:19:42.242579 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:42.236092  1227 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:42.243798  1227 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:42.245247  1127 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.245420  1160 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.245776  1127 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.246133  1227 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:42.256242 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.256950 28601 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:42.249526  1127 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:42.257828 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:42.260941 28605 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:42.266606 28601 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:42.244324  1134 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:42.279063  1079 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.275118 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.288607 28605 raft_consensus.cc:2368] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
W20260709 12:19:42.291079 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 201303us
I20260709 12:19:42.291967 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:42.292490 28605 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:42.294127 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.294735 28607 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:42.248242  1198 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.288498  1079 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:42.284126  1133 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:42.257261  1244 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.303359  1306 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:42.254750  1251 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:42.298022  1134 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:42.255231  1265 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.311287 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:42.316416  1160 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.317891  1255 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.328483  1133 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:42.330535 28751 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:42.331508  1244 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.333376  1251 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:42.296998  1273 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.334519  1273 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:42.335379  1264 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:42.335769  1264 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:42.336562  1265 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.336936 28748 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:19:42.337311 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.310606  1134 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:42.341084  1134 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.341441  1298 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.341933  1298 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:42.344055  1298 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:42.345546 28648 leader_election.cc:400] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12.
I20260709 12:19:42.345892 28648 leader_election.cc:403] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:42.347314 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:42.347510  1198 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.348182 28677 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.348806 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:42.350445 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:42.349546 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:42.351022 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:42.471539 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:42.472402 28676 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.401925 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:42.471868 28681 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:42.366506 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70596.4us
I20260709 12:19:42.351442 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:42.473822 28755 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:42.380760 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:42.474992 28749 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.475049 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:42.475888 28682 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:19:42.378991 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:42.478246 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:42.413765 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 241422us
I20260709 12:19:42.479588 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.479872 29321 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:42.384590 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:42.482697 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:42.384495 28601 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:42.484956 28598 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:19:42.413100 28599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:42.485612 28599 raft_consensus.cc:606] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:42.485541 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:42.486023 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:42.487231 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:42.489111 28599 raft_consensus.cc:614] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:42.493368 28747 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:42.499285 29317 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:19:42.500154 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 118799us
I20260709 12:19:42.500346 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:42.501102 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:42.502097 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:42.493858 28747 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:42.504776 28678 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:42.505300 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:42.507027 28605 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.507162 28674 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:19:42.378495 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:42.515305 28756 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:42.516307 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:42.519258 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.521901 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:42.460103  1299 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.214s	user 0.003s	sys 0.000s
I20260709 12:19:42.536623 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.538623 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.524123 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:42.520358 28605 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.532850 28753 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:42.507826 28747 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:42.544166 28598 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:42.545333 28747 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:42.544133 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:42.549074 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:42.550220 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.530038 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:42.533336 28681 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:42.562575 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.545862 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:42.563244 28598 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:42.469795  1269 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:42.424943  1255 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.512887   455 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.511013  1198 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12.
I20260709 12:19:42.566710 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:42.567181 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:42.582562 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.576933 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:42.583875 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:42.546262  1265 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:42.504585  1133 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:42.611824 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:42.586539 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:42.523094  1303 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:42.613015 28598 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:42.584050  1058 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:42.575035 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:42.589846   719 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:42.566409  1307 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.593101 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.594079 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:42.626363 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:42.594986   834 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:42.595525 28756 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:42.584332 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:42.627419 28753 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:42.598295 29320 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:42.598186 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:42.534273  1030 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:42.631462 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.542935  1253 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:42.632094 28607 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:19:42.612329 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:42.542706   987 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:42.562815  1227 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:42.615262 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:42.641741 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:42.591254 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:42.616696 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:42.624859 29292 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.517s (SENT) [suppressed 4 similar messages]
I20260709 12:19:42.643194 28605 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.625738 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:42.368542  1306 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.633891 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.597977   947 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:42.599812  1265 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.637890 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:42.617761  1303 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.336647  1264 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.651206 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.585485  1269 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.658174 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.658849 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:42.634227  1298 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:42.562366  1290 consensus_queue.cc:1175] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a8342e3fcab94ce89482df67988159ea" responder_term: 15 status { last_received { term: 15 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: [14.9-14.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:42.649919   987 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.648087   947 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:42.598057   455 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.639743  1145 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:42.620906  1133 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:42.672129 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.672215 28598 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
W20260709 12:19:42.368607 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5b3b2f4041a24b05983f30878f16db9d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:42.654760  1265 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:42.669436 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.684453 28749 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:42.698047 28607 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.656167  1260 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:42.661640  1156 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:42.696786 29322 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:42.656307  1303 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:42.664803   719 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:42.709043 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:42.709854 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 85014.7us
I20260709 12:19:42.639061  1030 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.646754  1253 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:42.713083 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 110956us
I20260709 12:19:42.634987  1307 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.695127  1059 raft_consensus.cc:2764] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:19:42.720469 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:42.722566 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 147612us
I20260709 12:19:42.722844 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.721788 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:42.724123 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:42.727234 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:42.729847 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 165974us
I20260709 12:19:42.672643  1298 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.731805 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:42.704901 28491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 336439us
I20260709 12:19:42.733475 29326 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:42.725201   834 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:42.734866 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:42.739028 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:42.739363 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:42.746603 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.741581 28681 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:42.724958  1308 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.742152 28679 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:42.742832 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.745379 28676 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:42.745424 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.758136 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:42.738613   947 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.760878   947 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:42.761135 28747 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:19:42.761480 28747 pending_rounds.cc:85] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 8
I20260709 12:19:42.761703 28747 pending_rounds.cc:107] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:19:42.761930 28747 raft_consensus.cc:2889] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:42.762753  1126 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:42.789454 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.780897 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:42.791431 28605 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.793753 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:42.794040 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:42.794836 28676 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:42.796738 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:42.784894 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:42.800943 29317 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
W20260709 12:19:42.804616 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58063.9us
I20260709 12:19:42.746881  1127 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:42.810932 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:42.740540  1311 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:42.815492 29322 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:42.821305 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:42.821913 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:42.801203  1310 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:19:42.827275 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:42.800693  1291 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:19:42.774176  1322 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:42.772586   987 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.834160 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:42.776384  1030 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.806874  1260 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:42.777464  1253 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.835440 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:42.809870  1079 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:42.773268  1318 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:42.844158 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:42.852808 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 122249us
I20260709 12:19:42.779950  1134 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.806318  1227 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:19:42.831128  1239 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:42.858227 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:42.864524 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66400.3us
I20260709 12:19:42.858532 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:42.859093 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.866848 29322 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:42.867723 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.769965  1308 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.868805 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:42.870244 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:42.870579 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:42.871459 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:42.871702 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:42.873127 28598 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:19:42.839771  1156 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:42.831696  1247 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:19:42.840291  1260 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:42.876380 28648 leader_election.cc:400] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:19:42.817338  1042 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:19:42.875018 28607 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:42.846884  1029 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:42.851985  1236 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:42.886873 28648 leader_election.cc:403] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:42.846870   455 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.891433 29319 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:42.857661  1253 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:42.899035  1253 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:42.899523  1253 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:42.852159  1320 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:19:42.900427  1253 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.864289  1322 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.887802  1211 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:42.864564  1058 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:19:42.893992  1328 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:42.894290  1042 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:42.836385  1127 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 12:19:42.896457 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45864.5us
I20260709 12:19:42.897853   987 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:42.895164  1269 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.894518  1255 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:42.888160  1260 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:42.847122   834 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:42.921423 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45178.1us
I20260709 12:19:42.894527   944 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:42.902365  1156 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:42.864413  1318 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:42.916414 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:42.876169  1226 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:19:42.928686 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 107459us
I20260709 12:19:42.904000  1211 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:42.894588  1311 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:19:42.954630 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:42.922464  1058 consensus_queue.cc:1243] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:19:42.911827  1042 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:42.915566  1133 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:42.972812 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:42.951920   549 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
W20260709 12:19:43.002928 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 113882us
I20260709 12:19:42.952131  1156 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:42.967511  1236 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:43.009387 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 278708us
I20260709 12:19:42.950800   987 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:42.907835  1322 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:42.973377  1307 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:42.971427  1255 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:42.922955   719 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:19:43.028878   719 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:43.029301   719 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:43.030165   719 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.020397   549 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 12:19:43.024580  1321 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:19:43.010962  1332 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:19:42.974118  1306 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:42.974355  1029 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:43.025345   987 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.026611  1318 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:43.023820  1325 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:19:42.971856  1298 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:43.009526  1236 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:43.043399 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 173228us
W20260709 12:19:43.042275  1324 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:19:43.058079 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:43.059080 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 86372us
I20260709 12:19:43.067674  1316 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.053278  1236 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:43.068392  1316 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.070814  1316 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:43.074548  1255 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.053823   719 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.087815  1264 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:43.091017  1224 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:43.091548  1224 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:43.094861  1224 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.039891  1134 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:43.098007 28676 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:19:43.099911  1273 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.000s
I20260709 12:19:43.102974   937 raft_consensus.cc:993] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:43.103706 29318 raft_consensus.cc:2410] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:19:43.107600 28679 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:43.107550 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:43.113322 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 102854us
I20260709 12:19:43.060492  1291 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:43.044404  1307 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:19:43.114743 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:43.052026  1292 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:19:43.108139  1224 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.072276  1303 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.122061 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:43.121037 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 117273us
I20260709 12:19:43.031140  1211 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.113369  1298 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:43.116948  1059 raft_consensus.cc:1081] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:43.140538 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.143818 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:43.057468  1156 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.144924 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:43.150703 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:43.145881 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:43.127112  1134 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:43.149569 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.154233 29326 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:43.155179 28598 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:43.156244 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:43.157316 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:43.157527 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:43.152747 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:43.158486 28752 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:19:43.161345 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:43.177155 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:43.161942 28756 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:43.181448 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:43.156311 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:43.145505  1298 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.186640 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.146229  1211 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:43.195654 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:43.149012  1030 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:43.197844 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.157194  1320 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:19:43.198838  1297 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.147840  1326 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 12:19:43.144850  1327 consensus_queue.cc:1175] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" responder_term: 9 status { last_received { term: 9 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 9 index: 11 } }
W20260709 12:19:43.242069 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.254213 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:43.254055 28601 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:43.286881 28607 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:19:43.286943 28601 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:43.245397 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:43.288141 28747 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:19:43.210251 28755 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:43.184113  1338 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:43.185906  1307 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:43.186338  1145 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:43.292769 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:43.287811 28601 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.293918 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.303838 28602 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:19:43.305099 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.303962 28601 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:43.238602 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet 3a420de289b844729c03c9625dd9e63c: Illegal state: Replica e3ce74ba14714b4dbd2d75e27f34eb0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
W20260709 12:19:43.221354  1341 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:19:43.192931  1247 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:43.366597 28602 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:19:43.221935  1311 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.368956 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:43.378222 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 84395.1us
I20260709 12:19:43.380252 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.238164  1298 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:43.243342  1322 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:43.390416 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 266469us
I20260709 12:19:43.303750  1307 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.391566  1331 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.399457 28681 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:43.403873 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:43.393498 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 203686us
W20260709 12:19:43.406411 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.240530  1236 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.380333  1273 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:43.385012  1194 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:43.416110 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:43.436583 28752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:19:43.437330 28752 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:43.437811 28752 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:43.402227  1307 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:43.466962  1236 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:43.487172 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet 2e9b05092c214663bd1a274ae3358eb4: Illegal state: Replica e3ce74ba14714b4dbd2d75e27f34eb0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
W20260709 12:19:43.480108  1346 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:19:43.371758  1247 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.512357 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:43.514250 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:43.515059 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:43.515795 28681 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:43.485728 28677 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:43.441658  1251 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:43.518692  1251 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.519069  1251 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.383096  1260 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.520078  1315 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:43.439275  1244 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:43.409377  1298 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:43.533160  1298 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.445237 28748 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:43.535449  1298 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:43.461444  1265 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.001s
I20260709 12:19:43.443507  1194 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:43.540365 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.470781 28752 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.441781  1331 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.446056 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.450393 28601 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:43.422374  1337 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 12:19:43.550765 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.461683  1030 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:43.554893 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 1078) took 1069 ms. Trace:
I20260709 12:19:43.555050 29321 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:43.555317 29319 rpcz_store.cc:276] 0709 12:19:42.485185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.485305 (+   120us) service_pool.cc:224] Handling call
0709 12:19:43.554707 (+1069402us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400628254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:43.554836 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922057984}
W20260709 12:19:43.556799 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 110888us
I20260709 12:19:43.536715  1265 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.557579 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.558923  1265 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:43.560130 28752 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:43.562889 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.563285 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.563663 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:43.562904 29323 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:19:43.564903  1304 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:43.543181  1315 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:43.566516  1315 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.558944  1303 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:43.568703  1315 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:43.566037 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.570466 29322 raft_consensus.cc:2410] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:19:43.571573 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:43.522564 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:43.574548 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:43.575541 29319 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:43.527442 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:43.523885 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:43.532135  1244 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.542299 28754 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:43.576562 28681 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.540165 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:43.499071   719 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:43.548951  1194 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.579505 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:43.590328 28676 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:43.581022 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:43.587551 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 63765.1us
I20260709 12:19:43.589018 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.537279  1198 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:43.599942 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.606998 28751 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:43.610249 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:43.610430 28752 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:43.611084 28753 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:43.612214 28753 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:19:43.612790 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:43.614423 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:43.590569  1224 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:43.602773  1211 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:43.608769  1198 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:43.606344  1134 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:43.617043  1297 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.617020  1127 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.626942  1330 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:43.590168  1331 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:19:43.630131  1211 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:43.643774  1251 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:43.378326 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5b3b2f4041a24b05983f30878f16db9d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:43.601703   719 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.635677  1198 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:43.698846 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:43.754177 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.810376 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.783911  1030 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:19:43.829874 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:43.797813 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:43.836639 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1253) took 1333 ms. Trace:
I20260709 12:19:43.873906 28753 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:43.873862 29321 rpcz_store.cc:276] 0709 12:19:42.502946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.505142 (+  2196us) service_pool.cc:224] Handling call
0709 12:19:43.554840 (+1049698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:43.555574 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:43.836187 (+280613us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400628250. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:43.836404 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413385600}
I20260709 12:19:43.831636 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 933) took 1239 ms. Trace:
I20260709 12:19:43.778313  1133 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:43.722177 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:43.875833 28751 rpcz_store.cc:276] 0709 12:19:42.592379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:42.641459 (+ 49080us) service_pool.cc:224] Handling call
0709 12:19:43.831186 (+1189727us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54002d5ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:43.831412 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218147584}
I20260709 12:19:43.806974  1079 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:43.876590  1042 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.877627  1079 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:19:43.780609 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.878376  1042 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.879319  1079 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.880900  1244 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:43.882078 28681 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:43.660542  1307 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.877671 29319 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.646057  1330 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:43.884672  1304 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:43.884871  1330 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.716286 28747 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: [10.11-10.11]
W20260709 12:19:43.745250 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47166.3us
I20260709 12:19:43.837951 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.763979  1029 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.893338  1029 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.795326  1243 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:43.897097  1243 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.815853 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:43.835136 29320 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:43.885740  1307 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:43.697754 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet c4d3afd7078b475e884e52f098a3b5cd: Illegal state: Replica e3ce74ba14714b4dbd2d75e27f34eb0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:43.718590 28750 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:43.796969  1211 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:43.903580 28491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 535783us
I20260709 12:19:43.907887  1251 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:43.777426   834 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:43.819937 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:43.657436  1311 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:43.851217  1156 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:43.912293 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:43.914242  1317 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:43.915378  1327 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:43.781311  1127 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.916678  1079 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.917012  1127 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.919952  1127 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:43.777488 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:43.921105  1244 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:43.921520  1243 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:43.813648   549 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:19:43.896376  1029 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:43.926544 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:43.927624 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.928787  1326 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:43.930301 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 153386us
I20260709 12:19:43.936614  1337 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:43.937427  1337 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.937954  1247 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:43.945123   719 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:43.940189  1337 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:43.942821 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45070.4us
I20260709 12:19:43.949946  1349 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:43.950598   944 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:43.950805  1349 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:43.952668 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 324598us
I20260709 12:19:43.952751  1315 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:43.953493  1315 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:43.909343   834 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.878160  1133 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.954834  1315 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.956413  1315 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:43.957593  1133 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:43.957906   834 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:43.956560  1326 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.963261 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:43.964170 29327 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.964782 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:43.966303 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:43.968043 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:43.968611  1133 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:43.969417  1133 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:43.971576  1133 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:43.964181  1160 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:19:43.968979 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.975117 29317 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:43.957952   719 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 12:19:43.982569 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 70593.5us
I20260709 12:19:43.985741  1297 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:43.986181  1297 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:43.987124  1297 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:43.978638   719 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:43.988744   719 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:43.993001 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:43.988253  1297 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:44.000188  1344 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:44.001926  1029 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:44.002410  1029 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:44.003814  1243 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:44.003690  1029 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.004726  1243 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.005486  1029 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:44.007073 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.007395  1243 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:44.008378  1269 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:19:44.008577 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.009375 28680 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:44.012857 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.013270 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:44.014269  1244 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:44.014822  1244 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:44.015957  1244 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:44.019621 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.010299 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:44.024542 28676 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:19:44.025306  1251 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:44.025743  1251 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.026104  1251 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:44.026755 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:44.027669 28751 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:44.036621 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.038436 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.039955 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:44.040544  1308 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.041863  1334 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:44.042313  1334 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:43.989980   719 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.043257  1334 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.046550  1334 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:44.047001 28753 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:44.047435 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.052083 28679 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:44.055862 29320 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:44.057891 28676 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:44.058298 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.059274 29325 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:44.059556 29318 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:44.060809 29321 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:44.062223 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.063197  1304 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:44.063611  1304 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.063973  1304 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:44.064769  1349 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.067531  1326 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:43.978638  1260 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.089973 29317 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:44.093575 28751 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:19:44.112198 29327 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:44.099889   719 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:44.117130 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.086740   834 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:44.117417 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.047055  1198 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.119940 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:44.119464 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.129088 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.133868   834 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.134227  1304 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.135077  1291 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:44.135540 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.135836 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.111474  1337 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:19:44.139216  1239 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:19:44.139293  1367 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:19:44.140645 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:44.141323 28753 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:44.145473 28747 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
W20260709 12:19:44.151495 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 89380.5us
I20260709 12:19:44.124570  1316 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:44.194746  1316 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.197184  1316 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.158488 28681 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:44.162487 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.163580 28678 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:19:44.204381 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.162551 28673 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:44.168349  1269 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:44.205574  1269 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.207890  1269 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.168545 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.169039  1226 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:44.169687  1256 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:44.170244  1227 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.217626  1264 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:44.218269  1264 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:44.219307  1264 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.138105  1198 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.220873 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.221570 28607 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:44.221271  1291 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:44.222077 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet 3e1813ffb1124b0d8e8500ca59a1550f: Illegal state: Replica a7ec63b6634944d0b5b5ea92fa2d303e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:44.224490  1239 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:44.213414  1226 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.225627  1239 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.227032  1226 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.229293 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.224064  1291 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.214114 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.214452  1256 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:44.215453 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 74930us
I20260709 12:19:44.217338  1227 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.221741 29321 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:44.175359 29319 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:44.243881 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.244992 29326 raft_consensus.cc:2410] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:19:44.245810 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.247212 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:43.700265 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.209050 28681 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:44.253989 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.253438 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:44.260861  1030 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:44.261098 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.262028 28678 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:44.261274  1030 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.265239 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.135578  1211 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.267241  1030 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:44.271854 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:44.272567 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:44.272716 28603 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:44.290303 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.294466 28673 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:44.296567 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:44.283604  1308 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:44.301816 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.303951 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:44.342166 28602 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:44.305761  1198 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.343098  1198 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.343781 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.344590 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.316356 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2653) took 1120 ms. Trace:
I20260709 12:19:44.341473 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:44.304807 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:44.348472 28599 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:44.349713 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.304395   549 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:19:44.316747 28753 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:44.350358 28682 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:44.314085 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.304308 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.353379  1126 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:44.353602 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49451.9us
I20260709 12:19:44.319957  1224 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:44.354666 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.311053 28606 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:44.307260 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:44.309095 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:44.356602 28603 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:44.311462  1256 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.307349   834 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.357100  1318 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:44.358188 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.356317 28600 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:44.304919  1329 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:19:44.359681  1315 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:44.308799  1304 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.361385 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.304841 28647 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.369478  1304 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.370028  1304 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.371129 29325 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:44.322463 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:44.378120 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55724.5us
W20260709 12:19:44.379522 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 74784.4us
I20260709 12:19:44.381274 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:44.380237 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.383569  1318 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:44.385185  1318 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:44.385754  1318 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.390232 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.279078  1251 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.397814 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.402029 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.402245 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:44.396411  1297 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:44.408195  1297 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.408651  1297 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:44.312639  1227 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.417382 28753 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:44.418385  1251 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.381959  1256 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:44.421037 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 59777.6us
I20260709 12:19:44.422219 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.381871   549 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:44.425021  1334 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.371893  1304 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.402149 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.424386 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.406667 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:44.436626 28673 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:44.436194 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.347286 28598 rpcz_store.cc:276] 0709 12:19:43.195778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:43.196378 (+   600us) service_pool.cc:224] Handling call
0709 12:19:43.196801 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:43.205977 (+  9176us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:19:43.854069 (+648092us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b180049bee0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:19:43.942408 (+ 88339us) log.cc:844] Serialized 14 byte log entry
0709 12:19:44.122059 (+179651us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:44.213826 (+ 91767us) log.cc:844] Serialized 26 byte log entry
0709 12:19:44.213966 (+   140us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:44.214002 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:44.214129 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:44.315930 (+101801us) raft_consensus.cc:1685] finished
0709 12:19:44.316021 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:44.316161 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17418,"prepare.queue_time_us":789227,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":23623,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":45217,"spinlock_wait_cycles":6691712,"thread_start_us":166357,"threads_started":2,"wal-append.queue_time_us":295063}
I20260709 12:19:44.447522 28680 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:44.470592 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:44.447322 28749 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:44.447273 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:44.445350 28603 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:19:44.471026 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:44.445731 29320 raft_consensus.cc:2368] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:19:44.523738 29318 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:44.523425 28673 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:44.531297 28754 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:44.439796  1256 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:44.451133  1126 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:44.541326 28607 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:19:44.535386 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:44.546147 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.471490  1334 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.557407 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.535116  1198 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.541035   944 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:44.450870  1030 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.450752  1297 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:44.574093 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 149810us
I20260709 12:19:44.579741 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.578240 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.583945 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:44.584812 29320 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:44.591959 28747 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:44.596079 28647 leader_election.cc:400] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:19:44.596544 28647 leader_election.cc:403] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:44.588608   719 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:44.603332 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:44.607980  1030 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.582995  1256 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:19:44.591338  1337 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:44.657582 29320 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:44.610666   549 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:19:44.612659  1260 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:44.728412 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:44.683319 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:44.730367   944 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:44.730818   944 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:44.731258   944 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:44.731859  1297 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:44.732612  1289 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:44.679596  1198 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.733285  1289 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.733960  1198 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.735759  1289 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.736212  1198 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:44.733632 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 141052us
W20260709 12:19:44.743314  1383 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:19:44.744300  1382 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:19:44.675393  1260 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:44.767570  1334 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.773960 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.759480  1260 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:44.732628  1337 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:44.794664 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 115390us
I20260709 12:19:44.779290   549 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.805728   549 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:44.806103 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 227943us
I20260709 12:19:44.806908 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.807111 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.808481  1335 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.793637  1256 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:44.808094   549 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.809136  1335 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.809834  1256 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:44.811241  1335 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.811345 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:44.812264  1337 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.808620  1079 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:44.813001  1079 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:44.813483  1304 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:44.813666 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.814467 28680 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:44.813937  1079 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.815830 28678 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:44.816339 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:44.816843 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5b3b2f4041a24b05983f30878f16db9d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:44.819295  1198 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:44.819738  1198 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:44.822185 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.830638 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:44.795387  1344 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:44.813932  1304 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:44.848097 28571 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.845533 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.820119  1198 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:44.854924 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:44.855773 28749 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:44.858400  1256 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:44.795073   944 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.813506  1330 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:19:44.872217 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.875000 29317 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:44.846748  1239 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.876164  1126 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:44.876804  1239 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:44.880399 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49841.5us
I20260709 12:19:44.882144 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:44.886030  1381 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.141s	user 0.004s	sys 0.000s
I20260709 12:19:44.886982  1211 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.809155  1338 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:19:44.836050  1243 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 12:19:44.898121  1387 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.165s	user 0.000s	sys 0.002s
I20260709 12:19:44.849736  1304 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:44.872478  1251 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:19:44.918944 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46842.2us
W20260709 12:19:44.924600  1388 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:19:44.923460  1384 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.246s	user 0.006s	sys 0.000s
I20260709 12:19:44.899003  1264 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:19:44.916366   944 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.903725 28499 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:44.903638  1126 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:44.914677  1337 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:44.914700  1315 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:44.920679  1318 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.898551   947 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.960121   947 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.940850   719 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:44.870900  1344 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.958048 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.961843   719 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.962239  1126 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:44.963358  1344 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:44.965763   719 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.965849   947 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.950349  1239 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:44.916884  1211 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:44.967306  1211 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:44.969419 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:44.969934 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:44.970196  1211 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.920375  1260 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:44.976979 28682 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:19:44.901186 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:44.981235  1337 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:44.982569 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 81993.3us
I20260709 12:19:44.983217  1126 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:45.013098 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:45.013022  1126 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:45.014251   944 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:44.990272  1328 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.016690  1328 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:45.017488  1211 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:45.018894  1328 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:45.020750  1126 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:44.994616 28571 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:45.022758   944 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:45.009382  1260 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:45.049503 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 241410us
I20260709 12:19:45.035097 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:45.084417 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.094579 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.076205   944 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:45.089775   549 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:19:45.028815  1198 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:45.103343 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:45.109712 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.110737 29327 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:45.111476 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:45.109354 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:45.114742 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 306689us
I20260709 12:19:45.125226 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:45.106060   944 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:45.144909 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:45.115048  1224 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:45.153048 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.153903 28681 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:45.155757 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:45.156502 28679 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:45.166074 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:45.171175 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.172919 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.175891 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.177081 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:45.176709 28600 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:45.179116 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.175899 28603 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:45.182459 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.183224 28606 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:45.183986 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:45.185355 28600 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:45.176941  1260 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:45.185968  1260 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.188561 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.189481  1260 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:45.189636 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:45.190814 28601 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:45.191224 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:45.191731 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.192417 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.193470 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:45.177146 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.191787 28605 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:45.195039 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:45.195035 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.194093 28598 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:45.196684 28604 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:45.197312  1198 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:45.200268   944 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.193727 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.192566  1322 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:45.206470  1322 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.206894  1322 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:45.207600 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 340173us
I20260709 12:19:45.193559 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.157348  1224 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.204838 28601 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:45.030100 28499 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 11, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 11 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:45.224867 28606 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:45.225495  1224 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:45.228971  1256 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:45.229724  1304 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.231925  1304 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:45.239598 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:45.240767 29321 raft_consensus.cc:2368] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12.
W20260709 12:19:45.257526 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 392855us
I20260709 12:19:45.267616 28598 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
W20260709 12:19:45.269450 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 123749us
I20260709 12:19:45.283558 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.284503 29317 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:45.295001 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.296262 29320 raft_consensus.cc:2410] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:19:45.298213 28607 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:19:45.311596 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:45.319227 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:45.320053 28750 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:45.317343 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 167947us
I20260709 12:19:45.325237 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:45.325770 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:45.325426 28607 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:45.330063 29325 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:45.329919 28599 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:45.330809 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.344993 28602 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:45.346109 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.346987 29326 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:45.340924 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:45.314210  1226 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:45.355386 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:45.371119 29327 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 10: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:45.353590 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.372309 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.370191 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.371999 29322 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:45.372938 28748 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:45.377619 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.378226 29326 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:45.380281 28679 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:45.383350 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:45.390002 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 178050us
I20260709 12:19:45.391052 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.398326 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.396730 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:45.400722 28753 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:45.401117 28748 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:45.374037  1394 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:45.432135 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.384871  1260 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.398468  1239 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:45.458262 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 58445.5us
I20260709 12:19:45.409384   947 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:45.476851 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.427567  1394 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.493765 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:45.494509 28679 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:45.496891 28605 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
W20260709 12:19:45.500732 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 130644us
I20260709 12:19:45.502492 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.458482  1251 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:45.513387  1401 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:19:45.515952 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.517266 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.520901 28675 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:19:45.520977 28680 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:45.521756 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.522509 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.522706 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.540712 28682 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:45.525908  1239 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:45.458334  1260 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.531670 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.560324 28677 raft_consensus.cc:2410] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:19:45.583531 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:45.492208  1394 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:45.502764  1211 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:45.559557   947 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.609753 28679 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
W20260709 12:19:45.612707 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 106263us
I20260709 12:19:45.613526 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:45.630043  1224 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.631280 29319 raft_consensus.cc:2368] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:19:45.631392 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:45.632608 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:45.589731 28499 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:45.639011  1260 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:45.642042  1079 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.642611  1079 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.643754  1407 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:45.645352  1404 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:45.645862  1404 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:45.646739  1404 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.648640  1418 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:19:45.648752 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 163668us
I20260709 12:19:45.649327  1418 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.649782  1418 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:45.650172 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.651939 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.652926  1243 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:45.653389  1411 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.686007  1411 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:45.686688 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.654145  1399 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:45.606123  1211 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.656122  1414 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.690851  1414 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:45.691910  1211 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:45.658752 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.693462  1414 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:45.693768  1413 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:19:45.695024 29325 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:45.665247 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:45.601228  1406 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:19:45.667088 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:45.700171  1396 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:19:45.663738 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:45.713822 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 50161.4us
I20260709 12:19:45.654168 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:19:45.714942 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60867.7us
I20260709 12:19:45.632201  1224 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:45.699383  1406 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:45.688234  1411 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:45.714004 28750 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:45.699493  1418 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.701051  1304 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:19:45.773208 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 121347us
I20260709 12:19:45.774060 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.776592  1264 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:45.777734  1399 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:45.761891 28749 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
W20260709 12:19:45.749099  1322 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 12:19:45.610524   947 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.721966  1260 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:19:45.788251 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62239.7us
I20260709 12:19:45.789979  1224 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.761129  1211 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:45.800671 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.723428  1335 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:45.770355  1079 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:45.833951 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:45.847447 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:45.859241 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.837359 28753 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:45.793813  1418 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:45.844909 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.723899  1406 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:45.851774 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51202.9us
I20260709 12:19:45.867483 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.867995 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.855047  1291 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:45.855542  1335 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.870451  1417 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:45.870684 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.871352 28673 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:45.872231  1335 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:45.856416  1264 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:45.861065 28750 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:45.873068  1264 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:45.869246 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.869568 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.875916  1264 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:45.857108 29318 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:45.876880 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:45.877723 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:45.877847 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:45.878695 28747 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:45.878985  1414 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:45.879834  1414 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:45.880375  1414 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:45.856186  1224 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.881305  1414 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:45.882465  1407 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:45.883227   947 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:45.872550 28680 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:45.883069  1407 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:45.846110  1343 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:45.886077  1407 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:45.886248  1343 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.888289   947 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:45.845729  1322 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.891422  1322 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:45.865283  1330 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:45.892917  1330 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:45.849748  1211 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:45.894002  1211 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:45.894723   947 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:45.895301  1330 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:45.876232 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:45.897462 29317 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:45.898109 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50788.9us
I20260709 12:19:45.898415 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:45.831683  1260 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.902396 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.882383  1224 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:45.911455 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:45.909967 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:45.912654 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:45.896699  1406 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:45.909014  1260 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:45.908221  1079 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:45.908118  1291 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:45.916194  1243 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:45.905808   947 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:19:45.919315  1322 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:45.930357  1343 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:45.924646  1247 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:45.923170  1224 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:19:45.961076  1335 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:45.948424  1322 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.976004 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 1288) took 1135 ms. Trace:
I20260709 12:19:46.038396 29321 rpcz_store.cc:276] 0709 12:19:44.815435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.816091 (+   656us) service_pool.cc:224] Handling call
0709 12:19:45.950434 (+1134343us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400568954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:45.950608 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956422400}
I20260709 12:19:46.010784  1395 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:19:45.951373  1079 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:46.019865  1335 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:45.948732  1394 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.032171  1322 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:45.950151  1247 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.077123  1335 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:46.125392 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 500462us
W20260709 12:19:46.129156 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 208792us
I20260709 12:19:46.142584 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:46.094831  1304 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:46.161625 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.153384  1405 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:46.167343 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.139824  1291 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:46.162896  1328 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:46.165396   944 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:46.158666  1226 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:46.145937  1251 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:19:46.178862  1405 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:46.262334  1432 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
W20260709 12:19:46.273268 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 95260us
I20260709 12:19:46.248638  1405 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:46.243037  1315 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:46.257051  1338 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.167297  1079 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.275708 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:46.223547   944 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.233868  1226 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.263557  1328 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.276114  1126 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:46.313560 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.311841 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:46.315119 29323 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:46.315348 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.314260 28602 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:46.293366  1394 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:46.318332 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.321621 28598 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:46.257609  1304 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.327260 29317 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:46.290405  1315 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:46.329768  1431 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:19:46.331816  1226 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:46.324182  1337 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:46.337030  1434 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:19:46.337190  1337 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.340688  1337 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:46.340232  1126 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.343509  1394 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:46.344079  1394 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.346479  1394 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:46.325289  1433 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:19:46.299685  1338 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:46.383193  1337 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:46.383826  1337 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:46.388588  1409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.008s	sys 0.010s
W20260709 12:19:46.389089  1409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.008s	sys 0.010s
I20260709 12:19:46.292721  1291 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.396317 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:46.402341 29317 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:46.397053 28721 leader_election.cc:400] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12.
I20260709 12:19:46.403280 28721 leader_election.cc:403] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:46.349280  1256 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:46.377072  1439 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.091s	user 0.001s	sys 0.002s
W20260709 12:19:46.376701  1435 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.133s	user 0.003s	sys 0.000s
I20260709 12:19:46.357587  1399 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:46.376579  1436 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 12:19:46.349457  1247 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:46.424213  1211 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.004s
I20260709 12:19:46.417121  1126 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:46.442749 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 280849us
W20260709 12:19:46.449678 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet 3e1813ffb1124b0d8e8500ca59a1550f: Illegal state: Replica a7ec63b6634944d0b5b5ea92fa2d303e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:46.449381 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 964) took 1067 ms. Trace:
I20260709 12:19:46.427749  1344 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12.
I20260709 12:19:46.451061 28754 rpcz_store.cc:276] 0709 12:19:45.379486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.381749 (+  2263us) service_pool.cc:224] Handling call
0709 12:19:45.399660 (+ 17911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:45.601631 (+201971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:45.601672 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:45.611217 (+  9545us) log.cc:844] Serialized 26 byte log entry
0709 12:19:46.078997 (+467780us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:46.079055 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:46.347253 (+268198us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400338954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:46.347304 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:46.446834 (+ 99530us) raft_consensus.cc:1685] finished
0709 12:19:46.446852 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:46.447066 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1360,"raft.queue_time_us":21625,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":450487680,"thread_start_us":317183,"threads_started":1,"wal-append.queue_time_us":437302}
I20260709 12:19:46.440765  1399 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.392957 28605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:46.456810 28605 raft_consensus.cc:606] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:46.448002  1337 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:46.465449 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 169760us
I20260709 12:19:46.467409 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:46.477730 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:46.482617 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:46.483142 28679 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:46.493472 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.494160 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.487401 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:46.466670   944 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:46.444917  1211 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.506301  1445 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:19:46.490945  1260 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.005s
I20260709 12:19:46.507998 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.508848 28603 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:46.478387  1338 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:46.510511 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:46.528311 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 112919us
I20260709 12:19:46.533700 28747 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:46.534262 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:46.534535 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.534874 28748 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:46.539100  1442 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:46.539721  1442 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.541999  1442 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:46.542819 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:46.545465 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:46.546105 28605 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:46.547435 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:46.548758 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:46.545508 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:46.555572 28750 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:46.557629 28677 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:46.562845  1030 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:46.563340 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.563432  1030 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:46.564079  1399 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:46.564571  1422 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:46.564689 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:46.565135  1422 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:46.567268  1422 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:46.567795  1422 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:46.568584  1462 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:46.574365 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.512740  1445 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:46.582566 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:46.584955 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48846.5us
I20260709 12:19:46.585391 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.585989 28601 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:46.568197  1422 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:46.588541 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.594813 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:46.588877 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.590621 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:46.597487 28606 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:46.592762 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.593140 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.600744 28605 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:19:46.581411  1433 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:19:46.553181   944 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.608129 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.613729 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:46.579646  1251 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:46.608958 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.557940  1459 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:46.595721  1322 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.003s
I20260709 12:19:46.622951 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.533224  1260 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.631866 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.586000  1445 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:46.630381 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:46.591127  1328 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:46.637142 28607 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:46.647465 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.658459 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.660280 28747 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:46.621219  1251 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:46.626443  1344 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:46.662034 29323 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:46.662390 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.647001  1198 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:46.629387  1459 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:46.650719  1315 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:46.664116  1406 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.000s
I20260709 12:19:46.634168  1322 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:46.679015  1472 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:19:46.682343 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.667752 29326 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:46.684583 28750 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:46.651332  1422 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.685657  1243 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:46.665261 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.690007  1260 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:46.650251  1414 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:46.691012 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.669194 28572 leader_election.cc:400] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:19:46.808185 28572 leader_election.cc:403] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:19:46.595039  1335 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:46.670439  1453 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:19:46.673138  1452 raft_consensus.cc:993] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:46.817704 28680 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:46.700006 28677 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:46.700322 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:46.717474 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.720906 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:46.727406 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 89977.3us
I20260709 12:19:46.717890 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:46.720422 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:46.819341 28753 raft_consensus.cc:2368] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15.
I20260709 12:19:46.819298 28749 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:46.824057 28679 raft_consensus.cc:2368] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:46.768646 28748 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:46.626801   944 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.707031 28606 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:46.713443  1251 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:46.701434  1030 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:46.702370  1211 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:46.827330 28571 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:46.860661 28598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:46.877077 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:46.836766 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:46.861523 28598 raft_consensus.cc:606] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:46.879691 29320 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:46.879752 28598 raft_consensus.cc:614] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:46.877432 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 390070us
I20260709 12:19:46.789271  1406 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.810490  1442 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:19:46.887744 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:46.899353  1466 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.138s	user 0.003s	sys 0.000s
I20260709 12:19:46.901048  1344 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:46.937009 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:46.820005  1243 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:46.930351 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 266524us
I20260709 12:19:46.905994 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:46.884865  1453 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:19:46.945210 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:47.086663 29319 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:47.087527 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1111) took 1267 ms. Trace:
I20260709 12:19:47.087901 29327 rpcz_store.cc:276] 0709 12:19:45.820370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.820502 (+   132us) service_pool.cc:224] Handling call
0709 12:19:45.820839 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:45.851837 (+ 30998us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:19:46.068426 (+216589us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b1800434e60. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a925e5 00007f6fe3a92568
0709 12:19:46.153968 (+ 85542us) log.cc:844] Serialized 14 byte log entry
0709 12:19:46.327929 (+173961us) log.cc:844] Serialized 14 byte log entry
0709 12:19:46.328699 (+   770us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:46.329118 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:19:46.329227 (+   109us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:46.352006 (+ 22779us) log.cc:844] Serialized 14 byte log entry
0709 12:19:46.352391 (+   385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:46.367563 (+ 15172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:46.389637 (+ 22074us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b1800434e60. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:47.087347 (+697710us) raft_consensus.cc:1685] finished
0709 12:19:47.087367 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:47.087474 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134421,"prepare.queue_time_us":363817,"prepare.run_cpu_time_us":6495,"prepare.run_wall_time_us":46101,"raft.queue_time_us":45647,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":18911,"spinlock_wait_cycles":53927424,"thread_start_us":225231,"threads_started":2,"wal-append.queue_time_us":283637}
W20260709 12:19:46.945787 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5b3b2f4041a24b05983f30878f16db9d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:46.953366  1471 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:19:47.090845 28491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 145110us
I20260709 12:19:47.091336  1291 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:46.954298  1469 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.123s	user 0.003s	sys 0.000s
I20260709 12:19:46.973649   944 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:46.974887  1476 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:19:46.985757  1335 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:46.986451  1433 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:46.929351  1417 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:46.993177  1405 consensus_meta.cc:287] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.000s
I20260709 12:19:46.994619  1322 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:46.884068  1395 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:46.931002  1458 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:46.998432 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:47.004649  1239 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.006197  1264 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:47.006842  1330 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:47.011986 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71298.8us
I20260709 12:19:47.137286 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:47.013787  1406 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.012918 28499 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 12, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 12 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.140426 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:47.141295 29322 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.140827 28499 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 10, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 10 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.014458 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:47.144979 28677 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:19:47.015884 28503 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 338) took 46558 ms (client timeout 15000 ms). Trace:
W20260709 12:19:47.018534  1468 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 12:19:47.022308  1260 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.147362  1239 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.148041  1260 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.027347  1251 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:46.972105  1475 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:19:47.031486 28678 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:47.037304  1452 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
W20260709 12:19:47.038072 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 201413us
I20260709 12:19:47.038726  1455 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:47.038969 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 211762us
I20260709 12:19:47.152508 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2283) took 1004 ms. Trace:
I20260709 12:19:47.152743  1455 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.153167  1455 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.153999 28571 leader_election.cc:400] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:47.152897 28673 rpcz_store.cc:276] 0709 12:19:46.147944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:46.148055 (+   111us) service_pool.cc:224] Handling call
0709 12:19:46.158769 (+ 10714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:46.441027 (+282258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:46.441095 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:46.444961 (+  3866us) log.cc:844] Serialized 26 byte log entry
0709 12:19:46.626880 (+181919us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:46.626919 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:46.626986 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:46.971181 (+344195us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:47.152210 (+181029us) raft_consensus.cc:1685] finished
0709 12:19:47.152231 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:47.152449 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12528,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6525,"spinlock_wait_cycles":10046848,"thread_start_us":405031,"threads_started":2,"wal-append.queue_time_us":342345}
I20260709 12:19:47.039333  1462 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:47.043623  1445 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.155328   944 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:47.156263   944 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:47.156654   944 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:47.051962   947 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.056622  1399 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.064410 28648 leader_election.cc:400] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15.
I20260709 12:19:47.068701 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:47.130223  1395 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.157869 28747 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.157629  1399 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.075472 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:47.159287 28749 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.159427 28755 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:47.077620  1344 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.078231 28752 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:47.156829  1458 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.820199  1414 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:46.988910  1459 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:47.114710 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:47.178511 28753 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:47.128664 29320 raft_consensus.cc:2368] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15.
I20260709 12:19:47.063969  1343 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.154364 28571 leader_election.cc:403] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:19:47.145852 28503 rpcz_store.cc:269] 0709 12:19:00.459214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.459406 (+   192us) service_pool.cc:224] Handling call
0709 12:19:01.564084 (+1104678us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540002c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e9090 00007f6fe3a87f3a 00007f6fe983de9c 00007f6fe993c04e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc 00007f6fe7dfc392 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:47.015645 (+45451561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:41.735253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:41.810475 (+ 75222us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:41.812886 (+  2411us) write_op.cc:435] Acquired schema lock
0709 12:19:41.815680 (+  2794us) tablet.cc:662] Decoding operations
0709 12:19:41.903589 (+ 87909us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:41.909873 (+  6284us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:41.913343 (+  3470us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:19:41.996647 (+ 83304us) tablet.cc:701] Row locks acquired
0709 12:19:41.996671 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:19:41.996814 (+   143us) write_op.cc:270] Start()
0709 12:19:41.996950 (+   136us) write_op.cc:276] Timestamp: P: 1783599581996770 usec, L: 0
0709 12:19:41.996973 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:19:42.090762 (+ 93789us) log.cc:844] Serialized 935 byte log entry
0709 12:19:42.868064 (+777302us) op_driver.cc:464] REPLICATION: finished
0709 12:19:43.025097 (+157033us) write_op.cc:301] APPLY: starting
0709 12:19:43.025193 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:43.026945 (+  1752us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:43.027075 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:43.051054 (+ 23979us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:43.080849 (+ 29795us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:19:43.080958 (+   109us) write_op.cc:312] APPLY: finished
0709 12:19:43.081318 (+   360us) log.cc:844] Serialized 33 byte log entry
0709 12:19:43.081675 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:43.082188 (+   513us) write_op.cc:454] Released schema lock
0709 12:19:43.082416 (+   228us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:43.084717 (+  2301us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:43.084859 (+   142us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11587,"reported_tablets":47,"spinlock_wait_cycles":2523768704,"child_traces":[["op",{"apply.queue_time_us":140775,"apply.run_cpu_time_us":6007,"apply.run_wall_time_us":59131,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12467,"num_ops":2,"prepare.queue_time_us":169203,"prepare.run_cpu_time_us":20864,"prepare.run_wall_time_us":526576,"raft.queue_time_us":520712,"raft.run_cpu_time_us":24305,"raft.run_wall_time_us":172721,"replication_time_us":849279,"thread_start_us":716091,"threads_started":4,"wal-append.queue_time_us":169095,"wal-append.run_cpu_time_us":20815,"wal-append.run_wall_time_us":1854672}]]}
I20260709 12:19:47.157510   944 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.069753 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:46.953801  1460 raft_consensus.cc:1081] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:47.157624 28648 leader_election.cc:403] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:19:47.150614  1239 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:47.193671 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 135023us
I20260709 12:19:47.126341  1417 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:47.165292 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.113245  1247 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.110962  1291 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.188179 28647 leader_election.cc:400] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15.
I20260709 12:19:47.189254 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:47.183211  1343 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.202068 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:19:47.143379 28499 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 7 to 8, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 8 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:47.204959 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51085.4us
W20260709 12:19:47.206650 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 136994us
I20260709 12:19:47.214339 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:47.222479 28749 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:47.187923  1335 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:19:47.228484 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.212271  1452 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:47.123977  1405 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.189836  1243 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.177708   947 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.235747 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:47.199707  1464 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.196326  1411 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15.
I20260709 12:19:47.248319  1452 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:47.237222  1465 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:47.252807  1417 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.255416  1291 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.256917  1344 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.193022  1304 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:19:47.224124   944 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:47.239133 29322 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:47.207139  1226 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.175652  1264 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.200735  1239 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.269867 28605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:47.270515 28605 raft_consensus.cc:606] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:47.250243  1464 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.237677  1458 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.237972 28499 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 13, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 13 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.266772 28682 raft_consensus.cc:2410] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:19:47.280932  1455 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.248687  1335 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:47.290104  1335 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.224370  1247 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.298246 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.305620 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:47.284621  1239 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.308097  1239 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.311445 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:47.312422 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:47.316993 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:47.317570 29319 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:47.319864 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.325307  1405 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:47.326124 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet 71e53cc7795245709057efe9ca977661: Illegal state: Replica e3ce74ba14714b4dbd2d75e27f34eb0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:47.330806 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.331437 28599 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:19:47.332913 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:47.333479 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.303225  1399 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.335536 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.337564 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.334682 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.340422 28603 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:47.324208   947 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.342201 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:47.343403 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.353490 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:47.355640 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.357349 28607 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:47.357553 28749 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:47.361047 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.318584  1458 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:47.319054  1409 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:47.367347 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.369246 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.314544  1318 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:19:47.380721 29319 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:47.381378 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.383077 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:47.394742 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:47.386348 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.368099  1458 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:47.395043 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet cb599a2fb1704106b47a69be90b821d0: Illegal state: Replica e3ce74ba14714b4dbd2d75e27f34eb0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:47.406787 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.388042 28678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:19:47.367606 28499 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 14, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 14 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:47.392961  1489 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:47.408622 28678 raft_consensus.cc:606] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:47.395593 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.386225  1490 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.411213  1322 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:47.425158  1497 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:19:47.374684  1395 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.428336 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.412497  1464 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.412695 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.435220 28680 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:19:47.413044  1260 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.393078  1455 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:47.414793 28499 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 12, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 12 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.391140  1247 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.380074  1409 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:47.444828  1409 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.444794 28499 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 10 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.446695 28499 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 6 to 10, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 10 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.418067 28607 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:47.419041 28598 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:47.448565  1395 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:47.401063  1251 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.424757  1490 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.448647 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:47.456015  1330 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:47.409623  1458 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:47.406515  1488 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:19:47.424830  1322 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.440730 28747 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:47.457780 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.468106 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.468348 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.468931 29322 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:47.388212  1343 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.461864 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.470185 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:47.464461 28602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:47.472975 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:47.471153 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67446.7us
I20260709 12:19:47.476605 28602 raft_consensus.cc:606] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:47.442464  1405 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:47.475076 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.476970 28602 raft_consensus.cc:614] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:47.451690 28599 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:47.456624  1330 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.457690  1260 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.466898  1442 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:47.483060 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.485332 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.473766  1415 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:47.449244  1395 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.482163  1422 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:47.448762 28499 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 9, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 9 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.528937 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.529357  1395 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:47.464988  1406 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:19:47.531746  1437 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:47.532370  1437 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.533092 28499 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 13, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 13 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.535181  1437 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:47.536000 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.484602  1394 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:47.488863 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:47.488755 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:47.541234 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:47.541517 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52881.8us
I20260709 12:19:47.490330 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:47.541864 28747 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.509773  1442 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:47.521059 28749 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:47.492393  1486 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:47.521847  1330 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.523165  1414 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:47.541846 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 53154.9us
I20260709 12:19:47.545962 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.543725 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:47.547549 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:47.546310 28754 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:47.550221 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.550410 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.547171  1422 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:47.556389  1226 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:47.556177  1422 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:47.557451 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 370871us
I20260709 12:19:47.482860   947 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:19:47.487715  1260 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.560173 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.544672  1437 raft_consensus.cc:2764] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:19:47.583873 28747 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:47.548038  1239 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:47.588935 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.560207  1330 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:47.527572  1415 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.584717  1482 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:47.602113  1264 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.535969 28499 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.585528  1394 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:47.586027  1322 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.612869 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:47.592947  1304 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:47.627007 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.627451 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.593562  1409 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:47.626291 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:47.631105 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:47.593206  1239 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:47.633672  1239 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.643031 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.644130 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.645614 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.646577 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.646919 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.644181  1315 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:47.629377 28748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:19:47.648900 28748 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:47.649271 28748 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:47.649824 28600 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:47.655509  1458 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.657979 28499 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.659488 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.660791 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:47.661027 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.661506 29327 raft_consensus.cc:2368] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:19:47.664896  1415 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.666226  1260 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.643833  1409 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.670375  1445 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.675256 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:47.677462  1490 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.593971  1496 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:19:47.678761 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:47.679405 28755 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.680084  1442 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.680750 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.682273 29317 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:19:47.682763  1499 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.209s	user 0.003s	sys 0.000s
I20260709 12:19:47.686986 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:47.642025  1126 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:47.692862  1126 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:47.693214  1126 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.695142  1445 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:47.695572  1445 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:47.695951  1445 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:47.698613 28601 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:47.670384  1409 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.703889 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:47.688064 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:47.629988  1226 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:47.711046  1490 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:47.716030 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:47.720058 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:47.731707 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:47.733495 28605 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:47.734532 28680 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:47.732398 28752 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:47.736980 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.736501 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.744849 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.751929 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:47.757491 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:47.758713 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.764086 28755 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:47.722076 28748 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.764945 28750 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:47.768832 28756 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:47.770259 28748 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:47.767614 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.773078 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.782454 29320 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:47.748585  1414 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:47.786141 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:47.775527  1251 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:47.769855  1490 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:47.775112  1264 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:19:47.789355   944 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.001s
I20260709 12:19:47.802583 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.802737 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.781616  1492 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:47.659648 28499 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 4 to 10, term changed from 12 to 17, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129), VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130), VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131), VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.813585 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:47.817932 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:47.819788 28499 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.821760 28499 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 13, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 13 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.824896 28499 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 5 to 13, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 13 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.827134 28499 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.828924  1458 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:47.775996  1030 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:19:47.781430  1415 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:19:47.801390  1438 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:19:47.830267 28499 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.831918  1394 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:47.832460  1394 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:47.809331  1496 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:19:47.834463 28721 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.844448 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:47.844763 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:47.847023 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:47.848377 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 100387us
I20260709 12:19:47.848603 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.852245 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:47.853027 28607 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:47.853410 28607 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:47.854517  1291 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:47.854240 28607 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:47.855250  1291 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:47.855589 28607 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:47.858435 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.858110 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:47.860172 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:47.866510 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52750.3us
I20260709 12:19:47.873605 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.835793  1394 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.883813 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.884868 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:47.870961 28680 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:47.853241  1343 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:19:47.901326 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 84537.5us
I20260709 12:19:47.892232 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:47.870555  1291 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:47.905606 28607 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:47.911801 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.833256 28499 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 13, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 13 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.914831 28499 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 12, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 12 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.919960 28647 leader_election.cc:400] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:19:47.920233 28647 leader_election.cc:403] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:19:47.905242  1343 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:47.929239  1343 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.888801  1256 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:19:47.936568 28499 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.939386 28499 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 11, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 11 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:47.937848  1126 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.954257  1126 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:47.946985 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:47.955461 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:47.949992   944 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:47.956910 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:47.963589 28607 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 12. (term mismatch)
I20260709 12:19:47.964076 28607 pending_rounds.cc:85] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 11
I20260709 12:19:47.964785 28601 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:19:47.925549  1460 raft_consensus.cc:993] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:47.903294  1445 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:47.964344 28607 pending_rounds.cc:107] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 10.12
I20260709 12:19:48.000130 28607 raft_consensus.cc:2889] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:47.942354  1318 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:47.921180  1417 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:48.010169 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.010169 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:48.017153 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.023049 28679 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:47.967151  1464 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:48.030627 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.036509  1247 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:48.031564 28751 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:19:48.037320 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.029367  1395 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:48.041507  1247 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:48.043221  1513 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 12:19:48.043375 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.045275 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:48.045604 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:48.027166  1415 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:48.051659 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:48.047899 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:48.056569 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 148198us
I20260709 12:19:48.057034 29290 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.003257  1455 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:19:48.069015 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.034044  1264 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:48.069710 28748 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:48.071878 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:48.048821  1492 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:48.044708  1247 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:48.078893 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.034289  1418 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:19:48.064523  1464 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:48.063846  1496 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:48.093441 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.067536  1514 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:48.113574  1445 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:48.116880 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:48.098224 28499 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 11, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 11 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:48.121451 28499 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:48.123922  1512 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:19:48.085533  1328 raft_consensus.cc:1081] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:48.085752  1291 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:48.125512  1464 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:48.087675  1335 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:48.133505  1510 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:19:48.134830 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:48.142109  1030 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:48.142590  1030 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:48.143486  1030 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:48.146699  1493 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:48.148072 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54709.5us
I20260709 12:19:48.149109 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:48.151896 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:47.969674   947 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:48.162923 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 253472us
W20260709 12:19:48.156723 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 200565us
I20260709 12:19:48.154121  1030 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:48.172217 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 98751.1us
I20260709 12:19:48.174765  1516 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:48.177119  1437 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:48.178128  1514 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:19:48.178506  1514 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:48.166541   947 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:48.179374  1514 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:48.180559   947 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:48.181268  1514 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:19:48.212810 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 139960us
I20260709 12:19:48.229774 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:48.263947  1524 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:19:48.264484  1508 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.434s	user 0.005s	sys 0.000s
I20260709 12:19:48.267364  1318 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:19:48.275957  1525 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:48.277149  1530 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.005s
I20260709 12:19:48.269806  1304 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:19:48.283397 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:48.284235 28674 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:48.293707 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:48.303328 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:48.306486 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:48.325443 29320 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:48.337339 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:48.342133 29320 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:19:48.344540 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:48.343077 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46660.2us
W20260709 12:19:48.348780 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 183901us
W20260709 12:19:48.354003 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 186235us
I20260709 12:19:48.330356 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:48.349822 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:48.359243 28747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:19:48.359169 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:48.359977 28747 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:48.360386 28747 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:48.366117 28756 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:48.327386  1318 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:48.371891 28751 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:48.373426 28602 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:48.346738  1418 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:48.391470 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.371217  1264 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:19:48.366631  1415 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:48.366920  1526 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.356622  1411 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:19:48.373183  1318 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:48.405277 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:48.400848 28747 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:48.395165  1493 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:48.410265  1456 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:48.410522  1318 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:48.447084  1462 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:48.447610  1462 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:48.457931  1406 raft_consensus.cc:993] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:19:48.403389  1526 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:48.460554  1462 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:48.465380 28674 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:48.466871 28678 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:48.467926 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.485873 28747 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:48.490828 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:48.496172  1482 raft_consensus.cc:1081] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:19:48.498554 28753 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:19:48.524215 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.502539   944 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:19:48.525228  1438 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:48.533541 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 174882us
W20260709 12:19:48.533838 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 162232us
W20260709 12:19:48.530241  1394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.007s	sys 0.013s
I20260709 12:19:48.546061 28753 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:19:48.545970 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 132974us
W20260709 12:19:48.545176  1394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.007s	sys 0.013s
I20260709 12:19:48.541311  1438 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:48.555744  1548 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:19:48.557833  1406 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:48.558000   944 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:19:48.560520  1526 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:48.563980 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:48.564716 28601 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:48.565037 28601 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:48.565881 28601 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:48.568041  1482 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:48.570533 28673 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:19:48.578035 28603 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:48.580152 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:48.580806 28603 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:48.583650 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:48.599936 29317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:19:48.600915 29317 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:48.601404 29317 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:48.614645  1318 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:48.618598  1343 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:48.624713  1438 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:48.626328  1509 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.798s	user 0.003s	sys 0.002s
I20260709 12:19:48.645893 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:48.648651 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:48.670845 29317 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:48.694582 29317 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:48.701267 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:48.702104 28607 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:48.712877  1318 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:48.689638  1537 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:19:48.715600 28747 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:48.690830  1526 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:19:48.719499  1493 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:48.720827  1490 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:48.721154  1490 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:48.721814  1414 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:48.721935  1490 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:48.724601  1458 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:48.727041  1269 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:48.727584  1269 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:48.775664 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:48.817672  1511 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.960s	user 0.002s	sys 0.001s
W20260709 12:19:48.860456 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:48.941438 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:48.943302 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 199319us
I20260709 12:19:48.947791 28607 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
W20260709 12:19:48.953399 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 207693us
W20260709 12:19:48.960561 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 241655us
I20260709 12:19:48.961256 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:48.962740 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:48.963083  1526 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:48.963514  1494 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:48.965999  1494 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:48.967185  1494 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:49.046303 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:49.049816 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 105602us
I20260709 12:19:48.774531  1328 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.200s
W20260709 12:19:48.974869  1553 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.201s	user 0.012s	sys 0.014s
I20260709 12:19:49.079810 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:49.084807  1512 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:19:48.882345  1269 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:49.134063 29290 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:49.135360 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:49.166412 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:49.167331 28673 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.178642 28679 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
W20260709 12:19:49.185387 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51460.6us
W20260709 12:19:49.178233  1557 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:19:49.179905 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:49.192333 28675 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:19:49.178536   944 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.000s
I20260709 12:19:49.192796 28675 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:49.184253 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 222951us
I20260709 12:19:49.199687 28673 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:49.179334  1243 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:49.186481  1554 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:49.229676 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 142748us
I20260709 12:19:49.225829  1490 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:49.248586 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45884.4us
I20260709 12:19:49.326193  1566 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:49.327023  1566 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:49.330564 29327 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:49.334314  1566 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:49.352514 28599 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:49.363160 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:49.369477 28604 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:49.376906  1247 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:49.377687  1247 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:49.380044  1247 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:49.376781  1406 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:19:49.382670 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5b3b2f4041a24b05983f30878f16db9d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:49.385412  1561 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:49.364754  1558 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:49.387583 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:49.387693  1558 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:49.390017  1558 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:49.392457 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:49.236258  1243 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:49.394078 28682 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:49.321739  1537 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:19:49.375434 28604 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:49.403976 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:49.395787  1343 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.000s
I20260709 12:19:49.353441  1239 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:49.363937   944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41410 (request call id 16) took 1929 ms. Trace:
W20260709 12:19:49.643209 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 234118us
W20260709 12:19:49.517405 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 122519us
W20260709 12:19:49.644449 28572 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5bdaade8df945828ab371a3267cd752. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.665804 28681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "302623a332a2421e848283481e8010f6"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:19:49.410079  1558 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:49.640463  1526 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:49.749871 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:49.667726  1465 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:49.772244 28602 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.031s	sys 0.080s
W20260709 12:19:49.775482 28602 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.031s	sys 0.080s
I20260709 12:19:49.671769  1328 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:49.731163  1516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.038s	sys 0.062s
I20260709 12:19:49.710265  1338 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:49.712242  1405 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:49.831360 28603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.067s
I20260709 12:19:49.660415  1239 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:49.832576 28598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.021s	sys 0.054s
I20260709 12:19:49.865924  1546 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:49.866266 28598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.021s	sys 0.054s
I20260709 12:19:49.866637  1546 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:49.732963  1322 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:49.867784  1239 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:49.844954  1417 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.743654  1558 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:49.848388 28603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.008s	sys 0.067s
I20260709 12:19:49.864846  1549 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:49.865296  1565 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.223s
W20260709 12:19:49.876811 28749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.002s
W20260709 12:19:49.877851 28749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.007s	sys 0.002s
I20260709 12:19:49.867929  1322 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:49.830731  1260 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:49.760470  1526 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:49.930152  1457 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:49.640801   944 rpcz_store.cc:276] 0709 12:19:47.425851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:47.426493 (+   642us) service_pool.cc:224] Handling call
0709 12:19:47.534963 (+108470us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b4c004d8180. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe1d4ba20 00007f6fe1d5ca29 00007f6fe1d22644 00007f6fe1d49f2d 00007f6fe1d49b93 00007f6fe39d81af 00007f6fe39d7f3e 00007f6fe3a5d888 00007f6fe3a7a75c 00007f6fe3a7b76a 00007f6fe3a7a91b
0709 12:19:47.553949 (+ 18986us) log.cc:844] Serialized 513 byte log entry
0709 12:19:48.105240 (+551291us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b54004a0c20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39ffb26 00007f6fe39f949a 00007f6fe39f8714 00007f6fe39d8eaa 00007f6fe39dfd53 00007f6fe39dfcd9 00007f6fe39dfc69 00007f6fe39dfc31 00007f6fe39dedfd 0000000000388634
0709 12:19:48.220632 (+115392us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:48.678525 (+457893us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b54004a0c20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f8142 00007f6fe39d8eaa 00007f6fe39dfd53 00007f6fe39dfcd9 00007f6fe39dfc69 00007f6fe39dfc31 00007f6fe39dedfd 0000000000388634 0000000000388479 00007f6fe0992475
0709 12:19:49.344057 (+665532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":216665,"raft.queue_time_us":115191,"raft.run_cpu_time_us":6466,"raft.run_wall_time_us":1348016,"spinlock_wait_cycles":180880256,"thread_start_us":124737,"threads_started":1,"wal-append.queue_time_us":217784}
I20260709 12:19:49.930980  1330 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:49.847838  1338 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:49.931783 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:49.933482  1322 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:49.956786  1565 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:49.847182  1516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.039s	sys 0.062s
W20260709 12:19:49.899386 28756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.030s	sys 0.028s
W20260709 12:19:49.984411 28756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.030s	sys 0.028s
I20260709 12:19:49.985100 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2765) took 1253 ms. Trace:
I20260709 12:19:49.874632  1405 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:49.878908  1564 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:49.888777  1501 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:49.890120  1438 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:50.015969  1564 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.016851  1438 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:49.997802  1243 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:50.018298  1564 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:49.985458 28756 rpcz_store.cc:276] 0709 12:19:48.731562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.733779 (+  2217us) service_pool.cc:224] Handling call
0709 12:19:48.734151 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:48.734356 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:48.774330 (+ 39974us) log.cc:844] Serialized 14 byte log entry
0709 12:19:49.984796 (+1210466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:49.984845 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:49.984883 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.984942 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:49.985038 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4726,"prepare.queue_time_us":39812,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":5337,"raft.queue_time_us":173272,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":34639,"thread_start_us":938097,"threads_started":1}
W20260709 12:19:49.982226 28719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.008s	sys 0.009s
W20260709 12:19:49.982489 28680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.006s
I20260709 12:19:49.906610  1549 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:50.020653 28719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.008s	sys 0.009s
I20260709 12:19:50.022460  1549 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:49.935276  1573 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:49.935048  1260 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.016149  1501 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.023072  1573 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.024907  1260 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.025068  1573 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:49.833853  1465 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.025450  1501 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:50.026584  1501 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.027221  1501 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:49.989764  1565 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.007802 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2733) took 1055 ms. Trace:
I20260709 12:19:50.029778  1405 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.029101 28607 rpcz_store.cc:276] 0709 12:19:48.952304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.952485 (+   181us) service_pool.cc:224] Handling call
0709 12:19:48.952919 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:49.045950 (+ 93031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.045981 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:49.052893 (+  6912us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.396224 (+343331us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:49.396269 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.396336 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.007544 (+611208us) raft_consensus.cc:1685] finished
0709 12:19:50.007568 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.007734 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94677,"raft.queue_time_us":105522,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6927,"thread_start_us":290338,"threads_started":1,"wal-append.queue_time_us":848433}
I20260709 12:19:49.979487  1457 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.004643  1558 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.014519  1338 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.028190  1243 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:50.031781  1564 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:50.031944  1243 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.032353  1564 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:49.977092 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 332816us
I20260709 12:19:50.020133  1546 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:50.020705 28680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.011s	sys 0.006s
I20260709 12:19:49.848575  1328 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.027720  1526 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.048090 28681 raft_consensus.cc:606] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:49.987772  1330 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.027246  1465 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.048691 28681 raft_consensus.cc:614] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:50.048158 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:49.907866  1417 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:50.034006 28754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.001s	sys 0.014s
W20260709 12:19:50.049472 28754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.001s	sys 0.018s
I20260709 12:19:50.050625  1417 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.051483  1573 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:50.057379 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.005s	sys 0.011s
I20260709 12:19:50.056403 28677 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
W20260709 12:19:50.058939 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.005s	sys 0.011s
W20260709 12:19:50.063082 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 717841us
I20260709 12:19:50.031045  1260 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.020357  1438 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.059242 28677 pending_rounds.cc:85] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 7
I20260709 12:19:50.079911 28677 pending_rounds.cc:107] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:19:50.080305 28677 raft_consensus.cc:2889] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:50.061566 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 407760us
I20260709 12:19:50.150498 28751 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:50.140524  1405 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:50.156672 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.158867 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:50.140508  1556 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:19:50.141422  1338 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:50.171168 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.047s	sys 0.071s
W20260709 12:19:50.172654 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.047s	sys 0.072s
I20260709 12:19:50.137657  1260 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:50.194504 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 211695us
I20260709 12:19:50.197227 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2731) took 1440 ms. Trace:
I20260709 12:19:50.167272  1405 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.209388 28604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:50.210268 28604 raft_consensus.cc:606] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:50.210731 28604 raft_consensus.cc:614] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:50.182037  1243 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.188186  1526 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.212662  1585 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.216677  1328 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.218575  1586 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.219305 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.220250  1580 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:50.221338  1578 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:19:50.223692  1260 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.226172  1564 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.213335 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.241533 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.214761 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.231689 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.243530 28751 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:50.232378 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.233645 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.203438  1437 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:50.209262  1438 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.174607  1338 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.254580 28750 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:50.236685  1526 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.258553  1438 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.236972  1585 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.250293  1501 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:50.242799  1580 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.241977  1493 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.289597  1493 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.250759  1588 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:19:50.290292  1330 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.291724  1493 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:50.293589  1405 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.294173  1338 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.295444  1585 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.295773  1438 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.296927 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1004) took 1048 ms. Trace:
I20260709 12:19:50.297632  1580 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.299376 28747 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:50.272967  1526 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.250583  1243 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:19:50.274106 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2730) took 1529 ms. Trace:
I20260709 12:19:50.233214  1465 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:50.278386 29323 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:19:50.238649  1328 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.297343 28754 rpcz_store.cc:276] 0709 12:19:49.248195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.248336 (+   141us) service_pool.cc:224] Handling call
0709 12:19:49.321678 (+ 73342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:50.049952 (+728274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:50.049999 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:50.058975 (+  8976us) log.cc:844] Serialized 52 byte log entry
0709 12:19:50.204528 (+145553us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:50.204561 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.204624 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.296688 (+ 92064us) raft_consensus.cc:1685] finished
0709 12:19:50.296709 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.296860 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20944,"raft.queue_time_us":54519,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"thread_start_us":765834,"threads_started":2,"wal-append.queue_time_us":218194}
I20260709 12:19:50.254686  1411 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:19:50.240581  1586 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.302384 28603 rpcz_store.cc:276] 0709 12:19:48.745191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.745330 (+   139us) service_pool.cc:224] Handling call
0709 12:19:48.745634 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.950309 (+204675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.950354 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.951147 (+   793us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.285849 (+334702us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b180031daa0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:19:49.874946 (+589097us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:49.874988 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:49.875058 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.273824 (+398766us) raft_consensus.cc:1685] finished
0709 12:19:50.273853 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.274048 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254938,"raft.queue_time_us":205117,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":21325,"spinlock_wait_cycles":14622976,"thread_start_us":588896,"threads_started":1,"wal-append.queue_time_us":1109805}
I20260709 12:19:50.308188  1328 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.308904  1465 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.310338  1328 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.310940  1465 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.314417 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1005) took 1029 ms. Trace:
I20260709 12:19:50.314859 28749 rpcz_store.cc:276] 0709 12:19:49.285195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.286242 (+  1047us) service_pool.cc:224] Handling call
0709 12:19:49.286668 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:49.878281 (+591613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:49.878324 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:49.946660 (+ 68336us) log.cc:844] Serialized 52 byte log entry
0709 12:19:50.184713 (+238053us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:50.313203 (+128490us) log.cc:844] Serialized 14 byte log entry
0709 12:19:50.314094 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.314169 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.314207 (+    38us) raft_consensus.cc:1685] finished
0709 12:19:50.314218 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.314365 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27285,"raft.queue_time_us":62105,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":194,"thread_start_us":879103,"threads_started":3,"wal-append.queue_time_us":280335}
I20260709 12:19:50.316869 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1277) took 1727 ms. Trace:
I20260709 12:19:50.324402 29319 rpcz_store.cc:276] 0709 12:19:48.589411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.590294 (+   883us) service_pool.cc:224] Handling call
0709 12:19:48.593659 (+  3365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:48.596934 (+  3275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:48.596968 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:48.599972 (+  3004us) log.cc:844] Serialized 26 byte log entry
0709 12:19:49.991650 (+1391678us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b180044cda0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:19:50.200732 (+209082us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:50.200789 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.200998 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:50.316599 (+115601us) raft_consensus.cc:1685] finished
0709 12:19:50.316619 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.316797 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2635,"raft.queue_time_us":13628,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":26117504,"thread_start_us":208826,"threads_started":1,"wal-append.queue_time_us":1687732}
W20260709 12:19:50.326951 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 107991us
I20260709 12:19:50.317561  1291 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.316879  1586 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:50.367262 28722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.759s (SENT) [suppressed 3 similar messages]
I20260709 12:19:50.404179  1465 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.417631 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.418174  1465 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:50.358258 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.420212 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.420989 28673 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:50.338276 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.398175 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.420946 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.372273 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.422058 28677 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:50.423218 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:50.358690 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 117374us
I20260709 12:19:50.435714 29319 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:50.428246 28682 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:19:50.430271 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.429693 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.396950  1522 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.397392 28675 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.473202 28675 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:50.441962 28756 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:19:50.461521  1526 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.458703  1492 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:19:50.477880  1526 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.422595  1328 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.483246  1328 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.471624  1465 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.562498 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.563786 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.565164 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.566812 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.567626 28753 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:50.568846 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.563264 29321 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:50.422322  1611 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:50.590427 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 223194us
W20260709 12:19:50.477651 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 43947.7us
I20260709 12:19:50.636716 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.637400 29325 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:50.638376 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.640465 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:50.641320 29317 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:50.652751 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.660753 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.661594 28751 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:50.662149 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.485351  1328 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.438330  1291 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.640353  1507 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:50.670208 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.663528 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.572993  1514 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:50.667182 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.698558 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.661834  1609 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.486559  1526 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.713879 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.717657 28755 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:19:50.654569  1464 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.720425 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.471947  1522 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.724647 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.726141 28749 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:50.728708 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.695151  1548 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.704630  1458 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.712582  1482 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:50.704775  1405 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:50.733435 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:50.197759 28602 rpcz_store.cc:276] 0709 12:19:48.757074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.955296 (+198222us) service_pool.cc:224] Handling call
0709 12:19:48.955589 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:48.955788 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:49.776016 (+820228us) log.cc:844] Serialized 14 byte log entry
0709 12:19:50.196738 (+420722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:50.196813 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:50.196889 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:50.196997 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:50.197149 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":888951,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":9475,"thread_start_us":1140149,"threads_started":2}
I20260709 12:19:50.772933 29320 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:50.770655 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 242937us
I20260709 12:19:50.716403  1507 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.648633  1611 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.739439  1493 raft_consensus.cc:476] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 12:19:50.719959  1514 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.771852  1243 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:50.766016  1614 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.725418  1464 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.722469  1609 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.764659  1458 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.799122  1458 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.760654  1548 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.801154  1291 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:50.772195  1405 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.802129  1548 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.770563  1482 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.803772  1405 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.797205  1479 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.791011  1243 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:50.815366 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.813376  1437 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.805612  1507 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:50.826076 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 107933us
I20260709 12:19:50.812948  1243 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:50.804401  1482 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:50.826949 28675 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:50.815557  1562 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:50.788133  1616 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:19:50.823617  1437 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:50.833431 28675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 1078) took 1653 ms (client timeout 1832 ms). Trace:
I20260709 12:19:50.835301 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:50.833984 28675 rpcz_store.cc:269] 0709 12:19:49.177136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.177936 (+   800us) service_pool.cc:224] Handling call
0709 12:19:50.397015 (+1219079us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b4c00132780. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe1d4ba20 00007f6fe1d5ca29 00007f6fe1d22644 00007f6fe1d49f2d 00007f6fe1d49b93 00007f6fe3a7a18b 00007f6fe3a7acb5 00007f6fe3a75f30 00007f6fe3a777de 00007f6fe3a8327c 00007f6fe8a44b17
0709 12:19:50.830114 (+433099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13768448}
I20260709 12:19:50.837186 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:50.837051 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 115052us
I20260709 12:19:50.835922 28749 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:19:50.795660  1614 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.841070 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.851312 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.848582 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.829121  1442 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:50.849159 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:50.812748  1479 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:51.161607  1627 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:51.148878 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:51.162577 28572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.024s	sys 0.039s
I20260709 12:19:51.184733 28676 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:51.154910 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.167457 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1282) took 1973 ms. Trace:
W20260709 12:19:50.923461 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 341014us
W20260709 12:19:51.184836 28572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.024s	sys 0.041s
I20260709 12:19:51.187995 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:51.188515 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 792954us
I20260709 12:19:50.838932 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:50.847450 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.074999 28601 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:51.189333 28572 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:51.192678 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.186084 28673 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
W20260709 12:19:51.046623 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 152451us
W20260709 12:19:51.194265 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:50.941018 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.194789 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:50.834949  1411 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:19:50.831336  1507 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.833246  1494 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:51.076581 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:51.224023 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.229125 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:51.210431 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.187543 29320 rpcz_store.cc:276] 0709 12:19:49.194299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.194470 (+   171us) service_pool.cc:224] Handling call
0709 12:19:49.194739 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:50.773833 (+1579094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.167129 (+393296us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54007a67d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:51.167370 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3628755328}
I20260709 12:19:51.242533 28748 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:51.234616 28682 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:51.245850 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:51.246071 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 169623us
W20260709 12:19:51.196928 28756 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.722s	user 0.008s	sys 0.004s
I20260709 12:19:51.246672 29319 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
W20260709 12:19:51.248942 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 59686us
I20260709 12:19:51.250825 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:51.015988  1405 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.251646  1494 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.252023  1405 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.249280  1507 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.254092  1405 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.253901  1437 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:51.200002 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 361131us
I20260709 12:19:51.254514  1315 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:51.254930  1507 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.255271  1315 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:50.927481  1548 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.256026  1437 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:51.256127  1548 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:51.256836 28571 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:51.256891 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:51.257522  1291 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:51.257709 29322 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:51.257977  1291 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.258122  1548 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:51.015794  1628 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:19:51.258397  1291 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:50.836226  1562 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:50.891686  1482 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.260140 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.935192  1458 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:51.036760  1608 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:19:51.262485 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:51.263067 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.263123 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:50.939581  1338 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:50.935804  1528 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:51.072750  1583 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:51.046033  1409 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:50.937463  1565 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:51.051054  1589 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.780s	user 0.005s	sys 0.005s
I20260709 12:19:51.078601  1584 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:51.195827  1460 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:51.264415 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 70366us
I20260709 12:19:51.267629 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:51.352240 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 84664.4us
I20260709 12:19:51.230129  1465 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:51.263885 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.310310 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1019) took 1075 ms. Trace:
I20260709 12:19:51.049575  1611 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.371709 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.366830 28747 rpcz_store.cc:276] 0709 12:19:50.235027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.235191 (+   164us) service_pool.cc:224] Handling call
0709 12:19:51.310117 (+1074926us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b5400338954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:51.310239 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131044608}
I20260709 12:19:51.068928  1304 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:51.307612  1226 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:51.002210  1522 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.050477  1609 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:50.898554  1625 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.260964  1315 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:51.260452   947 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.378247  1304 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.393143   947 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.394724  1304 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:51.347383  1409 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.397591  1409 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.343196 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.227427  1617 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:51.398517  1617 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:51.398970  1617 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:51.351464  1460 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:50.996687  1623 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.406991 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2453) took 1259 ms. Trace:
W20260709 12:19:51.407859 29323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 1137) took 1196 ms (client timeout 1553 ms). Trace:
I20260709 12:19:51.407523 28756 rpcz_store.cc:276] 0709 12:19:50.147881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.151637 (+  3756us) service_pool.cc:224] Handling call
0709 12:19:50.174026 (+ 22389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:50.176876 (+  2850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:50.176962 (+    86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:50.192667 (+ 15705us) log.cc:844] Serialized 513 byte log entry
0709 12:19:50.441828 (+249161us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:51.251168 (+809340us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.258842 (+  7674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:51.258925 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:51.406716 (+147791us) raft_consensus.cc:1685] finished
0709 12:19:51.406736 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:51.406916 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":205136,"threads_started":1,"wal-append.queue_time_us":422923}
I20260709 12:19:51.079226  1464 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:51.312057  1622 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:51.267416  1479 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:51.307612  1567 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.370059 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.370940 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.386787  1614 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:50.839251  1619 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.516s
I20260709 12:19:51.340256  1338 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.390569 28674 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:51.372913  1548 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:51.365196  1465 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.229614  1627 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.340703  1528 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.345237  1583 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.459211  1465 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:51.467474  1583 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:51.395303   947 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.263708  1030 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:51.344295  1482 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.402068 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.085675  1514 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:51.403855 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.405186 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.347813  1458 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:51.408648 29323 rpcz_store.cc:269] 0709 12:19:50.211775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.211881 (+   106us) service_pool.cc:224] Handling call
0709 12:19:51.407684 (+1195803us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b540042c054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:51.407790 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93496064}
I20260709 12:19:51.186694  1442 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:51.417462 28755 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:51.417698 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.481287 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:51.420416 28602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:51.482372 28602 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:51.482793 28602 raft_consensus.cc:614] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:51.421900 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:51.424373 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 173622us
I20260709 12:19:51.484141 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:51.354838  1584 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.426342 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.448560  1548 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.388401  1226 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:51.451049 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:51.491976 28601 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
W20260709 12:19:51.453377 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 190943us
I20260709 12:19:51.476504 28677 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:19:51.406368  1522 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.462368  1587 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:51.500149  1573 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.471540  1030 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.400331  1625 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.418377  1622 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.415495  1623 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:51.536801 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 50458.2us
W20260709 12:19:51.537559 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 188479us
W20260709 12:19:51.523185 28601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2402) took 2929 ms (client timeout 1759 ms). Trace:
I20260709 12:19:51.537946 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:51.538637 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:19:51.538375 28601 rpcz_store.cc:269] 0709 12:19:48.563608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.563750 (+   142us) service_pool.cc:224] Handling call
0709 12:19:49.208921 (+645171us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b18000d4b80. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3aba646 00007f6fe39f458e 00007f6fe3a75f9e 00007f6fe3a777de 00007f6fe3a8327c 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c
0709 12:19:49.214956 (+  6035us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b580089a8d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39db0aa 00007f6fe3a5d447 00007f6fe3a75fe7 00007f6fe3a777de 00007f6fe3a8327c 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c
0709 12:19:51.074819 (+1859863us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b580089abd0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39db0aa 00007f6fe3a5d447 00007f6fe3a75fe7 00007f6fe3a777de 00007f6fe3a8327c 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c
0709 12:19:51.492842 (+418023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4363409920}
W20260709 12:19:51.523818  1243 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.001s
I20260709 12:19:51.468394  1338 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.545441 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:51.546259 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.425412  1567 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.549029 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.550414  1567 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.470120  1457 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:51.471148  1562 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.552428 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.566306 28748 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:51.490191  1126 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:51.554546 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 323626us
I20260709 12:19:51.554768 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.555068 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:51.557060 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.557363 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.558146 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.559446 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.560647 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.553673 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.568025 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.492395  1548 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:51.535297  1584 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:51.511173  1566 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:51.614542 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:51.524880  1226 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:51.610486 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.614408 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.541757  1030 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:51.616341 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:51.637710 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:51.638377 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.640839 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:51.644515 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:51.703682 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 87426.2us
I20260709 12:19:51.565127  1565 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:51.704612 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:51.665984 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 110986us
W20260709 12:19:51.667104 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 68916.6us
I20260709 12:19:51.747632 28647 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:51.748252 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:51.748508 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:51.749372 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:51.552181  1624 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:51.564927  1609 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:51.690900 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.691910 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.615602  1479 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:51.694568 28601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:51.637060  1562 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:51.694999 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.690999 29290 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:51.753016 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.612481  1581 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.768743 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.544166  1573 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:51.770113 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:51.753161 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.760769 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:51.553004  1243 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.767688 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:51.776387 28677 raft_consensus.cc:2376] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11. Re-sending same reply.
I20260709 12:19:51.773058 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:51.759884 28601 raft_consensus.cc:606] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:51.665495  1564 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:51.500334  1442 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.687849  1338 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:51.782569 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.783548 28674 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:51.787927 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.789139 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.790033 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.791250 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.792862 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.798720 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.802754 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.803472 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.544942  1522 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.805410 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.807299 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.809350 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.666100  1528 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.694072  1226 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:51.788626 28598 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:51.840384 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:51.844413 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 91190.3us
I20260709 12:19:51.842839 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.845381 28602 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:51.843046 28603 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:51.705137  1588 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:51.848285 28607 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:51.847808 28605 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:51.759161  1507 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:51.754776  1549 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:51.875231  1549 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:51.875819  1549 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:51.745332   947 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.858392 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:51.878159 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.753631  1637 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:51.775208  1458 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.544312  1587 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:51.774988  1571 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:51.759311  1609 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.775378  1614 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:51.775686  1627 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.768548  1622 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:51.876660  1479 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:51.891247  1442 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:51.947470  1634 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:51.776050  1624 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.949599  1634 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:51.949759  1445 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.950102  1634 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:51.951298 28680 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:51.777357  1562 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:51.952669 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 203347us
I20260709 12:19:51.953111 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:51.842032  1564 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:51.924089 29320 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:51.899546  1514 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:51.899318  1567 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:51.886749  1482 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.957038 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:51.957763 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:51.958740 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:51.967411 28607 raft_consensus.cc:2376] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10. Re-sending same reply.
I20260709 12:19:51.967475 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.967034 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.969113 28602 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
W20260709 12:19:51.960084 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 202924us
I20260709 12:19:51.919042  1584 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:19:51.964195  1625 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:51.884222  1226 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:51.973062  1635 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:51.973634  1646 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:19:51.919566  1614 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.921736  1571 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:51.921373  1609 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:51.979641 28602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:51.950623  1445 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.008275  1614 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:52.014115  1564 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:52.018537 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:51.968189  1514 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:51.955776  1460 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:51.991017  1565 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:51.977053  1479 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:51.993211 28605 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:51.996872 28602 raft_consensus.cc:606] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:52.057080 28602 raft_consensus.cc:614] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:52.000665  1571 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:51.783265  1581 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:51.896572   947 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.027639 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.026837 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.030102 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.037369 28607 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:51.975744  1522 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.037147  1514 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:52.026831  1494 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.040804 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.095764 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:51.991366  1573 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.026623  1609 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.043030 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:52.045610  1291 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.003s
I20260709 12:19:52.046118  1625 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.047176  1445 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.048707 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:51.899168  1637 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.050952 28680 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:52.054490 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.058508 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.064885  1624 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.076164 28754 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:52.079100 28677 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:19:52.095933  1465 consensus_meta.cc:287] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.004s
I20260709 12:19:52.026178  1640 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:51.976945  1567 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.041810 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:52.077874 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 386900us
I20260709 12:19:52.104830  1030 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:51.976326  1584 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.111035 28756 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:52.102433  1291 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.019819  1635 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:52.124387  1647 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:19:52.126812  1636 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:52.129539 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1287) took 1060 ms. Trace:
I20260709 12:19:52.144789 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.149008 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.141081 28678 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:52.144848 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.150491 28607 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
W20260709 12:19:52.139267 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 84870.7us
I20260709 12:19:52.151463 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.076596  1479 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.149274 29317 rpcz_store.cc:276] 0709 12:19:51.069524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.230461 (+160937us) service_pool.cc:224] Handling call
0709 12:19:51.244958 (+ 14497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.468382 (+223424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.468411 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.468480 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:51.468522 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.129296 (+660774us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54004a92d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:52.129339 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.129470 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513327360}
I20260709 12:19:52.152026 28607 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:52.156474 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.153921 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:52.129485 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 87763.2us
I20260709 12:19:52.128410  1614 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.158494  1226 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.160310  1614 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.107582  1548 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:52.106374  1625 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.160823   947 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.160988 28601 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:52.161406  1656 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:52.136096  1584 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:52.166285 28599 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:52.168365 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.169792 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.170945 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:52.140647  1545 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:52.142045  1609 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.174440 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.139787  1651 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:52.151679  1624 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:52.140709  1030 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.177400 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.179605  1479 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.117084  1465 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:52.180135  1291 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.162376  1548 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.183782  1549 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.136129  1623 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.208503 28598 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
W20260709 12:19:52.223886 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 118433us
W20260709 12:19:52.212625  1617 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.811s	user 0.009s	sys 0.004s
I20260709 12:19:52.187788  1625 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.260816 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:52.185863  1243 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.226281 28606 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:19:52.184561  1545 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.262914 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:52.238199 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.189538  1624 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:52.161962  1656 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.267215 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.267504 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:52.155905  1636 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.257469  1650 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:52.271920 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.275185 28755 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:52.276978 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.214639  1581 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.277572 28751 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:19:52.280664 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.237103  1291 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:52.121869  1640 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.291999 28607 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:52.283727 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:52.265729  1562 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:52.299036 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.289005  1549 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.273846  1624 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:52.307575 28607 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:52.310287 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.298578  1291 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.268296  1617 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:52.316690 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:52.319871 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.321818 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.318709  1571 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.337481 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.317142  1465 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.282362  1650 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.337707 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:52.345999 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.357115 28598 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:52.362764  1640 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.325826  1567 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.365403 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.365603 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.366914 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.345573  1291 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.345523  1571 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.367596  1635 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.364658  1636 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:52.385644 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 72095.7us
I20260709 12:19:52.385775 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.386552 28600 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:52.391563  1269 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:52.385278  1545 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:52.379941  1514 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:52.507176 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.542958 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.544054 28598 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 9.
I20260709 12:19:52.545259 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.549001 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.556895 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.563875 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:52.560611  1634 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.006s
I20260709 12:19:52.567895  1634 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.568629 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.569964  1634 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.573488  1514 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.576905  1637 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.579838  1650 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:52.582365 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:52.584139 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.561262  1656 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.585516 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:52.586120 28752 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:52.588980 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1288) took 1390 ms. Trace:
I20260709 12:19:52.589381 29327 rpcz_store.cc:276] 0709 12:19:51.198230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.198421 (+   191us) service_pool.cc:224] Handling call
0709 12:19:51.198805 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.523655 (+324850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.523723 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.523794 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:51.523851 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.588768 (+1064917us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54004bafd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:52.588809 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.588926 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746410880}
I20260709 12:19:52.594025 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.596103  1587 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.598585 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.599447 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:52.599970 28751 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:52.603511 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.604473  1634 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:52.586129  1656 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:52.613185 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.614050 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.615343 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.616091 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.616221 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.616918 29317 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:52.617180 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:52.617530 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.615294 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.619068 29327 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:52.618999 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:52.618722 29326 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:52.620419 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:52.623381 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:52.623454 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:52.624279 29325 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:52.625388 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.625797 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:52.627072 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:52.627672 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.608008  1538 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:52.610029  1636 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:19:52.629292 28647 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:52.635021 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.635640 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.610105  1634 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:52.636143 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:52.621480  1571 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:52.633351  1610 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:52.633718  1030 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:52.630290  1458 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:52.636204 28755 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:19:52.635085 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.632566 28754 raft_consensus.cc:2368] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:52.617830  1656 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:52.616386  1587 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:52.657300 28748 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:52.619755  1406 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:52.660008 29325 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:52.649731  1625 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:52.650408 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1295) took 1011 ms. Trace:
I20260709 12:19:52.652501 28752 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:52.630358  1549 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:52.657330 29327 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:52.609269  1264 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:19:52.660933 29323 rpcz_store.cc:276] 0709 12:19:51.638513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.649549 (+1011036us) service_pool.cc:224] Handling call
0709 12:19:52.649892 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.650072 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:52.650098 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:52.650137 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:52.650176 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.650242 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.650353 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:52.649302 28751 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:52.638763  1634 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:52.657557  1656 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:52.680868 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:52.638569  1538 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.684204 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:52.687192 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:52.688102 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:52.690734 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.686580 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:52.692224 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:52.695353 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.695225 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.697458 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:52.695817 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.693073  1610 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:52.699949 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.700253  1256 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:52.702030  1462 raft_consensus.cc:993] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:52.702598  1462 raft_consensus.cc:1081] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:52.707345 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.661978  1406 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:52.709571 28606 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:52.701877  1409 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:52.710573 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.662005  1587 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:52.713476 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.717381 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:52.690510  1625 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:52.715461 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:52.716257 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.690900  1030 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:52.688465  1588 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:52.701917  1546 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:52.719903 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.723527 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.718784 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.726704 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:52.718499 28572 connection.cc:256] RPC call timeout handler was delayed by -1.9387483849998262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:19:52.738144  1406 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.738350 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:52.711956  1409 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:52.717451  1651 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:52.739414 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.739550 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:52.740235 28674 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
W20260709 12:19:52.744861 28572 connection.cc:256] RPC call timeout handler was delayed by -1.1624898630000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 12:19:52.717144  1318 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:52.722333   944 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:52.722780  1625 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:52.722643  1030 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.744688 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.755411 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.753877 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:52.740643  1546 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:52.779335 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:52.758641  1668 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:19:52.758045 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:52.768425 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:52.774871  1588 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:52.739531  1571 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:52.778880 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:52.778895 29323 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:52.743862  1651 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:52.770388  1318 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:52.742118  1462 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:52.784991 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:52.744289  1409 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:52.786820 29319 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:52.777292  1625 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:52.779016  1030 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:52.740895  1624 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.741912  1291 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:19:52.789233 28573 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.779882  1328 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:52.793156  1651 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:52.861049  1538 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.785791  1490 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:19:52.864707 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2411) took 1078 ms. Trace:
I20260709 12:19:52.865124  1490 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:52.865487  1490 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:52.868110 28676 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:52.865135 28603 rpcz_store.cc:276] 0709 12:19:51.786800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.788921 (+  2121us) service_pool.cc:224] Handling call
0709 12:19:52.864526 (+1075605us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b5400233f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:52.864629 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122449792}
I20260709 12:19:52.850906 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.873884 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.842656 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:52.859195 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.784106  1615 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:52.874472 28603 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:52.882616 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.781826  1546 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:52.837004 28604 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:52.846061 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:52.891727 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49151.4us
W20260709 12:19:52.889978 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 100812us
I20260709 12:19:52.892818 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:52.891618 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.817209 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:52.892210 28753 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:52.788563  1571 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:52.790735  1626 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:52.895509 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.897670 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.899070 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.899734 28573 leader_election.cc:400] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:52.902977 28573 leader_election.cc:403] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:19:52.890632 28647 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:52.894351 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.903234 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:52.906318 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.907495 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:52.835685  1587 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.881448  1318 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:52.902038  1458 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:19:52.895944  1490 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:52.915102  1490 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:52.916610  1643 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:52.916721  1624 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.917510  1624 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:52.918215  1624 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:52.908279  1661 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:52.919255  1661 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:52.919689  1661 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:52.920197 29323 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:52.901762  1626 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:52.920977  1626 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:52.909147 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.902076  1571 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:52.924870 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.925998 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.926997 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.927702  1651 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:52.927968 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.902436  1567 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:52.928644 28603 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:52.891173  1630 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:52.929517  1630 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:52.894825  1549 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:52.903183   944 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:52.932410   944 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:52.932852   944 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:52.935705 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2425) took 1058 ms. Trace:
I20260709 12:19:52.936219 28605 rpcz_store.cc:276] 0709 12:19:51.877689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.877895 (+   206us) service_pool.cc:224] Handling call
0709 12:19:52.935482 (+1057587us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400234954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:52.935622 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248350976}
I20260709 12:19:52.937496 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.937973 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.938776 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:52.939920 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.940007  1588 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:52.940055 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:52.910292 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.910604 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:52.943022  1291 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:52.943727  1291 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:52.944945 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:52.945960 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:52.946715 28599 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:52.947077 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:52.948320  1264 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:52.948864  1264 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:52.949738  1264 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:52.953172 28678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2331) took 1395 ms (client timeout 1542 ms). Trace:
I20260709 12:19:52.953972 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:52.954356 28680 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:19:52.952744  1291 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:52.953580 28678 rpcz_store.cc:269] 0709 12:19:51.557574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.567717 (+ 10143us) service_pool.cc:224] Handling call
0709 12:19:52.952976 (+1385259us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540016c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:52.953114 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228510976}
I20260709 12:19:52.957060 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:52.959117 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:52.957361 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.956835  1581 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:52.961236  1247 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:52.962963 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:52.964944   944 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.967131   944 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:52.967342  1568 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:52.970101 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2481) took 1082 ms. Trace:
I20260709 12:19:53.012044 28749 rpcz_store.cc:276] 0709 12:19:51.887583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.887775 (+   192us) service_pool.cc:224] Handling call
0709 12:19:51.888169 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.979229 (+ 91060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.979260 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.979304 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:51.979333 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.969894 (+990561us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b5400337a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:52.969937 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.970049 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208946560}
I20260709 12:19:53.012969 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2421) took 1206 ms. Trace:
I20260709 12:19:53.012367 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.013448 28601 rpcz_store.cc:276] 0709 12:19:51.806256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.807078 (+   822us) service_pool.cc:224] Handling call
0709 12:19:53.012776 (+1205698us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400218254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:53.012897 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721082752}
I20260709 12:19:53.014721 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:53.014791 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.015874 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:19:53.016388 28754 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:53.016793 28754 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.016206 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.018730 28751 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:19:52.970161 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.023736 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.024294 28747 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:52.973948 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.028214 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.026813 28605 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:52.929489 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:52.978756  1641 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.126s	user 0.037s	sys 0.091s
I20260709 12:19:52.980818  1537 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:52.980861 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1086) took 1615 ms. Trace:
I20260709 12:19:53.038717 28673 rpcz_store.cc:276] 0709 12:19:51.365787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.366047 (+   260us) service_pool.cc:224] Handling call
0709 12:19:51.366502 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.588880 (+222378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:51.588925 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.588981 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:51.589024 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.980613 (+1391589us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003b7254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:52.980656 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.980783 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510701312}
I20260709 12:19:52.972645  1239 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:52.983678  1625 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:52.984848  1669 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:19:52.972355  1656 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:52.991670 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:52.992120 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1027) took 1014 ms. Trace:
I20260709 12:19:53.047365 28756 rpcz_store.cc:276] 0709 12:19:51.977603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.977749 (+   146us) service_pool.cc:224] Handling call
0709 12:19:52.020266 (+ 42517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:52.149018 (+128752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.991900 (+842882us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b54002d5ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:52.992060 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208317824}
I20260709 12:19:52.992318  1617 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:52.994788 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.912976  1634 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.995558 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2780) took 1804 ms. Trace:
I20260709 12:19:52.997284  1546 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:52.997926  1584 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.002s
I20260709 12:19:52.999430 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:52.980361  1409 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:52.989082  1571 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.058782 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.007814 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2413) took 1220 ms. Trace:
I20260709 12:19:53.042944  1564 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:53.009836  1661 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:52.945971 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.074013 28606 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:53.074954 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.075094  1661 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:53.075806 28753 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:53.076018 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.034296 28599 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:53.080947  1625 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.081499 28599 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:53.081822  1571 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.005409  1030 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.085119 28754 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.085630  1643 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:53.086333  1030 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.087036 28749 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:53.087224 28754 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:53.035199 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 132012us
I20260709 12:19:53.077859 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.091158  1651 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:53.091991 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:53.040889 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70796.1us
I20260709 12:19:53.041688 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:53.044344 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 153799us
I20260709 12:19:53.048346 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.045045 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:53.016746  1568 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.037326 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.043484  1239 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:53.058002 28681 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:53.009629  1318 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.045747  1537 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.124442 28755 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:53.060940 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:53.142274 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.061977  1546 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:53.062944  1626 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.064810  1409 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.070094  1634 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:53.033600 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.076511 29320 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:53.059509 28604 rpcz_store.cc:276] 0709 12:19:51.787442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.790971 (+  3529us) service_pool.cc:224] Handling call
0709 12:19:53.007654 (+1216683us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000bde54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:53.007758 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2403343104}
I20260709 12:19:53.151973 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.052645 28750 rpcz_store.cc:276] 0709 12:19:51.190848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.190971 (+   123us) service_pool.cc:224] Handling call
0709 12:19:51.191323 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:51.370105 (+178782us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:19:51.537043 (+166938us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.562930 (+ 25887us) log.cc:844] Serialized 14 byte log entry
0709 12:19:51.563424 (+   494us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:51.563480 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:51.563544 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:52.995338 (+1431794us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003e8d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:52.995385 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:52.995503 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23773,"prepare.queue_time_us":1017300,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":196,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":254,"spinlock_wait_cycles":410439040,"thread_start_us":183231,"threads_started":2,"wal-append.queue_time_us":153007,"wal-append.run_cpu_time_us":3594,"wal-append.run_wall_time_us":1312920}
I20260709 12:19:53.154292 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.155063 28750 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.109658 28603 raft_consensus.cc:2368] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14.
I20260709 12:19:53.120568 28752 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:53.055783 28747 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:53.158289 28748 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:53.163486 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.164687 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.119899 28602 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:19:53.119889 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.123049 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:53.149838  1256 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:53.092619  1584 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.124192  1239 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.169968 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:53.170320 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47400.6us
I20260709 12:19:53.170717 28600 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:19:53.171051 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:53.168155 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48367.4us
I20260709 12:19:53.141052  1564 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:53.173527 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.175901 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.174602 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.176543 28607 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:53.172149  1322 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:53.172206  1564 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.181605  1630 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:53.182981  1584 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:53.170281 28682 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:53.184370  1414 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:53.184960  1414 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.185940  1414 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.178517  1264 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:53.190589 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.191476  1264 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:53.191897  1264 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:53.192297  1264 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.193534 28607 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 10.
I20260709 12:19:53.197039 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:53.197932 28674 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:53.198005 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.199106  1537 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:53.200070 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.201468 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.202203 28605 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:53.177788 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.127233 28673 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:53.202728  1458 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:53.203255  1458 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.204107  1458 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.204046  1568 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.204722  1291 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:53.206835 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.207427 28678 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.208976 28680 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:19:53.206058 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.212595 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:53.212231 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.213182 28750 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:53.214277 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.205364  1291 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:53.215741  1291 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:53.215955 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.224785 29325 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.216645 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.215480 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.224535  1409 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:53.231705 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.231974 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.213650 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:53.219041 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.232617 28675 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:19:53.169217  1251 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:53.231611  1243 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:53.148538  1617 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:19:53.231504  1409 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:53.224740  1459 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:53.217232  1674 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:19:53.223333 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.249539 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.282672 28603 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:53.258165 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.264353 28678 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:53.284154 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.265059 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.284868 29319 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.285624 28606 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
W20260709 12:19:53.281386 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 67810.7us
I20260709 12:19:53.251494 29325 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
W20260709 12:19:53.236490 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76058us
I20260709 12:19:53.289393 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:53.248428 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:53.236452 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 88997.7us
I20260709 12:19:53.294654 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.294793 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.295195 28605 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:53.251909 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.295617 28605 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:53.245497 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 197568us
I20260709 12:19:53.281466 28675 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:19:53.298622  1335 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:53.299243  1335 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.300616 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:53.301330  1335 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:53.306341  1584 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:53.307519  1335 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:53.307890  1335 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:53.308703  1335 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.309927  1335 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.310446  1462 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:53.311015 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.309753  1615 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:53.312507  1643 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:53.311177   944 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:19:53.313118  1643 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:53.314056  1634 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:53.314492  1643 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.315693  1643 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.321326 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:53.324784 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.263402  1409 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.286324  1322 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.319446   944 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:53.327054   944 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:53.327493 28605 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.328156   944 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.263288  1264 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:53.321099  1638 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:19:53.329377   944 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:53.330503  1264 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:53.221884  1537 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:19:53.296485  1674 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.286854  1459 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.332518  1674 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.333199  1537 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:53.332995  1459 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.333598  1537 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:53.334496  1537 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.335732  1537 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.336050  1659 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:53.337033  1659 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:53.337378  1659 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:53.338220  1659 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.339309  1659 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.340968 28675 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:53.342146 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:53.340991  1621 consensus_queue.cc:1175] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" responder_term: 13 status { last_received { term: 13 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 13 index: 12 } }
I20260709 12:19:53.343963  1538 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.343228  1579 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:53.345613  1588 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:53.346016  1588 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:53.347002  1269 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:53.346909  1588 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.348101  1588 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:53.348802  1666 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:53.237155  1568 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:53.350112  1318 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:53.350709 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:53.352833 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 94745.2us
I20260709 12:19:53.353421  1247 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.355180 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:53.355690  1243 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.356009  1615 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:53.356362  1615 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:53.357343  1243 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:53.357204  1615 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.357880  1243 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:53.358702  1615 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.359360 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:53.359181  1239 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.360111 28753 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:53.357252  1251 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:19:53.362329  1251 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:53.362689  1251 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:53.363543  1251 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:53.365180 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.365470 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.366248  1490 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:53.366884 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.365847 29319 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:53.366873 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.369676  1579 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:53.324268 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.371588  1673 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:53.347386  1269 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:19:53.371626 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 47417.4us
I20260709 12:19:53.372120 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.328682 28605 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.372789  1269 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.373311 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.373704  1251 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:53.373978  1269 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.374581  1414 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:53.375839 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.376528 28675 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
W20260709 12:19:53.378504 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.379208  1661 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.355293  1626 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.380596  1564 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.380826  1634 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:53.383140 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.383708 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.383921 28677 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:53.388638 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.358731  1243 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.393760  1437 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:53.393837  1291 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.395828  1634 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:53.395920 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.396237  1634 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:53.396811 29327 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:53.397248  1634 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.399191 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:53.400377 28678 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:53.400753 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:53.401582 28675 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:53.402038 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.403416 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:53.404306 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.405901  1315 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:53.406394  1315 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:53.396046  1291 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:53.408505 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.409495  1239 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.410120  1406 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:53.413391  1322 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:53.413882  1322 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.414870  1322 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.417749 28571 leader_election.cc:400] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:19:53.418241 28571 leader_election.cc:403] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:19:53.420115 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.420631  1579 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:19:53.421676 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48430.8us
I20260709 12:19:53.423022 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:53.423580 28606 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
W20260709 12:19:53.424708 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49559.9us
W20260709 12:19:53.424945 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 98986.2us
I20260709 12:19:53.428550 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.429891 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.428910 28605 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:53.434459 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.435833 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.435933 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:53.437892 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.437883 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.443485 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.447999 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.403415  1564 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:53.451563 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.453058 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.459858 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.458568 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.434190  1462 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:53.464221 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.468573 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:19:53.470564 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.441589  1602 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.440834  1304 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:53.475955 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.449134  1567 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:19:53.448789  1661 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:53.454989  1637 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:53.461143  1587 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:53.481635 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.475739  1566 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:53.451038  1571 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:53.407271  1315 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:53.501502 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.455482  1490 raft_consensus.cc:2764] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:19:53.505589  1566 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:53.506774 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48319.9us
I20260709 12:19:53.509727  1538 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:53.510474  1625 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:53.511759  1549 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:53.512342  1571 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.512240  1549 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.513307  1571 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.513617  1549 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:53.518504 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.489419 28749 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:53.466080  1671 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:19:53.484290  1304 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:53.474131  1659 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:53.530437  1671 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:53.531216  1587 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.472868  1621 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:53.462631  1584 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 12:19:53.539022 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57455.8us
I20260709 12:19:53.487625  1629 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:53.550738  1409 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:53.575843  1629 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:53.576325  1629 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.577877  1409 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:53.556095  1564 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:19:53.571709 29320 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:53.575176  1567 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:19:53.537067  1304 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.580145  1588 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:53.516198  1549 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.590248 28753 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:19:53.536873  1291 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.593688 28605 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:53.540766  1671 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.597536 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:53.600481 28602 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:19:53.589001 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5b3b2f4041a24b05983f30878f16db9d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:19:53.612422  1686 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:19:53.621966  1656 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.625525  1587 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.632790  1414 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:53.632973  1659 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:53.633354  1659 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:53.634189  1659 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.635387  1659 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.642506  1322 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:53.650395  1564 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:53.652379  1304 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.667074 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.668110 29327 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:53.412817 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:53.681269 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 192651us
I20260709 12:19:53.682876 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.706605  1584 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:53.707197  1584 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:53.708117  1584 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.711053  1634 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:53.680864  1304 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:53.717073 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.682789  1615 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:19:53.718168  1615 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:53.718490  1615 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:53.719280  1615 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:53.695012  1671 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.721659  1671 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:53.728634 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45852.7us
W20260709 12:19:53.732515 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.735591 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:53.738961 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.744869  1537 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:53.747012 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.748353  1537 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:53.764847 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.780395  1588 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:53.781172  1588 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.785315 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:19:53.797446 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 394917us
I20260709 12:19:53.750435 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:53.800825 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50605.9us
I20260709 12:19:53.801120 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.801549 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.801842  1629 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.802692  1304 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:53.802654 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.803020  1584 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:53.803051 29327 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:53.803599  1564 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:53.831133 28749 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:53.804001  1291 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:53.831895  1291 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.834076  1291 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.805836 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.834975 28752 raft_consensus.cc:2410] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:19:53.806984 28747 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:53.808971 28573 leader_election.cc:400] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:19:53.835599 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.810613 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.812073  1592 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:53.812917 28605 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:53.814152  1629 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:53.799134  1588 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:53.836882  1592 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.838682 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.839742  1592 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.842262  1588 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:53.843065 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:53.840235 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.743618  1549 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:19:53.840339  1318 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:53.822638 28750 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:53.797366  1615 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.853448 28747 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:53.854113 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:53.886268  1315 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:53.886827  1315 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:53.854480 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51900.5us
I20260709 12:19:53.857388  1409 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:53.857434 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:53.889189 29292 leader_election.cc:400] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14.
I20260709 12:19:53.859903 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:53.862120 28600 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:53.889988  1318 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:53.890563  1030 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:53.890893 28571 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.891014  1318 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:53.850270 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:53.891870  1409 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:53.892879 29327 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:53.870831 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.893123 29320 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:53.862977  1636 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:53.875765 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2749) took 1572 ms. Trace:
I20260709 12:19:53.893952  1409 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.895026 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:53.894316 28598 rpcz_store.cc:276] 0709 12:19:52.303656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.566752 (+263096us) service_pool.cc:224] Handling call
0709 12:19:52.955278 (+388526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:53.196281 (+241003us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:53.450840 (+254559us) log.cc:844] Serialized 14 byte log entry
0709 12:19:53.607086 (+156246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:53.693230 (+ 86144us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:53.693282 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:53.833890 (+140608us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b18003467e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419
0709 12:19:53.867803 (+ 33913us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400234954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:53.867856 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:53.875608 (+  7752us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400234950. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:53.875710 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174214,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":79,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5714,"spinlock_wait_cycles":1508014592,"thread_start_us":410088,"threads_started":2,"wal-append.queue_time_us":241724}
I20260709 12:19:53.892797 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.897684   944 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:53.897995 29320 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:53.898662 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.898787 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.900885 29325 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:53.901854 28673 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:53.905270 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:53.912580 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.919451 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.919874 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:53.924278 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:53.924541  1674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.013s	sys 0.014s
W20260709 12:19:53.925086  1674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.013s	sys 0.014s
I20260709 12:19:53.927618  1579 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:53.928081  1264 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:53.928690  1264 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.930862  1264 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.937808 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.949832 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.962517 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.922598  1588 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:53.946156  1564 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:53.923435  1549 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:19:53.920117  1459 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:19:53.964808  1615 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:53.971076 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.971299  1459 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:53.971768  1459 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:53.971522  1615 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.972656  1459 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:53.973739  1615 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:53.974045  1459 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:53.974478 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.975562 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.976118 29320 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:53.976734 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.976816 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.978091 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.979490 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.945971  1671 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:19:53.969220 28750 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:53.980273 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:53.971884 29325 raft_consensus.cc:2368] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:53.982357  1549 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:53.982554 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:53.983297 29321 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:19:53.986235 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:53.984894 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:53.998569 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:53.894850  1409 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:53.963502  1315 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:54.037460 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:54.038448 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:54.045496 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:53.999930 28607 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:19:54.060853 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:54.061969 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:54.062618 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:54.109822 28755 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:54.110589 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:54.111749 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46318.7us
W20260709 12:19:54.109134 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45073.8us
I20260709 12:19:54.065902 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:54.120553 28607 pending_rounds.cc:85] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 7
I20260709 12:19:54.122357 28607 pending_rounds.cc:107] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:19:54.123425 28607 raft_consensus.cc:2889] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:54.126605 29317 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:54.130770 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:54.134171 28749 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:19:54.144236 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.144783 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:54.146113 28677 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:54.150399 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:19:54.158876 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.161629   944 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:54.165997 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.166846 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:54.178489 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.179054   944 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:54.179816 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 163135us
I20260709 12:19:54.186239   944 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:54.181833  1291 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.177517  1490 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:54.167467  1629 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:54.178552  1634 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:19:54.204466  1490 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:54.222985 28753 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:19:54.225871  1490 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:54.243558  1701 ts_tablet_manager.cc:933] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:54.210729  1291 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:54.255936  1695 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.289s	user 0.004s	sys 0.000s
W20260709 12:19:54.275566  1700 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:19:54.286384  1636 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:54.287011  1636 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:54.271483  1490 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.301798  1490 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:54.288187  1636 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.305421  1636 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:54.341576 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 145781us
W20260709 12:19:54.349591 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 179265us
W20260709 12:19:54.380234 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 196595us
I20260709 12:19:54.392125 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:54.393656 28682 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:54.412194 28682 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:19:54.432423 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:54.440557 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:54.469061  1490 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:54.470127  1490 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.475920  1490 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:54.476989 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:54.481463 28682 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:54.477031  1291 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:19:54.483841  1459 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 12:19:54.448572 28500 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 9 to 13, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 13 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.494052  1701 tablet_copy_client.cc:323] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.129:36607
I20260709 12:19:54.497426  1588 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:54.498150  1588 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:54.499567  1588 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:54.515228 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 50718us
I20260709 12:19:54.529870 28750 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:54.539999 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:54.541033 28678 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:54.543776  1409 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:54.553265 28500 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:54.530303 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.564777  1437 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:19:54.564801 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 102355us
I20260709 12:19:54.567389 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:54.565441  1437 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:54.572904  1437 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.584522 28682 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:19:54.597460 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:54.565127 28500 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 8 to 13, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 13 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:54.602458 28675 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:54.609823  1462 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:54.610643  1462 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:54.665645 29323 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:54.671600  1411 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.671993 29320 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:54.672300  1411 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:54.674822  1411 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:54.674945  1462 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:54.675844 29319 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:54.677112  1692 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:19:54.678627 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:54.679363 28677 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:54.681330 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:54.682272  1462 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:54.682683  1462 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:54.683036  1462 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:54.693895  1251 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:54.694453  1251 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.694563 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:54.694895  1251 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:54.701025  1716 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:54.701725  1716 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:54.719425  1315 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:54.645761  1304 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
W20260709 12:19:54.725340  1718 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:19:54.725016 28500 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 7 to 9, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 9 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.733389  1716 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:54.736692 28499 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 231) took 16446 ms (client timeout 15000 ms). Trace:
I20260709 12:19:54.736866 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:54.739801 28499 rpcz_store.cc:269] 0709 12:19:38.290319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:38.317130 (+ 26811us) service_pool.cc:224] Handling call
0709 12:19:54.736411 (+16419281us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:48.319863 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:48.320712 (+   849us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:48.320782 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:19:48.320808 (+    26us) tablet.cc:662] Decoding operations
0709 12:19:48.323583 (+  2775us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:48.323710 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:48.323753 (+    43us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:19:48.496103 (+172350us) tablet.cc:701] Row locks acquired
0709 12:19:48.496155 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:19:48.496327 (+   172us) write_op.cc:270] Start()
0709 12:19:48.502484 (+  6157us) write_op.cc:276] Timestamp: P: 1783599588496260 usec, L: 0
0709 12:19:48.503649 (+  1165us) op_driver.cc:348] REPLICATION: starting
0709 12:19:48.554397 (+ 50748us) log.cc:844] Serialized 10760 byte log entry
0709 12:19:49.158203 (+603806us) op_driver.cc:464] REPLICATION: finished
0709 12:19:50.009188 (+850985us) write_op.cc:301] APPLY: starting
0709 12:19:50.009320 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:51.300263 (+1290943us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:51.333567 (+ 33304us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:52.854716 (+1521149us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:52.855312 (+   596us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 12:19:52.855377 (+    65us) write_op.cc:312] APPLY: finished
0709 12:19:52.910450 (+ 55073us) log.cc:844] Serialized 236 byte log entry
0709 12:19:53.056477 (+146027us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:53.056800 (+   323us) write_op.cc:454] Released schema lock
0709 12:19:53.061361 (+  4561us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:53.064859 (+  3498us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:53.064890 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3669837,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":777074,"apply.run_cpu_time_us":65657,"apply.run_wall_time_us":3075636,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116717,"num_ops":27,"prepare.queue_time_us":40398,"prepare.run_cpu_time_us":45596,"prepare.run_wall_time_us":304912,"raft.queue_time_us":495685,"raft.run_cpu_time_us":23416,"raft.run_wall_time_us":499669,"replication_time_us":654341,"thread_start_us":781783,"threads_started":5,"wal-append.queue_time_us":376010,"wal-append.run_cpu_time_us":48290,"wal-append.run_wall_time_us":2215980}]]}
W20260709 12:19:54.738263 28603 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.014s
I20260709 12:19:54.732714 28500 catalog_manager.cc:5697] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 7 to 10, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 10 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:54.747596  1030 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:54.745051 28603 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
W20260709 12:19:54.737013 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 67314.2us
I20260709 12:19:54.746449 28500 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 8 to 9, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 9 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.762709  1568 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:19:54.772225 29323 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.774478  1634 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:54.774891  1634 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:54.748247  1030 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.777587 28500 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:54.779310  1030 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:54.780079 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:54.781330 28750 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:54.787426  1315 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:54.788110  1315 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:54.790472  1315 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:54.792111 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:54.775831  1634 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.792505 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:54.798179 28678 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:54.797559 29317 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:54.779997 28500 catalog_manager.cc:5697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 5 to 8, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 8 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.803994 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:54.804914 28752 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:19:54.805401 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 626809us
I20260709 12:19:54.805667  1625 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:19:54.806614 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.806954  1625 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:54.807374  1625 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:54.808305 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.793283  1636 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:19:54.816565  1315 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:54.821298 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:54.821834  1568 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:54.817751  1315 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.822594  1568 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.822805  1315 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.821964 29319 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:54.829725  1315 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:54.831110  1568 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:54.842624 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:54.848735  1315 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:54.849622 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.851222 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.851406  1315 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:54.823479  1625 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.834281 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:54.853070 28748 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:54.853348  1625 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:54.803368 28500 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:54.855347 28500 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:54.834872  1634 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:54.837059 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:54.860258  1030 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:19:54.837257 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.864589  1636 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:54.844326 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.852064  1716 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:54.865898  1636 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.874419  1030 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:54.874903  1030 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:54.875342  1030 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:54.877022  1490 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.877785  1490 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:54.880119  1490 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:54.792757  1462 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:54.880210 28603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:54.883023 28647 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.884776 28603 raft_consensus.cc:606] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.886895 28603 raft_consensus.cc:614] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:54.887382  1459 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:54.884889 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.881790  1251 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:54.888702  1640 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:54.896194 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:54.896922 28752 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:54.896958 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:54.899184 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:54.899783 28673 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:54.900919  1251 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:54.901437  1462 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:54.902813 28748 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:54.902876 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:54.906437 28500 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:19:54.911019 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:54.913825 28603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:54.914443 28603 raft_consensus.cc:606] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.914845 28603 raft_consensus.cc:614] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:54.915164 28673 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:54.921847 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.912140 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:54.923030 28675 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:54.922372 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:54.922102  1490 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:54.933704 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48968.4us
I20260709 12:19:54.926690 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.934700 28748 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:54.941387 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:54.943919 28750 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:54.926162  1251 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:54.927722  1462 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:54.953680  1462 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:54.954244  1315 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:54.954219  1692 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:54.954910  1315 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:54.953379 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.938374  1490 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:54.963064  1615 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:54.963295 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.964291  1615 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:54.964697 29317 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:19:54.965184 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.966106  1615 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:54.966807 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:54.967336  1615 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:54.967958  1615 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:54.959259  1315 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:54.970366  1264 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:54.971009  1615 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:54.971231 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:54.989185 28675 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
W20260709 12:19:54.991163 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:54.991384  1030 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:54.951421  1251 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:54.972886  1490 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:54.959745  1640 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:54.995399  1615 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:55.001494 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:55.009277 28750 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:54.954859  1462 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.000746  1030 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.003578 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:54.990120  1716 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:55.011581  1615 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.015503 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:55.015933  1581 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:55.019481 28573 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:54.908262 28500 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 7 to 8, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 8 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:54.995798  1251 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:55.024029 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:55.028750 28750 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:55.028566  1640 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.032021  1640 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.034987 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:55.032792 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:55.018292  1581 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:55.036746  1716 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:55.053413 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:55.056721  1581 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.058323  1291 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.059079  1291 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.060854  1568 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.061622  1291 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.061463  1568 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:55.064764 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 70948us
I20260709 12:19:55.066606 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:55.067438 29322 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:55.071264 28673 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:19:55.032377  1615 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:55.064656  1571 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.079638  1571 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.081118 28572 leader_election.cc:400] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:55.082304  1571 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:55.075886  1568 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.083272 28572 leader_election.cc:400] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:19:55.085583 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:55.085881 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:55.086854 28750 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:55.088387  1315 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.089668 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:55.090415  1264 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:55.091455 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:55.094720 28673 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:55.097584 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:55.093850 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:55.104993  1567 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:55.107369  1729 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:19:55.111045 28754 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:55.122650 29319 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
W20260709 12:19:55.126650 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.100634  1571 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:55.137549 28749 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:55.135175  1615 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:55.135296  1571 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:55.132498  1568 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.156670 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:55.179973  1730 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:19:55.180763  1579 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.144564  1315 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:55.193655  1243 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.194397  1571 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:55.148962  1459 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:55.163251  1615 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:55.199713  1579 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.202826  1615 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:55.211773  1568 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.192260  1251 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.229708  1568 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.220089  1243 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.229066 29327 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:55.235227  1490 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.239560  1716 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:55.258423  1571 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.262998  1571 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.262738  1615 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.268153  1030 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:55.268181  1549 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.268935  1030 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.269259  1549 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.271541  1549 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:55.271080  1030 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:55.274478  1615 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:55.483596 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 398097us
W20260709 12:19:55.486018 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 466577us
W20260709 12:19:55.488054 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:55.494943  1716 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.747596  1716 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.751088  1716 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.751799  1716 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:55.497008  1737 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:55.497503  1735 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:55.501344 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:55.753114 28601 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:55.753705  1716 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.754643 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:55.495990  1315 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:55.752918  1735 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.756258  1716 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.755802  1315 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.757085  1735 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:55.758054  1315 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.758543  1315 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.752871  1737 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:55.759087  1315 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.652320  1640 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:55.760950  1737 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:55.760740  1640 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:55.763106  1640 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:55.764338  1315 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:55.769524 28601 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:55.821390  1743 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.822285  1743 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:56.041126  1745 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.042109  1745 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.112990  1716 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.114025  1716 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.116747  1716 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.150861  1315 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.151686  1315 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.154503  1315 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.155229  1315 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.155912  1315 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.158560  1315 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.159338  1315 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.160019  1315 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.162539  1315 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.186231  1640 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.187078  1737 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.187312 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:56.199681  1742 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.308949  1640 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:56.309340  1742 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.311307  1640 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.308972  1737 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.222574  1746 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.312954  1746 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.313719  1737 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.264371  1745 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.279145  1743 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.304131 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1059) took 1278 ms. Trace:
I20260709 12:19:56.314523 28603 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:56.306133 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:56.305694 28500 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 9 to 11, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 11 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:56.315600 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:56.311306  1742 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.316176 28603 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.314730 28752 rpcz_store.cc:276] 0709 12:19:55.025930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.026107 (+   177us) service_pool.cc:224] Handling call
0709 12:19:55.028756 (+  2649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:55.029125 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:55.029154 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:55.030176 (+  1022us) log.cc:844] Serialized 508 byte log entry
0709 12:19:55.095355 (+ 65179us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:55.095399 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:55.095452 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:56.303834 (+1208382us) raft_consensus.cc:1685] finished
0709 12:19:56.303857 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.304032 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":64831,"threads_started":1,"wal-append.queue_time_us":157760,"wal-append.run_cpu_time_us":2247,"wal-append.run_wall_time_us":1002258}
I20260709 12:19:56.317646  1315 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:56.318624 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:56.315858 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 128635us
I20260709 12:19:56.315039  1746 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.316315  1742 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.321539  1742 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.323602  1742 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.323674 28603 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
W20260709 12:19:56.277776 28719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.000s	sys 0.010s
W20260709 12:19:56.324613 28719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.000s	sys 0.011s
I20260709 12:19:56.325048 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.326122  1743 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:56.327090  1742 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.327674  1742 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.332557  1742 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.332393 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.337502 28603 raft_consensus.cc:2376] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12. Re-sending same reply.
I20260709 12:19:56.338783 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.339972 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.343021  1742 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:56.336284 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08002af5c0 after lost signal to thread 27446
W20260709 12:19:56.344866 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080027ace0 after lost signal to thread 27449
I20260709 12:19:56.344244  1743 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:56.345317 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.345986  1743 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.349812  1030 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.352994  1030 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.356833  1030 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.350330  1571 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.344136  1409 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.350615  1742 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.335426  1549 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.362088  1571 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:56.362856  1549 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.362792  1409 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.364490  1571 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.365154  1549 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.343024  1411 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.360858  1748 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.365906  1411 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.366099  1409 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.366004  1748 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.368172  1411 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.369450  1748 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.370159  1742 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.350030 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.374740 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.376868 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.387859  1629 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.391111  1629 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.393615  1629 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.389240 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.394377 28604 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:19:56.395818 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.396633 28604 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:56.398699  1411 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.403650  1411 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.407305  1411 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:56.400604 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.266s	user 0.012s	sys 0.036s
I20260709 12:19:56.401005  1549 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:56.408099 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.012s	sys 0.037s
W20260709 12:19:56.408408 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 1.27482e+06us
I20260709 12:19:56.408299  1549 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.410431  1549 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.401755  1571 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.411064  1571 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.412595  1742 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.413141  1742 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.415174  1742 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.415908  1438 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.402403  1409 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.421751 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.416414  1438 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.417511  1409 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.424129  1409 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.424997  1438 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.418702  1738 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.428200  1438 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.428313  1738 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.428817  1438 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.430505  1738 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.430941  1438 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.426548 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:56.418313  1571 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.421497 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.432283  1571 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:56.432691 28604 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:56.432847  1571 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:56.433784 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.433983 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.424762  1739 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:56.435072  1739 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.435243  1748 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:56.435603  1739 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:56.436276  1629 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.436863  1629 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.437880 29327 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:56.435940  1579 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.435083 28604 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:56.440588 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.440009  1571 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.441682  1579 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:56.442075  1579 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.442400  1579 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:56.446167 28678 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:56.451413  1030 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.451985  1030 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.453922  1030 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.454954 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.439000  1629 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.464367 28598 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:56.468015 28600 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:19:56.468946 28598 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:56.459187  1738 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.435827  1748 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.471488  1748 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:56.471146  1738 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.459486  1438 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.465083  1751 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.474561 28604 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:19:56.461238  1629 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.480568 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.490533 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.490533 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.491786 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:56.492605 28603 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.493386 28604 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:56.497941 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.344164  1749 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.496389 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.500067  1030 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.498551 29317 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:56.500721  1030 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.487423  1459 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.520196 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.521600 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:56.473150  1438 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.526435 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.509341  1745 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:56.523298 28722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.622s (SENT) [suppressed 25 similar messages]
I20260709 12:19:56.528999 29317 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:56.524022 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.530822 28617 tablet_copy_service.cc:140] P e3ce74ba14714b4dbd2d75e27f34eb0d: Received BeginTabletCopySession request for tablet e5bdaade8df945828ab371a3267cd752 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:39434)
I20260709 12:19:56.530908  1745 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.531564  1579 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.532684 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.491417  1629 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.536698 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.536899  1745 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.537115  1438 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.519654  1749 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.538003 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.538652 28606 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:19:56.539673 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.539861  1749 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.539975 28600 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:56.515813  1409 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.545357 29323 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:56.531622 28617 tablet_copy_service.cc:161] P e3ce74ba14714b4dbd2d75e27f34eb0d: Beginning new tablet copy session on tablet e5bdaade8df945828ab371a3267cd752 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:39434: session id = 5b3b2f4041a24b05983f30878f16db9d-e5bdaade8df945828ab371a3267cd752
I20260709 12:19:56.522689  1291 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:56.537839  1745 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.518471  1743 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.554265 28599 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:56.525765  1549 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.557054 28604 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:56.560200  1030 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.560532 29327 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:19:56.487892  1751 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.565063 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.565714  1751 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.566186  1579 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.555016  1291 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.567271  1291 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.568608  1549 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.570941  1549 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.570986 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2807) took 1070 ms. Trace:
I20260709 12:19:56.553591  1739 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.571605 28605 rpcz_store.cc:276] 0709 12:19:55.500274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.569868 (+1069594us) service_pool.cc:224] Handling call
0709 12:19:56.570234 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.570520 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.570547 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:56.570589 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:56.570644 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.570699 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.570822 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:56.540881  1409 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.573508  1739 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.553776  1459 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.574499  1409 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.562740  1757 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.576785  1757 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.577479  1490 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.563405  1759 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.571195 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2806) took 1071 ms. Trace:
I20260709 12:19:56.578958  1757 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.578717  1759 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.579808  1738 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.581007  1752 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.581280  1759 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.581583  1752 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.574229  1243 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.578717  1629 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.583994  1752 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.584550  1629 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.600612 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.579345 28607 rpcz_store.cc:276] 0709 12:19:55.499963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.570221 (+1070258us) service_pool.cc:224] Handling call
0709 12:19:56.570575 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.570749 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.570771 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:56.570824 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:56.570854 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.570921 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.571028 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:56.589042 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.613775 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.613746 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.615479 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.584769  1756 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.586881 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.559623  1749 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.599725 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2863) took 1501 ms. Trace:
I20260709 12:19:56.597867 28678 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:56.561590 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.585860 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:56.589308 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.586666 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.618760 29317 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:56.588411 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.620620 28682 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:56.587550 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.597797  1251 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.591828 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2809) took 1090 ms. Trace:
I20260709 12:19:56.586135 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:56.607719 28603 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:19:56.612102 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:56.615841  1634 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.590183  1742 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.620335 28677 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:56.621435 28601 rpcz_store.cc:276] 0709 12:19:55.501036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.754311 (+253275us) service_pool.cc:224] Handling call
0709 12:19:56.591675 (+837364us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5400216454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:56.591771 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32277376}
I20260709 12:19:56.618016 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.619378 28674 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:19:56.612222  1490 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.612871 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.618463 28756 rpcz_store.cc:276] 0709 12:19:55.098340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.140683 (+ 42343us) service_pool.cc:224] Handling call
0709 12:19:56.598978 (+1458295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.599199 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.599237 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:56.599289 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:56.599332 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.599401 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.599525 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:56.625319 29323 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:19:56.621377 28681 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:19:56.624778 29322 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:56.620827 28679 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:19:56.624478 28676 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:19:56.561017  1743 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.628198  1459 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.628053  1634 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.620337  1756 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.630043  1743 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.630411  1634 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.630859 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.631042 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.631211  1756 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.558996  1745 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.631652 28603 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:56.632642 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.631577 28682 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:56.632325  1438 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.637228  1438 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.618873  1629 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.642779 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.616753  1763 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.640724 28607 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:19:56.626066  1759 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.671170  1759 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.672715 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.673241 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.673394 28750 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:56.673591  1759 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.674183 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.639482  1490 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.645444  1459 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:56.675233  1745 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.674997  1459 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.675731  1756 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:56.676326  1490 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.677901 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.678579 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.679153 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.679359  1615 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:56.679715 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.680517 28747 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:19:56.647087 29320 raft_consensus.cc:2410] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:19:56.681087  1459 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.647898  1409 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.681304  1291 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:56.681892  1409 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.682130  1746 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:56.683292 28571 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.683949  1291 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.684139  1737 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:56.648612  1625 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:56.684635  1737 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.685081  1737 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:56.652349 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.653138  1743 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.686223  1743 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.684423  1409 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.678229 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.653753 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.688455 28756 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:56.654810  1739 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.688925 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.689435  1743 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.689787 28753 raft_consensus.cc:2410] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:19:56.689363  1739 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.691075 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.691804 28753 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:56.691936  1739 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.657160  1571 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:56.658051 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:56.693291 28749 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:19:56.678244  1462 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:56.694289  1462 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.694687  1462 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:56.695052  1625 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:56.695513  1625 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.695849 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:56.696664 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.662055 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.623718  1749 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.697042 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.697693 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.698274 28678 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:56.698550  1459 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:56.698889  1752 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:56.699405  1752 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.699826  1752 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:56.700800  1749 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.646204  1629 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.663872 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:56.640205  1634 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:56.701761  1748 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.702265  1634 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.704020 28754 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:56.704393  1634 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:19:56.666580 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.700832 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.701879 28681 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:56.669044 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.706624 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2800) took 1208 ms. Trace:
I20260709 12:19:56.707050 28673 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:56.707168 28602 rpcz_store.cc:276] 0709 12:19:55.497946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.705699 (+1207753us) service_pool.cc:224] Handling call
0709 12:19:56.706020 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.706186 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:56.706211 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:56.706279 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:56.706313 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.706365 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:56.706462 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:56.708052 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.663089 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.708762 28674 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:19:56.625928  1742 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.709182 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.679850  1615 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.710228  1615 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:56.686815 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.710732  1742 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.703764 28648 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.688768 28682 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:19:56.706666 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.695909  1625 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:56.713526  1409 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:56.705667  1567 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:56.715566 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.745434 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.745827 29318 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:19:56.718019  1756 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.748859 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.716231 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.715405 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.660725 28675 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:56.717048 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.667577 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.714123 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.757020 28756 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:56.722317  1636 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:56.724161 28570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.686s	user 0.022s	sys 0.063s
I20260709 12:19:56.724586  1759 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.726194  1629 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.727190 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:56.777158 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 50080.7us
I20260709 12:19:56.705703 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:56.777312 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.777761 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.732527 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.733103 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:56.731370 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080029dc80 after lost signal to thread 28539
I20260709 12:19:56.778604 28748 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.736322 28747 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:56.737737 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.670313 28617 tablet_copy_source_session.cc:215] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:56.704398  1748 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.699148 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:56.769670 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 246353us
W20260709 12:19:56.770712 28570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.734s	user 0.022s	sys 0.063s
I20260709 12:19:56.773897 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.790580 28673 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:56.775309 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.791544 28679 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 10.
I20260709 12:19:56.777930 28677 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.732122 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:56.780081 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080029e740 after lost signal to thread 28631
I20260709 12:19:56.792893 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:56.793538 28604 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:56.779488 28681 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:19:56.740097 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:56.781080 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.782364 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.783716 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.784673 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1133) took 1726 ms. Trace:
W20260709 12:19:56.793984 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080029e120 after lost signal to thread 28706
W20260709 12:19:56.795666 28777 debug-util.cc:398] Leaking SignalData structure 0x7b080029e0e0 after lost signal to thread 28707
W20260709 12:19:56.797462 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08003391c0 after lost signal to thread 28780
W20260709 12:19:56.797780 28777 debug-util.cc:398] Leaking SignalData structure 0x7b0800271800 after lost signal to thread 28781
W20260709 12:19:56.798964 28777 debug-util.cc:398] Leaking SignalData structure 0x7b0800052c20 after lost signal to thread 29351
W20260709 12:19:56.799302 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08002754c0 after lost signal to thread 29352
I20260709 12:19:56.747013  1409 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.745107  1567 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:56.792856 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60803.6us
I20260709 12:19:56.795526 28675 rpcz_store.cc:276] 0709 12:19:55.050862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.051026 (+   164us) service_pool.cc:224] Handling call
0709 12:19:55.051356 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:56.752855 (+1701499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:56.776706 (+ 23851us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54000c7954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:56.776881 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3700170624}
I20260709 12:19:56.795982 28754 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:19:56.801717 28777 debug-util.cc:398] Leaking SignalData structure 0x7b08003873a0 after lost signal to thread 1701
I20260709 12:19:56.728281  1615 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.803221 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.809569 28599 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:56.804309 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.809574 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.805382 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.808084 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.808269 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.808925 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:56.812026 28606 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:56.810994 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.814747 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.815726 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:56.816308 28603 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:56.781157  1746 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:56.814914 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.821929 28607 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:56.811864  1764 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.822978 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.822871  1764 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.819309  1748 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.825479 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:56.825928  1748 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.803709  1459 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:56.828056  1459 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.828389  1459 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.830551 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:56.832821 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:56.833550  1438 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.835860  1615 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.839066  1462 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.824112 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.817643 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:56.842516 29326 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:56.817842 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.832881 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.817217 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.822043 28617 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:39434 (request call id 961) took 1051 ms. Trace:
I20260709 12:19:56.815332 29321 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:56.843976 28599 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19.
I20260709 12:19:56.803272  1409 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.806638  1567 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.842089 28598 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:19:56.843755 29320 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:56.821113 28602 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:56.842617 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.768703  1756 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.847155 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.853994 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.781083  1636 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.854357 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.784776  1759 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.840767  1764 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:56.869379 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.840638  1753 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:56.862412 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.872614 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.820389  1746 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.851064  1640 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.677510  1763 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.867069 28603 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:56.870097 28755 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:56.855312  1291 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:56.871290 28604 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:56.877817 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.876039 29319 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:56.873227 29321 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:56.812356  1634 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:19:56.874444 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.873248 29318 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:56.800534  1629 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.845036 28617 rpcz_store.cc:276] 0709 12:19:55.771016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.523826 (+752810us) service_pool.cc:224] Handling call
0709 12:19:56.821927 (+298101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:19:56.876737 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.874934  1751 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:56.876992  1764 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:56.865590  1549 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:19:56.884845 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 298774us
I20260709 12:19:56.886420 29323 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:56.887123 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.875180 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.874490  1753 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.876748  1746 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.895294 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:56.897482 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:56.884578  1291 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.887874  1751 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.903992 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:56.904208 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 97491.1us
I20260709 12:19:56.904740 29323 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:56.903029 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.900823 28722 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19.
I20260709 12:19:56.905565 28722 leader_election.cc:403] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:56.916538  1490 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:19:56.892385  1549 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.892573  1764 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.922349 28677 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:56.922989 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.925853 29326 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:56.924966 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:56.927955 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:56.880362  1640 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.904049  1291 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:56.930491 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:56.902843  1588 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:56.920779 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.953341 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:56.896611  1753 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:56.932039 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:56.920771  1564 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:56.961923  1767 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.962479  1767 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.933290  1549 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:56.938675  1764 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:56.951272 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:56.956736 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.907758  1751 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.960333 28755 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:56.933024  1462 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:56.938488  1571 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.950114 28675 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:19:56.972779 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.973856 28750 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:56.960074  1742 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:56.953729  1588 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:56.977954 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:56.961089  1564 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:56.983647  1490 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19.
I20260709 12:19:56.989444 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.991127  1564 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:56.991998 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.992691 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.993216 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.989837  1625 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:56.990290 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.994238 28750 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:56.995519 28679 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:56.997041 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.997377  1625 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:56.997823 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:56.998732 28752 raft_consensus.cc:1813] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Handling vote request from an unknown peer a8342e3fcab94ce89482df67988159ea
I20260709 12:19:56.999315 28752 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:19:56.997633 28753 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:57.000013  1315 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.000803  1315 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:57.001271  1315 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:57.002156  1315 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:56.998752 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:57.012478 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.013504  1636 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:57.016619 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 106424us
I20260709 12:19:56.970973  1634 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:57.029783 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.030747  1749 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.036633  1772 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:57.075707 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:57.037570  1768 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:19:57.040658 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 85079.6us
I20260709 12:19:57.035660  1564 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:57.083484 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 132096us
W20260709 12:19:57.074133 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44489.4us
I20260709 12:19:56.979535  1251 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:57.077399 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:57.076548 28755 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:19:57.014493  1588 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:57.092587 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.073900 28748 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:19:57.025488  1742 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:57.090324 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.090847 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.075186  1490 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:56.978718  1571 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.107141 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.111486 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.113490 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.114104 28604 raft_consensus.cc:2376] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13. Re-sending same reply.
I20260709 12:19:57.116101 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:57.114929  1745 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.118389  1749 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:57.118836  1749 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:57.119279  1749 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:57.118569 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.107293  1759 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:57.107872  1634 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:57.109534  1251 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:57.124073 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.107401  1767 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.124203 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:57.127884 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 90436.6us
I20260709 12:19:57.125167  1629 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:57.128934 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.129539 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:57.131170 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.131870  1771 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.136847 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.136907 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.137722 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:19:57.152592 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 65465.6us
I20260709 12:19:57.138419 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:57.120684  1243 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:19:57.145390 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 222961us
I20260709 12:19:57.140333  1567 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.146065  1459 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:57.197600 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47448.1us
I20260709 12:19:57.201471  1772 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:57.188818 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.200585  1742 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.199150  1564 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:57.188102  1737 consensus_meta.cc:287] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 12:19:57.152024 28673 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:57.175611  1251 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.232754 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.139778  1763 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:57.189188  1774 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 12:19:57.123437  1776 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:57.222034 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:57.253613 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:57.223125 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 70808.9us
I20260709 12:19:57.229560 28606 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:57.191272 28675 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:57.241101  1634 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.243911  1571 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:57.245133 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 56437.4us
I20260709 12:19:57.256615 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:57.221737  1243 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.260036 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:57.261684 28673 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:57.262140 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:57.264338  1739 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.023s	sys 0.073s
I20260709 12:19:57.233949  1772 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:57.149444  1746 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:57.225178  1549 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.256189  1625 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.271780 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:57.298727 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.252940  1776 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:57.299431 28606 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:57.264778  1739 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.023s	sys 0.073s
I20260709 12:19:57.303690 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.301455 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.258633  1629 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.258770  1763 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:57.267601  1767 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:57.304808 29322 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:57.306238 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:57.306767 29321 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:57.267670  1264 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:57.265345  1243 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:57.237839  1291 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.249116  1737 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.268533  1772 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:57.257603  1409 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.340806  1756 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.342010  1409 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.303815  1776 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:57.298816  1759 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:19:57.324263  1781 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:57.324972  1748 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.333243  1459 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.329054  1779 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.329389 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.330231  1778 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:19:57.361812 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.335091 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.305856  1767 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:57.314260 28601 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:57.307624  1629 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:57.327267  1751 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:19:57.355789 28606 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:19:57.305753  1763 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:57.359236 28598 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:57.334486 28756 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
W20260709 12:19:57.343783  1752 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.004s
I20260709 12:19:57.362066  1778 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.367376 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.369102 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:57.371178 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.337884  1264 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:57.374768  1030 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:57.379148 28600 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:57.381223 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.383033 28678 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:57.381800 29320 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:19:57.382138 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.384675  1030 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.385334 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.385898 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.386420 29322 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:19:57.369685  1767 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.387545  1745 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:57.370095  1629 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.397516 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.389058  1549 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.391244  1780 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.397603  1751 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.397491  1749 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.398259  1756 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:57.375730  1748 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:57.373770  1778 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:57.438848 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 79969.4us
I20260709 12:19:57.369720  1763 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.400664 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.374059  1409 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.368819  1752 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.405489 28605 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:57.406422 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:57.367841  1781 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.442936  1567 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.438658  1462 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:57.407397  1764 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:57.450425 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49867.9us
I20260709 12:19:57.380394  1459 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 12:19:57.477023 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 70608.3us
I20260709 12:19:57.480057 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.462924 29321 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:19:57.405889  1743 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:57.485648 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:57.499204 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:57.493085  1790 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:19:57.486218  1753 consensus_meta.cc:287] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 12:19:57.440034  1748 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:57.396329  1588 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.484087  1490 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:57.483206  1549 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:19:57.496567  1764 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.465291  1779 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.508174 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.507681 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.518688 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:57.519493 28755 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.511955 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.520876 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:57.522899 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.523375 28607 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.523919  1742 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:19:57.528877 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45078.8us
I20260709 12:19:57.530470  1772 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.524055  1549 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.533730  1549 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:57.520587  1264 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.536991  1756 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:57.538494  1756 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:57.542594  1749 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.544571  1746 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.516029  1462 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.545665  1748 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.546600  1462 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.527117  1779 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:57.509892  1411 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:57.552835 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:19:57.553172  1791 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:19:57.553910 29326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:41278
I20260709 12:19:57.554153 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.554512 29326 raft_consensus.cc:606] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:57.554778 28598 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:19:57.555230 28606 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:57.555979 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.556972 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.522662  1753 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.524889 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:57.560850 28600 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:57.544129  1752 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.555497 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.563906 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.565821 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.568859 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.590478 28601 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:19:57.592998 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:57.511974  1743 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:57.518101  1409 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:57.593756 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.593855 29319 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:57.594515 28751 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:57.592128 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.548290  1779 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.599157 28602 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.595309 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.599614 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:57.603123 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.603868 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.604676 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.600665 28606 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:57.610852 29322 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
W20260709 12:19:57.614701 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52986.8us
I20260709 12:19:57.617194 29326 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:57.617552 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:57.625339 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 61554.4us
I20260709 12:19:57.626132 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:57.624951 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 59862.2us
I20260709 12:19:57.637650 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.638856 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.639850 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.628556  1490 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:19:57.641050  1701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bdaade8df945828ab371a3267cd752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:57.640990 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.643908 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:57.644217 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.646355 28678 raft_consensus.cc:2368] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
W20260709 12:19:57.648886 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 120702us
I20260709 12:19:57.650126 28598 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:19:57.651875 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.655121 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:57.655395 28598 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:19:57.655886 28675 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:57.658514 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.659324  1030 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.660758 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:57.594998  1759 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:57.602373  1743 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:57.663170 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.663101 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.602326  1411 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:57.668506 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:57.671267 29323 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:57.672390 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.663775 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.568089  1746 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 12:19:57.676348 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.632279  1409 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:57.677121 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:57.677901 28598 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:57.645488  1745 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:57.662968  1251 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.683283 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.631956  1772 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.685287 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.686934  1588 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:57.692708  1756 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:57.607077  1243 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.710078 29319 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:19:57.696095 28601 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:57.697388 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.713543 29319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdf685c3207841c286a253af2d105972"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:41278
I20260709 12:19:57.714280 29319 raft_consensus.cc:606] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:57.708283 29323 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:57.666415  1549 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.725342 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:57.646147  1763 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:57.731482 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48278.2us
I20260709 12:19:57.680089  1291 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:57.727169 28571 leader_election.cc:400] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:57.732717 28571 leader_election.cc:403] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:19:57.681047  1462 raft_consensus.cc:2764] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:19:57.728736 28678 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:57.730278 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.695398  1567 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:57.733383 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 67549.3us
I20260709 12:19:57.701895  1264 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.702373  1742 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.743139 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.673113  1759 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.733378 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.757841  1411 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.759653  1549 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.759892  1803 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:19:57.761277  1640 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:57.762043  1640 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.731700  1615 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:57.764390  1640 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:57.764735  1615 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:57.765206  1615 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:57.768064  1802 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:19:57.771775 28598 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:19:57.779067 28755 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:57.730773  1737 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.743716  1764 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:57.741035  1571 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:57.736850  1808 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:57.791432 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 58122.4us
I20260709 12:19:57.797968 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.747237  1772 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:57.729326  1581 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:19:57.740458  1264 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:19:57.791108 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44351.8us
I20260709 12:19:57.793372  1764 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:57.747082  1742 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:19:57.803836 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.804718 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.763985  1629 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:57.798980  1739 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:57.811691 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:57.819043 28753 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:57.812366 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:19:57.812367 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:57.795857 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 52790.9us
I20260709 12:19:57.820753 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.820282 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:57.822213 29323 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:57.802354  1773 raft_consensus.cc:993] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:57.797609  1808 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:57.826047 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.807946  1264 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.807399  1291 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:57.867036 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.868000 28598 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:57.827167 28748 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:57.838166 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.827992 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.829296 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.815158  1772 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:57.796665  1409 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:57.870163 29319 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:19:57.949724 28679 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:19:57.902720 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.877718 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.822613  1251 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.815795  1764 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:58.000175 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:58.001123 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.897704 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:57.902948  1030 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.002991  1030 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.003336 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:57.905643 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:57.894842 28607 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:19:58.004877 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:57.903736 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.913573 28605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37386
I20260709 12:19:58.005992 28605 raft_consensus.cc:606] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:19:58.006476 28605 raft_consensus.cc:614] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:57.950326 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.904095 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.903376 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.991434 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:57.861315  1490 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.889065  1782 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.988970 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:58.014830 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.814465  1742 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:58.009534 28682 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:58.016171 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:19:57.914995  1776 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 12:19:58.023938 28606 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:19:57.818866  1739 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:58.012238 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:58.018468 29317 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:58.019562 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.864238  1808 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.897962  1797 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:57.896405  1745 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:58.021836 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:58.009387  1315 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:57.906087  1763 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:57.898511  1749 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:57.977814  1625 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:58.036090  1549 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:58.043483 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:57.985737  1251 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:57.866137  1753 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:58.033697  1780 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:19:58.055202  1817 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:19:57.910072  1756 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 4 to 10, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:58.055980  1813 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:19:58.057128  1805 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 12:19:58.058100  1809 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:19:57.824563  1767 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.055238  1797 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:58.052558  1745 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:58.069710 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:58.072284 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:58.072458  1814 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:58.075270 28674 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:58.075678 28602 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:19:58.076140  1030 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.140479  1291 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:58.141783  1549 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:58.141733  1291 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.142829  1549 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:58.144764 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 273119us
W20260709 12:19:58.146140 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 154816us
W20260709 12:19:58.148555 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 74070.1us
I20260709 12:19:58.149897 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.153008 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.154158  1762 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:58.156697 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.157004 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.157160 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.157852 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:58.158601 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.159310 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.042164  1739 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:58.076813  1749 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:58.161338 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.161665  1749 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.162744  1749 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:58.163247 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.164191 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:58.105407 28605 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:58.164921 28748 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:58.165071 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.165428 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:58.166158 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.166728 28605 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:58.167411 28754 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:58.167867 28605 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:58.044515  1243 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:58.122884 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:58.169397 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:58.170133 28677 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:58.041446  1776 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.170253 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:58.170923 29317 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:58.172084  1776 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:58.108242  1251 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:58.166730 28748 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:19:58.175490 28599 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:58.176360 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.137691 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:58.179320 29317 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:58.181347 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:58.181545 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.138115 28606 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:19:58.159230  1771 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:58.184659 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:58.181977 29323 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:58.185947 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:58.196921 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.198789 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:58.199774 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.042884 28598 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:58.195093  1251 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.206318 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.207278 28748 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:58.209529 29327 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:58.209980 29327 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:58.210922 29327 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.212056 29327 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:58.213585 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:58.214432 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.223105 28754 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:58.224890 29321 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:58.228777 28754 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 4 to 10, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:58.236455 29323 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:58.122773  1579 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:58.252627 29326 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:58.103828  1625 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.418923 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:58.252506 28753 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:19:58.251828  1759 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:19:58.262320  1809 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 12:19:58.268656  1790 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:19:58.426447  1579 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.139457  1629 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:58.427906  1629 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:58.139106  1745 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:58.429167  1579 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:58.429885 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2829) took 1535 ms. Trace:
I20260709 12:19:58.250484  1813 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.122694  1779 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.433274  1625 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.433966  1779 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:58.139792  1772 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.435868  1792 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:58.257046  1815 raft_consensus.cc:1081] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:19:58.112344  1763 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.139s
I20260709 12:19:58.260941  1797 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.256637  1819 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:58.379429 29327 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:19:58.390367  1264 consensus_meta.cc:287] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.519s	user 0.015s	sys 0.019s
I20260709 12:19:58.392860  1767 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:58.397786  1782 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:58.398425  1810 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:19:58.407116 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.226819  1251 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:19:58.415611 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.405807 28648 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:58.426433 28750 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:58.430276 28603 rpcz_store.cc:276] 0709 12:19:56.895972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.955181 (+ 59209us) service_pool.cc:224] Handling call
0709 12:19:56.955645 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:56.969096 (+ 13451us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:19:57.342769 (+373673us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b180048ea40. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:19:57.592216 (+249447us) log.cc:844] Serialized 14 byte log entry
0709 12:19:57.805850 (+213634us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.810641 (+  4791us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.810771 (+   130us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:57.822649 (+ 11878us) log.cc:844] Serialized 14 byte log entry
0709 12:19:57.823010 (+   361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.823086 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:57.912053 (+ 88967us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b180048ea40. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:58.429638 (+517585us) raft_consensus.cc:1685] finished
0709 12:19:58.429660 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.429788 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48641,"prepare.queue_time_us":459621,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":32042,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":35955,"spinlock_wait_cycles":11522176,"thread_start_us":384771,"threads_started":3,"wal-append.queue_time_us":168757}
I20260709 12:19:58.473129 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:58.474514 28603 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:58.434262 28673 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.437948 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:58.401517  1743 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.001s
W20260709 12:19:58.439497 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 312321us
W20260709 12:19:58.392314  1615 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.000s
I20260709 12:19:58.436460  1792 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.445973  1629 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:58.460345  1264 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.465492  1813 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.468804 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.481002 28753 raft_consensus.cc:2368] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:19:58.436609  1808 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.482026  1264 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.482717 28756 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.483475 28606 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:58.451761  1778 consensus_meta.cc:287] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.001s	user 0.006s	sys 0.010s
I20260709 12:19:58.476459 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:58.486316 28752 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:19:58.488562 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 82790.1us
I20260709 12:19:58.511786 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:19:58.544984 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56651.5us
I20260709 12:19:58.471182  1737 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:58.471033  1810 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:58.476198  1746 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:58.454298  1817 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:19:58.557879 28603 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:19:58.554952 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 374111us
I20260709 12:19:58.544301  1751 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:58.549880  1251 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:58.582350 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.554039  1264 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:58.587540 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:58.557010  1773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.033s	sys 0.062s
I20260709 12:19:58.480998  1615 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.609782 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:58.492313  1743 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.613554 28602 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:58.614492 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:58.615108 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.618228 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:19:58.616940 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.476426  1782 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.561086  1737 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.628623  1777 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:19:58.629855 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.603540  1634 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:19:58.636566 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:58.633188 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:58.606709  1773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.034s	sys 0.062s
I20260709 12:19:58.639180 28753 raft_consensus.cc:2368] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:58.644730 28605 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:58.559955  1778 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.608560  1751 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:58.612155  1804 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:58.696332 28602 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:58.622220  1264 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:58.618649  1251 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:58.679934 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 55740.3us
W20260709 12:19:58.681066 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71394.2us
I20260709 12:19:58.709225 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:58.583248  1745 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.731350 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:58.737690  1251 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.633620  1779 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:58.634260  1772 raft_consensus.cc:2764] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:19:58.742462 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2852) took 1082 ms. Trace:
I20260709 12:19:58.604763  1815 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 12:19:58.697115  1459 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:58.752202 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:19:58.753101 28754 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.005s
I20260709 12:19:58.755554 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.755702 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:58.707659  1841 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:19:58.636538  1777 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:58.759670 28679 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:19:58.762818 28573 leader_election.cc:400] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:19:58.764541  1814 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:58.768705 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:58.756188  1764 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.002s
W20260709 12:19:58.756457  1742 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.716s	user 0.007s	sys 0.005s
W20260709 12:19:58.775353 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44052.6us
I20260709 12:19:58.768759 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:58.758718 28673 rpcz_store.cc:276] 0709 12:19:57.660386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.663409 (+  3023us) service_pool.cc:224] Handling call
0709 12:19:57.677091 (+ 13682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.475398 (+798307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.742245 (+266847us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400299d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:58.742404 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740854144}
I20260709 12:19:58.776841 28750 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:58.784282 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:58.774693 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.775905 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:58.791981 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:58.792078 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:58.793303 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:19:58.794329  1833 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:19:58.794387 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:58.797960  1825 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:19:58.636229  1810 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.759902  1753 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:19:58.799988  1751 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.800865  1813 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:58.801221  1813 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:58.801972  1813 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.803077  1813 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:58.804289  1778 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.804774  1835 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:58.805509  1835 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:58.773128  1739 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.600s	user 0.003s	sys 0.009s
I20260709 12:19:58.806430  1739 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.807163  1745 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.756795  1752 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:58.808108  1752 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.790143  1742 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.805549  1781 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.811285 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:58.811188 28753 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.819056 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:58.811991 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:58.822304  1030 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:58.799835 28752 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:19:58.822817  1030 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.824113  1792 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.794397  1264 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.790220  1764 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.829690 28752 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.772401  1834 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:58.784818  1777 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:58.842177 28598 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:58.847870 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:58.784953  1409 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:58.848588 28602 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:19:58.850168 28573 leader_election.cc:400] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:19:58.855850 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:19:58.808427  1739 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.808717  1815 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:58.858260  1841 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:58.860105  1778 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:19:58.863166  1838 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:19:58.864568  1844 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:19:58.864928 28751 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:19:58.865449 28752 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:58.858485  1834 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.866696 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2531) took 1306 ms. Trace:
I20260709 12:19:58.858986  1030 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:58.813485  1629 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 12:19:58.888774 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.893177 28602 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:58.856170  1792 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:19:58.894955  1837 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:19:58.896788 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 976) took 1007 ms. Trace:
I20260709 12:19:58.888621 28604 rpcz_store.cc:276] 0709 12:19:57.560604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.594049 (+ 33445us) service_pool.cc:224] Handling call
0709 12:19:57.594359 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:57.594717 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.594745 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:58.400648 (+805903us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b2c00058028. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:19:58.401228 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 12:19:58.610014 (+208786us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:58.770103 (+160089us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.770415 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.770484 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.866390 (+ 95906us) raft_consensus.cc:1685] finished
0709 12:19:58.866482 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.866638 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2112,"prepare.queue_time_us":249452,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":210,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":21514,"spinlock_wait_cycles":2470144,"thread_start_us":312573,"threads_started":2,"wal-append.queue_time_us":458913}
W20260709 12:19:58.898751 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 114548us
I20260709 12:19:58.899521 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.901777 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.903067 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:58.856369  1579 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:19:58.838757  1745 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:19:58.911381 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:58.897241 28600 rpcz_store.cc:276] 0709 12:19:57.891522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.944346 (+ 52824us) service_pool.cc:224] Handling call
0709 12:19:57.998675 (+ 54329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.999614 (+   939us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:19:58.023089 (+ 23475us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.335516 (+312427us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b180031bd00. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:58.424524 (+ 89008us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:58.475077 (+ 50553us) log.cc:844] Serialized 26 byte log entry
0709 12:19:58.475217 (+   140us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:58.475458 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 12:19:58.475709 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.475789 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:58.896583 (+420794us) raft_consensus.cc:1685] finished
0709 12:19:58.896604 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:58.896735 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":529,"prepare.queue_time_us":23711,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":16950,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":18546,"spinlock_wait_cycles":16336384,"thread_start_us":315590,"threads_started":1,"wal-append.queue_time_us":525135}
I20260709 12:19:58.878739  1778 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:58.930353 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:58.931522 28603 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:58.932058 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:19:58.910584  1797 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:58.908656  1781 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:58.876500  1291 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:19:58.910121  1571 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:58.908826  1839 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:58.942344 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.910526  1411 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:19:58.917063  1779 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:19:58.929984  1615 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.951547 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:58.935590  1782 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.935464  1743 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:58.937566  1797 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:58.938277  1834 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:58.939047  1737 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:58.962548 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:58.952348  1742 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:58.952597  1830 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:58.965750  1797 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:58.974152 28603 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:58.974809 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:58.967315  1842 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:19:58.957911  1778 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.964421  1815 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:58.956380  1756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53096 (request call id 10) took 4193 ms. Trace:
W20260709 12:19:58.982270 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 189022us
I20260709 12:19:58.985617  1779 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:58.988756 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:19:58.985857 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.977898  1737 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.994318  1779 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:58.995149  1737 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:58.997306  1737 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:59.004992  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39262 (request call id 1146) took 5112 ms. Trace:
I20260709 12:19:59.007507  1815 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.005980  1701 rpcz_store.cc:276] 0709 12:19:53.892913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.893279 (+   366us) service_pool.cc:224] Handling call
0709 12:19:54.243960 (+350681us) ts_tablet_manager.cc:934] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
0709 12:19:57.639592 (+3395632us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:58.838100 (+1198508us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:58.856493 (+ 18393us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:59.003575 (+147082us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:59.004066 (+   491us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:59.004662 (+   596us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:59.004849 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":651,"tablet-copy.queue_time_us":349660,"thread_start_us":483080,"threads_started":2}
I20260709 12:19:59.009485 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2846) took 1014 ms. Trace:
I20260709 12:19:59.010174 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.011381  1773 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.011233  1701 tablet_copy_client.cc:806] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:59.012537  1815 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:59.012917  1701 tablet_copy_client.cc:670] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:59.013705 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:59.016779 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.017925  1815 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:59.018684  1764 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:59.019210 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.019999  1815 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.020354 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.021855 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.022544  1831 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.022922 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.023175  1831 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:59.023743 29325 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:59.023907  1831 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:59.024132 29325 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:59.025033 29325 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.025692 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:59.026808  1815 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:59.027456 28603 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:59.028018  1845 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.264s	user 0.002s	sys 0.000s
I20260709 12:19:59.027961  1815 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:59.028681  1815 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:59.030130  1629 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:59.029333  1831 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:59.030469  1815 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.030856  1831 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.031801  1815 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:59.034967  1811 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:59.035346 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2832) took 2122 ms. Trace:
I20260709 12:19:59.035741 28599 rpcz_store.cc:276] 0709 12:19:56.912657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.356667 (+444010us) service_pool.cc:224] Handling call
0709 12:19:57.356987 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.175870 (+818883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.035135 (+859265us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400122ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:59.035290 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881856384}
I20260709 12:19:59.034400  1831 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:59.038308 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:59.039033 28599 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:59.040964 28599 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:19:59.042877 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 972) took 1205 ms. Trace:
I20260709 12:19:59.043255 28601 rpcz_store.cc:276] 0709 12:19:57.837776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.837917 (+   141us) service_pool.cc:224] Handling call
0709 12:19:59.042658 (+1204741us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54000a6c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:59.042784 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642041728}
I20260709 12:19:59.047500 28605 rpcz_store.cc:276] 0709 12:19:57.994928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.175264 (+180336us) service_pool.cc:224] Handling call
0709 12:19:58.175553 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.649902 (+474349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.009248 (+359346us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54003d3454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:59.009425 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078573440}
I20260709 12:19:59.030684  1629 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.064389 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:59.065634 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:59.066697 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:19:59.062876 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 187222us
I20260709 12:19:59.069013 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:59.069231  1629 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:59.069486 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:59.069978 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:59.070048 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:59.068185 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:59.072104 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.045840  1778 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.046221  1834 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:58.996369  1779 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:59.073757 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.002055  1830 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:19:59.075178 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 111011us
I20260709 12:19:59.035388  1811 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:59.079875 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.084245 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:59.074553 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:59.081606 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.085194 29323 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:59.081784 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.087659 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.088915 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.110333  1315 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:19:59.151055 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 64227.7us
I20260709 12:19:59.152513 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.071458 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:47636
I20260709 12:19:59.112782 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:59.113176  1438 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.059904  1571 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:58.989019  1756 rpcz_store.cc:276] 0709 12:19:54.751262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.751782 (+   520us) service_pool.cc:224] Handling call
0709 12:19:54.780503 (+ 28721us) log.cc:844] Serialized 508 byte log entry
0709 12:19:54.887851 (+107348us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b2c000eb598. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2387a0a 00007f6fe2387693 00007f6fe2387631 00007f6fe3abbb52 00007f6fe3abbcf5 00007f6fe39f8691 00007f6fe39d8eaa 00007f6fe39dfd53 00007f6fe39dfcd9 00007f6fe39dfc69
0709 12:19:58.943836 (+4055985us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5185,"raft.queue_time_us":6686,"raft.run_cpu_time_us":3657,"raft.run_wall_time_us":67254,"spinlock_wait_cycles":2363264,"thread_start_us":100561,"threads_started":1,"wal-append.queue_time_us":145288,"wal-append.run_cpu_time_us":14996,"wal-append.run_wall_time_us":1740379}
I20260709 12:19:59.118556 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 1149) took 1186 ms. Trace:
I20260709 12:19:59.120875 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:59.122426 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:59.076229  1746 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:58.963866  1841 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.158216 28679 rpcz_store.cc:276] 0709 12:19:57.932183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.014507 (+ 82324us) service_pool.cc:224] Handling call
0709 12:19:59.118265 (+1103758us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54001bd854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:19:59.118466 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707020672}
I20260709 12:19:59.161141 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.112119 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:59.162809 29317 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.127593  1808 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:59.148383  1615 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.166616  1745 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:19:59.167855 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:59.167655  1811 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:59.168747  1811 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.169028 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:19:59.129390  1847 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 12:19:59.129971 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:59.130174  1748 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:59.142057  1782 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.131965 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:59.175341 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.078444  1834 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:59.132368  1852 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:19:59.135077  1848 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:19:59.137137  1859 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:59.140203 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52612.4us
I20260709 12:19:59.089951 29319 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:59.146322 28606 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:59.149523 29323 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:19:59.201172 29319 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:19:59.151952 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.153326 28754 raft_consensus.cc:476] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Not starting forced leader election -- already a leader
I20260709 12:19:59.202963 29319 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:59.163590 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:19:59.203104 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51245.9us
I20260709 12:19:59.165184 28752 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:59.160851  1315 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:59.151036  1264 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:19:59.171115  1581 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:59.161991 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:59.130976  1830 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.173678 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.177722 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.171871  1751 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:19:59.174330  1748 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:59.179845  1855 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:59.184568  1860 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:19:59.184926 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2854) took 1418 ms. Trace:
I20260709 12:19:59.186028 28491 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5dc72678108404787b2aa034d4a7243 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:59.186580  1752 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:59.173019  1438 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.172703  1571 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:59.192420 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1187) took 1021 ms. Trace:
I20260709 12:19:59.193043  1852 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:59.195200 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2425) took 1127 ms. Trace:
I20260709 12:19:59.213824  1804 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:59.243959 28675 rpcz_store.cc:276] 0709 12:19:58.067690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.180057 (+112367us) service_pool.cc:224] Handling call
0709 12:19:58.180346 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:58.376215 (+195869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:58.376262 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:58.406666 (+ 30404us) log.cc:844] Serialized 26 byte log entry
0709 12:19:58.753395 (+346729us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:58.753620 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.753914 (+   294us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:59.134528 (+380614us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:59.194897 (+ 60369us) raft_consensus.cc:1685] finished
0709 12:19:59.194921 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.195137 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179738,"raft.queue_time_us":203309,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":202,"spinlock_wait_cycles":2728448,"thread_start_us":301905,"threads_started":1,"wal-append.queue_time_us":453985}
I20260709 12:19:59.195842 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 977) took 1235 ms. Trace:
I20260709 12:19:59.246460 28607 rpcz_store.cc:276] 0709 12:19:57.960328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.016702 (+ 56374us) service_pool.cc:224] Handling call
0709 12:19:58.017356 (+   654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:58.438357 (+421001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:58.438404 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:58.447681 (+  9277us) log.cc:844] Serialized 508 byte log entry
0709 12:19:58.583578 (+135897us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:58.583620 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:58.820428 (+236808us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54000a8054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:58.820513 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:59.128651 (+308138us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:19:59.195636 (+ 66985us) raft_consensus.cc:1685] finished
0709 12:19:59.195656 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.195783 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975656960,"thread_start_us":112785,"threads_started":1,"wal-append.queue_time_us":304543}
I20260709 12:19:59.155020  1291 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:19:59.163658  1815 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:59.218556  1753 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:59.241539 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 82782.9us
I20260709 12:19:59.221681  1828 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:59.223793  1549 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:59.261400 29327 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.263360 28677 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:19:59.270408 29317 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:59.271525 29323 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.225627  1780 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:59.230222 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.237407 28678 rpcz_store.cc:276] 0709 12:19:57.766613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.766767 (+   154us) service_pool.cc:224] Handling call
0709 12:19:57.767120 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:57.767476 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:57.767511 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:57.767977 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:19:57.980066 (+212089us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:57.980108 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:57.980172 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:59.181861 (+1201689us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b24002c2e38. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08189c4 00007f6fe0816acb 00007f6fe09d1dc9 00007f6fe09d1a55 00007f6fe09d0fb0 00007f6fe3647488 00007f6fe3647be8 00007f6fe361f398 00007f6fe361a76a 00007f6fe3619bb6
0709 12:19:59.184615 (+  2754us) raft_consensus.cc:1685] finished
0709 12:19:59.184639 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.184857 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19342,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1884,"spinlock_wait_cycles":62589312,"thread_start_us":211661,"threads_started":1,"wal-append.queue_time_us":358280}
I20260709 12:19:59.274660 28605 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:19:59.240986 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 67387.3us
I20260709 12:19:59.242271 29326 rpcz_store.cc:276] 0709 12:19:58.171443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.171673 (+   230us) service_pool.cc:224] Handling call
0709 12:19:58.171945 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.416214 (+244269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.192154 (+775940us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b54006e0d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:59.192361 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185124096}
W20260709 12:19:59.242065 28491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56194.1us
I20260709 12:19:59.255153  1571 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:59.258018  1797 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.225150  1625 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:59.284375 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.242272  1745 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:59.310407  1779 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:19:59.327201  1779 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.297874  1615 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.328959  1615 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.330250  1779 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:59.331166  1615 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:59.331296  1625 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:59.331786  1625 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:59.332660  1625 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.305996  1315 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:59.333909  1625 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.258069  1852 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:59.234146  1737 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:19:59.236961  1751 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:59.304272 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 74117.3us
W20260709 12:19:59.343327 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.332885  1579 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:59.340524  1701 tablet_copy_client.cc:538] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:59.336493  1866 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.298247  1782 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:19:59.243567  1748 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.296617 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.360817 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:59.295795 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:19:59.371641 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 75195.4us
I20260709 12:19:59.302500  1743 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 12:19:59.373183 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 77501.8us
I20260709 12:19:59.359661 29327 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:19:59.375042 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:19:59.383244 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:59.383697  1748 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:59.384407 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:59.385057 28678 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:59.386092 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:19:59.388986  1751 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:19:59.349656  1571 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:19:59.398131  1797 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:59.373842  1855 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.345888  1777 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.407912 28678 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:19:59.412927 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.427300 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:59.433504 28676 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.435274 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.444387  1737 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:59.447983 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.450199  1746 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:59.453761 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:59.379246  1859 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:59.365520  1778 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:19:59.457369 28681 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:59.458657 28676 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:59.399087  1291 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:59.374287  1615 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:59.462407 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.464658 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.424641  1629 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.454315  1743 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.452117  1737 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:19:59.425359  1815 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:19:59.482018 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.481048  1743 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.487512  1743 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:59.494498  1866 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.497267  1777 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:19:59.475587  1291 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:19:59.498898  1854 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260709 12:19:59.499317  1291 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.501767  1821 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:59.502372  1821 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:59.474066  1746 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:59.463266  1615 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:59.516494  1743 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:59.516379  1615 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.517027  1743 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:59.517937  1615 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:59.519232  1743 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:19:59.466288  1859 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:19:59.520638  1855 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:59.520300  1859 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.521341  1737 consensus_queue.cc:1243] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:19:59.521908  1737 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:59.522217  1737 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:59.506919  1821 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.523164  1737 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:59.529803 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47843.7us
I20260709 12:19:59.530649 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:19:59.531991  1821 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:59.536566  1855 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.538704  1810 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.544917  1840 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:59.545387  1840 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:59.546314  1840 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:59.547400  1840 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.479120  1782 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:19:59.551383  1782 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:59.551638 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2897) took 1749 ms. Trace:
I20260709 12:19:59.551776  1782 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:59.552106 28751 rpcz_store.cc:276] 0709 12:19:57.802662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.802807 (+   145us) service_pool.cc:224] Handling call
0709 12:19:57.812751 (+  9944us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:58.888498 (+1075747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.551354 (+662856us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002d5ad4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:19:59.551575 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419035008}
I20260709 12:19:59.552726  1782 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.554522  1782 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:59.556668 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.566356  1806 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:59.564116  1832 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:19:59.558018  1629 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:59.564801  1701 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:19:59.562908 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:59.574087 28753 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: [19.15-21.16]
I20260709 12:19:59.577842 28599 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:59.575888  1737 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.584123  1832 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:19:59.594404 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:59.579077 28607 raft_consensus.cc:2955] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 4 to 10, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:19:59.601868 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:59.603487 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:59.603744 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:19:59.605994 28753 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:19:59.580034  1855 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:59.608204 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:59.608273 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:19:59.593400  1315 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:19:59.613722 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:19:59.613924 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:59.585147  1832 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.634662  1832 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:19:59.635212 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.621157  1878 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:19:59.638026 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:59.639228 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1186) took 1470 ms. Trace:
I20260709 12:19:59.639561 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:19:59.641825 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:59.643281 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:19:59.612088  1792 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.646912 29318 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:59.649257 29318 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:59.653295 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:59.653872 28605 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:19:59.607579  1629 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:19:59.607599  1814 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:19:59.654599  1815 consensus_queue.cc:1175] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" responder_term: 22 status { last_received { term: 17 index: 14 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: [19.15-21.16]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:59.655588 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:19:59.639636 29320 rpcz_store.cc:276] 0709 12:19:58.169635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.169968 (+   333us) service_pool.cc:224] Handling call
0709 12:19:58.765888 (+595920us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aeee 000000000036eb39 00007f6fe89ce1e0 00007f6fe8a970c4 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:19:58.766075 (+   187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:58.771307 (+  5232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:58.771342 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:58.786201 (+ 14859us) log.cc:844] Serialized 26 byte log entry
0709 12:19:59.003309 (+217108us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:59.010803 (+  7494us) log.cc:844] Serialized 14 byte log entry
0709 12:19:59.011214 (+   411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.011906 (+   692us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:59.636817 (+624911us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b1800465880. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:19:59.638992 (+  2175us) raft_consensus.cc:1685] finished
0709 12:19:59.639017 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:59.639144 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4815,"prepare.queue_time_us":77198,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":4983,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":11722,"spinlock_wait_cycles":10758528,"thread_start_us":200569,"threads_started":2,"wal-append.queue_time_us":303085}
I20260709 12:19:59.658242 28605 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:19:59.593864  1746 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:19:59.654385 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:19:59.627252 29325 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:59.636356 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.662143 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48996.6us
I20260709 12:19:59.668072 28606 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:19:59.700961 28678 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:59.701834 29323 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:59.723654  1839 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:59.724146  1839 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:19:59.725200 29323 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:19:59.724996  1839 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.733642 29322 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:59.736750  1815 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:59.737363  1815 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.694500  1746 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:59.684185  1806 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:59.668226  1814 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:59.668219  1629 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:59.776971 28753 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:59.777410 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.779419 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:19:59.780069 28678 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:19:59.734901  1819 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:59.668366  1804 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 12:19:59.735106  1615 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:19:59.771634  1814 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:59.720216  1737 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:59.773597  1792 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:59.774896  1459 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 12:19:59.839550  1851 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:19:59.830837  1759 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.833174  1746 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:19:59.836717  1315 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:59.774958  1806 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:19:59.837177  1615 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.896278  1814 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.896456  1315 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:19:59.942579 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.838078  1737 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:19:59.951323 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.871285  1759 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.904099  1746 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.870242  1821 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:59.830211  1819 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.848973  1792 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:19:59.994017 29325 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:19:59.998780  1889 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:19:59.999537  1759 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:00.001736  1315 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.014115 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1483) took 1256 ms. Trace:
I20260709 12:20:00.105505 29325 rpcz_store.cc:276] 0709 12:19:58.757746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.757880 (+   134us) service_pool.cc:224] Handling call
0709 12:19:58.758155 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.023648 (+265493us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b54006804a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f6dc0 00007f6fe3a811c0 00007f6fe3a82231 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c
0709 12:19:59.626695 (+603047us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b58006857d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39db0aa 00007f6fe3a5d447 00007f6fe3a75fe7 00007f6fe3a777de 00007f6fe3a81b49 00007f6fe3a82416 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4
0709 12:20:00.013623 (+386928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.014033 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505214208}
W20260709 12:20:00.057926  1767 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:20:00.114907  1315 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.224385 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.013366  1821 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:00.226729 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.164212  1701 tablet_bootstrap.cc:700] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Time spent opening tablet: real 0.265s	user 0.004s	sys 0.006s
I20260709 12:20:00.218111  1814 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:00.247473  1459 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.250062  1892 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.089268  1889 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:00.267697 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.273707 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.246692  1884 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:00.316344  1891 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.001s
I20260709 12:20:00.266774  1888 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.283965  1459 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.245810  1315 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.337500  1806 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.312423  1579 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.371119 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.345871  1886 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.437s	user 0.000s	sys 0.001s
I20260709 12:20:00.301800  1892 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.346446  1888 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.405973  1819 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.411180  1315 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.385560  1889 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.426812  1315 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:00.432011 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.411747  1821 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:00.434129 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1162) took 1228 ms. Trace:
I20260709 12:20:00.394106  1737 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.435024 28673 rpcz_store.cc:276] 0709 12:19:59.205339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.205463 (+   124us) service_pool.cc:224] Handling call
0709 12:19:59.235152 (+ 29689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.273428 (+ 38276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:59.273459 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:59.273502 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:59.273532 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.433886 (+1160354us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b54000c7454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:00.433933 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.434065 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87523712}
I20260709 12:20:00.376992  1579 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.441211  1743 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:00.379733  1884 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.435045  1315 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:00.472121 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 106971us
I20260709 12:20:00.474845 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.451372  1743 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.461289  1459 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.478857 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.480899 28755 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:00.483282 28755 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:20:00.484526  1743 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:00.484959 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.485268 28751 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:00.480496  1896 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.487357  1896 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.488211 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.488847 28754 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:00.489673  1896 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.489907  1746 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:00.493225 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.500130 29325 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:00.497864 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.503957 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.505841 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 2900) took 2694 ms. Trace:
I20260709 12:20:00.506367 28756 rpcz_store.cc:276] 0709 12:19:57.807976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:57.808484 (+   508us) service_pool.cc:224] Handling call
0709 12:19:57.808719 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:58.483136 (+674417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.502270 (+2019134us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54002d69d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:00.502438 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549591424}
I20260709 12:20:00.510339 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:00.510555  1889 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:00.511234 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:00.511870  1737 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:00.512404  1889 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:00.512830  1889 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.513271  1889 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:00.512748 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:00.514057 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1163) took 1308 ms. Trace:
I20260709 12:20:00.514482 28681 rpcz_store.cc:276] 0709 12:19:59.205650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.205756 (+   106us) service_pool.cc:224] Handling call
0709 12:19:59.205995 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.463337 (+257342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.513814 (+1050477us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54000c7954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:00.513997 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577690496}
I20260709 12:20:00.517011  1815 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.524605  1896 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:20:00.526077  1813 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:00.526568  1813 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:00.527472  1813 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.528769 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.529168 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2858) took 1152 ms. Trace:
I20260709 12:20:00.529609 28682 rpcz_store.cc:276] 0709 12:19:59.376830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.377202 (+   372us) service_pool.cc:224] Handling call
0709 12:19:59.639777 (+262575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.639954 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:59.639976 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:59.640014 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:59.640044 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.640095 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.528984 (+888889us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54003b7750. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:00.529103 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602109184}
I20260709 12:20:00.531319  1889 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.505897  1859 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:20:00.500530  1819 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.532390  1852 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:00.533008  1852 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:00.490646  1892 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.533854  1852 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.534649 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 1496) took 1420 ms. Trace:
I20260709 12:20:00.534749  1459 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.535174  1852 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:00.535252  1459 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.537250 29319 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:20:00.537427  1459 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.537808  1834 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.538596 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1395) took 1451 ms. Trace:
I20260709 12:20:00.538640  1315 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.539072 29319 rpcz_store.cc:276] 0709 12:19:59.086845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.205578 (+118733us) service_pool.cc:224] Handling call
0709 12:20:00.537025 (+1331447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:00.537672 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.538421 (+   749us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54004b9450. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:00.538539 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3060360064}
I20260709 12:20:00.535081 29327 rpcz_store.cc:276] 0709 12:19:59.114552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.122153 (+  7601us) service_pool.cc:224] Handling call
0709 12:20:00.534460 (+1412307us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54004b9454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:00.534567 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230234496}
I20260709 12:20:00.541007 29320 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:00.541692 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1195) took 1081 ms. Trace:
I20260709 12:20:00.542068 29320 rpcz_store.cc:276] 0709 12:19:59.459964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.657289 (+197325us) service_pool.cc:224] Handling call
0709 12:20:00.540592 (+883303us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:20:00.540799 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.541425 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.541604 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10986240}
I20260709 12:20:00.543322  1888 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.505193  1773 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.546396  1773 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.552093  1030 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.552706  1030 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.490446  1746 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.560177  1781 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:00.562528  1889 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.562817  1781 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.565128  1781 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.565659  1781 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.533017  1819 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.577543  1819 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.583091  1438 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.560640  1773 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.587219  1829 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:00.592074 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.595752 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:00.596071 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:00.597239 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:00.598430 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:00.601635  1411 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:00.602043  1411 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:00.602252 29320 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:00.602927  1411 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.603834 29327 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 12:20:00.603957  1411 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:00.604185 29327 pending_rounds.cc:85] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 15
I20260709 12:20:00.604465 29327 pending_rounds.cc:107] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 12:20:00.604732 29327 raft_consensus.cc:2889] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:00.607864  1841 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:00.608278  1841 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:00.608317 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:00.609196  1841 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.617359  1841 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:00.620906  1866 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.621479  1866 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.623682  1866 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.627537  1615 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.629400  1821 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:00.633806 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.635428 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.635838 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.636191 28756 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:00.636978 28751 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:00.637995 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.638715 28755 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:00.640738 28752 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:00.641388 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.642634  1792 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.643153  1792 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.643795  1882 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.391s	user 0.000s	sys 0.003s
I20260709 12:20:00.643644  1792 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.644995 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1494) took 1557 ms. Trace:
I20260709 12:20:00.645340 29321 rpcz_store.cc:276] 0709 12:19:59.087994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.229331 (+141337us) service_pool.cc:224] Handling call
0709 12:19:59.242513 (+ 13182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:59.253322 (+ 10809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:59.253359 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:59.253874 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:19:59.555004 (+301130us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b180027ae40. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:19:59.709449 (+154445us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:19:59.709488 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.709556 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:00.643223 (+933667us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:00.644807 (+  1584us) raft_consensus.cc:1685] finished
0709 12:20:00.644827 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.644939 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9507,"raft.queue_time_us":9381,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":20267,"spinlock_wait_cycles":72758400,"thread_start_us":154265,"threads_started":1,"wal-append.queue_time_us":858333}
I20260709 12:20:00.648231 28747 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:00.649375 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.650064 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2556) took 1476 ms. Trace:
I20260709 12:20:00.651158 28601 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:00.650478 28603 rpcz_store.cc:276] 0709 12:19:59.173556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.173681 (+   125us) service_pool.cc:224] Handling call
0709 12:19:59.185534 (+ 11853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:59.262765 (+ 77231us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:19:59.263031 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 12:19:59.263213 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:59.263257 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:19:59.263302 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.542435 (+279133us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b1800367c60. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:20:00.649828 (+1107393us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b5400233a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:00.649885 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.650006 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1005,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":11427,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2011,"spinlock_wait_cycles":198092800}
I20260709 12:20:00.610507  1827 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:00.654660  1780 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.654980  1827 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.655426  1827 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:00.655195  1780 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.657465 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.657681  1780 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.658104 28673 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:00.658528 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.635437 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:00.661772 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1397) took 1432 ms. Trace:
I20260709 12:20:00.662145 29326 rpcz_store.cc:276] 0709 12:19:59.229462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.313826 (+ 84364us) service_pool.cc:224] Handling call
0709 12:19:59.314215 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.572418 (+1258203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:00.572470 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:00.572520 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:00.572558 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:00.661535 (+ 88977us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540007ab54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:00.661600 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.661715 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2893037440}
I20260709 12:20:00.663731 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.664310 28752 raft_consensus.cc:1813] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Handling vote request from an unknown peer a8342e3fcab94ce89482df67988159ea
I20260709 12:20:00.664876 28752 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:20:00.614144 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:00.665748 29317 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:20:00.615507  1815 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:00.610536 29323 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:00.653050 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.653494 28681 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:00.670933  1030 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.671500  1839 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:00.672811 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.653702 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.654394 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.674412  1894 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:00.674744 28680 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:00.675206  1634 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:00.675001  1894 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.675645  1634 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:00.676426  1834 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:00.676680  1634 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.587836  1829 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.609609 29320 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:00.688014  1634 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:00.684954 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.689352 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:00.689921 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.690649 28678 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:00.689527  1829 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.697551 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.688499 28681 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:20:00.791312 28748 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:00.699397  1251 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:00.695987 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.699532 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.811364 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.812529 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.813076 28606 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:00.813854 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.814384 28606 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:00.815125 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.690649 28682 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:00.700774 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:00.691363  1804 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:20:00.691962  1797 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:20:00.691648  1778 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:20:00.702898  1810 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:00.690928  1030 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.697196 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:00.687712  1792 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.708616 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.692523  1808 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:00.711024 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.835002 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.835762 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.836083 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.711498 28602 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:00.712584 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.714941 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:00.838600 28676 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:00.716053 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:00.716596 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.686617  1894 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.717002  1895 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.719676 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:00.694432  1827 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.726150  1813 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:00.732693  1738 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.728741 28604 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:00.734126 28753 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:00.734380 28598 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:00.863610 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.735577 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.736632 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.737615 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.738837 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.869056 28750 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:00.740502 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.740787 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.870190 28751 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:00.744063 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.621554 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:00.566149  1781 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.745263 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:00.751454  1884 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.752041  1579 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:00.760033 28500 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 339) took 30882 ms (client timeout 15000 ms). Trace:
I20260709 12:20:00.761548  1746 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.773877 29323 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:00.890883 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.897177 28600 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:20:00.897614 28600 pending_rounds.cc:85] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 11
I20260709 12:20:00.897841 28600 pending_rounds.cc:107] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:20:00.898080 28600 raft_consensus.cc:2889] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:00.840415  1810 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.902912  1810 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:00.903487  1804 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:00.904089  1804 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.774210 28679 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
W20260709 12:20:00.773741 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 55612.7us
I20260709 12:20:00.763098 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:00.809581  1251 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.830523 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:00.832195  1030 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:00.910177 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 147158us
W20260709 12:20:00.848248 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.916761 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:00.816761  1901 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:00.920358 28603 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:00.855324  1827 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.856176 28607 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:00.847443 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:00.858379 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.859434  1792 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.741395 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:00.876749 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:00.880357 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 135185us
I20260709 12:20:00.953413 28756 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:20:00.882042 28604 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:00.852612  1773 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.909011 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:00.958638 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49724.3us
I20260709 12:20:00.926740 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:00.944257 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:00.912305 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 409562us
W20260709 12:20:00.921031 28720 connection.cc:256] RPC call timeout handler was delayed by -1.6936995470000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
I20260709 12:20:00.952527 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:00.955286 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:00.971669 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:00.974349 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47734.6us
I20260709 12:20:00.977473 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:00.886988  1615 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.977198  1030 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.907497  1890 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:00.888136  1759 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:00.849689  1808 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:00.998135  1808 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:00.999128 28606 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:20:00.860457  1895 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.007391  1742 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:00.968631  1792 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.973883 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:00.987313 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:00.952901  1829 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:00.952826  1884 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:00.945621  1579 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:00.946833  1815 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.942222  1746 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:00.993219  1251 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:00.984896  1814 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:01.016326 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:00.979102  1753 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:00.887419  1738 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:01.019553 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45758.2us
I20260709 12:20:00.989981  1827 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:01.007962  1742 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:00.990392  1459 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:20:00.985163  1899 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:01.021165  1251 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:00.988878  1890 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:01.013442  1829 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:01.037119 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.041571 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.085480 28679 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:00.991258  1889 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 12:20:01.069736 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53464.7us
I20260709 12:20:00.954200  1901 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:01.007447  1804 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.984663  1852 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:20:00.991139  1409 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.034114  1866 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.014456  1759 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.090193 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:01.082233  1797 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:01.037423  1808 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:01.028483  1814 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.120769  1902 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:01.121196  1814 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:00.991940  1615 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:01.027182  1806 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:20:01.126410  1615 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.127678  1792 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:01.130014 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.131871  1781 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:00.980337  1773 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.068588  1767 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.069080  1753 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:01.070188  1827 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.036142  1894 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:01.075960 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.154557 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.114894 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:01.156780 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.080022  1438 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.086989  1890 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:01.113440  1459 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:20:01.163511 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:01.164613 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.165215 28673 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:01.119467  1804 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:01.120177  1738 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:01.191365 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.152271  1827 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:01.153731  1894 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:01.163276  1778 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:01.137097 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.138604 28749 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:20:01.207820 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.211066 29290 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.036607  1579 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:01.036521  1815 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.158102 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.165699 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.166047 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.151638  1767 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.216507 28682 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:01.217545 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.166167 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.164422 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:01.132869  1899 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.167505 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.121217  1902 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:01.168918 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.222165 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:01.149995  1753 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:01.170162 28674 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:20:01.174507 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.204982  1894 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:01.133023 28602 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:01.029188  1842 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:01.105461  1873 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:20:01.134660 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.167958  1438 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.117480  1409 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:01.117841  1866 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.101987  1746 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.209216 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.179613  1634 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:01.212598 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.256717 29321 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:01.192672  1834 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.258921 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 292549us
I20260709 12:20:01.259150 29319 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:01.214535 28600 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:01.212380 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:01.198263  1738 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.177321 28673 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:01.222535 28606 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:01.232954 28598 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:01.198144 28680 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:01.236058 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.241704  1810 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:01.243598  1842 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.244064 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.231817  1899 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.159881  1829 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.292428 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.330299 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.332445  1808 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.333128  1808 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:01.335778  1808 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.337327 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.338117 28598 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:01.339725 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:01.341034 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.341845 28601 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:20:01.343166  1888 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:01.345309 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:01.346355 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.347251 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:01.292697 28678 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:01.354051  1888 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.354768  1888 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.357226 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.358287  1792 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.358935  1792 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.362452  1792 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.363363  1792 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:01.363888  1792 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.364415  1792 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:01.368415  1888 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.328275 28674 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:01.377995  1438 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:01.385648 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:01.391546 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.289321  1852 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.405490 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.394255 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.420782 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.389377 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.295429  1810 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.424955 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.425907 28681 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:20:01.388510 28678 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:01.421434 28674 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:01.433811 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.259986  1746 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.262447  1634 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.435508 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.394542  1889 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:01.404707  1888 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:01.427515  1438 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:01.296064  1834 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:01.451310 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 229200us
I20260709 12:20:01.460780 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:01.448118 28720 connection.cc:256] RPC call timeout handler was delayed by -1.5942400550000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 12:20:01.432044  1810 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:01.328415  1738 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.435474  1742 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.440208  1804 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.428277  1852 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.451983  1911 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.440340  1901 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:01.449518  1859 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:01.490006 29322 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:20:01.464864 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.449224  1759 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:01.462741 28720 connection.cc:256] RPC call timeout handler was delayed by -1.2165800510001645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 12:20:01.495884 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.496345 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:01.496915 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.464651 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:01.472574 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 212809us
I20260709 12:20:01.486101 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:01.499279 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:01.460565  1773 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:01.511343 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.460947  1917 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:01.503582 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:01.475232  1813 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:01.515941 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 80570.6us
I20260709 12:20:01.516062 28601 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
W20260709 12:20:01.528493 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 150530us
I20260709 12:20:01.490183  1915 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:01.537014 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:01.551429 28602 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:20:01.471448  1438 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.517645  1759 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:01.510715  1873 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:01.482753  1804 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.517920  1813 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.510833  1778 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:01.510274  1859 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:01.502375  1808 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:01.531368  1910 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:01.560570  1907 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 12:20:01.541656  1924 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.525300  1459 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:20:01.557243  1866 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.539321  1579 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:01.581715 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55310.1us
I20260709 12:20:01.541325  1918 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.493263  1911 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:20:01.595695 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 90880.7us
I20260709 12:20:01.621279 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.626005 29319 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:01.556959  1915 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.542078  1581 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:20:01.628021 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.628332 28677 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:01.628791 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.579500  1409 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.629451 29319 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:01.633057 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:01.629670 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.626416 29321 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:20:01.581763  1813 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:01.632143 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 167743us
I20260709 12:20:01.638594 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.640244 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.640959 29318 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
W20260709 12:20:01.643204 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 113052us
I20260709 12:20:01.643648 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.644335 28678 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:20:01.643927 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.645124 28674 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:20:01.646076 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.647750 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:01.632392  1914 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:20:01.648734 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:01.622061  1888 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.630398  1743 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:01.654664 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.622810  1842 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.660328 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.635741  1866 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:01.660494 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 95906.5us
W20260709 12:20:01.660898  1913 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:20:01.636018  1927 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.631057  1915 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:01.631119  1918 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:01.678190 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.684762 28674 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:01.694278 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45611.5us
I20260709 12:20:01.695487 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:01.700779 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:01.668699  1926 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:20:01.619074  1924 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:01.710848 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.706626 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.717499  1900 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:01.718152  1941 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:01.665779  1917 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.666860  1899 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.666260  1842 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.718340  1928 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:01.671015  1738 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.696557  1923 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:01.687259  1746 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.734066  1804 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.712021  1834 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:01.750154 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 92488.8us
I20260709 12:20:01.719641  1459 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:01.664925  1888 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:01.719980  1940 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.728340  1852 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.733250  1773 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:01.776521  1459 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.669606  1931 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
W20260709 12:20:01.785356 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 118184us
I20260709 12:20:01.729764  1917 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:01.783094 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 149204us
I20260709 12:20:01.788364 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:01.726078  1873 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:20:01.766747  1923 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:01.687711  1927 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.737638  1842 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.786690  1834 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.787528  1459 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:01.783890  1940 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.807359  1918 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.808475  1927 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.814476 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.774616  1804 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:20:01.817963 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.818998 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.831311  1937 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.816236 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:01.831918  1929 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:20:01.691453  1634 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:01.832610  1932 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:20:01.832909  1936 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:01.882037  1936 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.882452  1936 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:01.883201  1953 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:01.883790  1953 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:01.833446  1951 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:01.834930 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46655.6us
I20260709 12:20:01.861541 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.885743 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.886307 29317 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:01.887599 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.862644 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:01.865613 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 164942us
I20260709 12:20:01.888760 29327 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:20:01.803574  1773 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.861976 28674 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
W20260709 12:20:01.867149 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51040.1us
I20260709 12:20:01.837182  1928 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.868374  1873 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:01.868887  1923 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:01.870842  1814 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.000s
I20260709 12:20:01.867723  1859 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:01.932781 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:01.933107 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.932781 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.934249 28748 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
W20260709 12:20:01.832296  1925 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:20:01.877017 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 62633.5us
I20260709 12:20:01.877665 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.884275  1953 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:01.829089  1852 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.833448 28498 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 14, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 14 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:01.895730 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.875443  1888 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.914470 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:00.912566 28500 rpcz_store.cc:269] 0709 12:19:29.877208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.877635 (+   427us) service_pool.cc:224] Handling call
0709 12:19:30.182596 (+304961us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b5400002490. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095b0b2 00007f6fe98d4759 00007f6fe986ca76 00007f6fe983dd58 00007f6fe993c04e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc
0709 12:19:30.783891 (+601295us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5400002490. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095b640 00007f6fe9832846 00007f6fe993c90e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc 00007f6fe7dfc392 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:00.759921 (+29976030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:56.613591 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:56.614297 (+   706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:56.614354 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:19:56.614373 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:56.615523 (+  1150us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:56.615618 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:56.615649 (+    31us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:19:56.628427 (+ 12778us) tablet.cc:701] Row locks acquired
0709 12:19:56.628497 (+    70us) write_op.cc:260] PREPARE: finished
0709 12:19:56.628683 (+   186us) write_op.cc:270] Start()
0709 12:19:56.628831 (+   148us) write_op.cc:276] Timestamp: P: 1783599596628617 usec, L: 0
0709 12:19:56.628862 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:19:56.629532 (+   670us) log.cc:844] Serialized 5222 byte log entry
0709 12:19:57.308480 (+678948us) op_driver.cc:464] REPLICATION: finished
0709 12:19:57.508533 (+200053us) write_op.cc:301] APPLY: starting
0709 12:19:57.508649 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:57.638508 (+129859us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:57.638623 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:57.911075 (+272452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:57.911399 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:19:57.911459 (+    60us) write_op.cc:312] APPLY: finished
0709 12:19:57.911864 (+   405us) log.cc:844] Serialized 121 byte log entry
0709 12:19:57.912060 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:57.912215 (+   155us) write_op.cc:454] Released schema lock
0709 12:19:57.912279 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:58.043241 (+130962us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:58.051754 (+  8513us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2125093,"reported_tablets":47,"spinlock_wait_cycles":183048960,"child_traces":[["op",{"apply.queue_time_us":103819,"apply.run_cpu_time_us":20291,"apply.run_wall_time_us":495256,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58337,"num_ops":13,"prepare.queue_time_us":276114,"prepare.run_cpu_time_us":24002,"prepare.run_wall_time_us":260834,"raft.queue_time_us":150539,"raft.run_cpu_time_us":17622,"raft.run_wall_time_us":73062,"replication_time_us":676761,"thread_start_us":557112,"threads_started":4,"wal-append.queue_time_us":311403,"wal-append.run_cpu_time_us":10792,"wal-append.run_wall_time_us":1959700}]]}
I20260709 12:20:01.913323  1911 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:01.925531  1928 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:01.866271  1927 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.875504  1778 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:20:01.871953  1797 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.000s
I20260709 12:20:01.927572 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.931007 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.931758 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.874155  1933 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.803224  1866 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:01.936822 28681 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:01.938537 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:01.874140  1918 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:01.966958  1918 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:01.967350  1918 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:01.971714  1924 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.939260 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.940307 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:01.940613 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.941395 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:01.875567  1792 consensus_meta.cc:287] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.005s
I20260709 12:20:01.941696 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.941571 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.915133  1780 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:01.944092 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48455.9us
I20260709 12:20:01.836212  1409 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:20:01.829206  1834 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.930051  1814 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:01.929505  1890 consensus_meta.cc:287] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.000s
I20260709 12:20:01.945849 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.950625  1808 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:01.949292 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:01.952080 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.994619 29327 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:01.957016 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.934773  1895 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:01.960415 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.996347 28749 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:01.963277 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:01.965422  1944 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:20:01.965693  1866 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.941809  1873 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:01.980216 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:01.982645 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.983297 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:01.884815  1951 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.915359  1746 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:20:01.946223 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:01.972208  1438 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:01.963392  1797 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:01.991122 28748 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:01.983422  1780 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.992857  1943 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:01.950512  1931 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:01.915153  1773 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:01.993623 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 79306.2us
I20260709 12:20:01.949314  1934 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:01.995102 28751 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:01.995537 28756 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:01.996515 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.014681 28678 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:01.998252 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.000141 28681 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:02.000281 28747 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:02.000521 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:01.955754  1778 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:02.002912 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.003207 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:01.953132  1888 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:01.975916  1859 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:01.872391  1937 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.988941  1792 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:01.979221 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51739.1us
W20260709 12:20:02.016387  1949 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:20:02.028623 28648 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:01.989179 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:02.000196  1827 consensus_meta.cc:287] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.002s
I20260709 12:20:02.036821 29319 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:02.036680  1827 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.038817  1827 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:02.039640 29292 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.514s (SENT) [suppressed 6 similar messages]
I20260709 12:20:01.978991  1933 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:01.997284  1808 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.975345  1940 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.015825 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:02.024461  1810 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.002s
I20260709 12:20:02.013334  1931 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:02.013142  1780 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:02.022609 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:02.023164  1888 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:02.001112  1956 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:02.005275 28754 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:20:02.007193  1895 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:02.029939 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:02.032033  1937 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:02.033403  1922 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.473s	user 0.003s	sys 0.000s
I20260709 12:20:02.016542 28498 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 11, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 11 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:02.001212  1924 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:01.950951  1852 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:01.964375  1927 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.081924  1951 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.082475  1927 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:01.997072  1890 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.029485 28752 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:02.082677  1806 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:02.045428 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.083729  1409 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:02.084163  1409 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.013840  1943 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.084556  1890 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.084708  1409 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:02.084915  1943 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:02.087116  1852 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.087196  1792 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:02.024852  1753 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.779s	user 0.012s	sys 0.001s
I20260709 12:20:02.088690  1834 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:20:02.011318  1950 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:02.089447  1950 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:02.089854  1950 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:02.090890  1961 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:20:02.015161 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:02.070485  1873 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:02.092800 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 77722.7us
I20260709 12:20:02.093497  1943 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.051720 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.019815  1934 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.027448  1941 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:02.054623  1810 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.103078  1810 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.107049  1902 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.108184  1902 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:02.024279 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:02.122991 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 98786.4us
I20260709 12:20:02.123946 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.056875 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.057826 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.125301 28606 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:02.058708  1918 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.059073 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.060195  1928 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:02.060513  1459 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.060760  1960 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:02.130398 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.051119  1808 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:02.131264 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.058699 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.061601 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.059963 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:02.131891 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 92259.8us
I20260709 12:20:02.026757  1859 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:02.066931 28747 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:02.067456  1956 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:02.075879 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45967us
I20260709 12:20:02.132884 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:02.053013  1931 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:02.080226  1924 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.084072 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:02.139411 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55415.8us
I20260709 12:20:02.140950 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.046710 29327 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:02.141152 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.065856  1888 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:02.073786  1894 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.821s	user 0.013s	sys 0.001s
I20260709 12:20:02.066206  1899 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:02.100214  1615 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:20:02.055289  1952 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:20:02.112471 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1418) took 1132 ms. Trace:
I20260709 12:20:02.114310 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.114380  1773 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.069361  1895 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:02.126174  1579 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:02.163393  1615 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:02.084722  1927 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:02.130074 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.181250 28681 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:20:02.181535 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.129544 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.067891  1777 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:02.099408  1792 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:02.023722  1955 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:02.114486  1953 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.143684 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.070032  1778 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.205557  1778 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:02.206983  1953 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:02.118629  1915 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.138468 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.178386  1895 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:02.208915 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70496.9us
I20260709 12:20:02.180761  1615 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.167862 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.168701 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:02.210547 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:02.165320  1810 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:02.175009  1459 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.132201  1829 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:02.088732  1753 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.131058  1839 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.139097  1852 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:02.187114 28676 raft_consensus.cc:2368] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:02.192698 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.165366 29323 rpcz_store.cc:276] 0709 12:20:00.980422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.980654 (+   232us) service_pool.cc:224] Handling call
0709 12:20:00.981039 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:00.986120 (+  5081us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:01.209399 (+223279us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.786971 (+577572us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.787593 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:20:01.787748 (+   155us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:01.787780 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.787849 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.032738 (+244889us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:02.112044 (+ 79306us) raft_consensus.cc:1685] finished
0709 12:20:02.112196 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.112371 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4481,"prepare.queue_time_us":409149,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":4316,"raft.queue_time_us":167156,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":33103,"spinlock_wait_cycles":11758976,"thread_start_us":754527,"threads_started":3,"wal-append.queue_time_us":307638}
I20260709 12:20:02.192233  1792 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.199852 28681 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:02.137904  1928 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:02.211381  1814 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.209698  1915 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.211022 29317 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:20:02.231057  1937 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:02.173084  1030 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.163792  1960 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:02.211424 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.211201 28599 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:02.212059 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.262636 28673 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:02.212554 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:02.212633 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68989.1us
I20260709 12:20:02.259008 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.265650 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:02.265961 28751 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:02.266353 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:02.211983 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 167761us
I20260709 12:20:02.266831 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.267647 28751 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:02.268831 28751 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:02.269567 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.270902  1945 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
I20260709 12:20:02.273746 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.274381 28682 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:02.275353 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.275938 28676 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:02.276821 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:02.277185  1956 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.281489  1934 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.282148  1933 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.250953  1792 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:02.216559 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.164693  1899 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:02.111848  1917 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.178352  1759 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:02.256733  1852 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.181702  1773 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:02.229899 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2571) took 1139 ms. Trace:
I20260709 12:20:02.231393 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:02.297326 28601 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:02.187464  1777 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:02.137360  1859 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:02.204200  1955 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.247049 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.248186 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.250521 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.126164 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.211151  1943 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.296518 28607 rpcz_store.cc:276] 0709 12:20:01.090853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.091082 (+   229us) service_pool.cc:224] Handling call
0709 12:20:01.091432 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.114168 (+ 22736us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:01.396298 (+282130us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.493688 (+ 97390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.493747 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:01.493789 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.229684 (+735895us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b5400233f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:02.229728 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.229844 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":648,"prepare.queue_time_us":431971,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":5963,"raft.queue_time_us":25125,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8316,"spinlock_wait_cycles":51559808,"thread_start_us":349507,"threads_started":2,"wal-append.queue_time_us":167772}
I20260709 12:20:02.307222 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.253192 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:02.217285  1951 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:02.165489  1894 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.226449  1953 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:02.166591 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.284001  1814 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:02.258931 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.324499 28678 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:02.260195  1030 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.284706 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:02.285355 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 72447.3us
I20260709 12:20:02.282877  1409 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.288899 28753 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:02.289927 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.229918  1923 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:20:02.217154  1890 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:20:02.294615  1940 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:02.180861  1927 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.214129 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:02.293902 29326 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:02.176394 28498 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 12, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 12 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:02.259938  1937 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.297732 28599 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:02.356572 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.298605 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.357496 28751 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:02.333906  1814 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.265372  1960 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:02.299932 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.362363 28677 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:02.301460 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.364331 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:02.302160 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.303297 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.223938  1810 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.248667  1839 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.217217  1746 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:02.289671  1915 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:02.292449  1956 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:02.290764  1899 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:02.292281  1911 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:02.292048  1759 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:02.414610 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.332823 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:02.301105  1411 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:02.307107  1955 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:02.290941 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 74524.2us
I20260709 12:20:02.295513 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.418681 28673 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:02.343935 28752 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:20:02.345018 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.349246 28675 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:02.350535 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.351325  1030 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.348603 28603 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
W20260709 12:20:02.353248 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 139190us
I20260709 12:20:02.365825 28681 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:02.423866 28648 leader_election.cc:336] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.500s (SENT)
I20260709 12:20:02.424209 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:02.424642 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.425284 28749 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
W20260709 12:20:02.387447  1972 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:20:02.425674 28682 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:02.341535  1933 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:02.307313  1852 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.391356 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.436749 28601 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:20:02.309149  1950 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.349025  1927 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:02.360427  1937 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:02.411222 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.338438 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.361753  1948 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:02.450498 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.388365  1810 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:02.453579 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:02.355870  1924 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.426124 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.455148 28747 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:02.389847  1918 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.426465 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:02.456808 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.457093 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.457963 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.458607 28756 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:02.435424 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.459589 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.426812  1030 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:02.461078 28751 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:02.442937 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.405560  1915 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:02.445302 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 106962us
I20260709 12:20:02.480883  1915 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:02.481153  1950 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:02.349339  1940 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.485620 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.447731 28681 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:02.483882  1923 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:02.488756  1923 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.489145  1923 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:02.491897 28681 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:02.448616  1753 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.449223  1409 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.449159 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.418046  1759 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:02.425426  1411 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.451668  1773 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:02.437737 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.463112 28682 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:02.471220  1780 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.463480 28750 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:02.472611 28677 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:02.473503 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:02.474184  1974 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:20:02.475214  1948 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:02.513702 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.478870 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:02.511662 29323 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:02.480306 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.492167 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.516798 28678 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:02.491710  1924 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.518055 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:02.492588 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 159845us
I20260709 12:20:02.448107 28601 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:20:02.413112  1746 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.541968  1985 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:02.542500  1985 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.542832  1985 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:02.543105  1746 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:02.465593  1936 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
I20260709 12:20:02.461404 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.369861  1777 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.498567 29322 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:02.494123  1866 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:02.489995  1940 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.485123  1933 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:02.460688  1976 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:02.440778  1931 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.484108  1918 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:02.516001  1030 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:02.540552  1977 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 12:20:02.545194 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66424us
I20260709 12:20:02.586912 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.545287 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:02.546435 28682 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:02.547946 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.548553 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.549355 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:02.551936 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.552937  1900 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:02.553177  1777 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:02.553892 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:02.555787  1938 consensus_queue.cc:1175] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5b3b2f4041a24b05983f30878f16db9d" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
I20260709 12:20:02.571060  1933 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:02.551169 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:02.567821 28680 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:02.590782 29290 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.589407  1030 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:02.588027 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:02.713760 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 125789us
I20260709 12:20:02.594856  1767 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.565811  1866 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.595734 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.596673 28754 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:02.597154 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48700.3us
I20260709 12:20:02.599156  1940 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:02.597563 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48337.7us
I20260709 12:20:02.557135 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.723728 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.638481  1911 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:02.652014  1979 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 12:20:02.653301  1981 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:20:02.736112  1920 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:02.737290  1920 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:02.737676  1920 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:02.730470  1767 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:02.738669  1767 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:02.739188  1767 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:02.739508  1804 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:02.742901  1839 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.745525  1956 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:02.746752  1927 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.747613 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:02.717839  1813 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.067s	user 0.007s	sys 0.014s
I20260709 12:20:02.720866  1814 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.734453  1950 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:02.748749  1813 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.748391  1923 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.762992  1813 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.655258  1955 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.588861  1918 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:02.703828 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.651583  1985 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.451131 28498 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:02.713896  1030 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:02.777485  1030 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.777249 28676 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:02.777882  1030 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:02.777938 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 226786us
I20260709 12:20:02.593847  1931 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:02.560662  1924 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.717483 28682 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:02.590353  1894 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.590273 29323 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:20:02.720361 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.636631  1773 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:02.703747  1701 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:20:02.727869 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.703274  1933 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:02.723757 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.756835  1780 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.770327 28756 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
W20260709 12:20:02.781992 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.595307  1792 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:02.799609 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:02.749370  1778 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.001s
I20260709 12:20:02.784276 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.814771 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.724403  1940 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:02.792949 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 65141.2us
I20260709 12:20:02.756217  1987 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:02.769606 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.749325  1814 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:02.561290  1936 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.798626 28604 raft_consensus.cc:2368] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18.
W20260709 12:20:02.798692 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 75006.4us
I20260709 12:20:02.810335 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.816157 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.738550  1920 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.578738  1976 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.795339  1894 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.834333 28756 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:02.832309  1030 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:02.798045  1911 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:02.840036 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 249247us
I20260709 12:20:02.840148 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.844007 28607 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:02.834333 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:02.847976  1927 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.848273 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.870069 28756 raft_consensus.cc:2368] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:02.871098 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.811172  1943 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:02.839337  1852 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.829237  1773 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:02.833587  1940 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:02.867656 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.881376 28755 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:02.872781 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:02.873498 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:02.873749 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.862093  1030 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.883504 28756 raft_consensus.cc:2393] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:02.885211 29325 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:02.877444 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.810896  1937 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:02.893687 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.950959 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.951300 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.889389 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.951921 28751 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:20:02.894172  1030 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:02.895733  1985 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.860896  1894 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.952540  1030 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.952958  1030 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:02.897105  1895 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.000s
I20260709 12:20:02.848186  1950 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:20:02.958034  1895 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.958789  1950 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:02.959164  1950 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:02.960711  1778 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:02.961113  1778 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.961454  1778 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:02.961637  1829 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.000s
I20260709 12:20:02.962437 28679 raft_consensus.cc:2410] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:20:02.963109 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.964347 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.965534 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.966012  1955 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.908771 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:02.909509 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1510) took 1106 ms. Trace:
W20260709 12:20:02.968407 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 59710.3us
I20260709 12:20:02.966203 28756 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 11: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:02.910431  1759 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.912534  1866 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.913334  1915 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:02.913992 29323 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:20:02.914517 28755 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:02.882972  1813 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:02.918156  1815 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.919140  1842 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:02.920678 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:02.931509 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.933285 29327 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:02.933538  1936 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:02.933796 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.026371 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:03.027282 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.028137 28753 raft_consensus.cc:2410] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:20:02.935797 29325 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:02.936802 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:02.937855  1976 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.939205  1924 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.940164  1852 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:02.941164  1859 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.011s
I20260709 12:20:02.941988 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:02.945335 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:02.947202 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.046121 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:02.874828 28498 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 11, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 11 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:02.948755 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:02.847136  1411 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.054877 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:02.855072  1911 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.852159  1899 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.944123 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.902462  1917 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.953753 29320 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 16. Ops: [14.13-14.13]
I20260709 12:20:02.954507 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.968283 29326 rpcz_store.cc:276] 0709 12:20:01.802670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.802831 (+   161us) service_pool.cc:224] Handling call
0709 12:20:01.803115 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.343786 (+540671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.909270 (+565484us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400780354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:02.909455 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128268160}
I20260709 12:20:02.960176  1895 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.877228  1792 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:02.970758 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.841601  1814 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:02.966172  1960 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.011s
I20260709 12:20:02.884821  1873 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:02.972945 28571 leader_election.cc:400] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:03.071895 28571 leader_election.cc:403] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:20:02.914713  1773 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:02.974908 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:02.975623  1985 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:20:02.975831  1030 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:02.976756 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:02.977360 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.977591 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:02.977892  1894 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.966809  1409 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.979161  1918 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:02.979717  1923 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:02.972261  1888 consensus_meta.cc:287] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.004s
I20260709 12:20:03.023029 28599 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:03.025918 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.040788 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.973327  1955 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:02.959996  1950 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.029950 28673 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:03.205247 28752 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:03.044966 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2581) took 1912 ms. Trace:
I20260709 12:20:02.947593  1810 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.047451 29322 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:03.047736 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.219532 28677 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:03.048461 28598 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:03.048888 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.049643 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:03.053128 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.053905 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.055119 28602 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:02.949565 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:03.056540 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 107869us
W20260709 12:20:03.060305 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 116257us
I20260709 12:20:03.061710 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.223084 29326 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:20:03.223148 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:03.025419 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5b3b2f4041a24b05983f30878f16db9d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:03.196731  1943 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:03.067315 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.067634 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:02.987672  1813 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:03.087853 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.099186 28750 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:20:03.100124 29323 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:03.058159  1911 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:03.076370 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2592) took 1012 ms. Trace:
W20260709 12:20:03.081032 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 301309us
I20260709 12:20:03.258328 28607 rpcz_store.cc:276] 0709 12:20:02.064300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.306988 (+242688us) service_pool.cc:224] Handling call
0709 12:20:03.076113 (+769125us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540004bd54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:03.076296 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232664960}
I20260709 12:20:03.259433 28573 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:03.065672  1411 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:03.046706  1931 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
W20260709 12:20:03.226131  1978 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:20:03.170617 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:03.052322  1852 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.054798  1859 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.169900  1030 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.119942  1792 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
W20260709 12:20:03.073547 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 102887us
I20260709 12:20:03.284994 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:03.180325 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 205515us
I20260709 12:20:03.286021 28606 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:03.288888  1995 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:20:03.073705  1960 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.291167  1960 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.292418 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:03.293171 29327 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:03.293169 29317 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:03.293251  1759 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.294209  1859 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:03.296319  1852 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.296916 28676 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:03.169414  1895 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:03.301327  1899 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.301288  1895 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.303550  1895 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.171752  1917 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:03.304225  1917 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.306895  1917 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.198218 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.308220 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.205757 28600 rpcz_store.cc:276] 0709 12:20:01.132126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.289400 (+157274us) service_pool.cc:224] Handling call
0709 12:20:01.499525 (+210125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.514398 (+ 14873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.514450 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.523951 (+  9501us) log.cc:844] Serialized 26 byte log entry
0709 12:20:01.664807 (+140856us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:01.664872 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.104792 (+439920us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54003d3954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:02.104882 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.104943 (+    61us) raft_consensus.cc:1685] finished
0709 12:20:02.104963 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.044780 (+939817us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003d3950. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:03.044906 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7441,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10135,"spinlock_wait_cycles":515294336,"thread_start_us":96781,"threads_started":1,"wal-append.queue_time_us":258162,"wal-append.run_cpu_time_us":2792,"wal-append.run_wall_time_us":1266476}
I20260709 12:20:03.172773  1937 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.222709 28753 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:20:03.224385 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.311144 28748 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:03.224112 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.064404 28756 raft_consensus.cc:2368] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:20:03.227605 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:03.313529 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 89475.7us
I20260709 12:20:03.229276  1815 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:03.229895  1810 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:03.313656 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 86134.4us
I20260709 12:20:03.230779 29318 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:03.231021 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2896) took 1083 ms. Trace:
I20260709 12:20:03.317399 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:03.317554 28603 rpcz_store.cc:276] 0709 12:20:02.148092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.518369 (+370277us) service_pool.cc:224] Handling call
0709 12:20:02.518667 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.637243 (+118576us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:02.637293 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:02.701657 (+ 64364us) log.cc:844] Serialized 26 byte log entry
0709 12:20:02.981134 (+279477us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:02.981179 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.981253 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:03.230821 (+249568us) raft_consensus.cc:1685] finished
0709 12:20:03.230841 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.230964 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29034,"raft.queue_time_us":182671,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":14113,"thread_start_us":260489,"threads_started":2,"wal-append.queue_time_us":347310}
I20260709 12:20:03.311444 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:03.232079  1777 consensus_meta.cc:287] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.005s
W20260709 12:20:03.232561 28491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 207206us
I20260709 12:20:03.233314 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.320394  1777 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:03.226016  1955 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:03.326895  1815 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:03.329434  1815 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:03.329820  1815 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:03.238325 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.330622  1813 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.234140 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:03.260154 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:03.332724 28607 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:03.333576 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:03.334270 28607 raft_consensus.cc:2368] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:20:03.269374 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.335173 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:03.274106 29323 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:03.059864  1936 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:03.276312 28573 leader_election.cc:400] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
W20260709 12:20:03.337354 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66466us
W20260709 12:20:03.287395  1808 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.144s	user 0.011s	sys 0.001s
I20260709 12:20:03.283692 28752 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:03.218565 28498 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 8 to 12, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 12 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:03.228778 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.346635 28673 raft_consensus.cc:2368] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
I20260709 12:20:03.275828  1943 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:03.314049  1937 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:03.230573  1950 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:03.319561 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.095443  1987 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:03.285302 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:03.350051 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:03.235805 29326 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:03.325758 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.351620  1030 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:03.352733 28648 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.221874  1409 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.221167  1888 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.311894  1778 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.277848  1918 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:03.352835 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.364329  1030 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:03.268694  1894 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:03.336127 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.337227  1915 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:03.386094 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 50040.4us
I20260709 12:20:03.386919 29290 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.346264  1827 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:03.355188 29317 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:20:03.388707 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.389370 28673 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:03.355850 28606 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:03.391887 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2901) took 1221 ms. Trace:
I20260709 12:20:03.392808 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.327322  1895 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:03.356931 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 314631us
I20260709 12:20:03.395426 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:03.359977 28676 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:03.277932 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.365746 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.286814  1411 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:03.343564  1960 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.384979 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.359050  1936 raft_consensus.cc:2764] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:20:03.396137  1923 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:03.346195  1813 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:03.392238 28606 rpcz_store.cc:276] 0709 12:20:02.170757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.391099 (+1220342us) service_pool.cc:224] Handling call
0709 12:20:03.391396 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.391562 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.391584 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.391624 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:03.391654 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.391704 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.391830 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.408332 28675 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:20:03.418087 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.408596  1030 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:03.409318 28648 leader_election.cc:400] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:20:03.418804 29326 raft_consensus.cc:2368] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:20:03.418964 28648 leader_election.cc:403] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:20:03.385507 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 100260us
I20260709 12:20:03.397189 28682 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:03.412922 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1508) took 1618 ms. Trace:
I20260709 12:20:03.413635 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:03.420033 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:03.415869 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 355664us
I20260709 12:20:03.417167 28673 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:03.348979  1808 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.427317  1030 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:03.398707  1827 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.398037  1937 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:03.424086 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:03.397022  1759 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:03.397178  1924 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:03.438815 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1428) took 1174 ms. Trace:
I20260709 12:20:03.399570  1956 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:03.434026 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:03.423237 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2898) took 1253 ms. Trace:
I20260709 12:20:03.420135 29321 rpcz_store.cc:276] 0709 12:20:01.794728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.794977 (+   249us) service_pool.cc:224] Handling call
0709 12:20:01.795443 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:01.803762 (+  8319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.803812 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.806635 (+  2823us) log.cc:844] Serialized 26 byte log entry
0709 12:20:02.950367 (+1143732us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b18001eb320. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1
0709 12:20:02.950527 (+   160us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:03.337404 (+386877us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.397573 (+ 60169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.398370 (+   797us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:03.398430 (+    60us) raft_consensus.cc:1685] finished
0709 12:20:03.412720 (+ 14290us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.412858 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7799,"prepare.queue_time_us":438675,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":79444,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":46477,"spinlock_wait_cycles":36757376,"thread_start_us":547329,"threads_started":3,"wal-append.queue_time_us":244284,"wal-append.run_cpu_time_us":2123,"wal-append.run_wall_time_us":1096052}
I20260709 12:20:03.394079  1895 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.436517 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.444700 28681 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:03.444583  1030 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:20:03.443229 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:03.444361 28680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 2902) took 1314 ms (client timeout 1726 ms). Trace:
I20260709 12:20:03.436363 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.440258 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.445098 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2584) took 1368 ms. Trace:
I20260709 12:20:03.450356 28674 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:20:03.463255 28674 pending_rounds.cc:85] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 12
I20260709 12:20:03.463541 28674 pending_rounds.cc:107] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:20:03.463807 28674 raft_consensus.cc:2889] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:03.386857  1873 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:20:03.343739  1773 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.416044  1923 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:03.460608 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:03.454550  1767 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.003s
W20260709 12:20:03.462291 28680 rpcz_store.cc:269] 0709 12:20:02.129475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.130164 (+   689us) service_pool.cc:224] Handling call
0709 12:20:03.444162 (+1313998us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540024f9d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:03.444303 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003852672}
I20260709 12:20:03.450773 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:03.456387 28679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2438) took 2282 ms (client timeout 2127 ms). Trace:
W20260709 12:20:03.478580 28679 rpcz_store.cc:269] 0709 12:20:01.163077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.163281 (+   204us) service_pool.cc:224] Handling call
0709 12:20:03.441285 (+2278004us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54000c6f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:03.445436 (+  4151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4134965504}
I20260709 12:20:03.464545  1998 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:03.464761 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:03.478214 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:03.466727 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2903) took 1295 ms. Trace:
I20260709 12:20:03.414650  1993 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:03.468353 28647 leader_election.cc:400] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:20:03.452349 29319 rpcz_store.cc:276] 0709 12:20:02.264216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.267608 (+  3392us) service_pool.cc:224] Handling call
0709 12:20:02.267971 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.329129 (+ 61158us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:02.329175 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.329233 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:02.329279 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.438596 (+1109317us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b540055ebd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:03.438644 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.438760 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139953024}
I20260709 12:20:03.497447 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.497941 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:03.461762 28600 rpcz_store.cc:276] 0709 12:20:02.169726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.309290 (+1139564us) service_pool.cc:224] Handling call
0709 12:20:03.309600 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.309798 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:03.310086 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.422886 (+112800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.422935 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:03.423005 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.423073 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.423180 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13960,"prepare.queue_time_us":2622,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":6041,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":15784,"thread_start_us":107892,"threads_started":1}
I20260709 12:20:03.462888 28754 rpcz_store.cc:276] 0709 12:20:02.077259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.077527 (+   268us) service_pool.cc:224] Handling call
0709 12:20:02.088073 (+ 10546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.717524 (+629451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.444883 (+727359us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54001c4654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:03.445043 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169220864}
I20260709 12:20:03.414721  1999 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:03.396616  1894 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.441558  1915 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:03.479669 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:03.479982  1030 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:03.464672 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:03.438355  1827 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:03.482486 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.483202 29318 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:03.416371  1960 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.437551  1997 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:03.457470  1814 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.493746 28606 rpcz_store.cc:276] 0709 12:20:02.171323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.441994 (+1270671us) service_pool.cc:224] Handling call
0709 12:20:03.466022 (+ 24028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.466254 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.466312 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.466370 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:03.466427 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.466506 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.466653 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.431285  1813 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:03.494143 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:03.504528 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.483533  1923 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:03.481098  1936 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:03.513171 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1520) took 1259 ms. Trace:
I20260709 12:20:03.516417 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.517028 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.424662  1955 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.520474 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.525684 28750 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:03.524082 29320 rpcz_store.cc:276] 0709 12:20:02.253705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.253899 (+   194us) service_pool.cc:224] Handling call
0709 12:20:02.254307 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.061178 (+806871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.512904 (+451726us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b5400790254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:03.513108 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602155392}
I20260709 12:20:03.489256  1994 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:03.529162 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.529066 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.529806 28754 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:03.485337  1767 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.530294 28750 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:03.510820  1999 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.535358 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2905) took 1344 ms. Trace:
I20260709 12:20:03.537165 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.545881 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:03.540855 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2895) took 1404 ms. Trace:
I20260709 12:20:03.547025 29326 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:03.546734 28599 rpcz_store.cc:276] 0709 12:20:02.136891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.514614 (+377723us) service_pool.cc:224] Handling call
0709 12:20:02.567107 (+ 52493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.202362 (+635255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.540548 (+338186us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400234954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:03.540780 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048015744}
I20260709 12:20:03.545651 28600 rpcz_store.cc:276] 0709 12:20:02.190762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.527022 (+1336260us) service_pool.cc:224] Handling call
0709 12:20:03.534879 (+  7857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.535058 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.535087 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.535125 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:03.535162 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.535211 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.535307 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.455312  1943 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.553730 29326 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:03.553373 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.550696 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.555107 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.555330 28750 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:03.554399 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.556212 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:03.556465 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 120048us
I20260709 12:20:03.557325 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.523253  1924 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:03.559122 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:03.570752 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.562327 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:03.562327 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.562851 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.563753  1888 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:03.564234  2005 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:20:03.565021  2008 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:20:03.490403  1411 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.566100  1895 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.580978 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:03.568912  1994 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:03.571405 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2597) took 1265 ms. Trace:
I20260709 12:20:03.519739  1998 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:03.571943 28599 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:03.572922 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.585166 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2596) took 1297 ms. Trace:
I20260709 12:20:03.585626 28599 rpcz_store.cc:276] 0709 12:20:02.287329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.548203 (+1260874us) service_pool.cc:224] Handling call
0709 12:20:03.571761 (+ 23558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.584882 (+ 13121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.585100 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.561918 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:03.451711 28498 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 12, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 12 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.573663 29322 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:03.573305 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.527946  1915 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:03.476701  1987 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.584539  1781 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:03.576239 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.537941  1936 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:03.597664 28680 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:03.581868 28600 rpcz_store.cc:276] 0709 12:20:02.305554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.548725 (+1243171us) service_pool.cc:224] Handling call
0709 12:20:03.570948 (+ 22223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.571106 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.571135 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.571170 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:03.571199 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.571251 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.571351 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.582552 28750 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:03.581151 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:03.569780  1813 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.550660  1999 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:03.590811 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.575318 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.577291  1993 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:03.593544 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:03.595866 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:03.581261  1918 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:03.597739 28599 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:03.581139 28675 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:03.611279 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.600111 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.588796  1888 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:03.599864 29327 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:03.597597 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.605852 28648 leader_election.cc:400] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:20:03.608456 28751 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:03.599181 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:03.615065 28648 leader_election.cc:403] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:03.615140 28752 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:03.578310  1924 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.615404 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:03.612044 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2598) took 1282 ms. Trace:
I20260709 12:20:03.590848  1778 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.619068 28599 rpcz_store.cc:276] 0709 12:20:02.329255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.586491 (+1257236us) service_pool.cc:224] Handling call
0709 12:20:03.597556 (+ 11065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.611773 (+ 14217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.611986 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.598517  1842 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:03.624006 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:03.607821  1895 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:03.636469 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:03.638399 28602 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:03.639230 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2599) took 1053 ms. Trace:
I20260709 12:20:03.639617 28602 rpcz_store.cc:276] 0709 12:20:02.585806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.637801 (+1051995us) service_pool.cc:224] Handling call
0709 12:20:03.638181 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.638931 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.639163 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.641197 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:03.642431 28747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1114) took 1183 ms (client timeout 1572 ms). Trace:
W20260709 12:20:03.642865 28747 rpcz_store.cc:269] 0709 12:20:02.458768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.636101 (+1177333us) service_pool.cc:224] Handling call
0709 12:20:03.642359 (+  6258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.615922  1888 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.649602 28752 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:03.600838  1797 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:20:03.619813  1813 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:20:03.650998 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 75486.2us
I20260709 12:20:03.656554 28751 raft_consensus.cc:2410] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:20:03.590181  1998 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.640650  1781 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:20:03.666036 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 92800.2us
I20260709 12:20:03.633065  2015 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13.
I20260709 12:20:03.642150  1808 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.652158  1888 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:03.646433  1895 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:03.671603 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:03.672708 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 57374.7us
I20260709 12:20:03.663524  1960 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.679141 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:03.666874  1915 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:03.685153  2006 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:20:03.685577  1940 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.005s
I20260709 12:20:03.686055  1940 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.679000  2003 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:03.687552 29326 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:03.661686  1993 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:20:03.665235  2022 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:20:03.680007  1894 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.691679  2023 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:03.696360  1924 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.697744  1701 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:03.677106  2010 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:20:03.698684  1993 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:03.699338  1815 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.698009  2012 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:03.667052  1936 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.688283  1767 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:03.716090  2011 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:20:03.690990  2020 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:20:03.728860 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 91225.5us
I20260709 12:20:03.708703  2023 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.700760  2003 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:03.700730  2021 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:03.700383  1895 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.735080 29323 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:03.736742 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2906) took 1223 ms. Trace:
I20260709 12:20:03.714934  1993 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.743203 28600 rpcz_store.cc:276] 0709 12:20:02.513061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.599465 (+1086404us) service_pool.cc:224] Handling call
0709 12:20:03.613829 (+ 14364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.614028 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:03.642742 (+ 28714us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.736107 (+ 93365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.736173 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:03.736229 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.736323 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.736672 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22966,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":108,"thread_start_us":92882,"threads_started":1}
I20260709 12:20:03.752574 29323 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:03.754058 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2897) took 1586 ms. Trace:
I20260709 12:20:03.754426 28601 rpcz_store.cc:276] 0709 12:20:02.167455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.523738 (+356283us) service_pool.cc:224] Handling call
0709 12:20:02.524003 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.544422 (+ 20419us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:02.768361 (+223939us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.059475 (+291114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.059532 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:03.059582 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.753860 (+694278us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5400092754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:03.753913 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.754012 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253342,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":22017,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"spinlock_wait_cycles":46056704,"thread_start_us":488866,"threads_started":3,"wal-append.queue_time_us":295774}
I20260709 12:20:03.756031 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:03.759964 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:03.761376 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:03.763705 28601 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:03.764642 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1016) took 1112 ms. Trace:
I20260709 12:20:03.765683 28601 rpcz_store.cc:276] 0709 12:20:02.652496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.762749 (+1110253us) service_pool.cc:224] Handling call
0709 12:20:03.763109 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.764348 (+  1239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.764572 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.712634  1911 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:03.680634 28498 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.751827  1993 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:03.756599  2010 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:03.778535 28601 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:03.763160  2012 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:03.785995  1701 tablet_bootstrap.cc:492] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:20:03.793540 28755 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:03.785331  1923 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.777930  1997 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:03.796896 28498 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 11 to 14, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 14 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:03.797477  1888 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.798732  1827 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:03.802567  1933 consensus_meta.cc:287] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.991s	user 0.006s	sys 0.005s
I20260709 12:20:03.774209  1615 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:03.783550  2023 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.809049  2003 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.841118  1997 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:03.792797  2019 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:20:03.769821  1815 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.905776  1888 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.906800 28498 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 11, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 11 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.811964 28606 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:03.908751 28498 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:03.909782  1923 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.849759  1933 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.789716  2010 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:03.913132  1933 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.913466  2010 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:03.890479 29320 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:20:03.901497  1827 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.902349  1997 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.916208  2010 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:03.916476  1997 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:03.917263  1950 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 12:20:03.917656 28606 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:03.917951  1998 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:03.918848  1701 ts_tablet_manager.cc:1403] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 4.354s	user 0.064s	sys 0.023s
I20260709 12:20:03.793582  2012 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:03.920532 28607 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:03.922029 28748 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:03.954531 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1004) took 1900 ms. Trace:
I20260709 12:20:03.847409  1940 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:03.955072 28604 rpcz_store.cc:276] 0709 12:20:02.054341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.056544 (+  2203us) service_pool.cc:224] Handling call
0709 12:20:03.953403 (+1896859us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54002c0e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:03.954437 (+  1034us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544961408}
W20260709 12:20:03.965042 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 304162us
I20260709 12:20:03.965891 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1223) took 1017 ms. Trace:
I20260709 12:20:03.840831  1999 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:03.967824 29322 rpcz_store.cc:276] 0709 12:20:02.948163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.221382 (+273219us) service_pool.cc:224] Handling call
0709 12:20:03.221683 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.588612 (+366929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.965585 (+376973us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54006531d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:03.965814 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805139840}
I20260709 12:20:03.844473  2015 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
W20260709 12:20:03.975586 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 294220us
I20260709 12:20:03.977826 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:03.981261 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:03.981916 28602 raft_consensus.cc:2368] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:20:03.984299 28720 leader_election.cc:400] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
W20260709 12:20:03.983775 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 140732us
I20260709 12:20:03.979800  1986 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:04.000851 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:03.983012  1998 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:03.987322 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 308209us
I20260709 12:20:03.995224 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:03.985289 28720 leader_election.cc:403] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:20:04.005343 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 165783us
I20260709 12:20:04.009941 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:04.012331 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:04.008190 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:04.012624 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:04.018267 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:04.013960 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.019977 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.022261 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:04.023584 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:04.024428 29327 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:04.026602 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.027236 28680 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:04.029186 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:04.031420 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:04.033651 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.034399 28680 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:04.035593 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:04.011901  1986 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:03.980777  2012 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.018692  2024 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
I20260709 12:20:04.040946 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.025830 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:04.030915  1998 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.044937 28673 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:04.042920 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.043735 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:04.030751  1943 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:20:04.044042 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.045970 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.047362 29317 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 10.
I20260709 12:20:04.051564 28679 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:04.050892  1917 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.053009  1917 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.055338 28605 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:04.033931  1937 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:04.074360  1993 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.029234  1859 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:04.027211  1962 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:04.081612 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:04.085336 28601 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:20:04.023432  1895 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:04.026993  1773 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:04.080063 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:04.086661 28602 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:04.035933  1911 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:04.088344 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44443.6us
I20260709 12:20:04.091027 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:04.094956 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.022377  1950 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:20:04.097330 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:04.079651 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:04.049367  2030 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:20:04.095888  1986 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:04.100637  1986 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:04.099371  1873 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:04.100944  1937 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:04.101795  1999 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:04.097709  1933 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:20:04.101706  1873 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:04.103441  1962 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:04.103874  1962 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:04.104336  1962 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.103926  1873 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.076213 28498 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 13, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 13 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:04.106621 28498 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:04.107806 29292 leader_election.cc:400] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18.
I20260709 12:20:04.108165 29292 leader_election.cc:403] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:04.078310  1940 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:04.108496  1821 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:04.109031  1821 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.109402  1821 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:04.109938 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:04.101047  1986 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:04.113339  2039 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.113842  2039 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.116463  2024 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:04.118860  2043 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.119059  2024 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:04.122066  1943 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:04.121825  2043 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.122604  1943 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.123642  2024 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:04.123970  2043 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:04.119290  1911 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:04.125167  2033 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:04.125546  2033 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:04.116006  2012 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:04.126402  2033 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.127131  1986 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.127691  2033 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:04.128556  1859 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:04.129678  1992 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.121s	user 0.000s	sys 0.019s
I20260709 12:20:04.131748  2039 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:04.132284  1701 raft_consensus.cc:359] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:04.133422  1701 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:20:04.146045 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2461) took 1696 ms. Trace:
I20260709 12:20:04.146575 28678 rpcz_store.cc:276] 0709 12:20:02.450041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.553114 (+103073us) service_pool.cc:224] Handling call
0709 12:20:02.553487 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.559739 (+  6252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:02.559788 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:02.570534 (+ 10746us) log.cc:844] Serialized 26 byte log entry
0709 12:20:02.793023 (+222489us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:02.793063 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.793131 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.129017 (+1335886us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:04.136706 (+  7689us) raft_consensus.cc:1685] finished
0709 12:20:04.136738 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.145961 (+  9223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5790,"raft.queue_time_us":6166,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10858,"spinlock_wait_cycles":53438848,"thread_start_us":148192,"threads_started":1,"wal-append.queue_time_us":296692}
I20260709 12:20:04.143402 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2468) took 1187 ms. Trace:
I20260709 12:20:04.149116 28674 rpcz_store.cc:276] 0709 12:20:02.956424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.322097 (+365673us) service_pool.cc:224] Handling call
0709 12:20:03.441941 (+119844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.464317 (+ 22376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.139180 (+674863us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000c6f50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:04.143314 (+  4134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274919680}
W20260709 12:20:04.153458 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 108001us
I20260709 12:20:04.136399  1951 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18.
W20260709 12:20:04.152384 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 112678us
I20260709 12:20:04.136346  1998 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:04.129699  1859 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:04.154690  1943 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:04.161258 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:04.134262  1701 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:20:04.150769  1990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.188s	user 0.011s	sys 0.015s
W20260709 12:20:04.161865 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50295.5us
I20260709 12:20:04.165995 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.166247 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:04.165664 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.166659 29320 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:04.167809 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:04.168026 28602 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:04.168128 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:04.168869 28753 raft_consensus.cc:2368] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14.
I20260709 12:20:04.169762  1701 ts_tablet_manager.cc:1434] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.251s	user 0.007s	sys 0.002s
I20260709 12:20:04.163655  1931 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:04.170514  1931 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:04.171809  2024 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:04.171471  1931 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.172341  2024 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:04.173354  2024 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:04.177387 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1121) took 1427 ms. Trace:
I20260709 12:20:04.177793 28748 rpcz_store.cc:276] 0709 12:20:02.749968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.312795 (+562827us) service_pool.cc:224] Handling call
0709 12:20:03.313064 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.931029 (+617965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.177125 (+246096us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54003e8854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:04.177314 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399493504}
I20260709 12:20:04.182411  1962 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.152194  1993 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:04.184790 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:04.192139 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:04.193166 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:04.193714 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.186384 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2900) took 2015 ms. Trace:
I20260709 12:20:04.203239 28607 rpcz_store.cc:276] 0709 12:20:02.170466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.334856 (+1164390us) service_pool.cc:224] Handling call
0709 12:20:03.335118 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.930631 (+595513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.186103 (+255472us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540004b854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:04.186280 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345734528}
W20260709 12:20:04.194669 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 159179us
I20260709 12:20:04.199810 28756 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:20:04.201036 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:04.205729 28753 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:04.201254 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:04.214510 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:04.217384 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:04.218108 28751 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:04.219048 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:04.219800 28752 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
W20260709 12:20:04.232316 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:04.164667  1990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.011s	sys 0.016s
I20260709 12:20:04.247825 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:04.248634  1767 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:04.248734 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47616.7us
W20260709 12:20:04.254083 29292 leader_election.cc:336] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.669s (SENT)
I20260709 12:20:04.255591 29292 leader_election.cc:400] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14.
W20260709 12:20:04.249970 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.255971 29292 leader_election.cc:403] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:04.270293 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:04.270895 29319 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:04.270936 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.272548 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.273844 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.180233  1821 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.275363 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.273586  1993 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:20:04.276651  2048 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:04.282426 28680 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:04.246905  1900 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:04.284857 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.285728 28682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:20:04.286465 28682 raft_consensus.cc:606] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Received request to transfer leadership to TS a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:04.288604 28753 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
W20260709 12:20:04.292620 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44877.9us
I20260709 12:20:04.283453 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.294894 28607 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:04.267216  2043 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.267469  1943 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:04.297077 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.272776  1986 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:04.299989 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:04.308243 29319 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:04.310075 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.310914 28678 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.310772 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:04.273797 28617 tablet_copy_service.cc:342] P e3ce74ba14714b4dbd2d75e27f34eb0d: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-e5bdaade8df945828ab371a3267cd752 received from {username='slave'} at 127.0.0.1:39434
I20260709 12:20:04.314743 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.268759  1842 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14.
I20260709 12:20:04.267169  1873 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:20:04.277943  1797 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:20:04.301076  2039 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:04.325084 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.330864 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.298534  1778 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:04.333565  1778 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.336417  1778 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:04.328035 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:04.318189  1997 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:04.298452  1960 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 12:20:04.344931  2045 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:20:04.324462 28617 tablet_copy_service.cc:434] P e3ce74ba14714b4dbd2d75e27f34eb0d: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-e5bdaade8df945828ab371a3267cd752 on tablet e5bdaade8df945828ab371a3267cd752 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:04.315543  2023 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:20:04.342041  2039 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.306707  2043 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:04.312888  1943 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.348971  2052 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:04.379546 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 79666.2us
I20260709 12:20:04.379637 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 1193) took 1422 ms. Trace:
I20260709 12:20:04.357129  1997 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:04.374850  1821 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:04.356842  1950 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:04.345398  1911 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:20:04.377251  2051 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:04.382045 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 67229us
I20260709 12:20:04.401553 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:04.372069 28678 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:04.380499 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:04.368165  2039 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.381250 28677 rpcz_store.cc:276] 0709 12:20:02.957198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.220204 (+263006us) service_pool.cc:224] Handling call
0709 12:20:04.379453 (+1159249us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b5400251f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:04.379578 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598139648}
I20260709 12:20:04.376166  2043 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:04.358449  2048 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:20:04.391562  1943 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:04.395107 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.399626 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:04.381855  2052 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:04.415441 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 56119.6us
I20260709 12:20:04.413378  1960 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:04.433993 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:04.435086 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:04.435755 28747 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:04.436336  1409 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:04.438202 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:04.440562 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:04.438202 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:04.440125 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:04.410516  1993 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:20:04.423394  1842 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:04.419644  2052 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.448055  1960 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:04.450102  1911 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:04.450917  1409 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:04.469106  1960 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:04.464772  1842 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:04.479254 29319 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:04.468775  1911 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:04.471114  1409 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.483973  1938 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:04.462231  1997 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.484411  1938 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:04.493309  1938 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.494541  1938 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.496320  2022 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:04.496781  2022 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:04.497632  2022 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:04.499307  2012 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:04.499549 29317 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:20:04.499724  2012 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:04.500027 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.500787 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.500589  2012 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.501518 29318 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:20:04.501885  2012 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:04.488279 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2456) took 2079 ms. Trace:
I20260709 12:20:04.502638 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.500636 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:04.489694 28605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2912) took 1595 ms (client timeout 2062 ms). Trace:
W20260709 12:20:04.513176 28605 rpcz_store.cc:269] 0709 12:20:02.894421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.023656 (+129235us) service_pool.cc:224] Handling call
0709 12:20:04.489535 (+1465879us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b540004b354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:04.489637 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2299031424}
I20260709 12:20:04.506282 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:04.502506 28681 rpcz_store.cc:276] 0709 12:20:02.408807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.493525 (+ 84718us) service_pool.cc:224] Handling call
0709 12:20:03.444521 (+950996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.461740 (+ 17219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.488093 (+1026353us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b540024f9d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:04.488223 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2186414848}
I20260709 12:20:04.511238 28601 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:04.519404 29320 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:04.474797  2060 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:04.527050 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.528781 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.532903 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.533654 28681 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:04.536379  1030 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.537038  1030 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.477368  1953 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:04.545169 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:04.546710 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:04.547546 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 130304us
I20260709 12:20:04.548554 28722 leader_election.cc:400] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:20:04.491930  1767 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:04.487524  1990 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:04.550661 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:04.556555 28607 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:04.505239  1409 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:04.554806 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:04.545761  2011 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:20:04.535624  1873 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.559870 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.535384  2060 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:04.553526 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:04.581218  1030 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:04.606967 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:04.723177 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 168434us
I20260709 12:20:04.743822  1810 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.814877 28605 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:04.724934 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:04.771565 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.788350 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:04.819286 28598 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:04.552214  2042 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:04.806722 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 263427us
I20260709 12:20:04.542106  2066 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.247s
I20260709 12:20:04.556026  1990 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:04.838357 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.838987 28674 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:04.808874 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.490231  1911 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.811590 28607 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:04.785902  2043 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:04.807899 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:04.765583 28681 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
W20260709 12:20:04.824082 28676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 2911) took 2000 ms (client timeout 1719 ms). Trace:
I20260709 12:20:04.553603  1953 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:04.851007 28676 rpcz_store.cc:269] 0709 12:20:02.824074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.839901 (+ 15827us) service_pool.cc:224] Handling call
0709 12:20:04.823847 (+1983946us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54003b8154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:04.823991 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982948224}
I20260709 12:20:04.873924 28676 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: []
W20260709 12:20:04.893420 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:04.897989 28677 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:04.837198  1839 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:04.833359  1821 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:04.826323  1810 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.918061  2015 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:04.918809  2015 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:04.921097  2061 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:20:04.921824  1956 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:04.922334  1956 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:04.923334  1956 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:04.927054 28755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2590) took 2440 ms (client timeout 3126 ms). Trace:
W20260709 12:20:04.927575 28755 rpcz_store.cc:269] 0709 12:20:02.486155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.307924 (+821769us) service_pool.cc:224] Handling call
0709 12:20:04.926790 (+1618866us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54003e9754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:04.926951 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114185472}
I20260709 12:20:04.935148  1917 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:04.935488  2032 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.821045  2024 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 12:20:04.943426 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1531) took 1386 ms. Trace:
I20260709 12:20:04.945047 29326 rpcz_store.cc:276] 0709 12:20:03.557153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.557327 (+   174us) service_pool.cc:224] Handling call
0709 12:20:03.557672 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.688620 (+130948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.943111 (+1254491us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54005df2d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:04.943342 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298292096}
I20260709 12:20:04.810681  1873 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:04.939097  2009 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.396s	user 0.001s	sys 0.000s
I20260709 12:20:04.832602  2042 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:04.816912  1842 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.953529  1956 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.955651  1911 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.936215  2032 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.966583  1810 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:04.966707  2068 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:04.972725  1873 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:04.950924  1990 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.973655  2042 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:04.961727  2033 consensus_meta.cc:287] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.834s	user 0.014s	sys 0.000s
I20260709 12:20:04.913159  1821 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:04.941376  2060 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:04.976984  2068 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:04.983075  1960 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.001s
I20260709 12:20:04.984557  1990 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:04.981834  2015 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:04.996670  2068 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:04.999864  2068 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:05.038043 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2899) took 2867 ms. Trace:
I20260709 12:20:05.039139 28603 rpcz_store.cc:276] 0709 12:20:02.170149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.319060 (+1148911us) service_pool.cc:224] Handling call
0709 12:20:03.319334 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:03.319659 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.319687 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:03.335759 (+ 16072us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b2c00058028. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:03.339461 (+  3702us) log.cc:844] Serialized 26 byte log entry
0709 12:20:03.367952 (+ 28491us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b1800053680. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:20:03.495515 (+127563us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:03.525952 (+ 30437us) log.cc:844] Serialized 14 byte log entry
0709 12:20:03.528351 (+  2399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.528500 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.479195 (+950695us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800053680. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:20:05.036951 (+557756us) raft_consensus.cc:1685] finished
0709 12:20:05.037053 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.037648 (+   595us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66749,"prepare.queue_time_us":30195,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":5711,"raft.queue_time_us":7306,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":16839,"spinlock_wait_cycles":59353216,"thread_start_us":127358,"threads_started":1,"wal-append.queue_time_us":205438}
I20260709 12:20:05.044076 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.045797 28598 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
W20260709 12:20:05.062330 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 205253us
I20260709 12:20:05.064112 28748 raft_consensus.cc:2410] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:20:05.075516  1767 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:05.076944  1767 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:05.077986 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.079207  1821 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.079275  1030 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.080727  1810 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.086835  1810 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.082791 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.119552  1810 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.083922 28647 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:05.120308 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.080379  1767 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.084767 29322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdf685c3207841c286a253af2d105972"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:41278
I20260709 12:20:05.137349  1999 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:05.138371  1999 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.140740 29322 raft_consensus.cc:606] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:05.141310 29322 raft_consensus.cc:614] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:05.148454 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:05.148878 28673 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:05.149438 28675 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:05.151188 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:05.151595 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2907) took 2589 ms. Trace:
I20260709 12:20:05.152428 28682 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:05.152232 28599 rpcz_store.cc:276] 0709 12:20:02.562296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.620136 (+1057840us) service_pool.cc:224] Handling call
0709 12:20:03.645601 (+ 25465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.677425 (+ 31824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.677445 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.677473 (+    28us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:03.677492 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.150969 (+1473477us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b54003d2054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:05.151072 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.151381 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72753024}
I20260709 12:20:05.081245  1030 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.172773 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:04.990626  1960 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:05.182174 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.184229  1953 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.189411  2032 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:05.189534 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106003us
I20260709 12:20:05.189868  2078 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:05.197594 28603 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:05.198702 28682 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:20:05.199234  1797 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:05.215734 28675 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:05.211102  1797 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:05.217420  1030 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.222769 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:05.223821  1950 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:05.222884  1797 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.225183  1797 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:05.224294  1950 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:05.222642  1941 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:05.225401  1917 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.227532  1941 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:05.228193  1960 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.230751 28603 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:05.229423  1917 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.232414  1950 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.235635  1941 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.238511  1941 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.241583  1917 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.243099 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:05.244100  1411 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.245121  1411 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.235836  1999 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.238299  1950 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.260048  1806 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:05.260689  1806 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:05.261870  1806 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.263594  1806 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.261943  1411 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.266022 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:05.268813  1411 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:05.267980 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:05.272773 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46953.9us
I20260709 12:20:05.273989 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.275167  1997 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:05.275717  1962 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.278151 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.279505  1962 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:05.281693  1962 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:05.282611  1962 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.283605 29326 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:05.284379 29317 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:05.286099  1962 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.286226 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:05.287472 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.289908 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.290743  1962 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:05.290817  2003 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.291967  2003 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.299192  2003 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:05.303858 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.021s	sys 0.021s
W20260709 12:20:05.304400 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.021s	sys 0.022s
W20260709 12:20:05.314248  2052 consensus_meta.cc:287] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.828s	user 0.015s	sys 0.004s
I20260709 12:20:05.310735 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:05.314040 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:05.313383 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:05.322650  1997 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:05.327461 29323 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:05.329080 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.329458 28599 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:05.327633 29326 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:05.330209 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.332743 29322 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:05.334914 29317 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:05.335489 28602 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:20:05.336714  1842 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:05.337220  1842 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.310674  2022 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:05.337538  1842 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:05.341145  2012 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.008s
I20260709 12:20:05.347291 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:05.348884 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 59266.9us
I20260709 12:20:05.349728 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.350881 29326 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:05.353336 29317 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:05.324847  2052 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.356699 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:05.357601 28678 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:05.357676 28603 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:05.358526  2052 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:05.359781 28674 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.006s
W20260709 12:20:05.359972 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.360726  1997 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.360816 28674 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:05.361482  1960 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:05.361410  1997 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.363853  1997 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.364049 28680 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:05.365132  1411 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.365806  1411 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:05.366987 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:05.353935  1938 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.829s	user 0.016s	sys 0.005s
I20260709 12:20:05.368326 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.369006 28598 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:20:05.370693 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.371199 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:05.371915  1409 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.006s
I20260709 12:20:05.371240 28598 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:05.372383  1409 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.373626 28673 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:05.374791  1409 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.374904 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.375077  1411 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:05.375821 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.377395  1997 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:05.373598  2047 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.380049 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:05.386338 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.392568 28607 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:05.390589 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.390141 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:05.391175  2062 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:05.395175 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.402521 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.402884  1920 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.403553 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.406250 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.393842  2035 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:05.409574  2060 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.409948  2062 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.412734  1759 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:05.413305  2039 consensus_meta.cc:287] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.995s	user 0.004s	sys 0.016s
I20260709 12:20:05.413534  1759 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.415486  2059 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:05.416673 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.413942  2039 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.387425  2047 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.419685  2039 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.416158  2059 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.425510  1997 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:05.418087  1759 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:05.432396 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55947.3us
I20260709 12:20:05.433483 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.434994  1999 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:05.438905 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.448522  1797 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:05.451473  2013 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:05.451869  2013 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:05.453002  2013 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.454682 28748 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:05.454398  2013 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:05.427350 29290 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:05.466842  1842 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.468817  1956 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:05.468855 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.470002  2059 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.470347 28603 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:05.470979  2047 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.472831 28648 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:05.473685  1411 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:05.474006 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.474112  1411 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:05.474560  1411 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.476418 28750 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:05.478092 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 146133us
I20260709 12:20:05.482215 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.482504 28755 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:05.486429  2033 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:05.492784  1997 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:05.428371  2062 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:05.508893 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70107us
I20260709 12:20:05.510912 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:05.514250 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.505544  2024 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:20:05.518050  1759 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.518661  1759 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.504216  1999 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:20:05.522789 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.523689 28755 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:05.524070 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:05.516923  2024 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:05.525391  2024 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:05.526482  2024 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.527726  2024 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:05.529280  2033 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:05.537200  1842 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.540684  2013 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:05.540755 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.541476  1759 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.541935 28753 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:05.544193 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:05.542601  1990 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.513s	user 0.014s	sys 0.000s
I20260709 12:20:05.541529  2013 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.547495 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:05.548612  1990 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:05.549048 28749 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:05.549765 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:05.550096  1742 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.550674  1997 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:05.551354 28749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1118) took 3063 ms (client timeout 1669 ms). Trace:
I20260709 12:20:05.551394  1997 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:05.551848 28749 rpcz_store.cc:269] 0709 12:20:02.488104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.701182 (+213078us) service_pool.cc:224] Handling call
0709 12:20:05.551077 (+2849895us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b54000348d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:05.551244 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6354979072}
I20260709 12:20:05.552752  1997 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.550712  1742 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.547580  2013 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.559450 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.560277 28749 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.563385  1742 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.563536 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:05.554025  1990 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:05.564544  1999 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:05.565040 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53806.5us
I20260709 12:20:05.565199  1999 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.565744  1999 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.566114  1962 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:05.568106 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.574059 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:05.577247  1759 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.579782  1759 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.581761 29317 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:05.582327  1759 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.583496 28749 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:05.583716  1990 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.584262  2013 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:05.584741 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:05.584972  2013 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.586603  2059 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:05.586968  2059 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:05.587147  2013 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.587380  2059 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.590690 29326 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:05.589566 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.574659  1962 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:05.591830 28681 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:05.592967 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.605228 28571 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:05.606446  1889 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.607230 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.607112  1889 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.607700  1917 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:05.609503  2034 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:05.610329 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.610541  2034 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:05.612834 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.611022 28750 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:05.614976 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.617887 28747 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:05.620339 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.616860 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.623733 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:05.620116 28673 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:20:05.625408 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:05.626015 29326 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:05.626343 28753 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:05.627183 28682 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:05.627357 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.628007 28607 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:05.615000  1889 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.611022  2034 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:05.634341 28748 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:05.644219 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.634601 28603 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:05.633303  1759 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:05.646834  1759 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.647720 28755 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:05.636042 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.648756 28605 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
W20260709 12:20:05.637144  2090 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:05.641031 28674 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:05.645129 28749 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:05.633798 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:05.647112 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:05.650892  1409 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:05.651319  1409 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.651722  1409 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.651878 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.653579  1759 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.654501  2013 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.654706 28747 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:20:05.654987  2013 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.635577 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.657053  2013 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.657711 28751 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:05.657894  1999 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.659211 28599 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:05.663937 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.667514 28673 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:20:05.669098  1409 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.671756  1409 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.673221 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.676870 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.677729 28756 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:05.685014 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.685508  2034 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.687434  2034 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:05.688699 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58524.4us
I20260709 12:20:05.633971  1962 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:05.711753 29317 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:05.660223  1999 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.716519 28681 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:05.718120 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.727054 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.728236 28603 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:05.714917  1759 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:05.717684  1920 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.729180 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:05.731860 28681 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:05.722124  2062 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.732944 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:05.741159 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.741837 28673 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:05.729805  1956 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:05.745110 28681 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:20:05.739775 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:05.749778 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:05.752640  2047 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.752722  1773 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:05.752959 28751 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:05.753407  1773 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.753841 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.732829  1759 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.755849  2033 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:05.756470  2033 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:05.757525  2033 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.763098  1956 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.765130 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:05.765234  1409 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:05.766865  1842 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:05.767069  1030 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:05.767500  1030 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.767444  1842 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.767992  1030 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:05.771665 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.770766 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:05.775272 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.779692 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.736511  2062 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.781342 28748 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:05.781921 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.782429 28747 raft_consensus.cc:2410] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:20:05.735785  1920 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.784588 28680 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:05.785043 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:05.785475 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.786113 28682 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:05.786468 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.784952 28680 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:05.787261 28677 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:05.787515 28680 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.788880 28680 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.788996 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.787909 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.782281  2062 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.762347  1411 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.798434 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:05.804422  1409 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:05.804495 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:05.805052  1409 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.795385  1030 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.789002 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:05.796720 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.805512  1409 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.811442 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.812772 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:05.813503 28673 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:05.813865 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:05.831766  1030 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:05.785079  1920 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.800305  1806 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:05.841809 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.845557 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.846303 28748 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:05.803839  1797 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:05.847366 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:05.832003  1938 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:05.853616 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.871799 28599 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:05.837729  1960 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:05.865267 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.878017 28749 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:05.871117  1938 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.866436  1806 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:05.835760  2052 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 12:20:05.890646 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 57649.1us
I20260709 12:20:05.876731  1960 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:05.904968 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 151897us
W20260709 12:20:05.905843 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 60267.7us
I20260709 12:20:05.909204  2081 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.909840  2081 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.912904 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:05.880836  1773 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.918809 28747 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:20:05.913767 28599 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:05.922050 28752 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:05.927402 28751 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:05.893682  1938 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:05.935900 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:05.931902 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 326691us
I20260709 12:20:05.937711 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:05.936690 28752 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:05.913074  1960 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:05.887516  1797 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:05.967324 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:05.925141  2081 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:05.964929 28756 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:05.974172 28750 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:05.953661 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:05.969836 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62057.5us
I20260709 12:20:05.975715 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:05.977523 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:05.977257  1409 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:05.979000  2024 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:05.979705  1409 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:05.979732  2024 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:05.980841 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:05.982623 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:05.970292  1999 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:20:05.972754 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:05.994885 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:05.996918 29326 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.001588 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:06.002316 28749 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:05.954167  1773 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:05.954288  2051 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:06.019618 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 78327.5us
I20260709 12:20:05.982393  2034 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:05.990540  1842 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:06.038054 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:06.043270 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62318.7us
I20260709 12:20:06.013260  2081 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:06.047775 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:06.061609 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:05.993155  2103 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:06.062345 29317 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:06.064659 28599 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:06.039665  1962 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:06.102095 28749 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:06.057753  1411 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.064425  2103 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.061257  1920 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:06.127306  2097 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.220s	user 0.001s	sys 0.001s
I20260709 12:20:06.032917  1773 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.139840 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:06.136561  1409 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.140769  1409 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:06.165968 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 145385us
I20260709 12:20:06.165004 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:06.171901  1409 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.132767  1859 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.040519  1806 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.073621  2034 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.182977 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:06.050956  2051 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.189429 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:06.190713 28752 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:06.148965  2099 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:06.133049  2103 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.199585 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.133577  1962 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:06.218041 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:06.219826 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.221709 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.222033 28673 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:06.222509 28677 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:06.237663 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:06.243739 28674 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:20:06.243887 28573 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:06.245069 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 87652.5us
I20260709 12:20:06.238111  1842 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.246337  1842 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.248744 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:06.249297 28682 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.249739  1409 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:06.250300  1409 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.252076  1409 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.252241 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:06.252949 29327 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:06.253360 28679 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:06.253782 28754 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:06.255113 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:06.240132 28755 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:06.259398 28674 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:06.264786 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:06.195765  1742 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:06.201323  2039 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:06.271833 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 207542us
I20260709 12:20:06.221871  2033 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:06.195067  2024 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:20:06.187637  1920 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.279855 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:06.280699 28680 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:20:06.313479 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:06.217850  1859 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.314560 29320 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:06.312594  1962 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.265808  1999 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:06.271025  2047 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.518s	user 0.002s	sys 0.009s
I20260709 12:20:06.239603  2107 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:06.252966  1759 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.287770 28680 pending_rounds.cc:85] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 9
I20260709 12:20:06.219439  1997 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:20:06.266012  1842 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.218168  2068 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.286s
I20260709 12:20:06.274006  2062 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:06.279690  1797 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.238323  2099 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:06.353058 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.353670 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:06.280947  2033 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.328521 28680 pending_rounds.cc:107] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:20:06.364167 28680 raft_consensus.cc:2889] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:06.361020 29327 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:06.351918 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:06.367272 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.369011 28647 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:06.370517 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:06.358711  2047 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:06.366295  2033 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:06.383208 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63160.7us
W20260709 12:20:06.379302  2095 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:20:06.351946  2107 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.407120 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:06.412240  2034 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:06.414738  2099 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.415349  2099 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:06.416162  2098 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
I20260709 12:20:06.387053  1797 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:06.382355 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 127323us
I20260709 12:20:06.415918  2099 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.405195  1842 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:06.436708 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.438517  1842 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:06.438800  2110 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:20:06.438673  2102 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:06.439585  1842 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.433581 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:06.447178 28680 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:06.449177 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.449824 28674 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
W20260709 12:20:06.454479  2059 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.867s	user 0.023s	sys 0.008s
I20260709 12:20:06.459000 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:06.459497 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:06.456645  1859 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.460630 28682 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:06.459910 28752 raft_consensus.cc:2410] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:20:06.472404 29326 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:06.425030  1797 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.457754 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.475636 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:06.478186 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.493290  1409 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:06.495138  1409 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.495599  1409 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.498107 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:06.419781  1999 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:06.471377  2101 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.504918 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:06.473213  2051 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.519964 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:06.509596 28674 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:06.511168 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:06.511345 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.430269  1806 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:20:06.478255  1797 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:06.519950 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 74899.3us
I20260709 12:20:06.504992  2013 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.546741 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:06.475199  2059 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.559418 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:06.562819 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.563612 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:06.519057  2117 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.561630  1920 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:06.593555  1920 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:06.593346  1999 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.596655  2051 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:20:06.586689  2102 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:06.601586  2102 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.601943  2102 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.602152 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:06.602890 28602 raft_consensus.cc:2368] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:06.604605  2119 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:06.513440  1997 consensus_queue.cc:1243] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:06.605438  1997 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:06.605887  1997 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.607941  1997 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.608945 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:06.612553  2114 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:06.613441  2130 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:06.613605  2123 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:06.614682  2123 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.617542  2059 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:06.619200  1960 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.648s	user 0.005s	sys 0.005s
I20260709 12:20:06.619900  2062 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:06.620399  2062 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.621773  2099 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.619649  1960 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.613914  2130 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:06.556619  2081 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:06.635682  1409 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.549211  1411 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:06.557818  2024 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:06.650240 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:06.650566 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:06.658708 28674 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:20:06.658488 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:06.565649 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:06.663728 28606 raft_consensus.cc:2410] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:20:06.664776 28678 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:06.589166  2125 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:06.696763 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 131178us
I20260709 12:20:06.686939  1409 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:06.586643  1938 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.004s
I20260709 12:20:06.564550  1962 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.701011 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:06.697515 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56675.5us
I20260709 12:20:06.637503  2119 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:06.660629  2081 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.659402  1411 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:06.718797 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 290159us
I20260709 12:20:06.638537  2059 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.660490  2024 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.557451  2052 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:20:06.718217 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:06.729759  1030 raft_consensus.cc:993] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: : Instructing follower a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:20:06.739537  1409 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.738556  2108 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:06.730685 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:06.740341  1030 raft_consensus.cc:1081] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Signalling peer a7ec63b6634944d0b5b5ea92fa2d303e to start an election
I20260709 12:20:06.740447  1409 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.742722 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.713050  1773 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:06.722397  2081 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:06.781100 28573 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:06.718590  1956 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:06.782472 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 218922us
I20260709 12:20:06.731717  1411 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:06.784318 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 193889us
I20260709 12:20:06.780351 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.785811  1409 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.732728  2051 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:06.748508  2024 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:06.788798 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.710251  1742 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:20:06.794915 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.715154  1938 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.800176 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:06.803159 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:06.780743  1842 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:06.733208  1889 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:20:06.740108  2099 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:20:06.806883 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:06.813771 28598 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.791647  1956 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.730736  1962 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.742980  2059 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.812028 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:06.819295 28681 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:20:06.820142 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:06.780772  1920 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:20:06.829733 28677 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:06.802393  2107 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.808943  1999 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:06.803571  2128 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:06.803992  2114 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.841001 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:06.842819 28755 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.817950  1997 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.848280 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.817037  1917 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:06.849112 28677 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:20:06.852640 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:06.853209 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 135048us
I20260709 12:20:06.841831 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:06.832497  1806 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:06.854569 28721 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:06.843885 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:06.857355 28749 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:06.865022 28647 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:06.873224 28677 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:20:06.841953  2115 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:06.870150 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:06.877207 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:06.827621  1956 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.879926  2107 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:06.849769  1999 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:06.856658  1806 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.879107 28604 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:06.851383  2120 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:06.895255 28755 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:06.896332 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.870889  1917 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:06.905337  1917 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:06.899725 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 99627.2us
I20260709 12:20:06.900892  2013 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:06.902148  2059 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.909586 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:06.910219 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:06.883803  2131 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:06.615199  2123 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.918507 28607 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:06.900139  1806 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.875685  1997 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:06.925344 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 70854.9us
W20260709 12:20:06.926751 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 194455us
I20260709 12:20:06.586961  2129 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.333s
I20260709 12:20:06.740336  2122 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.200s
I20260709 12:20:06.777741  2108 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.886649  2137 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:20:06.912149  2107 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:06.914558  2120 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:06.939533  2120 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.941345  2107 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.735920  2125 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.931689 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:06.925694  1859 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:06.944741  1859 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.945112  1859 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:06.946669  2139 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:20:06.953092  2136 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:20:06.831857  2119 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.954002  1997 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.954640  1938 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.922299  2131 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.956059 28598 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:06.956926  2118 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:06.957150  2131 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.957340  2118 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:06.855062  2114 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.933784  1956 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:06.546777  2101 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.620711  2117 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.937844  2146 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:06.938303  2116 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 12:20:06.938591  2113 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:20:06.933063  1999 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.963987 28603 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:20:06.960880 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:06.966164 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:06.986516 29317 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:20:06.986891 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:06.988101 29322 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:06.730221  2130 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:06.972721 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:06.976339 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:06.944190  2125 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.882721  2115 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.958474  1797 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.994410 28682 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:20:06.995165  2138 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:06.995471  1797 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.995950  2138 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:06.979441  1889 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:06.998070  1759 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:06.998617  1759 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:06.999744  2134 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.377s	user 0.002s	sys 0.000s
I20260709 12:20:07.000690  1759 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.000926  2150 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.001204  1842 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.001574  2150 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.001703  1842 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.003773  2150 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.004694  2144 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:07.005262 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.005213  2144 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:06.992595  2156 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:07.006139  2156 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.006266  2154 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:07.006606  2156 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:07.006728  2154 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.007134  2154 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:07.007465  2144 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:06.993005  1742 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:07.008805 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:07.007995 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 97909.3us
I20260709 12:20:06.965762  1960 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:06.987435  2121 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.010191  2121 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.011252 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.005496  2047 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:07.011821  2047 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:07.012889  2142 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:20:07.013475  2047 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.018116  2117 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.018895  2137 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:07.019217 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 91802.4us
I20260709 12:20:07.020156 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.020917  1759 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:07.021245  2101 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.021270  1759 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.021916  1759 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.021870  2138 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.022698 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1138) took 1179 ms. Trace:
I20260709 12:20:07.023350  2118 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.023041 28748 rpcz_store.cc:276] 0709 12:20:05.846171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.880311 (+ 34140us) service_pool.cc:224] Handling call
0709 12:20:05.890722 (+ 10411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:05.904186 (+ 13464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:05.904232 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:05.929828 (+ 25596us) log.cc:844] Serialized 26 byte log entry
0709 12:20:06.273228 (+343400us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:06.273284 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.276077 (+  2793us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:07.022495 (+746418us) raft_consensus.cc:1685] finished
0709 12:20:07.022514 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:07.022627 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2683,"raft.queue_time_us":13196,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9276,"thread_start_us":282840,"threads_started":1,"wal-append.queue_time_us":584350}
I20260709 12:20:07.025802  2024 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.026180 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:07.026913 29326 raft_consensus.cc:2368] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:07.027364 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.027866  2024 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.028101  2101 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.029147 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.029897  2115 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.030804  1997 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.031517  1997 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:07.032769 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:07.033099 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:07.034197 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:07.034628  2103 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.003s
I20260709 12:20:07.034899 29323 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:07.034583  1889 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.033674 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.000837 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.030829  2130 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:07.036542 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.038719 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.034848 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:07.035991 29327 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:07.049193 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.041167 28682 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:07.049300 29325 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:07.004287  2150 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.042130  2128 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.069671 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.069546  2128 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.070894 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.056618  2122 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:07.056982  2143 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:20:07.072491 28647 leader_election.cc:400] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:07.072842 28647 leader_election.cc:403] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:06.985328  2146 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.073390  1960 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:07.064481  2108 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.074923  2146 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.075208 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.075441 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.075819 28678 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:20:07.076771 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.078130  2128 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.081673  2102 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.053769  2062 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.052955 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.061625  1962 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.050740  2129 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.063028  2114 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.012285  2121 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.003798  1842 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.086056 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.086695 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.086834 28604 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:07.088567  2062 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.090093  1411 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.090787  1859 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.092758 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.093145  2138 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.093331 29325 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:07.094278 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:07.094895  2033 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.000s
I20260709 12:20:07.095352 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.095292  2033 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.095940 29325 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:07.096735 29326 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:20:07.076323  2123 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.097720 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.098269 29326 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:20:07.098888  2118 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.049887  1889 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:20:07.108227 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.108883 28678 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:07.110800  2145 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:07.083719  2102 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.111670  2145 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:07.112075  2145 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:07.110579  2156 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.112914  2145 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.114204  2145 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.115036  2081 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.115705 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.101473 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.064473  2117 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.102169 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.035123  2103 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.118244  2131 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:07.118793  2103 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.118901  2131 consensus_queue.cc:1243] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:20:07.032792  1997 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:20:07.119486  2150 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:07.102733 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.103565 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.106508  1956 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:07.106794 29327 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:07.107604 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.132699 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.132812 28673 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:07.133534 28603 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:07.101074 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:07.120731 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 68508.2us
I20260709 12:20:07.123014 28680 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:07.136008  2081 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.138567 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.139731  2115 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.140906 28678 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:07.144761 28680 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:20:07.123243 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 376671us
I20260709 12:20:07.124888 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.124938 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.033191  1759 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:07.131711 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 65296.1us
I20260709 12:20:07.108119 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.149034 28648 leader_election.cc:400] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:07.149447 28599 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:07.147358 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.150662 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.152478 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.153339 28605 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:07.092353  1411 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.154768 28600 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 11: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:07.161537 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:07.156544 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.156718 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:07.158629 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57644us
I20260709 12:20:07.163913 28747 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:07.166877 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:07.169313 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45306.1us
I20260709 12:20:07.170032 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:07.171944 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:07.161556 29323 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:07.180404 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.181164 28755 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:07.182538 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.183534 28748 raft_consensus.cc:2368] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13.
I20260709 12:20:07.186132 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.187369 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:07.140482  2115 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.188932 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.189924 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.190541 28749 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:07.192417 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.154685  2108 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:07.165278  2024 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.163107  2137 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:07.199097 28603 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:07.176726  2146 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:07.202065 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:07.204810  2160 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:20:07.206038 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.206741 28676 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:07.208029 28676 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:07.154599  1956 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.201663  1889 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.209405  1889 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.210291  1956 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:20:07.211679  1889 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.212523 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.212865 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:07.213930 29326 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.214059 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:07.215593 29292 leader_election.cc:400] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13.
I20260709 12:20:07.215875 29292 leader_election.cc:403] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:07.180095  2102 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:07.217231  2102 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.217048  2112 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:20:07.217669  2099 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:07.218089  2099 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:07.218842  1759 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.193614  1938 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.217660 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.179811  2101 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:07.219535  1773 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:07.223203 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:07.223780 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 73376.3us
I20260709 12:20:07.186836  2034 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.154806  1999 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:20:07.223873 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.227138 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.217659  2102 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.228015  1759 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:07.231402 28676 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:07.180215  2138 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:20:07.232566 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.203218  1411 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:07.221998  2146 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.239737 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.240453 28676 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:20:07.219053  2099 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.235488 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:07.238266 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:07.225528  2101 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:07.242648 29326 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:07.257270 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.255975 28571 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:07.200600  2144 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:20:07.228734  2130 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:07.228838  2137 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:07.229931  1773 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:07.254313 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:07.233979  2122 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:07.202566  2024 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.260711 28676 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.237174  1956 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.248229  2146 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:07.276736  2153 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.277474  2149 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:07.279574  2115 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.230948  1889 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:20:07.272056  1773 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.274057 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.264014  2138 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:07.230473  1806 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.283049  1411 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:07.307546  2150 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.261679  2108 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:07.262564  2101 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:07.261752  1962 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:07.263031  2130 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.263806  1999 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:07.271842  2137 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:07.240115  2034 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.284795  2033 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.257953  2103 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:20:07.302089  2122 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.326120 28673 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:07.322434 28675 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:20:07.350617 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.334060 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.382668 28605 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:07.345888 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.355831 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:07.349669 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:07.383253 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 150808us
I20260709 12:20:07.354399 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.384143 28676 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:07.388175 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.391628 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.393905 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.390136 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:07.396675 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.329105 28680 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:07.398965 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.402319 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.311025  1859 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.412263 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:07.324162 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.422945 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:07.421909 29321 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:07.424381 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.316768  2099 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:07.425323 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.308629  2153 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.332540  2151 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:07.348259  2129 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.383450  1962 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.347460  1842 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:07.346419  2024 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.429924 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:07.384315  2130 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.429970 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.430615 28598 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:07.384227  1999 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.384300  2137 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.344823  1411 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:07.433984 29317 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:07.427500 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71796.7us
I20260709 12:20:07.416795  1997 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:07.422442  2138 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:07.421944  1889 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:07.447945 28602 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:07.424705  2144 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:07.418054  2108 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:07.452391 28606 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:07.454591 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:07.455780 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.434191  1797 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:07.441686  1962 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.459717 28598 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:07.460124 29319 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:07.461000 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.449326  1999 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:07.446733  1842 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:07.315652  2149 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.489624  2149 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.448043  2039 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:07.457854  2129 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:20:07.515301  2152 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:07.515158  2108 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.515957  2152 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:07.516876  2152 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.518290  2132 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:07.518769  2132 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.519166  2132 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:07.528030 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 394130us
I20260709 12:20:07.441125  2151 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.532383  2150 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:07.533180  2150 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.537878 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.538434 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.538625 28680 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.545871 28605 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:07.565346 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.565951 28673 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.565646 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.508474  1759 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13.
I20260709 12:20:07.470247  1797 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:07.576171 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.575487 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:07.577626 28679 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:07.579985 28747 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.580253 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:07.579017 28680 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:07.581176 28755 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:07.515233  2141 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:07.582176 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:07.580694 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 167123us
I20260709 12:20:07.503590  2039 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:07.563966  2154 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.004s
I20260709 12:20:07.601730 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.605167 28748 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:07.603160 28756 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:20:07.603253 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.582484  2138 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.624809 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.545931  2146 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:07.607059  2167 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:20:07.651371 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.600467 28754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:20:07.653687 28754 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.654052 28754 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:07.655293 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.656363 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.600975  2141 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:07.661217 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.661947 28598 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:07.663129 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.663616 28605 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 10.
I20260709 12:20:07.575078  1842 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.673772  2151 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.651705  2138 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.678433  2138 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.679397  2153 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.680511  2156 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.684119  2039 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.684573  2122 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.658792  1773 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.687085  1773 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.566438  1411 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.693954 28747 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:07.694443 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.695187 28680 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:07.696898 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.704941 28673 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:07.713316 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.715372 28675 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:20:07.715997  1797 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.716627 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.718156 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.718962 28756 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:07.712051 28754 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:07.665020  2174 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:20:07.722072 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:07.732692 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.732841 28598 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:07.658912  2034 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.661574  2141 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:07.746040 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:07.746766 28756 raft_consensus.cc:2368] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:07.743680 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.747292 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.745067 28754 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.749974 28750 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 12:20:07.754362 28750 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:07.716671  2144 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:07.640087  2154 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.740695  1842 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.762765 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.768692 28749 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:07.790799 28752 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:20:07.790115 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.791404 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.791527 28756 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:07.746649  2151 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.794355 28755 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:07.793921 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.795485 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.798890 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.800050 28754 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:07.800694 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.800778 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.801316 28756 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:07.803087 28752 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:20:07.805312 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:07.806917 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.809319 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:07.809932 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.810575 28751 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:07.810398  1962 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.811470 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:07.812860 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.813503 28601 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:07.814446 28749 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
W20260709 12:20:07.814906 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.815023 28749 pending_rounds.cc:85] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 8
I20260709 12:20:07.815505 28749 pending_rounds.cc:107] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:20:07.815796 28749 raft_consensus.cc:2889] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:07.819000 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2962) took 1013 ms. Trace:
I20260709 12:20:07.819397 28607 rpcz_store.cc:276] 0709 12:20:06.805816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.819058 (+ 13242us) service_pool.cc:224] Handling call
0709 12:20:07.818843 (+999785us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b54003d3454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:07.818939 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147420928}
I20260709 12:20:07.822715 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.823448 28605 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:07.824232 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:07.813031  2181 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:07.831197 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.763486  1773 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:07.832652 29322 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:07.827832 28673 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:20:07.828377 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.834182 28680 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.828174 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.829483 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:07.825519 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:07.843339 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.757239  2131 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.792856  2102 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 12:20:07.848963 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.850136 28673 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:07.857577 28682 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:07.857877 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.857430 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:07.858458 28673 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:07.858791 28673 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:07.855234 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:07.868243 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:07.872362 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.831033  2125 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:07.884719 28680 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:07.831864  1889 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.841869  1920 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.881372 28673 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.832504  2150 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.842020  2152 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:07.848088  2118 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:07.857095  2127 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:07.869901  2131 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.914511 28673 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:07.844401  1997 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:07.859123  1962 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.888347  2125 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:07.948529  2125 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.949558  2125 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:07.949374  1999 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.950268  2149 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:07.950663  2149 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:07.951717  1999 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.951471  2149 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.921989  1806 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:07.952736 28603 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:07.956313  2149 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.956601  1842 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:07.923161  2131 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.914009  2127 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:07.960302 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:07.931267 28601 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:07.934087  2154 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:07.938249  2099 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.001s
I20260709 12:20:07.939244  2146 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:07.940927  2123 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:07.901832  1917 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:07.913234  2152 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.941704  1962 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.978037 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:07.978669 28679 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:07.978983 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.919606  2118 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:07.946485  2132 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.954362 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:07.961041 29326 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:07.965822 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:07.869701  2102 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.974720 29317 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:07.919224  1997 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:07.981976 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:07.982275 28674 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:07.961426  2127 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.987480 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:07.992547  1997 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:07.917191  1889 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:07.999683 28673 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
W20260709 12:20:08.001969 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 173885us
I20260709 12:20:08.006081 29318 raft_consensus.cc:2368] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:08.006428 28602 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:07.978669  2152 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.993750  1920 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:08.023751 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:07.961983  2137 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:07.979903  2123 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.007205  2047 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.022670  2148 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:08.030128  2193 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:08.021700  1920 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:08.022850  2101 consensus_meta.cc:287] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.000s
I20260709 12:20:08.051647  1920 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.052371  1889 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.056190  2132 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.056545  2118 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.057641  2102 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:08.060281  2123 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.023226  2141 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.071094 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:08.072137 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:08.072245 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.072775 28605 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.072847 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:08.073822 28599 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:08.075948 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.083627 28598 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:08.083693 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:08.084859 28605 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:08.044837  2193 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.081008 28606 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:08.062922  2130 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.597s	user 0.000s	sys 0.009s
I20260709 12:20:08.089869 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:08.096001 28605 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:20:08.092006 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:08.096455 28605 pending_rounds.cc:85] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 10
I20260709 12:20:08.096788 28605 pending_rounds.cc:107] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:20:08.097152 28605 raft_consensus.cc:2889] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:08.103210 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:08.103953 28751 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:08.108750 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:08.109508 28756 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:08.110961 28754 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:20:08.045707  2148 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:08.112176  2148 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.113544 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.114410  1889 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:08.114775  1889 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.115103  1889 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.120543  2130 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.122161 28604 raft_consensus.cc:2368] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:08.126279 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.129819 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:08.134539  2033 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.134711  2146 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:08.135294  2146 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.135100  2033 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.135667  2146 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.137277  2033 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.128695  2149 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:08.138152  2149 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.140486  2141 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.142036  2137 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.143294  2146 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.144495  2130 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.144670 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:08.031735  2192 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:20:08.042141  1997 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:20:08.041394  2129 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:20:08.134539 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.155483 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.095189  2193 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.158311  1889 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:08.160804  2131 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:08.161473 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.081162  2101 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.164698  2101 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:08.176620  1889 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.184310  2127 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.184959 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:08.185778 28752 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.187191  2127 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.190088 28753 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:08.201318 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.204032 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:08.210961 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:08.212874 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.217662 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 222388us
I20260709 12:20:08.219375 28647 leader_election.cc:400] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:08.219750 28647 leader_election.cc:403] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.221320 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.222998 28604 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:08.229285 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:08.233040 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 377905us
I20260709 12:20:08.239311 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.240284 28604 raft_consensus.cc:2368] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12.
I20260709 12:20:08.232672 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1150) took 1066 ms. Trace:
I20260709 12:20:08.236825 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.241027 28753 rpcz_store.cc:276] 0709 12:20:07.166046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.176996 (+ 10950us) service_pool.cc:224] Handling call
0709 12:20:07.193230 (+ 16234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:08.196279 (+1003049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.213079 (+ 16800us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400306e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:08.232580 (+ 19501us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291758336}
I20260709 12:20:08.250489 28749 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:08.251543 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.252522 29323 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:08.246460 28598 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:08.246783 29326 pending_rounds.cc:85] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 12
I20260709 12:20:08.257829 29326 pending_rounds.cc:107] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:20:08.258167 29326 raft_consensus.cc:2889] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:08.254570 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.250809 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.259992 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:08.261415  1030 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.262183  1030 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.261335 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:08.195982  2146 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.265012 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.264117 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.271453 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:08.272044 28748 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:08.262845 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.273093 28602 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:08.274547 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.217356  1773 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:08.276962 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:08.277859 28677 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:08.270841 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:08.270412 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.277993 28751 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:08.279312 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.279855 28680 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.280761 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.281368 28673 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:08.281512 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.282016 28676 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.282344 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.282850 28679 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.284699 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.287851  1797 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.288599  2155 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:08.289083 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:08.289480 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:08.290292  2154 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:08.257862  1997 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:20:08.291266 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.292459  2132 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:08.292914 28676 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:08.293008  2132 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:08.293339 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.294068  2132 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.299513  2145 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:08.300379  2145 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:08.300714  2145 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:08.301469  2145 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.290972 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:08.304734 29325 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:08.279673 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.232475  2137 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:08.232653  1842 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:08.306805 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 87616.2us
I20260709 12:20:08.304034 28752 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:08.308518 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.314721 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:08.315740 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54485.4us
I20260709 12:20:08.316740 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:08.318146 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:08.329463 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:08.330430 29317 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.335162 28680 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:08.319998 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:08.338759 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 73820.3us
I20260709 12:20:08.340356 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:08.337514 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:08.343138 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.344612 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.342489 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.345479 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:08.348219 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.349162 28676 raft_consensus.cc:2368] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12.
I20260709 12:20:08.349655  1030 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.263420  2051 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:08.352285 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:08.353796 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.354985 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.242744  2107 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:20:08.360865 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.304860  2081 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:08.276796  2122 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.359773 28673 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:08.361534 29290 leader_election.cc:400] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12.
I20260709 12:20:08.378278 29290 leader_election.cc:403] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.306242  1773 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:08.384202 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46767.3us
I20260709 12:20:08.385239 28648 leader_election.cc:400] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:08.385591 28648 leader_election.cc:403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:08.387276  1030 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:08.387889  1030 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.346251  1411 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:08.345057  2013 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:08.364099 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.344539  2128 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:08.388326  1030 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.345213  2154 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.350769  1889 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:08.352425  2114 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:08.396180 28571 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.361974  2034 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.371232  2145 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.421098 28607 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:08.425161 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:08.425751  2129 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:08.426291  2129 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:08.426975  2125 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.427228  2129 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.428375  1030 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.429224 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.378247  1742 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.430364  1030 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.430471  1742 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.363037  2117 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:08.433141  2117 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:08.434083  2117 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.438524  1742 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.354559  2153 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:08.376808  2127 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.446899 29317 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:08.357313  2130 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:08.398981 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:08.396679  1411 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.392861  2122 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.376904  2101 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:08.408740  2114 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:08.414954  2149 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.416467 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1223) took 1342 ms. Trace:
I20260709 12:20:08.373368  2051 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.394816  2150 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:08.467666 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44971.4us
I20260709 12:20:08.460116  2128 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:08.446630  2148 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.479806  2128 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.468474 28681 rpcz_store.cc:276] 0709 12:20:07.074475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.084598 (+ 10123us) service_pool.cc:224] Handling call
0709 12:20:07.304355 (+219757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.304616 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:07.447278 (+142662us) log.cc:844] Serialized 14 byte log entry
0709 12:20:07.581182 (+133904us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:07.581230 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:07.581270 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.581328 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.198464 (+617136us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b18003a6480. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4
0709 12:20:08.416242 (+217778us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400299850. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:08.416356 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13267,"prepare.queue_time_us":185945,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":538,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":19546,"spinlock_wait_cycles":509456000,"thread_start_us":264826,"threads_started":2,"wal-append.queue_time_us":247664}
I20260709 12:20:08.481150  2148 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:08.482987 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.483850 28607 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:08.430982  1030 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:08.461129  1411 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.449527  2137 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.467931  2039 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.408653  2194 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:20:08.462527  2101 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:08.495232 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 131252us
I20260709 12:20:08.487473  2131 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:08.505324 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 126767us
I20260709 12:20:08.487214  2130 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:08.503130 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 141562us
I20260709 12:20:08.492012  2182 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.515367 28679 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:08.504581 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.512362 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.518440 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.499228  2137 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.468528  2152 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.483954  1742 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:20:08.504159  2151 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.508460  2101 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:08.535893 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.541687 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.519737  2108 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:08.546168  2154 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:08.549685  2155 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.546188 28750 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:20:08.553076  2201 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:08.560424 29292 leader_election.cc:400] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12.
I20260709 12:20:08.562737 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.567267  2131 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:08.567378  2155 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.567818  2131 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.565935  1411 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.571223 29325 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:08.546615 29318 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:08.576473 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:08.578521 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:08.525445  2191 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:08.602519 29321 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:08.616798 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.532397  2208 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:08.617268 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.624361 29327 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.546080  2034 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:08.629371  1842 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.638141  2152 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:08.640522  2122 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:08.641185  2191 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:08.642385  2191 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.645519  2149 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:08.523240  2182 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.659269 29322 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:08.618064  1411 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.623361  2208 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.625739  2141 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.685160 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.689386 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:08.693177 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.673707 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:08.705228 28673 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:08.705439 28600 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:08.697180 28680 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:08.682339 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:08.718683 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:08.725711 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.717581 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.734957 28676 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:08.737205 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.744901 28674 raft_consensus.cc:2368] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
W20260709 12:20:08.681855  2207 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:20:08.766752 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.718990 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:08.690693  2204 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:20:08.771605 29323 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:08.768337 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:08.772512 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:08.659947  2081 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:08.792949 28749 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
W20260709 12:20:08.777313 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70447.2us
I20260709 12:20:08.795912 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.801241 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:08.693158  2208 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:08.775424  1859 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:08.810031 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58545.5us
W20260709 12:20:08.760210  2205 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:08.746287  2102 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:08.804402  2195 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:20:08.726116  2146 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:08.713738  1938 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:08.809159  2153 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.843303  1938 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.812775  2151 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:20:08.845084  2210 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.845608  2210 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.847604  2210 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.764214  2051 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.812686 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.714872  2034 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.815596 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.850736 28720 leader_election.cc:400] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
I20260709 12:20:08.851051 28720 leader_election.cc:403] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:20:08.746852  2193 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
I20260709 12:20:08.852707  2051 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:08.853080 29321 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:08.853391  2051 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.828006 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:08.854981 29326 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 13: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:08.852733  2193 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.856386 29326 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:08.856642 29322 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:08.857834  2193 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.830672  2081 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.859335 28602 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:08.861183  1938 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:08.843330  2153 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.864039  2153 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:08.687835  1742 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 12:20:08.809010  1842 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:20:08.713572  2141 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:08.834306 29327 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:08.869926 29327 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:08.838505  2137 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.691598  1773 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:08.877758  1773 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.878852 29319 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:08.671871  2130 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:08.791858  2062 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:20:08.813809  1859 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.883261 29323 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:08.883582  1859 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:08.886224 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.842391  2150 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 11. Current term is 12.
I20260709 12:20:08.808807  2047 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:08.763072  2182 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.875151  2141 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.815877  1917 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:08.890071  2208 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:08.901714 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 105911us
I20260709 12:20:08.813555  2129 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:08.928072 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.928680 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.894155 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:08.931361 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:08.933375  2034 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:08.933838  1842 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.927590  2047 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:08.937376 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.021s	sys 0.027s
I20260709 12:20:08.979359 28505 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 7 to 11, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 11 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:08.943512  2202 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.379s	user 0.002s	sys 0.000s
I20260709 12:20:08.945552 29325 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
W20260709 12:20:08.940012  2203 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 12:20:09.024066 28747 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:08.962124 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:08.961997  1997 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:08.967236 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1487) took 1967 ms. Trace:
I20260709 12:20:08.974813 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:08.975983  2137 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:08.991290  1889 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.028554 29320 rpcz_store.cc:276] 0709 12:20:07.000006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.000515 (+   509us) service_pool.cc:224] Handling call
0709 12:20:07.889047 (+888532us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:20:07.902200 (+ 13153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:08.409247 (+507047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:08.409282 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:08.409754 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:20:08.610267 (+200513us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:08.610323 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:08.966817 (+356494us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54004bb4d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:08.966888 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:08.966955 (+    67us) raft_consensus.cc:1685] finished
0709 12:20:08.966973 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:08.967140 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2597,"raft.queue_time_us":2689,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":1163920000,"thread_start_us":200110,"threads_started":1,"wal-append.queue_time_us":197656}
W20260709 12:20:09.030735  2215 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:20:09.031946  2218 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:09.033010  2218 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:09.033388  2218 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:09.034314  2218 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.000645 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:09.022504 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.022s	sys 0.027s
I20260709 12:20:08.959182 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:09.037761 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 643575us
I20260709 12:20:09.038021  1859 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.038580 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:09.039815  1938 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:09.040169  1938 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:09.040547  1938 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.041949  2107 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:09.036051  2218 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.044766 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:09.047231 28648 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:09.023492  1842 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.049324  2107 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:09.050595  1842 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:09.051123  2107 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.999801  1917 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:09.030350  1889 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.010726  2051 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
W20260709 12:20:09.026935 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 132848us
I20260709 12:20:09.055732 28648 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:09.007910  2129 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:08.996059 28677 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:09.064263 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:09.060894 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 98867.1us
I20260709 12:20:09.074779 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:09.057646  2210 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:09.077714  1938 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.079938  1938 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:09.028112  2141 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.073654 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.024494  2047 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.064352  2149 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:09.084323 28750 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:09.070297  2129 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:09.072466  2062 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:09.082741  2131 consensus_meta.cc:287] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.006s
I20260709 12:20:09.096614 28648 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:09.100180 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:09.100203 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:09.101078 28598 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.112082  2062 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:09.112373  2108 raft_consensus.cc:2764] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:20:09.113139  2062 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.086000  1960 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:09.124007 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:09.093631  2101 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.004s
I20260709 12:20:09.126600 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:09.150677  1917 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.158874 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:09.159804 29317 raft_consensus.cc:2368] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:09.159726 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.129050 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:09.160945 28754 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.155050 28756 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:09.155555 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:09.155716 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 55619.7us
I20260709 12:20:09.119268 28598 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:09.153864 28607 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:09.089620  2210 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:09.156925 29321 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:09.160470 28752 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:09.161784 28675 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:09.184193 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:09.097803  1411 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.109566  2192 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.171392 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:09.197023 29323 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:09.182588 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:09.191596 28682 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:09.160876  2191 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:09.185748 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:09.202484 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:09.157117  2127 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.108702  2131 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.097640  2141 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.198848  1917 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:09.162452  2101 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.249696  2101 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:20:09.250715 29325 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:09.252908 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:09.253484 29325 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.264953 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:09.266245 29325 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:09.266932  1889 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.201613  2194 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:09.267812  2194 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.268136 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:09.269513  2153 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:09.270709 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:09.271165  2153 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:09.268173  2194 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:09.272913  2210 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.278111 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:09.278187  2153 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:09.199069  1411 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.226611  2150 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:09.213866  2127 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.231877  2122 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:09.235224  2131 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:09.235884  2208 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.217792 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:09.291894 29317 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.278992  2156 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:09.294216 28602 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:09.218474  2130 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:09.224104 28754 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:09.280964  1411 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:09.207041  2149 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:09.289508  2204 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:20:09.284246  2150 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.310627 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:09.212123  1997 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:20:09.330207 29317 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:09.201799  2192 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.211978  1962 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 12:20:09.315052  2051 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.398133 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:09.318259  2156 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:09.332002  2150 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:09.441928 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 331578us
I20260709 12:20:09.406214  2141 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.322466  2213 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 12:20:09.406949  2051 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.347736  2131 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.409718  2192 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.410306  2208 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:09.345295  2151 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:09.422712  2194 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.431214  2081 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.444804 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:09.453471 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 295891us
I20260709 12:20:09.477629 28648 leader_election.cc:400] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:09.459112  2152 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:09.491123 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:09.491714 28677 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:09.452414  1411 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:20:09.468648  2208 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:09.452540  2047 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.505738 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.469990  2151 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:09.459632  2131 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.470865  2081 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.483476  1960 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:09.516891 28751 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:09.518958 28749 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:09.516847 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.528962 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:09.512207  2216 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:09.518292  1411 consensus_queue.cc:1243] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:09.486418  2107 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:20:09.489333  2156 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:09.559641 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 349867us
I20260709 12:20:09.563140 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:09.572676 28572 leader_election.cc:400] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:09.573024 28572 leader_election.cc:403] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:20:09.576835 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:09.580562 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2652) took 1047 ms. Trace:
I20260709 12:20:09.559471  2127 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:09.582235 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:09.536650  2129 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.581073 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:09.580968 28747 rpcz_store.cc:276] 0709 12:20:08.533570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.533697 (+   127us) service_pool.cc:224] Handling call
0709 12:20:08.541161 (+  7464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:09.025788 (+484627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.580328 (+554540us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54001c4b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:09.580506 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110128000}
I20260709 12:20:09.586401 29317 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:09.586745 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:09.594292  1859 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.594916  1842 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:09.595492  1842 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:09.580752  1997 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:09.596611  1842 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.598553  2118 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:09.598977  2118 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.599309  2118 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.601214  2131 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:09.568833  2208 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.601790  2059 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:09.603246  2233 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:20:09.578299  1962 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:09.565444  2209 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:20:09.610559  2099 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:09.610960  2099 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:09.611711  2099 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.552649  2216 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:09.623080 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46340.4us
I20260709 12:20:09.624522 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:09.621318  1997 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.625847  1997 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.626956  1962 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:09.627290  2194 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:09.627959  1997 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.628947  2047 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:09.629088  2107 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:09.631207 29327 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEARNER]: Advancing to term 19
I20260709 12:20:09.627889  1962 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.632607  2141 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.633145  2141 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:09.634157  2234 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:20:09.635111  2141 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:09.624358 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:09.635049 28677 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:09.636906  2241 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.638008  2149 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:09.637581  2241 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.638428  2149 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:09.639353  2149 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.640105  2241 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.641719 28598 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:09.642570 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:09.643231 28606 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:09.643324 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:09.642673 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:09.644537 28599 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:20:09.644661 28607 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.645763 28598 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 12:20:09.646131 28598 pending_rounds.cc:85] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 7
I20260709 12:20:09.646324 28598 pending_rounds.cc:107] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 12:20:09.646564 28598 raft_consensus.cc:2889] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:09.647750 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:09.654865 28675 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:09.654928 28607 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:09.657411 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:09.658495  2241 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.658994  2241 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.659518  1997 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:09.660020  1997 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.661062  2193 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:09.661883  2193 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:09.662196  2193 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:09.662197  1997 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.663025  2193 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:09.579324  2218 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.535s	user 0.004s	sys 0.007s
I20260709 12:20:09.682164 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.683082 28751 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:09.671766 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.679855 28606 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:09.709965 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:09.705073 28750 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:09.579041  2145 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.702663 29327 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:20:09.706172 28602 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:09.713459 28751 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:09.682056  2231 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:09.680998  2232 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:20:09.726677 28679 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:09.664425  2193 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.750203 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.722234 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.720777  2129 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:09.665048  1773 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:09.764837 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.682875  2149 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:09.773414 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:09.566728  2151 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.734452  2216 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.781190 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:09.735176 28599 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:20:09.736446 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 202816us
I20260709 12:20:09.781863 28602 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:09.782217 28598 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:09.783042 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:09.783733 28604 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:09.784454 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:09.784999 28750 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.736943 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.789623 28748 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:20:09.792349 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:09.737426 28752 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:09.737673 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:09.738157 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:09.797278 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.798475 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:09.799501 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.720038  2125 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:20:09.703197  2157 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.749082 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.801923 28754 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:09.751576 28747 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:09.802399 28750 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:09.723088 28675 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:09.749099  2145 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.731124  2099 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:09.732764  2081 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:09.807461 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.813952 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.807744 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.808139 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:09.816151 28678 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.809144 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.805228  2157 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.832466  2157 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:09.752918 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:09.800422 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.821458  2128 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:20:09.823648  2238 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:20:09.847831 28753 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:09.829282 28606 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:09.748917  2231 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.830070 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:09.851154 28599 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.811810 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:09.826133  2222 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:20:09.862658 28676 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:09.863111 28676 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:09.851639 28602 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:09.765154  1773 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:09.854127 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.865686 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:09.870977 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.869014 28754 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:09.873538 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:09.863895 28676 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.880136 28676 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.884477 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:09.828336  1962 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:09.849354  2128 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:09.898334  2128 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:09.899255  2229 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.496s	user 0.002s	sys 0.000s
I20260709 12:20:09.915423 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:09.916275  2107 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:09.917140 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:09.918682 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:09.920033 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:09.920717  2107 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.921370  2107 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:09.921823  2107 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:09.922516  2245 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.355s	user 0.003s	sys 0.001s
I20260709 12:20:09.922650  2107 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.924767  1797 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:09.925117  2243 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:20:09.925299  1797 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:09.926189  1797 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.941854 28678 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:09.949151 28599 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:09.947713 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:09.954070 28753 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:20:09.852612  2033 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:20:09.887552  2144 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:09.813753  2150 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.955161  2144 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.957252  2144 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:09.957625  2231 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:09.954111  1773 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:09.890280  1962 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:09.961254  1962 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.962630  1962 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.965469  2246 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:09.966029  2246 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:09.966876  2246 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:09.967283 28676 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:20:09.967803 28676 pending_rounds.cc:85] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 8
I20260709 12:20:09.968107 28676 pending_rounds.cc:107] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:20:09.968400 28676 raft_consensus.cc:2889] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:09.974347 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:09.980541 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.987396 28751 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:09.987746 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:09.988260 28748 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 12:20:10.011837 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:10.016978 28676 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:20:09.893020  2216 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.022713 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:10.023257 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:10.023638 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:10.024266 29325 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:20:10.033267 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:10.032919 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47650.1us
I20260709 12:20:10.040125 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:10.040992 28674 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:10.041390 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.054651 29317 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:10.020798  2125 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.065989  2145 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.032860  2108 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:20:10.052398  2216 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:10.070289  2125 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.049235  2102 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:20:10.073104  2059 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:10.081431  2251 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:20:10.095541 28676 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:20:10.079901  2150 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:10.100099 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63738.1us
I20260709 12:20:10.094763  1917 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 12:20:10.105126  2250 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:20:10.096921  2131 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.108289  2131 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.109120  2039 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:10.110500  2131 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.097103  2192 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:20:10.092501  2145 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.128098 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 140411us
I20260709 12:20:10.146827 29319 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:20:10.143661 29318 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:10.147279  2122 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:10.147323  2102 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:10.149714 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:10.153620  2216 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:10.153689  2145 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.154191 28674 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:09.952996 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:10.175539 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:10.167207 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.167517  2208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.007s
I20260709 12:20:10.089138  2129 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:20:10.183666 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.187528 28677 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:10.184367 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:10.156769  2118 consensus_meta.cc:287] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.002s
I20260709 12:20:10.191078 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:10.194425  2099 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:10.194867 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.194957 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:10.195681 28680 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:10.195694  2130 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:10.196167 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.197088 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.197559  2099 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:10.197940  2192 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:10.191699 29326 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:10.200390 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.200067 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:10.209226  2192 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:10.169600  2121 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:10.216815  2121 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.218140  2145 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.191784  2125 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.218847  2121 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.185418  2216 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.219408  2216 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.221506  2216 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.222216 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:10.222790 28751 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:10.199750  2118 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:10.224113 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.189316  2102 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.224934  2146 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:10.225926 28755 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:20:10.185586  2208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.005s	sys 0.007s
I20260709 12:20:10.225332  2146 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:10.233597 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:10.233955  2146 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:10.225308  2118 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:10.228031 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:10.235144 29325 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:10.230738  2102 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:10.231899 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:10.227728 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:10.236202 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.236368 28679 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:10.236729 29326 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
W20260709 12:20:10.232550  2260 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:10.233762 29319 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:10.232916  2194 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:10.235432  2118 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:10.238438  2118 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:10.237581  2194 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.239235 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:10.241935 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.246946 28751 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:10.200402  2151 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:10.250653 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:10.238818  2118 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:10.317830 28599 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 12:20:10.321863 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:10.318511 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:10.323033 28598 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:10.323324 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:10.323889 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:10.324029 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:10.324496 28607 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:10.243398  2194 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:10.243672  2208 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:10.243543  2246 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:10.241238  1938 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:10.248391  1889 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:10.342509  2242 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.759s	user 0.000s	sys 0.004s
I20260709 12:20:10.342840  2131 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:10.326809  2129 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
W20260709 12:20:10.348173  2245 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:20:10.315191  2062 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:10.388667 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 144202us
W20260709 12:20:10.358984 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 347232us
I20260709 12:20:10.243247  2081 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 12:20:10.248780  2213 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:20:10.329038  2118 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:10.320117  2141 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:10.436405 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46794.7us
I20260709 12:20:10.335028  2208 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:10.458004 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 59826.2us
I20260709 12:20:10.326637  2149 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:20:10.466634 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:10.466794 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:10.470638 28600 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:10.371270  2062 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.470625 28604 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:10.474069 28602 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:10.362051  1938 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.476998 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:10.478159 28606 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
W20260709 12:20:10.479115 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 221969us
W20260709 12:20:10.531322 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.469961  2193 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.541656 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:10.476748  2062 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:10.479825  1962 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
W20260709 12:20:10.607425 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.681407  2272 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
W20260709 12:20:10.685447  2276 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:20:10.475946  2216 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:20:10.692046  1889 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.541692  1797 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
I20260709 12:20:10.545390  2193 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:10.690675  2151 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:10.738749 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 269717us
I20260709 12:20:10.739789 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:10.749406  2277 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:20:10.730993  1889 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:10.702070  2081 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:20:10.741881  2266 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:10.755020  1889 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:10.565537  2208 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.756494  2208 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:10.758090  2193 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:10.767277 28600 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
W20260709 12:20:10.779987  2263 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:20:10.796846  2275 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 12:20:10.799352  2278 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:20:10.802224  1938 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.804818  2051 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.809038 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3040) took 1023 ms. Trace:
I20260709 12:20:10.809551 28754 rpcz_store.cc:276] 0709 12:20:09.785727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.802628 (+ 16901us) service_pool.cc:224] Handling call
0709 12:20:09.802897 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:09.872256 (+ 69359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.808732 (+936476us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b54002d69d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:10.808963 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141805824}
I20260709 12:20:10.815536  2155 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.816049  2155 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.817526 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1611) took 1204 ms. Trace:
I20260709 12:20:10.818145  2155 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:10.820374  2193 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.820982  2193 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.823057  2193 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:10.833434  2273 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:10.834000  2273 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:10.835050  2273 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:10.843678  2241 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:10.849538 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:10.851747  2279 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:20:10.818017 29317 rpcz_store.cc:276] 0709 12:20:09.613534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.617552 (+  4018us) service_pool.cc:224] Handling call
0709 12:20:09.617899 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:10.055075 (+437176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.817223 (+762148us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540010ac54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:10.817453 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003883776}
I20260709 12:20:10.859699 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:10.836300  2273 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:10.872995  2102 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:10.887378 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:10.890596 28682 raft_consensus.cc:2410] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:20:10.854264  2246 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:10.875661  2146 consensus_meta.cc:287] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.004s
I20260709 12:20:10.871168  2257 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.897250 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:10.870949  2155 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:10.903268 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.903992 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:10.739602  2151 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.907079 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.037772 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:10.921625 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:10.908593  2125 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:10.910037  2130 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:10.932729 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:10.934888 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 61303.7us
I20260709 12:20:10.900775  2241 consensus_queue.cc:1059] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:20:10.939901 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:10.943014 29323 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:10.902518  2146 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:10.902259  2246 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:10.925772  1742 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.926153  2193 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:10.949586 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 205829us
I20260709 12:20:10.935635  2130 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.909292  2257 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.937722  2210 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:10.938060  2039 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:10.958949 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:10.959918 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.909473  2155 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:10.961647 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:10.968680 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:10.963469  2130 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:11.078802 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.107378 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:11.062705  2247 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 1.313s	user 0.006s	sys 0.010s
I20260709 12:20:10.956521  2153 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:11.126255 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 157649us
I20260709 12:20:11.126507 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:10.971611  2193 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:10.950490  2287 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 12:20:11.111615  1773 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.137006  2257 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:11.077342  2102 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:11.136837  1797 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:11.138891  2151 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:11.112157  2118 consensus_meta.cc:287] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.001s
W20260709 12:20:11.117285  2062 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.002s
I20260709 12:20:11.132691  1938 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:11.146039 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:11.123066  2153 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.146831  2155 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:11.078809  2283 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:10.973074  1842 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:11.148628  2281 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.116312  2282 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:11.154726 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.194585 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:11.154193  2193 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:10.961323  1742 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.155982 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:11.118134  2292 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:20:10.972724  2210 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:11.138145  2244 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:11.156401  2194 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.000s
I20260709 12:20:11.173720 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:11.140385  2293 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:11.180416 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:11.236613  2122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.004s	sys 0.019s
I20260709 12:20:11.157836  2146 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:11.196607 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:11.268097 28678 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:11.169040  1797 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:11.197971 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:11.177536  2149 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.176764  2284 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:11.254987 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:11.184618  2216 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:11.259332 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 172515us
I20260709 12:20:11.181526 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:11.264921 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.266132 29321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:41278
W20260709 12:20:11.266613 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93012.5us
I20260709 12:20:11.189793  2153 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.247288  2210 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.272182 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3046) took 1485 ms. Trace:
I20260709 12:20:11.177796  2118 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:11.267222  2122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.004s	sys 0.019s
I20260709 12:20:11.249039  2244 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:11.254583  2289 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.294344 29321 raft_consensus.cc:606] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:11.306077 29321 raft_consensus.cc:614] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:11.181876  2062 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.296051 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 2999) took 1101 ms. Trace:
I20260709 12:20:11.298959 28755 rpcz_store.cc:276] 0709 12:20:09.787210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.816133 (+ 28923us) service_pool.cc:224] Handling call
0709 12:20:09.829543 (+ 13410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.226285 (+396742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.271875 (+1045590us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540004a6d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:11.272104 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911045504}
I20260709 12:20:11.270278  2236 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.194617  1938 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.234633  2281 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:11.273330  1797 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:11.193501  2283 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.229223  1842 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.309399 28750 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:11.269531  2194 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.308097 28674 rpcz_store.cc:276] 0709 12:20:10.194306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.194419 (+   113us) service_pool.cc:224] Handling call
0709 12:20:10.194676 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.238082 (+ 43406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.238113 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.238571 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.362879 (+124308us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:10.362930 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.270124 (+907194us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b54000c7454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:11.270173 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:11.270225 (+    52us) raft_consensus.cc:1685] finished
0709 12:20:11.270239 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:11.295963 (+ 25724us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11137,"raft.queue_time_us":13563,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8424,"spinlock_wait_cycles":73319808,"thread_start_us":123952,"threads_started":1,"wal-append.queue_time_us":244366}
I20260709 12:20:11.318755 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:20:11.234171  2282 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:11.305804  2244 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:11.308198  2117 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.292271  2149 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.329897 28751 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:20:11.331732  2125 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:11.332306  2125 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.333041  2062 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.334450  2125 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.334991  2125 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:11.335443  2125 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:11.337795  2291 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:20:11.271944  2102 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.271293  2293 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.298503  2216 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:11.304451  2129 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:20:11.356526 28602 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:20:11.357470 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.358759 28599 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:11.358979 28600 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:11.296392  2284 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:11.358840 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.361119 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.337816  1842 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:11.312206  2289 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:11.365787 28677 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:11.346774  2246 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:11.367693 28602 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 12:20:11.367026 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 196331us
I20260709 12:20:11.367894 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:11.379786 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:11.380106  2292 consensus_queue.cc:1243] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:11.316519  2236 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.395236 28603 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:11.359514  2300 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:11.400563 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 106889us
I20260709 12:20:11.402045 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:11.370097  2156 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.758s	user 0.021s	sys 0.013s
W20260709 12:20:11.384425 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 196248us
I20260709 12:20:11.346827  2117 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.414112 28747 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:11.419293 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:11.383070  2209 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:11.413785  2156 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.798s	user 0.022s	sys 0.013s
W20260709 12:20:11.444343 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 76572.2us
I20260709 12:20:11.446177 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:11.420264  2246 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:11.425370  1842 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.422976  2300 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:11.476858 28748 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:11.414078  2218 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:20:11.442813  1742 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.490522 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.491169 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.492060 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.492666 28598 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:11.492995 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.493495 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.446763  2241 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:11.524711  2305 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:11.523219  2313 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:11.523869  2308 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:20:11.550462  2298 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:20:11.441212  2209 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.609671 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:11.610479 29326 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
W20260709 12:20:11.608798 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 125258us
W20260709 12:20:11.614744 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 211610us
W20260709 12:20:11.601514  2208 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.002s
I20260709 12:20:11.619660 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:11.533569  2155 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:11.497659  2292 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:20:11.632406 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:11.635962 28678 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:11.485002  1842 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.636888 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:11.645370 28676 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:11.656558 29318 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:11.500114  2241 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.661667 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:11.662618 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 247276us
I20260709 12:20:11.624576  2125 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.625337  1742 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:11.671852 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 378263us
I20260709 12:20:11.672562 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:11.631590  2194 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.674348 29318 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:11.675297 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:11.636034  2281 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:11.681757 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:11.610281  2313 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.701695 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:11.703888 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:11.659890  2156 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:11.707648 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:11.644169  2155 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:11.721848  2310 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:20:11.721603  2334 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:20:11.605759  2305 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:11.706665  2293 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:11.705789  2102 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:11.608507  2300 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:11.706578  2146 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:11.710465  2284 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:11.713169  2292 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:11.761778 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.725164  2194 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.783834  2194 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:11.785494  2305 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:11.786129  2194 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:11.786012  2210 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.786644  2336 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.787266 28753 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:11.787194  2336 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:11.787994  2313 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.788498  2283 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.788615  2332 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:20:11.789328  2336 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:11.790074 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.761250  2293 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:11.757613 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:11.754529 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 138826us
I20260709 12:20:11.792136  2325 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.792668  2325 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.789592  2244 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.795017  2322 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:11.795533  2322 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.683046  1742 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.794394  2321 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:11.716466  2156 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:11.813832 28648 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:11.815337 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.816172 28605 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:11.816720 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:11.815732 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:11.817215 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.713310  2151 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:20:11.817763 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.757424  2289 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:11.796844  2130 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.639s	user 0.016s	sys 0.003s
I20260709 12:20:11.874118 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:11.853083 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:11.897012 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.899283 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:11.804168  2332 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:11.914595  2335 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:11.799213  2319 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:20:11.765439  2146 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:11.786226  2318 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:20:11.812335  2295 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:11.859575 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.910312  2292 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:11.810432  2330 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:11.797212  2323 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:11.906895 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 242019us
I20260709 12:20:11.916307 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.032506 28755 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:11.916611 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.917078 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:11.797870  2322 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:11.920953 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.813930  2210 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.796264  2244 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.806164  2340 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 12:20:11.812077  1889 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:11.813891  2325 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:11.962056 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.797789  2308 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.803539  2312 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:11.896042  2315 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.804755  2218 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 12:20:11.966856 28605 raft_consensus.cc:2410] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:20:11.851511  2326 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:11.914620  2332 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:12.054704 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 347310us
I20260709 12:20:12.055460 28754 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:11.957772 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 104770us
I20260709 12:20:12.058359 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:11.796317  2153 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.061244 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:12.062614 28606 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:12.065562 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:11.915544  2130 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.071763 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:12.056311  2125 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:11.966259  2295 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:12.030411  2307 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:12.030995  2302 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:12.056200  2353 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:12.062193  1889 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:12.029361  2304 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:20:12.121615 28599 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:20:11.966213  2335 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.066314  2241 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.109289 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:12.066310  2283 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:12.088497  2331 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:12.106315 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1632) took 1145 ms. Trace:
W20260709 12:20:12.114290 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.119393 28754 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:20:12.110443  2336 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.097702 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:12.085037  2333 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:12.105327 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44179.2us
I20260709 12:20:12.107707  2295 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:12.233310  2349 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:12.233845  2349 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.234206  2349 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:12.103962  1842 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:12.096019  2151 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:12.057060  2323 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:12.159288 28572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.816s (SENT) [suppressed 10 similar messages]
I20260709 12:20:12.131969 29319 rpcz_store.cc:276] 0709 12:20:10.960545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.961548 (+  1003us) service_pool.cc:224] Handling call
0709 12:20:10.975177 (+ 13629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.110605 (+135428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.110651 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:11.115607 (+  4956us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.393887 (+278280us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:11.393931 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.394014 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.106084 (+712070us) raft_consensus.cc:1685] finished
0709 12:20:12.106118 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.106257 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134938,"raft.queue_time_us":137090,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":16904,"thread_start_us":236871,"threads_started":1,"wal-append.queue_time_us":310957}
I20260709 12:20:12.163159 28755 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:20:12.259828 28755 pending_rounds.cc:85] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 11
I20260709 12:20:12.260200 28755 pending_rounds.cc:107] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:20:12.260525 28755 raft_consensus.cc:2889] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:12.227378 28756 raft_consensus.cc:1813] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Handling vote request from an unknown peer a8342e3fcab94ce89482df67988159ea
I20260709 12:20:12.262590  2335 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.262794 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:12.263509 29319 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:12.121438  2353 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.101553  2308 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.265825 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.267062 28756 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:20:12.120870  2302 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.229964 28748 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:20:12.114269  2307 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:12.163777  1797 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.003s
W20260709 12:20:12.236014 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 138434us
I20260709 12:20:12.094091  2312 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.109460  2125 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.095829  2315 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.275213  1889 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.192600  2331 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.286903 28598 raft_consensus.cc:1813] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Handling vote request from an unknown peer a8342e3fcab94ce89482df67988159ea
I20260709 12:20:12.287163 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.296044  2153 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.236742  2336 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.297456  2323 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.180488  2332 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.344830  1889 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:12.345346  2332 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:12.298532  1773 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.131s	user 0.003s	sys 0.016s
W20260709 12:20:12.299678  2273 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.414s	user 0.011s	sys 0.008s
I20260709 12:20:12.300217  1742 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.261093  2151 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.260555  2155 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:12.305774 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:12.354303 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48615.4us
I20260709 12:20:12.355082 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:12.355536  2302 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:12.356140  2302 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:12.311944 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.314114  2125 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.315882  2312 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:12.316601  2359 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:12.372098 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:12.239674  2339 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:20:12.339699 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.289124  2156 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.344455  2293 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:12.390468  2351 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:20:12.368026  1773 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:12.392143 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:12.230755 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:12.394347 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 163776us
I20260709 12:20:12.236605  2333 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.356571 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2677) took 1176 ms. Trace:
I20260709 12:20:12.357807  2315 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:12.358881  2308 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.359458  2349 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.360069  2353 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.261647  2047 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.352550  2218 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.364924  2130 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:12.366624  2151 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:12.344492  2304 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.120297  2325 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:12.375557  2359 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.377405  2292 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.402515  2125 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:12.379407 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:12.381096 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.382793 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.447430 29321 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:12.448412 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.343912 28598 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:20:12.311268  1797 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.354305  2296 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.400714 28747 rpcz_store.cc:276] 0709 12:20:11.180066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.180179 (+   113us) service_pool.cc:224] Handling call
0709 12:20:12.356353 (+1176174us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54000e8b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:12.356481 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345637120}
I20260709 12:20:12.402019 29319 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:12.405326 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2707) took 1036 ms. Trace:
I20260709 12:20:12.453183 28604 rpcz_store.cc:276] 0709 12:20:11.368454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.368571 (+   117us) service_pool.cc:224] Handling call
0709 12:20:11.368843 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.479618 (+110775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.479655 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:11.487959 (+  8304us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.914812 (+426853us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:11.914852 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.914922 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.405071 (+490149us) raft_consensus.cc:1685] finished
0709 12:20:12.405099 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.405255 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36491,"raft.queue_time_us":224646,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":13004,"thread_start_us":402473,"threads_started":2,"wal-append.queue_time_us":392839}
I20260709 12:20:12.357833  2336 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:12.414721 28682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.012s	sys 0.041s
W20260709 12:20:12.455607 28682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.012s	sys 0.041s
I20260709 12:20:12.416476 28606 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:12.379148  2331 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.450348 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:12.460471 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.461831 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:12.451479 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.462634 29319 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:12.462710 28755 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:12.418763  2353 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:12.449497  2125 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.468948 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.471424 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.449323  2151 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:12.451067  1742 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:12.415452  2218 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.418255  2304 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.417308  2047 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.461297  2033 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:12.478040 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:12.479314 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.474639 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.459259  2155 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:12.480074 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:12.473534 28747 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:12.469383  2302 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:12.486308 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.476115  2125 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:12.486570 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:12.490357 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.488152 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:12.414948  2307 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.480858  1773 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:12.491256 28748 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:12.493530 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:12.492141 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.498370 28755 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:12.468329  1842 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:20:12.502485 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:12.503209 28747 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:12.503405 29319 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:12.504300 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:12.492822  2327 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.693s	user 0.003s	sys 0.003s
I20260709 12:20:12.490424  2320 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:12.508725 28747 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:12.475968  2353 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.494678  2130 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:12.480881  2151 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.468470  2296 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.482371  1742 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:12.517091 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 357970us
W20260709 12:20:12.518537 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:12.519387  2362 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:20:12.505942  1773 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:12.487186  2033 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.510423  2320 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.490360  2155 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:12.770699 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.529851 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2709) took 1160 ms. Trace:
I20260709 12:20:12.600941 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:12.775349 28678 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:12.509001  2325 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:12.766978 29321 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:12.752087 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1633) took 1791 ms. Trace:
I20260709 12:20:12.774207 28607 rpcz_store.cc:276] 0709 12:20:11.369035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.369167 (+   132us) service_pool.cc:224] Handling call
0709 12:20:11.369432 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.369699 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.369722 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:11.370141 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.605914 (+235773us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:11.605954 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.606027 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.394143 (+788116us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:12.529494 (+135351us) raft_consensus.cc:1685] finished
0709 12:20:12.529525 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.529776 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59679,"raft.queue_time_us":113224,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":46525,"spinlock_wait_cycles":11702656,"thread_start_us":180765,"threads_started":1,"wal-append.queue_time_us":314370}
I20260709 12:20:12.777119 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:12.777545 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:12.783638 29317 rpcz_store.cc:276] 0709 12:20:10.960864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.961382 (+   518us) service_pool.cc:224] Handling call
0709 12:20:11.105494 (+144112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.344276 (+238782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.344306 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:11.344344 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:11.344372 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.751784 (+1407412us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54007a0154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:12.751846 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.752014 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548686592}
I20260709 12:20:12.785256 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:12.682870 29323 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:12.608410 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:12.742413 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2675) took 1562 ms. Trace:
I20260709 12:20:12.743088 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2676) took 1563 ms. Trace:
I20260709 12:20:12.745807  1938 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.785715 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.012778 28681 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:13.021991 28681 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:12.576750 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.013568 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:13.029186 29317 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.966115 28678 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:12.789727  2325 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:12.741655  2369 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:20:12.514078  2300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.024s	sys 0.032s
I20260709 12:20:12.879256 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:12.932595 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.029163 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:12.571031  2365 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:20:12.760968  2128 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:12.522056  2304 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:12.575066  2125 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:12.749734  2361 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:13.027091 28750 rpcz_store.cc:276] 0709 12:20:11.179754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.179849 (+    95us) service_pool.cc:224] Handling call
0709 12:20:11.194234 (+ 14385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.321596 (+127362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.742846 (+1421250us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000e8654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:12.743026 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264412416}
I20260709 12:20:13.023160 28681 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:13.090943 28681 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.932895  2149 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.051723  2325 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:13.092492  2149 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:13.094156  2149 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.096175  1742 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.024528 28751 rpcz_store.cc:276] 0709 12:20:11.179486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.179610 (+   124us) service_pool.cc:224] Handling call
0709 12:20:11.179962 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.330414 (+150452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.742130 (+1411716us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003e9754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:12.742344 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343845632}
I20260709 12:20:12.743650  2117 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.737640  2216 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:13.055668 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.015s	sys 0.031s
W20260709 12:20:13.097725 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.015s	sys 0.032s
I20260709 12:20:13.097847  2149 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:13.098304 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 636490us
I20260709 12:20:12.753070  2236 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.513211  2130 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.525803  2151 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.127583  2151 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:12.522670  2349 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:12.775851  1889 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.128633  1889 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:13.130740  1889 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.131212  1889 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:13.131644  1889 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:12.932670 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1290) took 1289 ms. Trace:
I20260709 12:20:12.776114  2359 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:12.528386  2333 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:12.785099  2320 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.132563  2257 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:13.104490 28605 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:13.107483 28681 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:20:13.134994 28681 pending_rounds.cc:85] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 8
I20260709 12:20:13.135263 28681 pending_rounds.cc:107] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:20:13.135519 28681 raft_consensus.cc:2889] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:13.135829 28681 pending_rounds.cc:107] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:20:13.136037 28681 raft_consensus.cc:2889] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:13.136866 28678 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:13.099490  2149 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:13.092263  1773 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:13.124521  2130 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:13.125516 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3060) took 1227 ms. Trace:
I20260709 12:20:13.029211 29319 raft_consensus.cc:2368] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
W20260709 12:20:13.059768  2300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.029s	sys 0.041s
I20260709 12:20:12.986159  2336 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:12.969801  2323 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.168459 28752 rpcz_store.cc:276] 0709 12:20:11.897643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.897854 (+   211us) service_pool.cc:224] Handling call
0709 12:20:11.898211 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.087887 (+189676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.087924 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.089483 (+  1559us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.469688 (+380205us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:12.481069 (+ 11381us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.482900 (+  1831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.482986 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.125212 (+642226us) raft_consensus.cc:1685] finished
0709 12:20:13.125243 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.125434 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34298,"prepare.queue_time_us":11196,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":1605,"raft.queue_time_us":166441,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":15339,"thread_start_us":465096,"threads_started":2,"wal-append.queue_time_us":404503}
I20260709 12:20:12.879653  2324 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.060817  1797 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:13.088745  2295 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.855s	user 0.007s	sys 0.008s
I20260709 12:20:13.132581 29320 rpcz_store.cc:276] 0709 12:20:11.642830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.642976 (+   146us) service_pool.cc:224] Handling call
0709 12:20:11.659939 (+ 16963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.065331 (+405392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.066597 (+  1266us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.073209 (+  6612us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.342605 (+269396us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:12.342650 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.344006 (+  1356us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.932377 (+588371us) raft_consensus.cc:1685] finished
0709 12:20:12.932405 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.932609 (+   204us) inbound_call.cc:177] Queueing success response
0709 12:20:13.097987 (+165378us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b480021c858. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe89a8aa1 00007f6fe899fb37 00007f6fe899f9ca 00007f6fe8a9726f 00007f6fe8a96f37 00007f6fe8aab55c 00007f6fe8aab508 00007f6fe8aab488 00007f6fe8aab443 00007f6fe8aaa6ec 00007f6fe79d4a96
Metrics: {"raft.queue_time_us":9452,"raft.run_cpu_time_us":3056,"raft.run_wall_time_us":1424631,"spinlock_wait_cycles":12479872,"thread_start_us":618935,"threads_started":2,"wal-append.queue_time_us":291491}
I20260709 12:20:13.189842 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:13.141119 29317 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:13.162936  2304 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.162541  1742 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.170229 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.062978  1920 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.134692  2353 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.152556  2333 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:13.162815  2357 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.140224  2149 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.213696 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1531) took 2266 ms. Trace:
I20260709 12:20:13.192785  2324 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.224952 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.195179  2295 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.205899  2350 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.189785  2323 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.192625  2336 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.227108 29322 rpcz_store.cc:276] 0709 12:20:10.939258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.939377 (+   119us) service_pool.cc:224] Handling call
0709 12:20:10.950469 (+ 11092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:10.950686 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:12.754659 (+1803973us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.205637 (+450978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.205698 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:13.205758 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.205929 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.206072 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1803639,"prepare.queue_time_us":1805173,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":124,"raft.run_cpu_time_us":1809,"raft.run_wall_time_us":8380,"thread_start_us":448467,"threads_started":1}
I20260709 12:20:13.202642  2304 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:13.222905  2359 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.234930 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1630) took 2745 ms. Trace:
I20260709 12:20:13.163415  2151 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.214421  2353 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:20:13.203991  1742 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.207646  1920 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.228945  2155 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.214864  2333 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:13.233434  2102 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:13.248061  2367 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:20:13.237412  1889 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.216043  2357 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.266803  2149 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.232851  2350 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.267236  2102 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.251533  2359 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.277475 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2672) took 2099 ms. Trace:
I20260709 12:20:13.277846 28753 rpcz_store.cc:276] 0709 12:20:11.178520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.178657 (+   137us) service_pool.cc:224] Handling call
0709 12:20:11.194120 (+ 15463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.787701 (+593581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.277207 (+1489506us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54001c4154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:13.277382 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363649280}
I20260709 12:20:13.278333  2359 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.313786  1742 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.311764  2325 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.328141 28604 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:20:13.332181 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.332319 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:13.334235 28679 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:20:13.280468  1920 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.335925 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.336736 28681 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:13.308020  2125 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.338701 28674 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:13.331939 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.345885 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:13.357738 28679 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:13.336114  2118 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:13.349505 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:13.360617  2149 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:13.345721  2304 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:13.362694 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:13.362622  2370 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:20:13.378261 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:13.380577  2295 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:13.384564 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.359344  2193 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:13.375110  2213 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.392241  2213 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.376677  2149 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:13.385377  2324 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.397094  2151 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.388129  1889 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:20:13.390072  2125 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:20:13.411441  2357 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.408286  2324 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:13.398614  2320 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.404495  2193 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:13.405403  2333 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:13.422963 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.422365  2324 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.423492  2125 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.425850  2193 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:13.425192  2336 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.427861  2323 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.427441  2151 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.430523  2324 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:13.424160  2149 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:13.443502 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 415524us
I20260709 12:20:13.446146 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:13.433419  2193 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:13.433911  2125 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:13.434006  2325 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.457819 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:13.451712  2155 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:13.461151 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:13.460400 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.016s
I20260709 12:20:13.443452  2151 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.456295  2374 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:13.462890 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.003s	sys 0.016s
I20260709 12:20:13.464962 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1538) took 2412 ms. Trace:
I20260709 12:20:13.468086 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2686) took 1114 ms. Trace:
I20260709 12:20:13.491061 28748 rpcz_store.cc:276] 0709 12:20:12.353568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.474348 (+120780us) service_pool.cc:224] Handling call
0709 12:20:13.467866 (+993518us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b540003f554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:13.468009 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14935424}
I20260709 12:20:13.489818 29327 rpcz_store.cc:276] 0709 12:20:11.052762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.080549 (+ 27787us) service_pool.cc:224] Handling call
0709 12:20:11.080948 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.128659 (+ 47711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.128689 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:11.128730 (+    41us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:11.128760 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.464687 (+2335927us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b540042c054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:13.464751 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.464906 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109181824}
I20260709 12:20:13.477350  2296 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.480952 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.481666 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.484810 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.503877 28607 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:13.485144 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:13.504362 28600 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:13.486194 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1292) took 1839 ms. Trace:
I20260709 12:20:13.495684 28748 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:20:13.496554 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:13.497565 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.506101 28752 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.506191 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:13.503042 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.506803 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.508244 28601 raft_consensus.cc:2368] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:20:13.509423 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.459698  1889 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:13.513799 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.512169 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.514828 28607 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:13.514971 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:13.515972 28607 pending_rounds.cc:85] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 10
I20260709 12:20:13.516887 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.517773 28751 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
W20260709 12:20:13.518409 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 140230us
I20260709 12:20:13.516332 28607 pending_rounds.cc:107] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:20:13.461340  2325 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:13.463313  1773 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.522776 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:13.521281 28607 raft_consensus.cc:2889] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:13.523307 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.533591 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.534791 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.535413 28748 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:13.509868  2131 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:13.548751  2131 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:13.549638  2131 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.498968  2193 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.553617  2193 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.554548  2047 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:13.555864  2274 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:20:13.557292  2151 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
W20260709 12:20:13.510943  2375 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:20:13.522137  2381 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:13.558486  2381 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.485752  2257 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:13.560752  2257 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.561636 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1182) took 1386 ms. Trace:
I20260709 12:20:13.562018 28755 rpcz_store.cc:276] 0709 12:20:12.175669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.500398 (+324729us) service_pool.cc:224] Handling call
0709 12:20:12.500718 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.935762 (+435044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.935810 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.935870 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:12.935918 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.561415 (+625497us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54002d5fd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:13.561460 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.561579 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999819136}
I20260709 12:20:13.562857  2257 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.563326 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.499644  2374 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.478972  2155 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.526516 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:13.530139 28752 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:13.536260 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.537657 28679 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:13.537760 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.539259 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:13.569566 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 45479.9us
I20260709 12:20:13.540679 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.541806  2333 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:13.542430 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.546165  2125 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.546749 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3010) took 1030 ms. Trace:
I20260709 12:20:13.560180  2282 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:13.525077 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 192382us
I20260709 12:20:13.603982 28751 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:13.579216 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.566087 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 3057) took 1692 ms. Trace:
W20260709 12:20:13.564952 28754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2673) took 2386 ms (client timeout 1689 ms). Trace:
W20260709 12:20:13.623638 28754 rpcz_store.cc:269] 0709 12:20:11.178825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.178943 (+   118us) service_pool.cc:224] Handling call
0709 12:20:11.757479 (+578536us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ae9c 00007f6fe095aa5b 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:20:13.564762 (+1807283us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400337554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:13.564877 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610566528}
I20260709 12:20:13.564389 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:13.625191 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:13.603525 28748 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:13.565538 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3016) took 1685 ms. Trace:
I20260709 12:20:13.629516 28600 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:13.610702 28677 rpcz_store.cc:276] 0709 12:20:12.516459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.516666 (+   207us) service_pool.cc:224] Handling call
0709 12:20:13.412976 (+896310us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:20:13.413254 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.413529 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:13.419396 (+  5867us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.545465 (+126069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.545618 (+   153us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:13.545838 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.545990 (+   152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.546498 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13751,"prepare.queue_time_us":6161,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":948,"raft.queue_time_us":13955,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":7195520,"thread_start_us":109535,"threads_started":1}
I20260709 12:20:13.632728 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:13.634099 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 107606us
I20260709 12:20:13.635480 28755 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:13.626573 28598 rpcz_store.cc:276] 0709 12:20:11.880165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.058102 (+177937us) service_pool.cc:224] Handling call
0709 12:20:13.565339 (+1507237us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54000a8054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:13.565456 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493434624}
I20260709 12:20:13.636816 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.637396 28598 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:13.638299 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.638837 28598 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:13.639631 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:13.640120 28598 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:13.623030 28756 rpcz_store.cc:276] 0709 12:20:11.873592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.873764 (+   172us) service_pool.cc:224] Handling call
0709 12:20:13.565884 (+1692120us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400306954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:13.566035 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616263040}
I20260709 12:20:13.641409 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:13.643802 28756 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:13.627323 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.644915 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.669931 29322 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:13.645529 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.670405 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.671077 28681 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:13.671380 28679 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:13.530602  2325 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.646697 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:13.645592  2386 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:13.647665 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 124942us
W20260709 12:20:13.566004  2309 consensus_queue.cc:1175] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5b3b2f4041a24b05983f30878f16db9d" responder_term: 14 status { last_received { term: 14 index: 14 } last_committed_idx: 13 last_received_current_leader { term: 14 index: 14 } }
I20260709 12:20:13.649166 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:13.608148  2377 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:20:13.675098  2325 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.655953 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.683243 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.524928  2349 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:13.635095 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:13.569378  2382 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.565795  2374 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:13.662489 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.608417  2320 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.663975 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:13.613067  2274 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:13.631079  2333 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.683765 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.805354 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1286) took 2189 ms. Trace:
I20260709 12:20:13.710374 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.806519 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.807279 28681 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:13.807930 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.808140 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.630769  2336 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.620539  2295 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.633474  2257 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:13.646783 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:13.673506 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.852368 28674 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
W20260709 12:20:13.853113 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.663638 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:13.659225  2323 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:13.534307  2296 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.131s
I20260709 12:20:13.568872  1773 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.702198  2385 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:13.658779  2381 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.703313 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:13.666998 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.820685 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.865535 28600 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:13.821237 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.833531 28722 leader_election.cc:400] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:20:13.817754  2380 raft_consensus.cc:1064] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:20:13.710718  2390 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:13.869259  2390 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.871979 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.788141  2287 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.872655 28678 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:13.872800  2287 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:13.873631 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.874693 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.875238 28678 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:13.875620  2287 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:13.836412 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:13.837524 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:13.805872 29326 rpcz_store.cc:276] 0709 12:20:11.616168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.616332 (+   164us) service_pool.cc:224] Handling call
0709 12:20:11.616714 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.617124 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:12.755023 (+1137899us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.234431 (+479408us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.250969 (+ 16538us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.251108 (+   139us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:13.251142 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.251205 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.805165 (+553960us) raft_consensus.cc:1685] finished
0709 12:20:13.805185 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.805299 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1155662,"prepare.queue_time_us":1138997,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":19977,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":18402,"thread_start_us":460497,"threads_started":1,"wal-append.queue_time_us":643993}
I20260709 12:20:13.877050 28602 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:13.878417  2244 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:13.838928 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.880450 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.880676  2108 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:13.881816 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:13.883033  2380 raft_consensus.cc:1068] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Unable to promote non-voter 5b3b2f4041a24b05983f30878f16db9d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:13.884723 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:13.885718 28600 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:13.872179  2390 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:13.889400 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 186144us
I20260709 12:20:13.891040 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:13.806531 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 171487us
I20260709 12:20:13.845877 28756 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:13.848625 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.893432 29320 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:20:13.853624 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.854416 28680 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:13.901860 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.903400 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.906337  2324 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:13.856489 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.923740 28677 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:13.859197 29327 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:13.818600  2386 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:13.865536 29322 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:13.866937 28722 leader_election.cc:403] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:13.855608  2062 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.890125  2287 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:13.929806 28598 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:13.930406 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.892077  2047 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:13.909693 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:13.911244 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.820070  2274 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:13.838500 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 234139us
I20260709 12:20:13.856061 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:13.829957  2349 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.876015 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:13.737888  2145 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.130s
W20260709 12:20:13.930301 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 96904.5us
I20260709 12:20:13.931174 28674 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:13.934489 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:13.912822  2333 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.908056 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:13.817795  2382 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:13.858608  2295 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:13.858446  2336 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:13.937950 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 61368.8us
W20260709 12:20:14.042445 29323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 1638) took 2250 ms (client timeout 2536 ms). Trace:
W20260709 12:20:14.042845 29323 rpcz_store.cc:269] 0709 12:20:11.791597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.391873 (+600276us) service_pool.cc:224] Handling call
0709 12:20:14.042246 (+1650373us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400780354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:14.042360 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510591872}
I20260709 12:20:14.044142 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.045336 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.945712 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.052222 29327 raft_consensus.cc:2410] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:20:14.048704 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 100189us
I20260709 12:20:13.940972 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3016) took 1328 ms. Trace:
I20260709 12:20:14.056293 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:13.965796 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:14.057018 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 122589us
I20260709 12:20:14.054713 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:13.913688  2155 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.057340 29322 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:13.998467 28605 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:14.050549 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.059195 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:13.987069 28679 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:14.067173 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.065272 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:14.068096  2145 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:14.000874  2193 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
I20260709 12:20:13.946689  2357 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:14.073757 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:14.040028  2209 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:13.935997  2385 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15.
I20260709 12:20:14.058043  2149 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:14.081429 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.021924  2320 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:20:14.056206 28673 rpcz_store.cc:276] 0709 12:20:12.608890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.609040 (+   150us) service_pool.cc:224] Handling call
0709 12:20:13.832801 (+1223761us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:20:13.832994 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.833194 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:13.847284 (+ 14090us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.937049 (+ 89765us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.937119 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:13.937180 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.937269 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.937400 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22683,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1331,"raft.run_wall_time_us":28738,"spinlock_wait_cycles":9988224,"thread_start_us":89355,"threads_started":1,"wal-append.queue_time_us":127456}
I20260709 12:20:14.040349  2033 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:14.073179 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.081506 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:14.073742 29317 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:14.074718 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 196826us
I20260709 12:20:13.932897  2386 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:13.861836  2257 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.061465  2300 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:14.093621 29321 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:14.094455 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.095054 29322 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15. Re-sending same reply.
I20260709 12:20:14.079315 28677 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:20:14.090638 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:13.937740  2323 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:14.075639  2357 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:13.937625  2062 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.082540  2193 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:14.083334 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.092487 29327 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:14.093591  2402 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:14.069574 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:14.080992  1859 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:14.077435  2122 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:14.077723  2380 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:14.101687 28648 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.106451 29317 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:20:14.100982 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58324.3us
I20260709 12:20:14.101060 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.108425 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.114614 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.144938 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.088270  2155 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:14.104592  1859 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:14.160637  1859 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.095849  2131 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:14.161500  2131 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.161904  2131 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:14.150012 29327 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:14.165199 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.165973 29327 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 11: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:14.166726 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.160421  2382 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.168969  2274 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.128177 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:14.156730 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.157112  2257 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:14.100032  2193 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:14.100028  2357 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:14.088339  2149 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.105571  2402 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.158401  2155 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:14.159117  2282 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.106707  2209 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:14.153292  2062 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:14.096849  2386 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:14.111047 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.112807 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.169703  1859 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.189841  2282 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.190332 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.191478 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.191680 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.192205 29320 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
W20260709 12:20:14.192718 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 119027us
I20260709 12:20:14.194067 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.173103 28751 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:14.110615  2380 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:14.177942 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49847.9us
I20260709 12:20:14.110513  2122 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.110562  2381 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:14.149299  2130 consensus_meta.cc:287] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.961s	user 0.006s	sys 0.007s
I20260709 12:20:14.143922  2399 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:14.144145  2397 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:14.149365  2359 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:14.170293  2393 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:20:14.180971  2274 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:14.195451 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.189106  2155 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:14.170809  2325 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.203552 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:14.278448 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 74967.6us
I20260709 12:20:14.205332 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1071) took 1422 ms. Trace:
I20260709 12:20:14.279835 28604 rpcz_store.cc:276] 0709 12:20:12.782534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.782657 (+   123us) service_pool.cc:224] Handling call
0709 12:20:12.782963 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.328598 (+545635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.205102 (+876504us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54000bd954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:14.205278 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253189888}
I20260709 12:20:14.203207 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.188743  2209 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.202818 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.263861 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.188963  2402 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:14.284409 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45391.4us
W20260709 12:20:14.299252 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 96114.6us
I20260709 12:20:14.299767 29320 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:14.303686  2410 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:14.304211  2410 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:14.304646  2410 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.304930  2325 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.199225  2122 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:14.199479  2380 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:14.278972  2324 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.299716  2193 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:14.315011  2372 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 1.631s	user 0.003s	sys 0.002s
I20260709 12:20:14.321297 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.321982 28753 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:14.323060 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3059) took 2446 ms. Trace:
I20260709 12:20:14.301859  2209 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:14.323499 28749 rpcz_store.cc:276] 0709 12:20:11.876347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.876586 (+   239us) service_pool.cc:224] Handling call
0709 12:20:11.877003 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.072660 (+195657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.072691 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.088122 (+ 15431us) log.cc:844] Serialized 26 byte log entry
0709 12:20:12.461135 (+373013us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:12.461175 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.461610 (+   435us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.314414 (+1852804us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:14.322758 (+  8344us) raft_consensus.cc:1685] finished
0709 12:20:14.322784 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.322997 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32671,"raft.queue_time_us":153555,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7209,"spinlock_wait_cycles":10671360,"thread_start_us":488713,"threads_started":2,"wal-append.queue_time_us":400246}
I20260709 12:20:14.325783 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.326599 28749 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:14.327584 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:14.328781 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.334025  2131 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.198992  2381 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:14.262844  2130 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.301571  2406 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:14.408602  2410 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:14.421022  2407 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:20:14.196225  2323 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.423774 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.425947 28601 raft_consensus.cc:2393] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:14.384843  2381 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:14.428977  2296 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:14.429548  2296 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.431098  2282 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.431550 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:14.432564  2131 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.435544 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:14.436496 29320 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:14.431648  2296 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:14.440109 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 137710us
I20260709 12:20:14.441241 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.441258 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.442322  2412 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:14.442786 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.444957 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.451424 28750 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:20:14.416256  2122 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.445885  2295 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:14.445580 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.446798  2209 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.454612 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.455216 28678 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:14.455317 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.447373 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.448511  2336 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.351441  2359 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 12:20:14.459787  2359 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:14.458626  2209 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.460332 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.461786  2359 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:14.462707 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.463212 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.463721 28750 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:14.453433 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:14.460458 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.464532 28673 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:14.440359 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:14.461468 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.441370  2193 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:14.466017 29322 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:14.443562  2349 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:14.462771  2359 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.467746 28753 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:14.471128  2155 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.500415 28750 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 12:20:14.476061  2122 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:14.500959 28753 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:14.502146  2155 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.503021 28753 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:14.451702  2412 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:14.505015  2412 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:14.477120 29320 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:20:14.482615  2402 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.486696  2149 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.486817  2397 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:14.487380 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.490350  2386 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.492770 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.465479 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:14.465601 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:14.510013  2149 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:14.510456  2149 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.510798  2149 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:14.515339 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:14.509938 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44442us
I20260709 12:20:14.519804 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.521363  2146 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:14.516227 28676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 3014) took 1908 ms (client timeout 2362 ms). Trace:
W20260709 12:20:14.524668 28676 rpcz_store.cc:269] 0709 12:20:12.608198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.608326 (+   128us) service_pool.cc:224] Handling call
0709 12:20:14.515168 (+1906842us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:20:14.516127 (+   959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3296000}
W20260709 12:20:14.528795 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 63694.4us
I20260709 12:20:14.529647 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:14.504681  2381 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.504251 28753 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:20:14.548826 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.476915  2357 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.509052 29323 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:14.541574 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3011) took 3180 ms. Trace:
I20260709 12:20:13.243877 29325 rpcz_store.cc:276] 0709 12:20:10.489321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.489473 (+   152us) service_pool.cc:224] Handling call
0709 12:20:10.489808 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:10.490044 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:10.873299 (+383255us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.750784 (+1877485us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b180007b640. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:20:12.751040 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.233220 (+482180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.233272 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:13.233317 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.234747 (+  1430us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.234863 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1871052,"prepare.queue_time_us":2264549,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":61910,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":12487,"spinlock_wait_cycles":7009536,"thread_start_us":793462,"threads_started":2}
I20260709 12:20:13.505079 29318 rpcz_store.cc:276] 0709 12:20:11.646915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.683927 (+ 37012us) service_pool.cc:224] Handling call
0709 12:20:11.684238 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.684426 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:13.217191 (+1532765us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.485835 (+268644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.485891 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:13.485937 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.486012 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.486139 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1088886,"prepare.queue_time_us":1071937,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":30,"raft.queue_time_us":18738,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9860,"thread_start_us":710552,"threads_started":2}
I20260709 12:20:14.496156  2380 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.539618  2155 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:14.556520 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.499326  2102 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.545199  2397 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:14.540591  2293 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:14.552904 28599 rpcz_store.cc:276] 0709 12:20:11.361389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.365890 (+  4501us) service_pool.cc:224] Handling call
0709 12:20:11.366264 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.122216 (+755952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.541215 (+2418999us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b5400093654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:14.541470 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736272128}
I20260709 12:20:14.555029 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.557121 29320 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:14.582645 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.557688 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.549593 28678 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:14.566330 28505 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 9 to 10, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 10 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.437606 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:14.554371  2296 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 12:20:14.570029 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2564) took 2950 ms. Trace:
W20260709 12:20:14.570127 28606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2725) took 2461 ms (client timeout 2048 ms). Trace:
I20260709 12:20:14.571228  2350 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.556308  2155 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.573899 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:14.575807  2380 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.576131  2297 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:14.580358 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1188) took 2103 ms. Trace:
I20260709 12:20:14.610283 28747 rpcz_store.cc:276] 0709 12:20:12.477012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.756921 (+279909us) service_pool.cc:224] Handling call
0709 12:20:13.570211 (+813290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.570382 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.570406 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:13.570446 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:13.570477 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.570529 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.580155 (+1009626us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b5400306950. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:14.580286 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1869612928}
I20260709 12:20:14.590180 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.612951 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.590646 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.615101 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.615830  2336 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:14.588757 28606 rpcz_store.cc:269] 0709 12:20:12.108789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.108935 (+   146us) service_pool.cc:224] Handling call
0709 12:20:14.569903 (+2460968us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400233f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:14.570011 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549432064}
I20260709 12:20:14.620889  2413 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:14.621732  2413 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:14.604779 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.602919 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:14.625617  2280 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:14.626516 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.608661 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.628118  2280 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:14.629318 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.630384 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.632944  2293 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:14.633952  2293 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.637030 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:14.643939  2336 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:14.588325 28682 rpcz_store.cc:276] 0709 12:20:11.619675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.620552 (+   877us) service_pool.cc:224] Handling call
0709 12:20:11.620807 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.635021 (+ 14214us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:11.759948 (+124927us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.595126 (+835178us) log.cc:844] Serialized 14 byte log entry
0709 12:20:12.595423 (+   297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.595489 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:12.595562 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.569741 (+1974179us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b540019ee54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:14.569792 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.569945 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19101,"prepare.queue_time_us":820816,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":1851,"raft.queue_time_us":22946,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":72409,"spinlock_wait_cycles":32140032,"thread_start_us":922224,"threads_started":3,"wal-append.queue_time_us":694013,"wal-append.run_cpu_time_us":21245,"wal-append.run_wall_time_us":1689909}
I20260709 12:20:14.649330  2297 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.591226  2102 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.647614 28721 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.653275 28747 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:14.608902  2155 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:14.609222  2282 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.660104  2102 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.667009  2287 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:14.652312  2297 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.658807  2081 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:14.654974  2386 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:14.671355  2149 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.682166 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:14.682915 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.684191 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.684731 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.686553 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.687120 28678 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:14.688525 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.691387 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.692756 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.693559 28678 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:14.694190 28682 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:14.694944 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.674023  2287 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:14.696512 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:14.696734 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 112056us
I20260709 12:20:14.699743 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.668056  2282 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.688830  2402 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.688998  2405 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:14.705566 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:14.708638 28749 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:14.708081 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:14.709924  2295 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:14.720373  2295 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.716079  2287 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.722164  2295 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:14.722780  2287 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:14.708079  2405 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:14.714068  2381 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.715673  2421 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:14.727044  2293 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:14.729548  2405 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.750046  2149 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.750748 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.751387 28673 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:14.752983  2282 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.731527  2421 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:14.753890  2421 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.754899 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:14.755736 28675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 3011) took 2238 ms (client timeout 1597 ms). Trace:
I20260709 12:20:14.757866  2213 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.759531  2412 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.761209 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.761826 29325 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:14.762418  2386 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:14.762756 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:14.763803 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:14.764922  2102 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:14.766077  1773 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:14.768329 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:14.768947 29317 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.772970 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:14.775384 28676 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 12:20:14.776154 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.777487 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:14.778285  2376 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 1.373s	user 0.001s	sys 0.012s
I20260709 12:20:14.778738  2346 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:14.779333  2346 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:14.780282  2346 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.781699 28505 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 10 to 11, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 11 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.775292 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:14.783902 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:14.764315 29325 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:14.795696 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:14.799703 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:14.846822 28603 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:14.800362 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.814752 29327 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:14.848016 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47739.2us
I20260709 12:20:14.847363 28673 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:14.813251 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.795946 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:14.813920 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:14.792924 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:14.817025 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:14.850361 28598 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:14.848377 28606 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:14.851491 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:14.756083 28675 rpcz_store.cc:269] 0709 12:20:12.516842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.517893 (+  1051us) service_pool.cc:224] Handling call
0709 12:20:14.754749 (+2236856us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a450a0 00007f6fe8a44984 00007f6fe1fbf6d4 00007f6fe1fbf662
0709 12:20:14.755598 (+   849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7568128}
W20260709 12:20:14.845331 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 61512.3us
I20260709 12:20:14.853888 28606 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:20:14.849918 28599 raft_consensus.cc:2368] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
I20260709 12:20:14.855248 28606 pending_rounds.cc:85] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 14
W20260709 12:20:14.855456 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62607.7us
I20260709 12:20:14.805761 28720 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:14.855693 28606 pending_rounds.cc:107] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:20:14.856325 28606 raft_consensus.cc:2889] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:14.857515 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51839.4us
I20260709 12:20:14.858589 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.858644 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:14.864848 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:14.865885 28603 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:14.867030 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.867477 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:14.868137 28599 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:20:14.868593 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.871985 29325 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:14.867643 28675 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:14.874004 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:14.874900 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.919728 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:14.920248 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.920671 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:14.784289  2295 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.922250 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.761827  2412 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:14.762789  2386 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:14.852221  2108 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:14.813211  1773 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:14.857218  2274 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:14.879215 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.880592 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.880216 28679 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:14.880774 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.880162 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.944352 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.878206 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:14.862309  2297 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:14.878834 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.860858 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:14.946132 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.946647 28606 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:14.861406 29317 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:14.784343  2282 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:14.945737 28678 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:14.859443  2353 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:14.859547  2081 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:14.926806 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:14.881778  2122 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:14.922384 28598 raft_consensus.cc:2376] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16. Re-sending same reply.
W20260709 12:20:14.929343 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 214855us
I20260709 12:20:14.877000  2405 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:14.933017 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.957258 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:14.956487 29323 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:14.947643 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:14.949288 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.951390 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:14.960884 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:14.968626 29317 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:14.971485 29317 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:14.960075 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.976679 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.916088  2402 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:20:14.941062 28675 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:14.978140 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2590) took 1318 ms. Trace:
I20260709 12:20:14.982492 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:14.989454 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 110125us
I20260709 12:20:14.956514  2122 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.957141  2081 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:14.951105  2282 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:14.975386  2353 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:14.951274  2274 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:15.002552 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 103207us
I20260709 12:20:14.994268 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:14.990540 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 113148us
I20260709 12:20:14.961592  2297 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:14.961143  2390 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:14.960894  2412 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:14.998523  2081 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.979110  2380 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:14.984688  2323 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:14.956346  1773 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:14.987346  2383 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:15.006457 28648 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:15.009681 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 90030.3us
I20260709 12:20:15.019626 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1550) took 1214 ms. Trace:
I20260709 12:20:15.023010  2303 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:14.997349  2122 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.002277  2282 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:15.046608 28675 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:20:15.049182 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62908.4us
I20260709 12:20:15.065073 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.003750  2274 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:15.051754 29319 rpcz_store.cc:276] 0709 12:20:13.804993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.805207 (+   214us) service_pool.cc:224] Handling call
0709 12:20:13.813880 (+  8673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.069912 (+256032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.069943 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:14.069985 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:14.070015 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.019406 (+949391us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54007a5b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:15.019450 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.019572 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588397440}
I20260709 12:20:15.052763 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.056282 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:15.060472 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54127.2us
W20260709 12:20:15.061679 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70116.2us
I20260709 12:20:15.086983 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.003453  2427 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 12:20:15.049090  2412 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:15.090147 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:15.062222  2402 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:15.059245  2390 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:15.094224 29319 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:15.006588  2244 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:20:15.095321 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:14.997402  2386 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.091853  2382 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:15.042742  2155 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.097009  2383 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:15.102468 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 145301us
I20260709 12:20:15.085707  2218 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:15.094573  2209 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:15.111419 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.122675  2399 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:15.123178 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.103992  2390 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:15.112671 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 103906us
I20260709 12:20:15.085391  2381 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:20:15.100226  2435 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:20:15.109002  2346 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:15.092083 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 78517.9us
I20260709 12:20:15.127561 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:15.123184 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.157678 29320 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:15.160548 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 107899us
W20260709 12:20:15.123409 28498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 232) took 20254 ms (client timeout 15000 ms). Trace:
I20260709 12:20:15.160087 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:15.162631 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:15.163935 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.164845  2441 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:15.165503  2441 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:15.165915 28491 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet a5dc72678108404787b2aa034d4a7243 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 10
I20260709 12:20:15.131824  2390 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:15.168078  2441 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.169102  2440 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:15.169517  2399 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:20:15.165514  2431 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 12:20:15.162611  2426 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:20:15.097999  2353 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.113867  2336 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:15.127509  2295 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:20:15.210340 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:15.210914 28749 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.133097  2383 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:15.180580  2380 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:15.210211 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.215212 28603 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:20:15.217024  1773 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:15.192675  2440 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:20:15.227902  2439 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:20:15.229607  2155 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:15.212508  2303 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
W20260709 12:20:15.236028 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 127000us
W20260709 12:20:15.173280 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44990.4us
W20260709 12:20:15.124966  2432 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:20:15.176282 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 50691.5us
I20260709 12:20:15.158718  2382 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:15.181337 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58229.2us
I20260709 12:20:15.126658  2209 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:15.182943 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.218815  2380 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:15.184525 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.184796 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:15.185181 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.289115 28598 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 11.
I20260709 12:20:15.290370 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.291628 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.291955 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:15.183991 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.292742 28606 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:15.293658 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.294333 28606 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:15.295225 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:15.182973 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.115152  2153 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:15.296970  2153 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:15.298045  2153 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.299667  2153 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:15.159409  2346 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.129158  2427 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:15.300675  2346 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.207301 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.303345 28600 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:15.304354 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.305577 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.306741 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.307924 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.208660  2336 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:15.179970 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:15.308668  2336 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:15.309041 28752 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:15.238881 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.310740  2427 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:15.311615 29322 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:15.311811 28603 raft_consensus.cc:1217] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Deduplicated request from leader. Original: 11.8->[13.9-15.10]   Dedup: 15.10->[]
I20260709 12:20:15.312618 28603 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 12:20:15.314278 28603 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:15.239354 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:15.316372 28602 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:15.174793  2412 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.279994 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.183267 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:15.317830 28756 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:15.257964 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:15.333045 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:15.332332 28602 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:15.335500 28598 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:15.347795 28751 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 11.
I20260709 12:20:15.117430  2297 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.352769 28604 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:15.358470 28604 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:15.210757  2122 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:15.270915  2421 consensus_meta.cc:287] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.517s	user 0.000s	sys 0.010s
W20260709 12:20:15.367244 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 75368.3us
I20260709 12:20:15.368392 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:15.368661 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 95104us
I20260709 12:20:15.371452 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.373158 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.377979 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:15.378284 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 98421.5us
I20260709 12:20:15.379405 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:15.377342 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 137061us
I20260709 12:20:15.265940  2410 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.403765 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:15.404089 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.405627 28606 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:15.405879 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:15.365572 28598 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:15.350929  2380 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:15.414654 28749 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:15.383589  2309 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:15.269820  2081 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.401715  2193 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.382546  2435 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:15.466315  2447 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.466487  2281 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:15.462532  2244 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:20:15.450702  2218 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:15.384337  2421 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.473639  2282 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.445705  2442 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:15.462532  2399 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:15.378799  2452 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:15.404693  2438 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:15.446914  2382 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:15.451813  2410 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:15.500861 29325 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:15.484136  2218 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:15.486763  2442 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.483062  2193 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.517613  2274 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.522096  2274 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.523514  2436 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:15.523185  2336 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.523921  2436 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:15.524761  2436 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.525839  2336 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.506875  2218 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:15.510057  2442 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:15.525920  2436 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:15.497045  2399 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.559777  2399 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.539925  2386 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.560369  2359 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:15.540179  2421 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:15.542953  2455 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:20:15.545467  2357 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.487242  2209 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.570490  2425 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:15.571038  2425 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:15.553584  2406 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:15.571911  2406 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:15.572156  2425 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.572779  2406 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.573788  2425 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:15.574133  2406 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.553715  2282 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.554020  2433 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:15.575829  2433 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:15.576676  2433 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.577884  2433 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:15.573980  2460 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:15.555536  2390 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.602418  2447 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:15.610569  2442 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.613041  2442 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:15.643152 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 238957us
W20260709 12:20:15.645129 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 273993us
I20260709 12:20:15.650951  1773 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:15.651935  2081 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:15.650975 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 467940us
I20260709 12:20:15.653973 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:15.655135  2122 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:15.656824 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 381849us
I20260709 12:20:15.580011  2218 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.657394  2151 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:15.656821  2282 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:15.659531  2282 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.662649  2282 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:15.662714  2193 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:15.663774 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:15.668648  2122 raft_consensus.cc:2764] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:20:15.670056 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2731) took 2187 ms. Trace:
I20260709 12:20:15.672592 28605 rpcz_store.cc:276] 0709 12:20:13.481985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.513729 (+ 31744us) service_pool.cc:224] Handling call
0709 12:20:13.514012 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.065478 (+551466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.669097 (+1603619us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400217354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:15.669730 (+   633us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113341824}
I20260709 12:20:15.668030 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:15.675611  2122 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:15.676350  2122 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:15.678723  2122 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:15.681802 28601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2734) took 2198 ms (client timeout 2852 ms). Trace:
W20260709 12:20:15.682416 28601 rpcz_store.cc:269] 0709 12:20:13.482908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.523072 (+ 40164us) service_pool.cc:224] Handling call
0709 12:20:15.681245 (+2158173us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b540004b854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:15.681558 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052704512}
I20260709 12:20:15.684820 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:15.686101 28747 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:15.684875 28602 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 12:20:15.690490 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.695042 29319 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:20:15.701993 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.706938 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:15.708870  2218 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:15.711270 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:15.702292  1859 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:15.164147 28498 rpcz_store.cc:269] 0709 12:19:54.750919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.751197 (+   278us) service_pool.cc:224] Handling call
0709 12:20:14.997169 (+20245972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:04.540179 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:04.954365 (+414186us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:04.957143 (+  2778us) write_op.cc:435] Acquired schema lock
0709 12:20:04.959131 (+  1988us) tablet.cc:662] Decoding operations
0709 12:20:04.996562 (+ 37431us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:04.996647 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:04.996674 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:20:04.998091 (+  1417us) tablet.cc:701] Row locks acquired
0709 12:20:04.998116 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:20:04.998272 (+   156us) write_op.cc:270] Start()
0709 12:20:04.998382 (+   110us) write_op.cc:276] Timestamp: P: 1783599604998220 usec, L: 0
0709 12:20:04.998402 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:20:05.186747 (+188345us) log.cc:844] Serialized 5172 byte log entry
0709 12:20:05.418936 (+232189us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b
0709 12:20:05.518360 (+ 99424us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540002c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7ae28 00007f6fe74b5581 00007f6fe74b4d58 00007f6fe74b99f1 00007f6fe74b99a9 00007f6fe74b9939 00007f6fe74b9901 00007f6fe74b8b2d 0000000000388634 0000000000388479
0709 12:20:05.606932 (+ 88572us) op_driver.cc:464] REPLICATION: finished
0709 12:20:05.879892 (+272960us) write_op.cc:301] APPLY: starting
0709 12:20:05.882458 (+  2566us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:06.432019 (+549561us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:06.432068 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:06.949355 (+517287us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:06.949677 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:20:06.949738 (+    61us) write_op.cc:312] APPLY: finished
0709 12:20:06.950118 (+   380us) log.cc:844] Serialized 121 byte log entry
0709 12:20:07.192996 (+242878us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:07.212706 (+ 19710us) write_op.cc:454] Released schema lock
0709 12:20:07.212773 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:07.213250 (+   477us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:07.213277 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10579,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":204253,"apply.run_cpu_time_us":43956,"apply.run_wall_time_us":1369831,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58337,"num_ops":13,"prepare.queue_time_us":227330,"prepare.run_cpu_time_us":28278,"prepare.run_wall_time_us":1036077,"raft.queue_time_us":59780,"raft.run_cpu_time_us":33812,"raft.run_wall_time_us":112823,"replication_time_us":608124,"spinlock_wait_cycles":273336448,"thread_start_us":798722,"threads_started":5,"wal-append.queue_time_us":635588,"wal-append.run_cpu_time_us":7626,"wal-append.run_wall_time_us":2112163}]]}
I20260709 12:20:15.713634  1773 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:20:15.719931 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:15.721479 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:15.722369 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3064) took 1601 ms. Trace:
I20260709 12:20:15.722790 28750 rpcz_store.cc:276] 0709 12:20:14.120623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.475440 (+354817us) service_pool.cc:224] Handling call
0709 12:20:14.500153 (+ 24713us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:14.500875 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.721914 (+1221039us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b5400305f50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:15.722166 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55985920}
I20260709 12:20:15.723394  1773 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:15.723894  1773 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:15.724406  1773 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:15.728782  2151 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:15.729342  2151 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:15.730954  2151 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.732754 28679 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:15.734261 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.735252 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:15.736791 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:15.737628 28680 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.738802 28678 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:15.739310 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 1663) took 1141 ms. Trace:
I20260709 12:20:15.739738 29320 rpcz_store.cc:276] 0709 12:20:14.598015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.630164 (+ 32149us) service_pool.cc:224] Handling call
0709 12:20:15.738894 (+1108730us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400780354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:15.739124 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152663296}
I20260709 12:20:15.740542 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:15.742584 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:15.743323 28678 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:20:14.981675 28681 rpcz_store.cc:276] 0709 12:20:13.660282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.058886 (+398604us) service_pool.cc:224] Handling call
0709 12:20:14.059161 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.069001 (+  9840us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:14.080987 (+ 11986us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.525498 (+444511us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b1800360520. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9
0709 12:20:14.753825 (+228327us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b1800360520. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a 00007f6fe3a89a2a
0709 12:20:14.977447 (+223622us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.977775 (+   328us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:14.977825 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:14.977868 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.977941 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.978074 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2989,"prepare.queue_time_us":11744,"raft.queue_time_us":20548,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3512,"spinlock_wait_cycles":17157376,"thread_start_us":213966,"threads_started":1,"wal-append.queue_time_us":902406}
I20260709 12:20:15.745517 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1560) took 1726 ms. Trace:
I20260709 12:20:15.750356 28676 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 12:20:15.753114 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:15.753854  2108 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:15.754318  2108 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:15.757002 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:15.757630 29317 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:15.757843 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.759783 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:15.762029  2309 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:15.768054  2151 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:15.770730 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:15.771656 29323 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:15.772120 29317 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:20:15.773837 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:15.736183 28607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2744) took 1736 ms (client timeout 1687 ms). Trace:
I20260709 12:20:15.782229  2314 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:20:15.782560 28607 rpcz_store.cc:269] 0709 12:20:13.999548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.735725 (+1736177us) service_pool.cc:211] Skipping call since client already timed out
0709 12:20:15.735938 (+   213us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:20:15.782588  2286 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:20:15.786216  1859 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:15.772743 29327 rpcz_store.cc:276] 0709 12:20:14.019465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.171779 (+152314us) service_pool.cc:224] Handling call
0709 12:20:14.814479 (+642700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.852613 (+ 38134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.745011 (+892398us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54004a92d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:15.745253 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477368576}
I20260709 12:20:15.788235  2314 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:15.788879  2314 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:15.790426  2314 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.792872  2314 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:15.792979 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:15.796290 28755 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:15.798012 28678 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:15.799078  2153 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.813638  2130 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:15.814908 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:15.815841 28755 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:15.817744 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:15.817976 28674 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:15.799840  2153 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.830271 28680 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:15.755724  2108 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.832587 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:15.913122 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.913659  2108 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:15.927523 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 123459us
I20260709 12:20:15.928670  2359 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:15.928572 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.929333  2359 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:15.929567 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:15.930819  2466 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:15.931767  2390 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.932025  2421 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:15.930584  2359 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.932652  2466 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:15.824400  2380 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:15.936960 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.937876 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:15.936198  2218 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:20:15.939254  2380 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:15.927587  2153 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:15.941007  2153 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:15.941294  2346 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.640s	user 0.005s	sys 0.014s
I20260709 12:20:15.942095  2153 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:15.940251 28603 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:15.941916  2346 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.940071  2282 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:15.950467  2282 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:15.954216 28681 pending_rounds.cc:85] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 8
I20260709 12:20:15.954694 28681 pending_rounds.cc:107] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:20:15.954522 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:15.955188 28681 raft_consensus.cc:2889] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:15.956157 28682 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:15.956671  2466 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:15.957202  2153 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:15.961618 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:15.949862  2421 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:15.980587 28755 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:20:15.981542  2282 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:15.982786 29323 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:15.983279  2282 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:15.986685 29326 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:20:15.995945 28572 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.008s	sys 0.018s
W20260709 12:20:15.996466 28572 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.008s	sys 0.018s
W20260709 12:20:15.996970 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 549621us
I20260709 12:20:15.958679  2463 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:15.973058  2466 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:16.038374 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:16.042305 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:16.042551 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:16.042589 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 1278) took 1158 ms. Trace:
I20260709 12:20:16.009860  2463 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:16.047442 28674 rpcz_store.cc:276] 0709 12:20:14.881036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.920013 (+ 38977us) service_pool.cc:224] Handling call
0709 12:20:16.012050 (+1092037us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b5400251054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:16.039692 (+ 27642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040869760}
I20260709 12:20:16.008056  2421 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.101712 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:16.135413 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.008s	sys 0.008s
I20260709 12:20:16.155115 29317 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:16.157140 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:16.158612 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:16.159559 29321 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:16.160255 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.006s	sys 0.018s
W20260709 12:20:16.160652 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.006s	sys 0.018s
I20260709 12:20:16.162256  1773 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:16.164369 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.012s	sys 0.008s
W20260709 12:20:16.164769 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.013s	sys 0.008s
W20260709 12:20:16.165082 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 710229us
I20260709 12:20:16.166697  2442 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:16.167467  2442 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.169588  1859 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:16.170783 28753 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:16.173970 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 189032us
I20260709 12:20:16.174731 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:16.175699 28747 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:16.176350 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:16.176789 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:16.177102 28752 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:16.177369 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:16.177824 28754 raft_consensus.cc:2410] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:20:16.177914 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:16.178833  2209 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:16.179243 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:16.179418  2209 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:16.180846 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:16.180554  2209 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.181396 28747 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:16.183238  2468 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:16.183976  2468 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:16.184720 28674 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:16.185599  1773 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:16.185768  2102 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:16.185969 28752 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:16.186127  2468 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:16.186412  2102 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:16.187351  2102 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.178109 28748 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:16.189822 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.008s	sys 0.016s
I20260709 12:20:16.190016  2342 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:20:16.190227 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.008s	sys 0.016s
I20260709 12:20:16.190446  2342 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:16.191635  2342 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:16.193758  2429 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:20:16.195969 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:16.196154 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:16.196890 28750 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.197533  2342 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:16.205435 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.211275 28748 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:16.216460 28680 raft_consensus.cc:2410] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 19 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:20:16.216724 28747 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:20:16.176651 29320 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:16.222424 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.009s	sys 0.008s
W20260709 12:20:16.251611  2472 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:20:16.257311 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:16.268900 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:16.270792 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 867008us
I20260709 12:20:16.272010 28722 leader_election.cc:400] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
I20260709 12:20:16.275107  2380 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:16.275794  2380 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:16.277674  2309 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:16.278062  2380 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:16.278250  2309 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:16.270923  2346 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:16.272323 28722 leader_election.cc:403] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:16.285385 28682 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:20:16.289011 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.296037 28750 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:16.303508 29321 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:20:16.306797 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 140333us
I20260709 12:20:16.309913  2442 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:16.312064 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:16.312712 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54388.9us
I20260709 12:20:16.313413  2467 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16.
I20260709 12:20:16.314013  2433 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:16.319996 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:16.326174 29317 raft_consensus.cc:2368] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12.
I20260709 12:20:16.341439 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:16.355988 28681 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:16.362776 29317 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:16.268102  2463 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:16.385560 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 103847us
I20260709 12:20:16.416818 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:16.427188 29318 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:16.426472 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:16.430701 29321 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:16.279349  2309 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.426483  2463 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.436000 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:16.446450 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:16.454582  2296 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.455247  2296 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.457787  2296 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:16.430289  2442 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:20:16.460562 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:16.463452 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93401.4us
I20260709 12:20:16.464448  2468 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:16.465159  2468 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:16.467761  2468 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:16.468604  2108 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:20:16.448302 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 78528.3us
I20260709 12:20:16.375533  2300 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.472353 28677 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:16.472370  2346 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:16.473371 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:16.473800  2346 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:16.474408 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:16.476225  2406 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.008s
I20260709 12:20:16.476399 29318 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:16.484313 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:16.487190 28674 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:16.485868  2380 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:16.486586 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 174654us
I20260709 12:20:16.490483 29326 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:16.491211 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:16.468355  2468 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 12:20:16.498934  2151 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.728s	user 0.013s	sys 0.000s
I20260709 12:20:16.505874  2380 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.474794  2346 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.501281 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:16.500080 28573 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:16.512048 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:20:16.501190  2479 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:20:16.508991 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:16.488361  2442 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:20:16.496987  2397 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 12:20:16.559819 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58637.2us
W20260709 12:20:16.564337 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 65514.5us
W20260709 12:20:16.569290  2466 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.528s	user 0.000s	sys 0.012s
W20260709 12:20:16.582160 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77358.2us
I20260709 12:20:16.573479  2467 raft_consensus.cc:2764] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:20:16.572582  1773 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:16.587529  1773 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:16.590696  1773 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.580829  2466 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:16.615383 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.621076 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:16.639952 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:16.641300 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:16.643610 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 160578us
I20260709 12:20:16.643980 28674 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:16.622848  2464 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:16.622870  2280 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:16.658627 28754 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:20:16.670182  2482 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:20:16.670734 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 75272.1us
I20260709 12:20:16.671303 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:16.639900  2102 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:16.667469 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:16.688942 28673 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:16.657876  2397 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:16.692001  2108 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:16.683169  2300 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:16.700729  2131 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:16.705185  2131 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:16.705372 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:16.706243  2131 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:16.706732 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:20:16.708595  2477 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 12:20:16.708875 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:16.712002  2425 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:16.701000 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 114765us
W20260709 12:20:16.703353 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.694626  2421 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:16.685115  2464 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:16.702234  2481 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:20:16.715761  2421 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:16.718474 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 224314us
I20260709 12:20:16.699232  2108 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:16.699182  2397 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:16.721005 28674 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:16.719697 29321 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:16.712766  2425 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:16.714646  2380 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:16.722499  2421 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.717566  2463 raft_consensus.cc:2764] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 12:20:16.722595  2467 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:16.699126  2102 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.726336  2425 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.717502  2151 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:20:16.730350 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:16.748153 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:16.726752  2466 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:20:16.769716  2466 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.770592  2466 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:16.771013  2466 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:16.779327  2359 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:16.780045  2359 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:16.781255  2359 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.785219  2102 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:16.787212  2342 consensus_queue.cc:1059] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:16.788944 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.788378  2342 raft_consensus.cc:3055] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:20:16.792814  2484 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
W20260709 12:20:16.794382  2485 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:20:16.749783  2303 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:16.726859  2280 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.772079  2466 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:16.809146 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 82286.5us
I20260709 12:20:16.810357 28755 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:16.796903  2342 raft_consensus.cc:740] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:16.817253  2488 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:20:16.817955  2406 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:16.817581  2464 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.801331  2433 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:20:16.811319  2108 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:16.825450 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:16.796983  1773 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:16.834685 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 315454us
W20260709 12:20:16.814869 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47650.3us
W20260709 12:20:16.828315  2282 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.844s	user 0.015s	sys 0.000s
I20260709 12:20:16.852321 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:16.830299  2466 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:16.820849  2397 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:16.878381  2296 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:16.888370 28754 raft_consensus.cc:2410] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 12:20:16.890614 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 238238us
I20260709 12:20:16.882949  2406 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:16.899979 28679 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:16.900844 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:16.895706 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 80469.5us
W20260709 12:20:16.900405 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 135755us
W20260709 12:20:16.897549 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 177675us
I20260709 12:20:16.914922 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:16.907948 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:16.916664 28750 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:16.917570 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:16.918179 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:16.895818  2280 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:16.919641 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:16.895771  2296 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.941514 29317 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:16.929870 29318 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:16.931734 28748 raft_consensus.cc:1240] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 12:20:16.936972  2486 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:20:16.951619  2151 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:16.952162  2151 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:16.953121  2151 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:16.954417  2151 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:16.955415  2505 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:16.973673 28750 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:16.977303  2380 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.978009  2380 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:16.979699  2296 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:16.980020  2380 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:16.990406 28753 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:16.922000  2494 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:16.989693  2380 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.018080 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:16.959673  2342 consensus_queue.cc:260] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.023083  2513 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:17.023772  2513 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.025307  2503 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:17.025801  2503 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:17.026057  2513 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.026162  2503 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:17.030907  2494 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.034001  2494 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.033742  2425 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.040772  1773 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.040910  2342 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:17.015482  2406 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.020998  2303 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.041898  2493 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:17.042382  2465 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:20:17.044390 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.046528 28748 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:20:17.053103 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 145199us
I20260709 12:20:17.036834  2296 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.068806 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.069026  2397 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.060600  2494 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:17.081712 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.082305 28680 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:20:17.088923 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 170899us
I20260709 12:20:17.058243  2380 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.075111  2466 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.062238  2421 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.089105  2406 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:17.110509 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:17.067399  2503 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.079083  2131 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.079377  2296 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.102964  2153 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:17.067358  2303 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.136571 29321 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.141114 29325 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.141374 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:17.142572  2464 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:17.144881  2102 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:17.145334  2102 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:17.145720  2102 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:17.142753 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.150089  2380 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:17.157963 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.097182  2397 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.163051 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.163915 28750 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:17.165795 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:17.172060  2153 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.172828 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:17.174635  2153 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.175757 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:17.175940  2297 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:17.176887  2282 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:17.177008  2346 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:17.177544  2282 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.175709  2499 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.179633  2282 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.180274  2303 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.181603  2503 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:17.181761 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.182266  2513 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:17.182664  2300 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:17.159752  2131 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.113121  2494 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.185156 28748 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:17.166616  2309 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.001s	sys 0.005s
I20260709 12:20:17.179330  2499 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.182489 28751 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:17.174671 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:17.198000  2523 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:17.198120 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.198529  2523 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:17.198856 28747 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:17.199311  2296 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.199592  2523 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.200197 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:17.200675  2512 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:17.201258 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.201855 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:17.206318 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.206554 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.136576  2466 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.164785  2151 raft_consensus.cc:2764] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:20:17.200692 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.181632  2421 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:17.171339  2380 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:17.214453 28603 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:17.319397 28753 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
W20260709 12:20:17.207295  2309 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.002s	sys 0.006s
I20260709 12:20:17.177080  2297 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:20:17.214892 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 135057us
W20260709 12:20:17.284010 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.400363 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:17.287840 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.364777 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:17.322031 28602 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:17.364343 29317 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.423555 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:17.401113 29318 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:17.345865 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 170205us
I20260709 12:20:17.341831 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:17.297921 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 79813.4us
I20260709 12:20:17.215576 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1214) took 1077 ms. Trace:
I20260709 12:20:17.368796 29326 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:17.424870 29327 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:20:17.263936 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.402685 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.242355 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:17.310357  2516 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:17.241983  2523 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:17.295804  2513 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.365254  2300 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.229238  2296 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:17.366794  1859 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.208148  2359 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:17.311269  2425 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.366278  2397 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.310586  2478 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.275256 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.502650  2421 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.400363 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.275563 28751 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:17.533569 28680 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:17.297662  2512 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.552177 28677 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
W20260709 12:20:17.358577  2518 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:17.350131  2466 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:17.516760 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 116877us
W20260709 12:20:17.501147 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.560491 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.432376  2496 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:17.503785 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.485100 28755 rpcz_store.cc:276] 0709 12:20:16.132554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.132746 (+   192us) service_pool.cc:224] Handling call
0709 12:20:17.210031 (+1077285us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54003e8854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:17.210138 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093461248}
I20260709 12:20:17.544579 28747 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:20:17.478806  2521 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.337s	user 0.000s	sys 0.002s
I20260709 12:20:17.549654 29323 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:20:17.369194  2131 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.359428  2102 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.550063 28749 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
W20260709 12:20:17.503072  2514 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
W20260709 12:20:17.481669  2530 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:20:17.364868  2151 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.172s
I20260709 12:20:17.423530  2515 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:17.548614 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.555384 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.559154 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:17.467823  2297 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:17.564535 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.565586 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.567795 29327 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.242663  2346 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:17.569670 28682 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:17.357570  2494 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.566255 29323 pending_rounds.cc:85] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 13
I20260709 12:20:17.588611 29323 pending_rounds.cc:107] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:20:17.588971 29323 raft_consensus.cc:2889] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:17.502547  2390 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:20:17.564239 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.471654  2380 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.582686 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:17.595578 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.595849 28602 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:17.596764 29321 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:17.597052 28674 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:17.596880 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:17.585812 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.570977  2397 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.504101  2527 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 12:20:17.609926  2533 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:17.610028 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 64314.6us
I20260709 12:20:17.610297  2499 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:17.610914 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.612658  2296 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:17.613168  2296 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:17.614071  2296 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.568395  2513 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.617125  2534 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:17.558446  2478 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.617977  2397 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.619468  2478 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.612234 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:17.584326  2425 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.598032 28676 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:20:17.570905  2466 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.600523  2520 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.589576  2309 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:17.605831  2346 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.554276  2300 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.597741 28751 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:17.556787  1859 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.633286  2505 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:17.560278  2516 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.617625  2151 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:17.607487  2102 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.630333  2108 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:20:17.635906 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:17.637470  2527 consensus_queue.cc:1243] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:20:17.647346 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 60396.7us
I20260709 12:20:17.633857 28607 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:17.689162 28602 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:17.654485  2380 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.654156  2297 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.654860  1859 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.587345  2359 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:20:17.628819  2397 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:17.670554 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58426.2us
I20260709 12:20:17.599783  2496 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.663065 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.697279  2505 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:17.704111  2297 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:17.704259  2505 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.706689  2505 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:17.631273  2515 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.708750  2513 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.610570  2533 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.709892  2515 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.655040  2425 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.710839  2533 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.711930  2425 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.712596 28604 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:20:17.691179 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55359us
I20260709 12:20:17.622226  2494 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:20:17.595176  2421 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.664077 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.697245 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.719429 28602 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
W20260709 12:20:17.671824  2537 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:20:17.700162 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:17.700265 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 121101us
I20260709 12:20:17.669958  2151 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:17.662315  2512 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.721132  2151 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:17.644784  2466 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.722488 28606 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:17.634418  2209 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 12:20:17.732955 29319 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:17.655444  2309 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.743185  2494 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:17.744184  2516 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:17.744858 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44780.1us
I20260709 12:20:17.755234 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:17.745569  2512 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:17.746264  2531 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
I20260709 12:20:17.746832 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.754490 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:17.752990  2390 consensus_queue.cc:1243] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:20:17.755527  2494 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:17.651309  2520 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.731032  2397 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.769263 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.771082 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:17.774053 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 59631.4us
I20260709 12:20:17.776607  2511 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:17.772843 28606 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:17.784699 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.785338 28599 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:17.786243 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.767405  2542 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:17.786876  2542 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.786933 28599 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:17.787307  2542 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:17.787983 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.788604 28605 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:17.791527 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:17.791899 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.792634  1859 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:17.792718 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:17.781839  2421 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.794831 29321 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.795565  2153 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:17.795996  2153 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.778513 28571 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.798060 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:17.798277 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.788322 28599 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:17.796334  2153 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:17.764686  2512 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:17.824687  2512 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:17.821954  2466 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.769929  2513 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:17.833636 28607 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:17.769646  2346 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.834971 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.835371 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:17.838912 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.839744 28674 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:17.835975 29320 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:17.835919 28681 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:17.846058 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:17.847461 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69006.2us
I20260709 12:20:17.848187 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.846755 28679 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:17.824060  2520 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.848402 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:17.852468 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.852830 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.857169 28750 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:17.826495  2300 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:17.832782  2297 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.898903 28752 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:20:17.900722 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.901392 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.858701 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.856884  2505 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.889616 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.891068 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.891290  2499 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:17.893250 28749 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:17.911748 28756 raft_consensus.cc:2410] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:20:17.893908 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.895799 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:17.913337 28604 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.902273 28605 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:17.861526 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:17.843657  2108 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:17.905916 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.916342 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:17.838335  2463 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:17.914980 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62639.6us
I20260709 12:20:17.922138 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.924818 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:17.847945  2466 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:17.925761  2346 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.925907 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:17.926359  2436 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:17.926851  2436 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:17.927110 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:17.927675  2538 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:20:17.927834 28756 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
W20260709 12:20:17.928191  2546 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:20:17.926311  2346 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.928834 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.928952 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:17.929569 28756 raft_consensus.cc:2410] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:20:17.929666 29319 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:17.930393 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:17.930522  2346 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.933943  2153 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.935139 28753 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:17.927203  2436 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:17.937959  2526 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:17.921041  2529 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:20:17.944106 29318 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:17.868634  2390 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:17.911932  2515 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:17.944866 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:17.916726  2108 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.952591 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.917125  2520 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:17.951635 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.962713 28674 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:17.964051 28599 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:17.953469 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:17.955451 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:17.927253  2505 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:17.843954  2516 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:20:17.850214  2397 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:17.952461  2380 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:17.958103  2421 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:17.952610  2406 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:17.913154  2314 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:17.976022  2406 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:17.976146  2314 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:17.977100  2406 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.977260  2314 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.978410  2314 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:17.979012  2357 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:20:17.980109  2357 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:17.980458  2357 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:17.981341  2357 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.966090  2300 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:20:17.983656  2300 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:17.983992  2300 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:17.984686  2541 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:17.985178  2541 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.984908  2300 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.985563  2541 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:17.986208  2300 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:17.957768 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:17.954315 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:17.961175 28750 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:17.953821  2515 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:17.965570 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.990063 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:17.857095  2494 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:17.997442 28676 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:17.966089 28604 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:20:17.991089 28749 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:17.920883  2297 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:17.991693 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 140021us
I20260709 12:20:17.956053 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:17.993108 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.994088 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.963219  2108 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:18.003639 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:18.008240 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:17.948565  2463 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.010998 28750 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:18.012272 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:17.978339  2406 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:18.017076  2548 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:20:18.017537 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.018451  2496 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.019425 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.016975 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.030023 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:18.058430 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.021552 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:18.061271 28680 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:18.064806 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:18.066004  2505 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.066538  2505 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.067783 28603 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:20:18.068735 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:18.069348 28751 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:18.073860  2542 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.075986  2542 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.076717 28606 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:18.001269  2296 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:18.077471  2296 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:18.078316 28602 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:18.078409  2296 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.079402 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:18.013085  2478 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:17.948956  2466 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:20:18.080474 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:18.080615 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:18.080991 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:18.081733 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:18.082103  2466 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:18.083261  2397 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.083551  2297 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.084193 28749 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:18.088825 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:18.089409  2505 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.089604 28604 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:18.089928  2153 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:18.091178 28754 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:18.092641  2463 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.001873  2515 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:18.093221 28755 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.997313  2421 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:18.097332  2421 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.102634  2303 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:18.103677  2303 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.104020  2303 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.105154 29320 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:18.107723 28600 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:18.108683  2122 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:18.109102  2122 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.080469  2478 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:18.058318 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:18.109457  2122 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:18.081899 28599 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:20:18.115984 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.116496 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.114370 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.121234 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:18.121940 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.114749 28599 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:18.123847 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 170453us
W20260709 12:20:18.124786 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.127110 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:18.127915 28680 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:20:18.119669  2309 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.015223  2520 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:18.124462 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.133741 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:18.131978 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.111240  2380 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:18.136101 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.141467 28752 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:18.139343 28604 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:18.103224  2357 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.138224 29327 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:18.152544 28681 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:20:18.152917 28681 pending_rounds.cc:85] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 9
I20260709 12:20:18.153141 28681 pending_rounds.cc:107] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:20:18.153381 28681 raft_consensus.cc:2889] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:18.155058 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.170516 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:18.171212 28754 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:18.172714 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:18.173362 28749 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:18.173550  2512 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.175661  2512 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:18.176491 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51969.6us
I20260709 12:20:18.176868  2342 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:18.177389  2102 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:18.177848 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.178328  2342 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:18.178869 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:18.178994  2102 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:18.179329  2342 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:18.184252 28679 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:18.184609  2380 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.185177 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:18.185736 28676 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:18.186910  2380 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.188066  2534 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:18.188457  2534 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:18.188710 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.189431  2405 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.189720  2468 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:18.189950  2405 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.143345  2533 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.191185  2533 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.192135  2405 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.192459  2493 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:20:18.023207  2359 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.128s
I20260709 12:20:18.151080  2397 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:18.197923  2303 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.137931  2520 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.199167  2151 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.199931 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.189285 28673 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:18.190330  2468 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.129595  2346 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.180100 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.248490 28754 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
W20260709 12:20:18.249303 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 117396us
W20260709 12:20:18.249737 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.281155 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.250530 29319 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:18.282250 28604 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:18.215283 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:18.195878  2515 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:18.273603 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 76033.3us
I20260709 12:20:18.204417  2533 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:18.284458 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 69249us
I20260709 12:20:18.273834 28680 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:18.289945 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:18.281075 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.272503 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:18.288861 28753 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
W20260709 12:20:18.283663 28572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.778s (SENT) [suppressed 18 similar messages]
I20260709 12:20:18.269263  2380 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:18.269001  2520 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:18.293164 28600 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:18.280560  2468 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:18.319357 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.321110 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:18.320197 29319 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:18.323808 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.290917  2309 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:18.287140 28599 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.291587  2505 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:18.299873  2397 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:18.300185  2297 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.345724 29319 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:18.341943 28676 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
W20260709 12:20:18.362550 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 182767us
I20260709 12:20:18.323153  2542 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:18.365809 28599 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:18.289744  2346 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:18.371711 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 97237.9us
I20260709 12:20:18.331614  2309 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:18.379652 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52455.9us
I20260709 12:20:18.334343  2505 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:18.382171 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:18.448755 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.497594 28682 raft_consensus.cc:2410] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 12:20:18.497740 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 206215us
I20260709 12:20:18.537328 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:18.383153  2523 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.001s
I20260709 12:20:18.366940  2397 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:18.564531 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.383641  2309 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:18.593405 28605 raft_consensus.cc:2410] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:20:18.594245 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 310600us
I20260709 12:20:18.385984  2505 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:18.573622 29319 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:18.369375  2297 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.535863  2466 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:18.378281  2436 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.663492 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:18.662523 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 283464us
W20260709 12:20:18.665058 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45547.7us
W20260709 12:20:18.671089 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.675770 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.678947 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.679157 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:18.681687 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.683030 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:18.674515 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:18.685016 28675 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:18.678412 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:18.687975 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.689220 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:18.692943 28673 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:18.658406  1859 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:20:18.710876 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:18.711911 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:18.711108 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:18.714684 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:18.716326 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:18.687476  2421 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:18.687814  2425 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:18.742044 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.747939  2380 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:18.748451  2562 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:18.709383  2151 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:18.713719  2526 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:18.717250  2550 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
W20260709 12:20:18.752516 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 572422us
I20260709 12:20:18.709067  2553 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:18.690742  2359 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:20:18.758456 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:18.761904 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 379759us
I20260709 12:20:18.696303  2342 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:20:18.743599  2421 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.762971 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.768563 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.750597  2303 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.750299  2515 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.753784  2405 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.757128  2425 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:18.770076  2297 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.749739  2397 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.710860  2512 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:20:18.750401  2559 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:18.749411  2562 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:18.778110 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.794309 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 96022.9us
I20260709 12:20:18.762773  2553 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:18.802103 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:18.784545  2421 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:18.765272  2380 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:20:18.788267  2151 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:18.813397 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:18.189282  2534 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.814208 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:18.818743 29319 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:18.799723  2517 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:20:18.797526  2559 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:18.796972  2405 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.824185 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:18.807039  2553 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:18.826638 29325 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:18.797222  2542 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:18.799572  2562 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:18.825583 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.815467  2346 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.831538 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.810302  2570 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:18.790877  2526 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:18.815843  2544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.018s	sys 0.017s
W20260709 12:20:18.836258 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 93121.1us
I20260709 12:20:18.807926  2511 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
W20260709 12:20:18.829023  2108 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.770s	user 0.004s	sys 0.006s
W20260709 12:20:18.839352 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 120436us
I20260709 12:20:18.828758  2463 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.849509 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:18.840745  2544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.019s	sys 0.017s
I20260709 12:20:18.830667  2559 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:18.821195  2314 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
I20260709 12:20:18.836573  2296 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:18.840543  2570 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.856809 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.857741 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:18.857131 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 182695us
I20260709 12:20:18.831305  2297 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:20:18.850287  2436 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.870186 29317 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 12: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:18.869635 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.873812 28572 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:18.878472 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.860394  2467 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.860239  1859 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.880280 29325 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:18.880581 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:18.849987  2108 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.862989  2570 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:18.855051  2463 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.872788  2296 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:18.899529 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.903564  2505 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.905827  2108 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.907613  2421 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.883545  2467 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.910430  2467 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:18.910864 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:18.911428 28682 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:18.911482  2406 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.798s	user 0.009s	sys 0.001s
I20260709 12:20:18.912465  2576 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:18.913820  2539 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:18.914242  2539 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.914567  2539 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:18.915361  2579 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.897333 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.878157 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:18.917434 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:18.919927 28682 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:18.922293 29317 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:18.923619 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:18.924036 28752 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:18.924474 29325 raft_consensus.cc:2410] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:20:18.927096 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.928794 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:18.931085 28678 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:18.871454  2572 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 12:20:18.930450 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 81275.4us
W20260709 12:20:18.935390  2566 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:18.935621  2405 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.883869  1859 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.935940 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:18.927910  2576 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:18.939244  2122 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.806s	user 0.008s	sys 0.002s
I20260709 12:20:18.972869  2122 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.973956  2463 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:18.974184  2468 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.643s	user 0.003s	sys 0.006s
I20260709 12:20:18.974618  2468 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.975006  2122 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:18.975694 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.873225  2425 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:18.977450  2574 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 12:20:18.978754  2300 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.992s	user 0.010s	sys 0.002s
W20260709 12:20:18.979110  2567 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 12:20:18.980147  2580 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:20:18.980692  1859 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:18.942036 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:18.944025 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71884.5us
I20260709 12:20:18.946254 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:18.986207  2565 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.986754  2565 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.986682  2296 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:18.987196 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:18.988085  2572 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:18.988482  2572 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:18.988832  2572 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:18.989617  2541 consensus_meta.cc:287] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.004s	user 0.010s	sys 0.000s
I20260709 12:20:18.955936 29319 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:18.961135  2421 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.992373 29326 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:20:18.961465 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 91590.9us
W20260709 12:20:18.963776 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 426466us
I20260709 12:20:18.968361 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:18.970335 28678 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:18.937500  2309 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.941466  2505 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:18.911986  2559 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.010960 28752 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:18.999053 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.004227 28750 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 12:20:19.017962 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71804.1us
I20260709 12:20:19.019029 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:19.033245 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.034190 29325 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.036368 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:19.037283 28755 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:19.038829 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:19.039690 28754 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:19.044955 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.046025 29317 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:18.943188  2570 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:19.047494 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53760.6us
I20260709 12:20:19.035101 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:18.993786  2303 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.990046  2541 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:18.924609  2579 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:19.056228 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 56275.8us
I20260709 12:20:19.073729 28749 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:19.004184  2576 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:19.077909 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:19.009689  2511 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:19.069072 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.085158 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:19.067276 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:19.057042  2584 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:19.092414 28753 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:19.064126  2468 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:19.079282  2300 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:19.113812  2587 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:20:19.087172  2122 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:19.116262  2575 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:19.117878  2309 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:19.124212 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 113826us
I20260709 12:20:19.150631 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.132748 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.160938 29317 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:19.091382  2421 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:19.073570  2303 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.131251  2300 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:19.121575  2526 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:19.182327 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 133825us
W20260709 12:20:19.181440 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 65961.5us
I20260709 12:20:19.097061  2511 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.133844  2575 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:19.130529  2464 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:19.181529 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.155660  2122 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:19.160210  2505 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:20:19.182276  2300 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.169077  2421 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:19.158833  1859 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:20:19.136957 28747 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:20:19.201797 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 43579.2us
I20260709 12:20:19.202816 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:19.205289 28675 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:19.171408  2563 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:20:19.195284  2565 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:19.104594  2584 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.195601  2468 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:19.217705 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:19.224112 28673 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:19.232508 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:19.214008 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44544.6us
I20260709 12:20:19.234760  2296 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:19.236992  2589 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:20:19.204645  2421 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.241312 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.242697 28747 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:19.245064  2570 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.244899  2575 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.246030  2575 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.246215  2303 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.215694  2564 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 12:20:19.215497  2464 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.250327  2464 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:19.250542  2357 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.013s	user 0.006s	sys 0.005s
I20260709 12:20:19.251621  2494 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:19.251752  2122 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:19.231417  2600 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:19.252660  2600 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:19.253644  2600 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:19.254973 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.255580 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:19.256281  2542 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:19.252271 29325 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:19.216526  2584 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:19.260493 29317 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:19.263738  2604 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.264000 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:19.264302  2604 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.264863 28673 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:19.266031  2549 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 1.075s	user 0.003s	sys 0.004s
I20260709 12:20:19.266530  2604 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.268258  2516 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:19.268692  2516 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:19.214421  2309 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:20:19.274961 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.273168 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:19.276935 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:19.277456 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:19.271418  2541 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:19.282058 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.282675 29325 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:19.283334  2604 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:19.284114  2600 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.284915  2565 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:19.285144 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:19.285820 28751 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:19.285964  2579 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.286762 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.286970 28573 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:19.287930 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.288793 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:19.233496  2468 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.285300  2565 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:19.290634  2565 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.291363  2468 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.291841  2565 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.211795  2576 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:19.296204  2559 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:19.297065  2588 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:20:19.298374  2556 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:19.300537 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.301088 28749 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:19.303858 28675 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:19.304841 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:19.306425 28751 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:19.291438  2562 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.308290 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.308463 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:19.270573  2523 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:19.310818 28747 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:19.318382  2523 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:19.320262 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.320806  2523 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.320914 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2770) took 1641 ms. Trace:
I20260709 12:20:19.321348 28598 rpcz_store.cc:276] 0709 12:20:17.665114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.666286 (+  1172us) service_pool.cc:224] Handling call
0709 12:20:17.666709 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:17.667118 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:17.667160 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:17.667731 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 12:20:17.970877 (+303146us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:18.006940 (+ 36063us) log.cc:844] Serialized 14 byte log entry
0709 12:20:18.092540 (+ 85600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:18.092615 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.265209 (+1172594us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:19.270864 (+  5655us) raft_consensus.cc:1685] finished
0709 12:20:19.305972 (+ 35108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.306118 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85354,"prepare.queue_time_us":35829,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":89342,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":210,"spinlock_wait_cycles":34462720,"thread_start_us":302705,"threads_started":1,"wal-append.queue_time_us":467930}
I20260709 12:20:19.330703 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3044) took 1409 ms. Trace:
I20260709 12:20:19.331143 28605 rpcz_store.cc:276] 0709 12:20:17.921274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.921542 (+   268us) service_pool.cc:224] Handling call
0709 12:20:19.330471 (+1408929us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54000bf254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:19.330613 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323840384}
I20260709 12:20:19.332000  2562 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.341078 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:19.331818  2572 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.319249  2587 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:19.349669 28749 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:19.350477  2539 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.352548  2604 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:19.311247  2309 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:19.405579  2309 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:19.406018  2309 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.353493  2600 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:19.409659  2600 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.411851  2600 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:19.354875  2556 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:19.412977  2556 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:19.359025  2568 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.610s	user 0.000s	sys 0.002s
I20260709 12:20:19.360558  2534 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:19.362568 28753 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:19.422259 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:19.423650 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:19.364017 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 55644.7us
I20260709 12:20:19.376216 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:19.424427 28676 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:19.378541 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.310070  2542 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:19.359498  2523 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.400545  2579 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:19.403614  2539 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.404583  2604 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.427171 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.424665 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:19.348337  2553 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.501s	user 0.000s	sys 0.010s
I20260709 12:20:19.428102 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:19.430594 29327 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:19.431268 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:19.431744 28751 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
W20260709 12:20:19.389870  2520 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.055s	user 0.011s	sys 0.000s
I20260709 12:20:19.393078  2559 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:19.391872  2606 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.441489 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:19.447400 28676 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
W20260709 12:20:19.448513 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.451375  2603 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:19.452019  2572 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:19.452732  2572 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:19.453204  2572 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:19.454129  2572 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.457343  2523 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.443171  2526 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:19.458580  2526 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:19.459565  2526 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:19.443405  2520 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.461789  2591 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:19.462327  2591 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:19.462738  2520 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.463227  2591 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.441238  2576 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:19.464756 28604 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:19.469205 28750 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:19.469136 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.469965 28753 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:19.473588 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 132582us
I20260709 12:20:19.473773 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1606) took 1369 ms. Trace:
I20260709 12:20:19.474472 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:19.478340 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:19.480674 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:19.474493 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 111352us
I20260709 12:20:19.442435  2559 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:19.484416 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 53215us
I20260709 12:20:19.474241 29323 rpcz_store.cc:276] 0709 12:20:18.104348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.105984 (+  1636us) service_pool.cc:224] Handling call
0709 12:20:18.106288 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.106700 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:18.330228 (+223528us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.002483 (+672255us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.053868 (+ 51385us) log.cc:844] Serialized 26 byte log entry
0709 12:20:19.054018 (+   150us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:19.054050 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.054116 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:19.358312 (+304196us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:19.464502 (+106190us) raft_consensus.cc:1685] finished
0709 12:20:19.473565 (+  9063us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:19.473710 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":275149,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":42501,"raft.queue_time_us":80533,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"spinlock_wait_cycles":17683840,"thread_start_us":844152,"threads_started":3,"wal-append.queue_time_us":383319}
I20260709 12:20:19.495193 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:19.499291 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.441447  2553 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.574368  2542 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:19.576030  2553 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.415475  2587 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.507397 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:19.579998 28682 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:19.580217 28599 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:20:19.604673 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:19.605398 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.606079 28600 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:19.608595  2560 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:19.605425 28601 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:19.610699 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.477543  2539 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:19.490923  2523 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.490667  2559 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:19.613047 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 105732us
I20260709 12:20:19.621407 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:19.497493  2520 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.449321  2606 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.582034  2405 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:19.590929  2515 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.634011 29325 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:19.578560  2300 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.590121  2464 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:19.649293 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:19.628743  2122 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:19.630779  2499 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:19.663607 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:19.663719 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.660868 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.665395 28747 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:20:19.625800  2309 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.664469 28605 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:19.673048 28749 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:19.677464 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:19.678071 28600 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:19.678689 29325 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:20:19.667737 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 182400us
I20260709 12:20:19.681038 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:19.682509 28750 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:19.683358 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.681500 28598 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:19.663391  2122 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.684952  2122 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:19.685045 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:19.685406  2612 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:20:19.687992 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:19.656622  2515 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.692067 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:19.706825 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.708040 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.708823 28750 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:19.710223 29322 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:19.710283 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:19.710973 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.718858 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:19.723053 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:19.730947 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.731704 28747 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:19.732846 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.655586  2405 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.688268  2314 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:19.679307  2499 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:19.736779 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 132774us
I20260709 12:20:19.728730  2468 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:19.747416 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.717397  2553 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:19.688607  2209 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 12:20:19.733320  2512 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:19.759742 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.760630 28602 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:19.761464 28750 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:19.761843 28747 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:19.763917 29317 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:19.762390 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:19.765252 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:19.724826  2342 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 12:20:19.766099 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.767767  2610 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:20:19.752744  2300 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:19.776731 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.782639 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.758857  1859 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:19.763631  2611 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:20:19.736703  2421 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.815747 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.771347  2581 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:19.806777 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:19.800287 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:19.810557  2606 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.772243  2576 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.810979  2587 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:19.814417  2584 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.000s
I20260709 12:20:19.819860 28682 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:19.816388 29322 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:19.829596  1859 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.836798 28602 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:20:19.837325 29323 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:19.841674 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:19.845494 28602 pending_rounds.cc:85] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 10
I20260709 12:20:19.845376 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:19.845873 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 119496us
I20260709 12:20:19.845913 28602 pending_rounds.cc:107] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:20:19.846617 28602 raft_consensus.cc:2889] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:19.846951 28602 pending_rounds.cc:107] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:20:19.847179 28602 raft_consensus.cc:2889] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:19.849126 29320 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:19.801935  2616 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:19.856731  2616 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.858219 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.859020  2616 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:19.859351 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.860008 29322 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:19.844529  2576 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.850136  2584 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:19.848016  2606 raft_consensus.cc:2764] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:20:19.863762  2421 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:19.817188  2623 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:19.848042 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:19.864902 28601 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:19.849658  2467 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:20:19.865850 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:19.866698 28601 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:19.866933  2554 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 1.114s	user 0.000s	sys 0.002s
I20260709 12:20:19.865770  2584 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:19.867477 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:19.868076 28601 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:19.869787 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.870131 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.869977  2122 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:19.871183 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:19.872998  2619 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:20:19.826526  2539 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.874725 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.870924 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:19.878667 28600 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:19.688509 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:19.880635 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:19.838737  2300 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:19.892131 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.894173 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.894937 29320 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.906705 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.909034 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:19.909302 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.910101 28600 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:19.911111 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.915438 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:19.920069  1859 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.872059  2122 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:19.922428 28602 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:19.924947 28601 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:19.929040 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:19.936107 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:19.915501  2615 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:19.926268  2560 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:19.915692  2623 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:19.940145 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:19.926280  2463 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.895720  2539 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:19.938867  2534 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
I20260709 12:20:19.936705  2466 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:19.950309 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:19.934458  2309 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.947583  2463 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.946314  2623 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.968245  2463 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.971215  2615 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:19.890657  2499 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:19.971805  2615 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:19.975291  2625 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:20:19.953126 28600 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:19.956735 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:19.958179  2405 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:19.942250  2314 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:19.937973  2512 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:20:19.983029  2615 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:20.037010 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.020155  2314 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:20.038031  2314 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:19.951809  2466 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.041994  2466 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:20.077689 28600 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
W20260709 12:20:20.094894 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 152349us
I20260709 12:20:20.096793 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:20.103960 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.104048 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:20.105238 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:20.100659 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 118341us
I20260709 12:20:20.100603  2623 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:20.126082 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.127256 28600 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.115899  2534 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.133396  2534 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.135073 28600 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:20.135408  2534 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:20.136011  2534 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.136238 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.136961 28600 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:20.137540  2209 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.138193  2209 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.139293  2539 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:20.139293  2516 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.140365 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1339) took 1302 ms. Trace:
I20260709 12:20:20.140789 29326 rpcz_store.cc:276] 0709 12:20:18.838318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.895168 (+ 56850us) service_pool.cc:224] Handling call
0709 12:20:18.991938 (+ 96770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:18.992750 (+   812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.140167 (+1147417us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b54002f58d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:20.140308 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185366784}
I20260709 12:20:20.116230  2405 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:20:20.116412  2581 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:20.149998  2581 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:20.150213  2516 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.150400  2581 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:20.120777  2576 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.162643  2397 raft_consensus.cc:1064] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
W20260709 12:20:20.163059 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5b3b2f4041a24b05983f30878f16db9d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:20.164911 29326 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:20.160029  2591 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:20.171986 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.126577  2559 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.192595 28600 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:20.196131 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.156605  2534 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.201908 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.202919 28600 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:20.176733  2209 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:20.216326 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.207983 28648 leader_election.cc:400] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
W20260709 12:20:20.207679  2523 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 12:20:20.221163 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:20.222455 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.223272 28600 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:20.217468  2397 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.232548  2512 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:20.233718  2512 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:20.234473  2512 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:20.234809  2512 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:20.237099  2628 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:20:20.239427  2559 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.243618  2314 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.244546  2209 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:20.245944  2209 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:20.246351  2209 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:20.247236  2209 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:20.254822 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.268148 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.268981 28606 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:20.270011  2641 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:20.271293 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.273720  2314 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:20.188597  2591 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.213896  2632 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:20.256090  2582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.016s	sys 0.009s
I20260709 12:20:20.248301  2534 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:20.276863  2589 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:20:20.277341  2520 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.643s	user 0.004s	sys 0.008s
I20260709 12:20:20.298787  2520 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:20.277024 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:20.300467 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:20.301469  2640 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:20.302183  2640 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:20.303390  2640 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.304684  2314 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:20.305401  2314 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:20.306648  2511 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:20.306542  2314 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.312500  2581 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.312866 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:20.314718  2581 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.235726  2512 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.283483 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.316906 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.317657 28606 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:20.318776 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.319494 28606 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 11.
I20260709 12:20:20.322095 28753 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:20:20.323300 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.324113 29321 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:20.324510 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 1332) took 1512 ms. Trace:
I20260709 12:20:20.324795 29321 rpcz_store.cc:276] 0709 12:20:18.811967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.293529 (+1481562us) service_pool.cc:224] Handling call
0709 12:20:20.324425 (+ 30896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:20.324527 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 3099) took 1399 ms. Trace:
I20260709 12:20:20.325588 28752 rpcz_store.cc:276] 0709 12:20:18.925160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.925312 (+   152us) service_pool.cc:224] Handling call
0709 12:20:20.324338 (+1399026us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b5400337a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:20.324471 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6279040}
I20260709 12:20:20.327574  2591 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:20.327788 29320 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:20.328577  2466 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.330129 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.330839 28606 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:20.331739 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.293820 28600 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:20.275458  2523 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:20.279276  2209 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:20.334342 28599 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
W20260709 12:20:20.279976  2582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.016s	sys 0.010s
I20260709 12:20:20.332341 28606 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:20.334882 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:20.336612 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.345927 28606 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:20.348119 28606 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:20.355580  2515 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.281876  2632 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:20.365978 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.366286  2631 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.411s	user 0.004s	sys 0.000s
I20260709 12:20:20.369414  2553 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:20.366127  2632 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:20.369493 28647 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:20.371551  2641 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:20.374706 28647 leader_election.cc:400] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:20.375123 28647 leader_election.cc:403] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:20.378058  2581 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14.
I20260709 12:20:20.383574 28603 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:20.387509 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.389008  2573 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:20.389449  2573 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:20.390352  2573 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.391167 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.391604  2573 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.392536 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:20.394217 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.396028 28675 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:20.397545 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.398665 28675 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:20:20.399999 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.405277 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.397668 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 1739) took 1089 ms. Trace:
I20260709 12:20:20.408772 29325 rpcz_store.cc:276] 0709 12:20:19.308150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.308302 (+   152us) service_pool.cc:224] Handling call
0709 12:20:20.397471 (+1089169us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540055ebd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:20.397597 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719718784}
I20260709 12:20:20.429276 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.429997 28680 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:20.430112 28600 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:20:20.430442 28600 pending_rounds.cc:85] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 9
I20260709 12:20:20.430640 28600 pending_rounds.cc:107] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:20:20.438000 28673 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:20:20.441774 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:20.443704 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.444552 29320 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 12.
I20260709 12:20:20.445492 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:20.446210 28676 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:20.447408 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.447541 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:20.447453 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.448755 29320 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:20:20.452275 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.452728 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.453231 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:20.460629 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.463881 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:20.464671 28680 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.464735 28676 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:20.464924 29326 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:20.463862  2516 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:20.467556  2516 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:20.467952  2516 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:20.469400  2466 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.471534 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.472033 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:20.473168 28681 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:20.463815 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.478432 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.481226 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:20.481865  2523 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:20.482775 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:20.482568  2523 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.483458 28673 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.480026 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:20.490149 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:20.486204 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:20.489290 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47600.7us
I20260709 12:20:20.495092 28680 raft_consensus.cc:2410] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 12:20:20.501572 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 168327us
I20260709 12:20:20.501780 28676 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:20:20.502317 28676 pending_rounds.cc:85] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 8
I20260709 12:20:20.502616 28676 pending_rounds.cc:107] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:20:20.502887 28676 raft_consensus.cc:2889] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:20.509416 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.512202 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:20.493234  2122 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:20.483929  2516 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:20.514220 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.512744 28681 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:20.516093 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:20.492677  2515 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:20.492977  2493 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:20.430905 28600 raft_consensus.cc:2889] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:20.548489 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:20.519629 28606 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:20.523597 28571 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:20.521668  2282 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.526721  2573 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:20:20.531049 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69643us
I20260709 12:20:20.513372  2314 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:20.535117 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:20.511828  2526 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:20:20.495271  2466 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:20:20.559293  2466 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:20.559677  2466 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:20.560624  2466 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.561726 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:20.562132  2466 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:20.562304 29322 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:20.543251  2523 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.564795 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:20.565498 29325 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:20.556841  2573 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:20:20.566047  2613 log.cc:927] Time spent T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.936s	user 0.002s	sys 0.001s
I20260709 12:20:20.566308  2573 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:20.567221  2573 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.569980 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.570751  2526 consensus_queue.cc:1243] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:20.571338  2526 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:20.542753  2575 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.572206  2575 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.574540  2575 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:20.542424  2591 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:20:20.576272 29322 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:20.553932 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:20.551774 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.577819 29320 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:20.535884  2587 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.550510  2309 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:20.556844 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.582204 29326 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:20.557329  2314 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.554435  2282 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.561133 29321 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:20.543912 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.524932  2515 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:20.597752 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.565375 29327 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:20.598798 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3089) took 1272 ms. Trace:
I20260709 12:20:20.602066 28674 rpcz_store.cc:276] 0709 12:20:19.309280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.309388 (+   108us) service_pool.cc:224] Handling call
0709 12:20:19.309681 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.316964 (+  7283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.316996 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.318857 (+  1861us) log.cc:844] Serialized 26 byte log entry
0709 12:20:19.397513 (+ 78656us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:19.397561 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.397640 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:20.565419 (+1167779us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:20.577089 (+ 11670us) raft_consensus.cc:1685] finished
0709 12:20:20.577111 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:20.582020 (+  4909us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1451,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3368,"spinlock_wait_cycles":31370496,"thread_start_us":51252,"threads_started":1,"wal-append.queue_time_us":119477}
I20260709 12:20:20.624325 28673 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:20.620889 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:20.579650 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44650.4us
I20260709 12:20:20.630524 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:20.633195 28750 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:20.606913 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.581416  2573 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:20.636046 28606 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:20.641861 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 125851us
I20260709 12:20:20.642817 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:20.643422 28647 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:20.647384 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.648906 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.583877  2582 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:20.649680 28600 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:20.582638  2296 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:20.651686 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:20.659902 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:20.662338 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:20.663331 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.664929 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:20.659237 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.601511  2515 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:20.668042 28756 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:20.670378 28752 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:20.644009  2405 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:20.675275 28606 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:20.651319  2342 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:20.653105  2582 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.658759  2523 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:20.584076  2587 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.701711 29327 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:20.679353 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.626490  2575 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 12:20:20.683233 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.689394 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1618) took 1007 ms. Trace:
I20260709 12:20:20.707281 29323 rpcz_store.cc:276] 0709 12:20:19.681687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.682263 (+   576us) service_pool.cc:224] Handling call
0709 12:20:19.682571 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.845591 (+163020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.689143 (+843552us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54006c1bd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:20.689332 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355467520}
I20260709 12:20:20.672812  2405 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.693863 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2652) took 1767 ms. Trace:
I20260709 12:20:20.672866  2544 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:20.663740  2296 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:20.724684  2296 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:20.725383  2644 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 12:20:20.711938  2405 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.730015  2314 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.703444 28600 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:20.731886  2587 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:20.732467 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.733757 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.735594 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1093) took 2047 ms. Trace:
I20260709 12:20:20.735962 28604 rpcz_store.cc:276] 0709 12:20:18.688202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.688321 (+   119us) service_pool.cc:224] Handling call
0709 12:20:18.711592 (+ 23271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.476262 (+764670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.735359 (+1259097us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54003d2054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:20.735535 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731570560}
I20260709 12:20:20.701431  2582 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:20.735999  2357 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:20.737533 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.737671  2357 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.709129 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.738796 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1239) took 1466 ms. Trace:
I20260709 12:20:20.739149 28749 rpcz_store.cc:276] 0709 12:20:19.271918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.400357 (+128439us) service_pool.cc:224] Handling call
0709 12:20:19.400735 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:19.673592 (+272857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.738583 (+1064991us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400306954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:20.738740 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625686272}
I20260709 12:20:20.740151 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:20.740991 28602 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:20.741816  2516 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.742862 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:20.743304  2584 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:20.743707  2584 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:20.695221 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.744498  2584 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.745270  2122 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:20.710742 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.745865  2122 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.746447  2512 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:20.748070  2122 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:20.704056 28677 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:20:20.713981 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 68764.8us
I20260709 12:20:20.749142 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:20.749440 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:20.749665 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:20.622365  2478 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.750214 28756 raft_consensus.cc:2368] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17.
I20260709 12:20:20.750790  2478 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:20.718717  2282 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:20.752640  2463 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:20.753176 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2798) took 1043 ms. Trace:
I20260709 12:20:20.753536 28599 rpcz_store.cc:276] 0709 12:20:19.709764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.709910 (+   146us) service_pool.cc:224] Handling call
0709 12:20:20.753024 (+1043114us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b5400216454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:20.753122 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381674240}
I20260709 12:20:20.754982  2357 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:20.738075 28604 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:20.752650 28603 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:20.709173 28682 rpcz_store.cc:276] 0709 12:20:18.926167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.928564 (+  2397us) service_pool.cc:224] Handling call
0709 12:20:20.693682 (+1765118us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400251f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:20.693800 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496301312}
I20260709 12:20:20.758301 28603 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:20:20.759763 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:20.756875 28601 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:20.760592 28752 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:20.763898 28604 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:20.764544 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:20.765935 28604 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:20.766834 28674 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:20:20.766672 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 116200us
I20260709 12:20:20.767130 28601 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:20:20.768293 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:20.774185 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:20.775313 28673 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:20:20.778731 28673 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:20.779981 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:20.780571 28673 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:20.783915 28606 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 12: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:20.789502 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:20.849417 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.888082 28682 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:20.785025  2102 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:20.785758  2656 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:20.924224 28756 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:20:20.925622 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:20.926651 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 241823us
I20260709 12:20:20.884922  2539 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:20.937384 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 91517.1us
I20260709 12:20:20.905354  2357 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:20.940618 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 186463us
I20260709 12:20:20.953711 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:20.847846  2640 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
W20260709 12:20:20.953132 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 191228us
I20260709 12:20:20.964094 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:20.967563 28756 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:20:20.969178 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 195051us
I20260709 12:20:20.970939 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:20.952075 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:20.924877  2663 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:20.924153  2122 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:20.929462  2499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.008s	sys 0.007s
W20260709 12:20:20.990922 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.943624  2603 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:20.989666  2499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.008s	sys 0.007s
I20260709 12:20:20.966488  2505 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:20:20.993641  2517 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:20.995730  2655 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.276s	user 0.000s	sys 0.002s
I20260709 12:20:20.996620  2520 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:21.030366 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.998577 28678 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:20.959851  2357 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:20.950820  2587 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.076s
I20260709 12:20:20.968897  2511 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:21.006448 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:21.012364  2661 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.287s	user 0.002s	sys 0.007s
I20260709 12:20:21.029197 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:20.983496  2615 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:20.997994  2671 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:20:21.067631  2632 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:21.068215  2632 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:21.071864 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:21.072484 28601 raft_consensus.cc:2376] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19. Re-sending same reply.
I20260709 12:20:21.091094  2584 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:21.092693  2282 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:21.093262  2282 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.093719  2282 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.093585  2582 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.095089 28676 raft_consensus.cc:2368] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:20:21.096256  2615 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.096848  2615 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.978163  2616 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:20:21.038547 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.983193  2593 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:21.006145  2658 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:20:21.051062 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:21.118090 28606 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:20.971860  2591 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:20:21.062925 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:21.063396 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57067.9us
I20260709 12:20:21.069308  2632 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:20.986524  2122 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:21.067067 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1720) took 3041 ms. Trace:
I20260709 12:20:21.126303 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:21.121325 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.063804 28598 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:21.130225 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.026933  2151 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
W20260709 12:20:21.132814 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 153752us
I20260709 12:20:21.141274 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:21.102432  2562 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:21.028228  2603 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:21.134670 28679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.017s	sys 0.035s
W20260709 12:20:21.147522 28679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.018s	sys 0.035s
I20260709 12:20:21.162621 28750 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:21.141085 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 175234us
I20260709 12:20:21.126654 29318 rpcz_store.cc:276] 0709 12:20:18.025925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.026067 (+   142us) service_pool.cc:224] Handling call
0709 12:20:18.059779 (+ 33712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:18.122203 (+ 62424us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:20:18.756042 (+633839us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b1800279fa0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a925e5 00007f6fe3a92568
0709 12:20:18.992979 (+236937us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.199320 (+206341us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.622769 (+1423449us) spinlock_profiling.cc:243] Waited 906 us on lock 0x7b2c000eb598. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:20.623208 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:20:20.767470 (+144262us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:20.782822 (+ 15352us) log.cc:844] Serialized 14 byte log entry
0709 12:20:20.783033 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:20.783114 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.011745 (+228631us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:21.066833 (+ 55088us) raft_consensus.cc:1685] finished
0709 12:20:21.066855 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.066979 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50814,"prepare.queue_time_us":283263,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":5974,"raft.queue_time_us":81109,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":183348,"spinlock_wait_cycles":77124864,"thread_start_us":515425,"threads_started":3,"wal-append.queue_time_us":298960,"wal-append.run_cpu_time_us":1198,"wal-append.run_wall_time_us":1048791}
I20260709 12:20:21.168526 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:21.173297 28748 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:21.175024 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:21.175465 28749 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:21.175825 28756 raft_consensus.cc:2368] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:21.027310  2663 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:21.132228  2342 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:21.179441 28571 leader_election.cc:400] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:20:21.181177 28571 leader_election.cc:403] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:20:21.171728 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:21.135366  2511 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:21.177786 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:21.166566  2573 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.001s
I20260709 12:20:21.182946 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:21.178972 29292 leader_election.cc:336] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.812s (SENT)
I20260709 12:20:21.191895 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.135564  2309 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:21.165246  2523 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.172798  2405 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.207398  2523 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.209210  2405 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:21.209561  2523 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:21.173257  2575 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:20:21.210110  2523 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:21.210762  2122 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:21.145599  2562 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:21.211737  2296 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.212240  2562 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:21.213519  2357 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:21.213918 28607 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:21.190225  2511 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:21.214495  2663 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:21.197800  2667 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:21.214986  2582 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:21.215242  2667 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.215797  2667 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.189162  2425 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:20:21.216338 28756 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:21.119184  2517 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 12:20:21.218909 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.219326  2466 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.003s
I20260709 12:20:21.206090 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:21.171074  2632 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.198552 28721 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:21.203699  2463 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:21.223960  2463 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:21.215301  2390 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.205467 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:21.203027  2660 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:20:21.168612  2559 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.210584  2523 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:21.243615  2523 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:21.245236  2575 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:21.245633  2575 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:21.246731 28753 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:21.246443  2575 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.247702  2575 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:21.225875 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:21.224022 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.226521 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3078) took 1104 ms. Trace:
I20260709 12:20:21.259670 28599 rpcz_store.cc:276] 0709 12:20:20.122149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.754437 (+632288us) service_pool.cc:224] Handling call
0709 12:20:20.754822 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.755069 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.755093 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.755547 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:20:21.027058 (+271511us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:21.027119 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.027219 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.226281 (+199062us) raft_consensus.cc:1685] finished
0709 12:20:21.226300 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.226461 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":271086,"threads_started":1,"wal-append.queue_time_us":408919}
I20260709 12:20:21.213285  2478 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.252164 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:21.228005 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.206087  2603 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:21.232861 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:21.265719 29318 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.237753 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:21.266453 28681 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:21.266916 29322 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:21.239296 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60370.3us
W20260709 12:20:21.239816  2515 consensus_meta.cc:287] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.566s	user 0.001s	sys 0.009s
I20260709 12:20:21.239820  2600 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:21.225643  2569 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:21.261165 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:21.278612 28682 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:21.264372  2309 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:21.284192 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.234935  2390 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.274753  2357 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:20:21.269369  2466 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:21.317854 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:21.288612  2102 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:21.290666 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2796) took 1621 ms. Trace:
I20260709 12:20:21.268839  2559 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.264779  2494 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:21.293071 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 299995us
W20260709 12:20:21.298803 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.301352 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.282524  2569 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:21.304095 28598 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:21.280200 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:21.282747  2616 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:20:21.278239  2515 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.272637  2615 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:21.321319 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60213.3us
I20260709 12:20:21.320124 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.335567 29322 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:21.348033 28604 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:21.334152 28605 rpcz_store.cc:276] 0709 12:20:19.669197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.682413 (+ 13216us) service_pool.cc:224] Handling call
0709 12:20:19.724691 (+ 42278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:19.733683 (+  8992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:19.733720 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:19.748689 (+ 14969us) log.cc:844] Serialized 26 byte log entry
0709 12:20:19.923929 (+175240us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:19.936311 (+ 12382us) log.cc:844] Serialized 14 byte log entry
0709 12:20:19.936534 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:19.936634 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.288485 (+1351851us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b1800390340. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:20:21.290366 (+  1881us) raft_consensus.cc:1685] finished
0709 12:20:21.290469 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.290605 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14217,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":14943,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":13436,"spinlock_wait_cycles":38975232,"thread_start_us":151338,"threads_started":1,"wal-append.queue_time_us":211152}
I20260709 12:20:21.337816  2621 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:21.337546  2591 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:21.392930 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:21.336974  2122 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:21.316628  2539 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:21.395327 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 75315.4us
I20260709 12:20:21.416543 29326 raft_consensus.cc:2368] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:21.417320 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:21.421007 28600 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:21.421094 28648 leader_election.cc:400] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17.
I20260709 12:20:21.421728 28648 leader_election.cc:403] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:20:21.421936 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.423117 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.424238 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:21.306151  2463 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:21.428138 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.424985 28751 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:21.433032 28751 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:20:21.398377 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:21.451113 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:21.451615 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:21.451870 28605 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:21.451184 28751 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:20:21.455255 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:21.581868 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 126531us
I20260709 12:20:21.582935 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:21.585821 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 130663us
I20260709 12:20:21.586870 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:21.392917  2581 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.644920 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:21.645162 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:21.620600 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:21.354818  2494 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:21.645115 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63102.3us
I20260709 12:20:21.392982  2466 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:20:21.421236  2520 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:21.416631  2674 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:21.425207  2663 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17.
I20260709 12:20:21.663458 28598 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:21.397734  2621 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:21.731639 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3076) took 1610 ms. Trace:
W20260709 12:20:21.806633 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.744560 28674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.075s	sys 0.145s
W20260709 12:20:21.760897 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:21.808025 28674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.078s	sys 0.151s
I20260709 12:20:21.665518 28755 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:21.811082 28675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.024s	sys 0.148s
W20260709 12:20:21.811540 28675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.024s	sys 0.148s
W20260709 12:20:21.822516 28606 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.699s	user 0.013s	sys 0.000s
I20260709 12:20:21.823621 28606 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:21.427459  2600 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:21.810578 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:21.833722 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:21.834831 28598 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:21.453599  2425 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:21.588624  2573 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:21.839591 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.056s	sys 0.136s
I20260709 12:20:21.686882 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:21.806336 28602 rpcz_store.cc:276] 0709 12:20:20.121455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.741560 (+620105us) service_pool.cc:224] Handling call
0709 12:20:20.741880 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:20.768692 (+ 26812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.768724 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:20.776305 (+  7581us) log.cc:844] Serialized 52 byte log entry
0709 12:20:21.024311 (+248006us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b18003319c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:20:21.306590 (+282279us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:21.352562 (+ 45972us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.356591 (+  4029us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.391320 (+ 34729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.391424 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:21.731393 (+339969us) raft_consensus.cc:1685] finished
0709 12:20:21.731422 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:21.731577 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191594,"prepare.queue_time_us":47892,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":29166,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":45563,"spinlock_wait_cycles":100176128,"thread_start_us":279260,"threads_started":1,"wal-append.queue_time_us":640340}
I20260709 12:20:21.453955  2678 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:20:21.846503 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.056s	sys 0.136s
I20260709 12:20:21.646278  2584 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:20:21.854991 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 663566us
I20260709 12:20:21.855690 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:21.857194 28722 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.423359  2539 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:21.861593 28673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.002s	sys 0.023s
I20260709 12:20:21.688469  2209 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:21.589712  2587 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:21.744292  2282 consensus_meta.cc:287] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.000s
W20260709 12:20:21.686275  2652 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 12:20:21.853080 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:21.907125 28598 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.865514 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:21.909363 28602 raft_consensus.cc:2376] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21. Re-sending same reply.
I20260709 12:20:21.650331  2632 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:21.854745  2678 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.866398  2584 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.939770 28602 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:20:21.897084  2357 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:21.838596  2581 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:21.933080  2599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.019s	sys 0.024s
I20260709 12:20:21.870211 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:21.717826  2675 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 12:20:21.734683  2515 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:21.736469  2615 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:21.872251 28673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.003s	sys 0.023s
I20260709 12:20:21.830279  2603 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.828490  2582 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:21.583735  2151 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.271s
I20260709 12:20:21.828855  2656 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.826359  2621 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:21.588320  2468 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.276s
I20260709 12:20:21.426656  2499 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.424s
I20260709 12:20:21.645439  2405 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.219s
I20260709 12:20:21.849524 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:21.845950  2573 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:21.986593  2573 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:21.857559  2296 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:21.844969  2520 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:21.990619  2520 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:21.955758 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 85657.6us
W20260709 12:20:21.956048 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.007s
W20260709 12:20:21.991474 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.010s	sys 0.008s
W20260709 12:20:21.992038 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 574742us
I20260709 12:20:21.974782  2656 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:21.957630 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 370833us
I20260709 12:20:21.993299  2684 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:21.994354  2656 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:21.994463 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:21.994894  2684 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:21.995380  2684 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:21.995245  2151 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:21.995805  2684 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:21.937774  2584 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.996727  2151 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:21.999174  2539 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:21.728675  2569 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.002665 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:22.003506 29322 raft_consensus.cc:2368] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
W20260709 12:20:22.003849  2677 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.653s	user 0.002s	sys 0.000s
I20260709 12:20:22.005095 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3057) took 3926 ms. Trace:
I20260709 12:20:21.937189  2678 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:22.005759  2581 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.007668 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.009334 29326 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:20:22.009701 29326 pending_rounds.cc:85] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 10
I20260709 12:20:22.009995 29326 pending_rounds.cc:107] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:20:21.970445  2603 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.010222 29326 raft_consensus.cc:2889] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:22.010946  2511 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.011691  2603 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:22.013271 29317 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEARNER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:22.013530 29323 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:20:22.013968 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1330) took 1169 ms. Trace:
I20260709 12:20:22.015050 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:22.014334 28673 rpcz_store.cc:276] 0709 12:20:20.844301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.844517 (+   216us) service_pool.cc:224] Handling call
0709 12:20:20.845044 (+   527us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:20.900579 (+ 55535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.900631 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:20.925835 (+ 25204us) log.cc:844] Serialized 52 byte log entry
0709 12:20:21.176524 (+250689us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:21.959757 (+783233us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.960053 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.960127 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:22.013757 (+ 53630us) raft_consensus.cc:1685] finished
0709 12:20:22.013777 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.013911 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40339,"prepare.queue_time_us":40928,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":62849,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":23441,"thread_start_us":958217,"threads_started":2,"wal-append.queue_time_us":359480}
I20260709 12:20:22.015522 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.005786 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.016135 29323 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:22.016392 29322 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:22.015731 28604 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:22.018193 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:22.018747 28604 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:20:22.020093 28604 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
W20260709 12:20:22.021139  2686 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:22.015720 29326 raft_consensus.cc:2368] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:20:22.005105 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1326) took 1231 ms. Trace:
I20260709 12:20:22.005564 28607 rpcz_store.cc:276] 0709 12:20:18.078448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:18.081899 (+  3451us) service_pool.cc:224] Handling call
0709 12:20:18.082191 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:21.214255 (+3132064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.004815 (+790560us) spinlock_profiling.cc:243] Waited 3.13 s on lock 0x7b54003d3454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:22.005021 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7201405696}
I20260709 12:20:22.036794 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.037686 28572 leader_election.cc:400] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:22.038125 28572 leader_election.cc:403] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:20:22.039086 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:22.039951 28673 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:21.737389  2616 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:20:21.962849 29318 consensus_meta.cc:287] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.697s	user 0.006s	sys 0.006s
W20260709 12:20:21.953872  2599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.019s	sys 0.024s
I20260709 12:20:21.890120  2209 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:21.953550  2122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.006s	sys 0.010s
I20260709 12:20:21.922959  2282 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:21.979601  2667 consensus_meta.cc:287] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.004s
I20260709 12:20:22.061095 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:22.061883 28674 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.956704  2357 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:21.980634  2623 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:21.967052  2559 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.044925 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.045197 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.033203 28680 rpcz_store.cc:276] 0709 12:20:20.774058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.774182 (+   124us) service_pool.cc:224] Handling call
0709 12:20:20.884044 (+109862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:20.906183 (+ 22139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:20.906214 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:20.911968 (+  5754us) log.cc:844] Serialized 26 byte log entry
0709 12:20:21.164021 (+252053us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:21.164061 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.164129 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:22.003255 (+839126us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:22.004833 (+  1578us) raft_consensus.cc:1685] finished
0709 12:20:22.004853 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.005049 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23971,"raft.queue_time_us":24008,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":15703,"spinlock_wait_cycles":5724416,"thread_start_us":180906,"threads_started":1,"wal-append.queue_time_us":346757}
I20260709 12:20:22.050927 29318 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:22.046816 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:22.053444 29327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.036s	sys 0.064s
W20260709 12:20:22.064884 29327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.037s	sys 0.064s
I20260709 12:20:21.955884  2466 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:22.071012  2466 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:21.975122  2309 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.056053 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:21.977661  2632 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.031679  2102 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.081924  2632 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.064589 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.012198  2511 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:22.024530  2575 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.000s
I20260709 12:20:22.069137  2505 raft_consensus.cc:2764] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:20:22.069270  2421 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.085525  2421 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.087713  2421 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.089515  2390 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.089771 29317 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:22.091284 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:22.055866  2122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.010s
I20260709 12:20:22.093175  2122 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:22.094340  2122 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.095640  2562 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:22.098131  2282 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.053179  2512 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.099911  2512 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.102541  2512 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.111382  2632 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.117823 28606 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:22.117533  2357 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.119242 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3087) took 1084 ms. Trace:
I20260709 12:20:22.119619 28606 rpcz_store.cc:276] 0709 12:20:21.034336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.022632 (+988296us) service_pool.cc:224] Handling call
0709 12:20:22.117652 (+ 95020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:22.118300 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.119053 (+   753us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b54003dbdd0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:22.119182 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217885056}
W20260709 12:20:22.117574 28600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1113) took 1639 ms (client timeout 1987 ms). Trace:
I20260709 12:20:22.120595  2667 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.070336  2209 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.081974  2102 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.123054  2667 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.123387  2102 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.068388 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:22.120981 28600 rpcz_store.cc:269] 0709 12:20:20.478397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.733492 (+255095us) service_pool.cc:224] Handling call
0709 12:20:22.117368 (+1383876us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54003dbdd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:22.117513 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578968448}
I20260709 12:20:22.124796  2209 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.125403  2209 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.127807  2209 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:22.128072 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.128530 28719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.018s	sys 0.054s
I20260709 12:20:22.070022  2623 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:22.129976 28719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.018s	sys 0.054s
W20260709 12:20:22.141812 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 81193.4us
I20260709 12:20:22.142517 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:22.143221 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:22.134914 28673 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:22.144165 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2820) took 1111 ms. Trace:
W20260709 12:20:22.139686 28605 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.004s
I20260709 12:20:22.144573 28602 rpcz_store.cc:276] 0709 12:20:21.032632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.944152 (+911520us) service_pool.cc:224] Handling call
0709 12:20:21.944538 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:22.025209 (+ 80671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.025255 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:22.025309 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:22.025354 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.143931 (+118577us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b5400217854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:22.143977 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.144109 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184606592}
I20260709 12:20:22.145143 28605 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:22.145810 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3085) took 1112 ms. Trace:
I20260709 12:20:22.146171 28605 rpcz_store.cc:276] 0709 12:20:21.033782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.420336 (+386554us) service_pool.cc:224] Handling call
0709 12:20:22.145741 (+725405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:22.046273  2615 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.161516 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1635) took 1186 ms. Trace:
I20260709 12:20:22.161912 29327 rpcz_store.cc:276] 0709 12:20:20.974583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:20.974723 (+   140us) service_pool.cc:224] Handling call
0709 12:20:20.990019 (+ 15296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:20.990240 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:21.333966 (+343726us) log.cc:844] Serialized 14 byte log entry
0709 12:20:22.161222 (+827256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:22.161284 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:22.161316 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.161364 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.161461 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97498,"prepare.queue_time_us":40377,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":1021333,"threads_started":2}
I20260709 12:20:22.163939 28673 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:22.168630 28598 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:22.169262 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:22.181598 28753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.010s	sys 0.069s
W20260709 12:20:22.183776 28753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.011s	sys 0.069s
I20260709 12:20:22.189267 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:22.067286  2656 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:22.187714  2151 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:22.191221 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48801.3us
I20260709 12:20:22.191633  2656 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:22.191548  2151 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.192117  2656 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.192528  2656 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.192883 28572 leader_election.cc:400] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 12 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:20:22.193775 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:22.194023  2151 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.194651  2517 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:22.147575  2209 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.147672  2632 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.195395  2517 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.195996  2517 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.197983 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:22.198395 28682 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:22.195408  2209 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.201771  2209 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.202782  2517 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.203935 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:22.204913 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.203962  2573 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.141462  2616 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:22.208983 28602 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:20:22.141166  2405 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.211920 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:22.210340 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.161957  2282 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.195760  2632 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.213142 28647 leader_election.cc:400] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:22.223596 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.218636 28675 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:22.214421 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:22.204150  2663 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:22.261200 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:22.254586 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:22.262254 28606 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.257107 28647 leader_election.cc:403] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:22.259601 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.260924 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.208112  2573 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.256222 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.170938  2512 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.187588  2468 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:22.264380 28601 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:22.189636  2390 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.269696 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.147289  2523 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 12:20:22.270661 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58825.7us
I20260709 12:20:22.170114  2599 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 12:20:22.208559  2693 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:22.214854  2582 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:22.301198 28674 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:22.215437  2539 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:22.253073  2209 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:22.170317  2520 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 12:20:22.170689  2615 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.215639  2494 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.261178  2314 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:20:22.337255  2615 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.282912  2390 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.273540  2593 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:22.277952  2102 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:22.307461 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.305035  2468 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:22.301584  2582 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.215174  2621 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.283627  2581 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:20:22.267465  2641 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
W20260709 12:20:22.329617 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.211939  2623 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.305105  2693 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.330638  2209 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:22.330924 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:22.332103 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.333807  2632 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.340947 28598 raft_consensus.cc:2376] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16. Re-sending same reply.
I20260709 12:20:22.303630 28606 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:22.346517 29327 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:22.265385  2405 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.262596  2282 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:22.353935 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.257095  2533 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:20:22.305197  2539 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.344663  2663 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:22.304265  2700 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:22.280761  2512 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.391765 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:22.364857 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:22.359719  2478 consensus_meta.cc:287] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.090s	user 0.013s	sys 0.000s
W20260709 12:20:22.386718 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 55889.5us
I20260709 12:20:22.358036  2390 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.395328 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:22.389606 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:22.391117 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 398316us
I20260709 12:20:22.351215  2582 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:22.397485 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:22.365532  2623 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:22.398274 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.410383 28598 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:22.411871 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:22.410204 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.362092  2296 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.349802  2593 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.419890 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.388027  2539 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.386229  2697 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:22.420830 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 207817us
W20260709 12:20:22.419860 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 158727us
I20260709 12:20:22.423236  2511 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:22.429667  2667 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.429901  2511 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.430332  2511 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:22.430238  2667 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.430894  2282 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.409317  2663 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:22.421806  2468 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.358141  2616 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.393714  2151 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:22.425617 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:22.439365 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.439989 28755 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
W20260709 12:20:22.442142 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.013s	sys 0.009s
W20260709 12:20:22.442523 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.013s	sys 0.009s
W20260709 12:20:22.442770 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 627668us
I20260709 12:20:22.416829  2615 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:22.412072  2478 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13.
I20260709 12:20:22.421561  2569 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:22.436959  2690 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:20:22.448642 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.449906 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:22.455756 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.432406  2667 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.437136  2151 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.458673 28751 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:20:22.462373 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.470417 29318 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:22.463966 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.466207 28599 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:22.471637 28598 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:22.475028 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.475586  2678 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.441226  2697 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.477671 28504 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 10 to 11, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 11 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:22.478797  2697 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.432691  2663 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.444952  2282 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:22.484982  2282 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:22.441411  2390 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.486110 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:22.489347 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.489549 28747 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.486940 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:22.493289 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.488032 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.499454 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.431856  2296 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.455197  2421 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.463546  2615 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:22.468053  2314 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:22.516417 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.516517 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.486830  2151 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:22.519140 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.522272 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.523069 28674 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:22.511849 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:22.495939  2569 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:22.508764 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.032s
I20260709 12:20:22.441962  2209 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:22.538275 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.033s
W20260709 12:20:22.538569 28599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3099) took 1313 ms (client timeout 1580 ms). Trace:
W20260709 12:20:22.538794 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 547096us
W20260709 12:20:22.539149 28599 rpcz_store.cc:269] 0709 12:20:21.225599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.279886 (+ 54287us) service_pool.cc:224] Handling call
0709 12:20:22.538358 (+1258472us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003db3d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:22.538494 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537881344}
I20260709 12:20:22.540791 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:22.541379 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.537001  2314 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:22.545550 28504 catalog_manager.cc:5697] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.552496 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.553349 28674 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:22.563335  2615 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.504297  2390 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.530982  2478 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.570405 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.571311 28674 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:22.568802 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.572922 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.573298 29321 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:22.573745 28599 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:22.577317 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.578087 29318 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:22.580053 28747 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:22.582732 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.555559  2667 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:22.520717  2421 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.594643 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:22.591060 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:22.589474 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:22.596671 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:22.597321 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:22.594053  2696 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:20:22.607125 28573 leader_election.cc:400] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
W20260709 12:20:22.615075 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 146842us
I20260709 12:20:22.616824 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.576710  2621 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:22.617224 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.616871 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.556061  2582 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.617666 28751 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:22.618582 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.619346 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:22.619673 28675 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:22.619385  2582 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.621999 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.622826 28682 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:22.619570 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.624619 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.625957 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.627426 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.628947 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.630100 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.631366 28680 raft_consensus.cc:2410] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 12:20:22.536646  2282 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.633194 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:22.594182  2517 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.603173 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:22.635174 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.601684  2523 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:20:22.643091 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44182.4us
I20260709 12:20:22.645215 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:22.643935 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:22.645828 28680 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:22.645965 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.646574 28678 raft_consensus.cc:2410] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:20:22.602008  2520 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:22.596819  2405 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.601534  2693 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.653357 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:22.649291 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:22.611922  2297 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:22.601475  2705 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.587867  2478 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.637168  1773 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:22.633318  2463 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.632149  2632 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:22.654930 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:22.632107  2700 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:22.653729 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51071.7us
I20260709 12:20:22.611850  2494 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:20:22.644898  2523 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:22.677259 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:22.631794  2703 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:20:22.656669  2641 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:22.638151  2562 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:20:22.689049 28598 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:22.659276  2582 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:22.662964  2581 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:22.663461  2575 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:22.701537 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:22.641554  2516 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:20:22.637349  2511 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.696610 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.697587 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:22.644984  2517 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.698243 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.698850 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.707297 28607 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:22.699420 28680 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:20:22.670065  2342 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:22.634709  2701 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:20:22.704236 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:22.658563  2505 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:20:22.652493  2621 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:20:22.613416  2569 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.672271  2309 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:22.709255 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:22.709928 28505 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 335) took 55650 ms (client timeout 15000 ms). Trace:
I20260709 12:20:22.686375  2667 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:22.703429  2468 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:22.707439 28751 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:22.721489 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.636092  2314 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.655772  2122 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 12:20:22.712869  2708 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:20:22.740270 28504 catalog_manager.cc:5697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 6 to 7, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 7 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:22.700650  2581 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:22.705246  2405 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:22.748648 28602 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:22.675717  1773 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:22.759596 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 113989us
I20260709 12:20:22.711377  2342 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:22.766289 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 127393us
I20260709 12:20:22.739499  2582 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:22.745982  2512 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.685868  2463 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:22.760409 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 127298us
I20260709 12:20:22.774714 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:22.690922  2700 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:22.781894 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 115803us
I20260709 12:20:22.795006 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:22.797405 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.671828  2705 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:22.800258 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:22.783428 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:22.789705 28603 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:22.704113  2641 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:22.814090  2584 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.817s	user 0.011s	sys 0.002s
I20260709 12:20:22.776603  2701 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.814574  2584 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.814834  2701 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.815549  1773 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:22.816223 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:22.816568  2591 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.417s	user 0.011s	sys 0.003s
I20260709 12:20:22.766510  2581 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:22.817920 28607 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:22.765089  2405 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.822770 28747 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
W20260709 12:20:22.792353  2656 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.000s
I20260709 12:20:22.788115  2582 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:22.826098  2584 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:22.831722 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.834085 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:22.832729 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:22.834383 29321 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
W20260709 12:20:22.823065  2710 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 12:20:22.742334 28505 rpcz_store.cc:269] 0709 12:19:26.911395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:26.926065 (+ 14670us) service_pool.cc:224] Handling call
0709 12:20:22.551390 (+55625325us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:15.232656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:15.233295 (+   639us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:15.233343 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:20:15.233374 (+    31us) tablet.cc:662] Decoding operations
0709 12:20:15.233984 (+   610us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:15.234063 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:15.234093 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:20:15.234520 (+   427us) tablet.cc:701] Row locks acquired
0709 12:20:15.234561 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:20:15.234729 (+   168us) write_op.cc:270] Start()
0709 12:20:15.234884 (+   155us) write_op.cc:276] Timestamp: P: 1783599615234662 usec, L: 0
0709 12:20:15.234905 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:20:15.402804 (+167899us) log.cc:844] Serialized 1316 byte log entry
0709 12:20:16.623732 (+1220928us) op_driver.cc:464] REPLICATION: finished
0709 12:20:17.028476 (+404744us) write_op.cc:301] APPLY: starting
0709 12:20:17.028643 (+   167us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:17.031634 (+  2991us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:17.031754 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:17.241856 (+210102us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:17.345978 (+104122us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:20:17.360630 (+ 14652us) write_op.cc:312] APPLY: finished
0709 12:20:17.361018 (+   388us) log.cc:844] Serialized 41 byte log entry
0709 12:20:17.596305 (+235287us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:17.600722 (+  4417us) write_op.cc:454] Released schema lock
0709 12:20:17.600787 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:17.601281 (+   494us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:17.601310 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6485253,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":329014,"apply.run_cpu_time_us":32414,"apply.run_wall_time_us":591719,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16637,"num_ops":3,"prepare.queue_time_us":230249,"prepare.run_cpu_time_us":20545,"prepare.run_wall_time_us":406387,"raft.queue_time_us":554283,"raft.run_cpu_time_us":10547,"raft.run_wall_time_us":375804,"replication_time_us":1338431,"spinlock_wait_cycles":42752,"thread_start_us":902411,"threads_started":5,"wal-append.queue_time_us":717829,"wal-append.run_cpu_time_us":131967,"wal-append.run_wall_time_us":2523969}]]}
I20260709 12:20:22.743304  2695 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:20:22.845602 29320 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:22.820853  2712 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:22.839119  2706 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:20:22.828883  2390 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.850739  2517 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:22.890555  2723 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:20:22.891134  2511 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:22.823330  2591 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:22.852651 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:22.823928  2405 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:22.835955  2582 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:22.880652 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44979.6us
W20260709 12:20:22.884182 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106863us
W20260709 12:20:22.868018  2709 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:20:22.890009  2390 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:22.894694 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 103242us
I20260709 12:20:22.824041  2632 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:20:22.836913  2656 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:22.910248 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.910485 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.911024 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:22.911132 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:22.911580 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.963056 28603 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:22.963203 28753 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:22.956928 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.897090  2621 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.966104 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:23.032858 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 121916us
I20260709 12:20:22.964790 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:22.916304  2701 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:23.043020 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 209010us
I20260709 12:20:23.044587 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.047518 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:22.905591  2505 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:22.960373  2714 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 12:20:22.919293  2722 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:20:23.069136 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 106155us
I20260709 12:20:22.912098  2727 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:22.915159  2715 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 12:20:22.959290  2478 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.110455 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:23.111158 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.111719 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.112030 28756 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:20:23.113325 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.079311 28680 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:22.911635  2731 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:22.915940  2122 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:22.969286  2623 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.004s
I20260709 12:20:23.078154 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:23.094553 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:23.130434 28678 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
W20260709 12:20:23.043681  2539 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.000s
I20260709 12:20:23.131824  2539 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.134778  2539 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.048193 28753 raft_consensus.cc:2376] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21. Re-sending same reply.
I20260709 12:20:23.116335 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.137439 29325 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:23.068784  2494 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:20:23.110776  2720 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 12:20:23.072688  2296 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:23.071441  1773 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:23.045802  2516 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.122958 28603 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:22.949312  2390 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.127811 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:23.126168  2478 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.145128 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:23.193289 29326 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.138875  2463 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:23.116068  2721 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 12:20:23.083527  2728 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.103973  2663 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.183485 29320 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:23.109875  2505 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:23.043246  2533 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.064356  2621 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.043959  2562 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:23.142747  2494 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.183123  1773 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.217350  2728 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.253742 29326 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
W20260709 12:20:23.294512 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 175144us
I20260709 12:20:23.192958  2516 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:23.353900  2738 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 12:20:23.357329 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:23.392903 28647 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:23.395365 28603 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:23.323135  2282 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:23.340667  2641 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:23.341323  2732 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:20:23.341323  2730 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
I20260709 12:20:23.217510  2663 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:23.346029  2499 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:20:23.348783  2718 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.446s	user 0.000s	sys 0.000s
I20260709 12:20:23.350402  2728 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.353152  2745 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.355072  2516 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.333829 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1122) took 1124 ms. Trace:
I20260709 12:20:23.359140 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:23.473809 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 114760us
I20260709 12:20:23.117830  2727 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.256590  2494 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:23.258055  1773 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:23.397496 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:23.491519 29321 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.398514 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:23.330086  2717 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.493s	user 0.001s	sys 0.001s
I20260709 12:20:23.402321 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:23.403337 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:23.405535 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.497306 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:23.406100 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.498231 29326 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:23.257045  2562 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.325194  2739 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.342007  2735 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:20:23.357007  2102 consensus_meta.cc:287] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.008s	user 0.012s	sys 0.000s
I20260709 12:20:23.342988  2656 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:23.461935 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.005s	sys 0.004s
I20260709 12:20:23.465624 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3126) took 1073 ms. Trace:
W20260709 12:20:23.465454 28599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.001s
W20260709 12:20:23.531392 28599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.007s	sys 0.002s
W20260709 12:20:23.466393 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.005s
W20260709 12:20:23.532358 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.005s	sys 0.005s
W20260709 12:20:23.533244 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.005s	sys 0.005s
W20260709 12:20:23.288102 28573 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 2.075s (SENT) [suppressed 22 similar messages]
I20260709 12:20:23.475080 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:23.249182  2533 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.472223 28600 rpcz_store.cc:276] 0709 12:20:22.209616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.209754 (+   138us) service_pool.cc:224] Handling call
0709 12:20:22.261622 (+ 51868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.261958 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.261985 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.274704 (+ 12719us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.456989 (+182285us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:22.457038 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.458001 (+   963us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.333577 (+875576us) raft_consensus.cc:1685] finished
0709 12:20:23.333602 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.333755 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":757,"raft.queue_time_us":82,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":11683,"thread_start_us":115796,"threads_started":1,"wal-append.queue_time_us":289618}
I20260709 12:20:23.240075  2632 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:23.454861  2296 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:23.518415  2516 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.493364 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:23.332840  2314 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.139s
I20260709 12:20:23.497320 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:23.249713  2591 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.283571  2700 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.284600  2705 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:23.208050  2478 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:23.507525  2741 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:23.507848  2209 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:23.508355 28606 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:23.510447 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:23.513315  2390 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.515367  2734 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 12:20:23.490849  2505 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:23.517330  2684 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.521s	user 0.015s	sys 0.000s
I20260709 12:20:23.517768  2759 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:23.469048  2499 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:23.601480  2593 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.601316  2499 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.602378  2499 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:23.603310  2621 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:23.603536 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.603897  2621 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:23.518702 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.604931  2774 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:23.605496  2774 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:23.607802  2774 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:23.583240  2727 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.614377 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.615262 29319 raft_consensus.cc:2410] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:23.614692  2684 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:23.539381 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 64416.9us
I20260709 12:20:23.508792  2623 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 12:20:23.531152 28754 rpcz_store.cc:276] 0709 12:20:22.391824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.392197 (+   373us) service_pool.cc:224] Handling call
0709 12:20:22.419909 (+ 27712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.422214 (+  2305us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:22.422259 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.444175 (+ 21916us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.590555 (+146380us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:22.590596 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.590664 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.465340 (+874676us) raft_consensus.cc:1685] finished
0709 12:20:23.465367 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.465558 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1819,"raft.queue_time_us":2082,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":18149,"thread_start_us":112051,"threads_started":1,"wal-append.queue_time_us":208687}
I20260709 12:20:23.554834 29321 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:23.255506  2512 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:23.488049  2745 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:23.586529  2761 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:23.575771 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:23.597780  2151 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.061s	user 0.011s	sys 0.001s
I20260709 12:20:23.578631 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:23.582094 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:23.584636  2743 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.541332  2615 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:23.587122 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.538077  2102 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:23.595701 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 85363.6us
I20260709 12:20:23.595139 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:23.526986  2739 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.612416 28598 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:23.612814  2776 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.620296  2705 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:23.656962 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.658435 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.659814 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:23.539172 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 146356us
I20260709 12:20:23.576603  2296 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:23.624979 29321 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:20:23.604281 29325 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:23.558352 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.559962 28601 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.663610 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.631227 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2699) took 1003 ms. Trace:
I20260709 12:20:23.664922 28682 rpcz_store.cc:276] 0709 12:20:22.628131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.628268 (+   137us) service_pool.cc:224] Handling call
0709 12:20:22.628689 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.655592 (+ 26903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.655623 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.656153 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.794193 (+138040us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:22.794232 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.794302 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.630932 (+836630us) raft_consensus.cc:1685] finished
0709 12:20:23.630964 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.631161 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15145,"raft.queue_time_us":15391,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5317,"thread_start_us":93945,"threads_started":1,"wal-append.queue_time_us":394714}
I20260709 12:20:23.608228  2700 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:23.669142 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:23.641213 28602 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:23.582945  2533 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.643985 28603 raft_consensus.cc:2368] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18.
I20260709 12:20:23.581578  2516 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.645800 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:23.587152  2731 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:23.594869  2209 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.652650 28606 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:23.646893 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.647553 28752 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:20:23.676051 28754 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
W20260709 12:20:23.632460  2581 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.000s
I20260709 12:20:23.581626  2591 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.667574 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.668493 29320 raft_consensus.cc:2368] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:23.671214 28603 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:23.679352 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:23.689958 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:23.690006 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.690706 28603 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:23.691975 28603 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: [15.12-17.13]
W20260709 12:20:23.644029 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 355941us
I20260709 12:20:23.605829  2621 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:23.794052  2621 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.667640 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1368) took 1273 ms. Trace:
I20260709 12:20:23.796972 29327 rpcz_store.cc:276] 0709 12:20:22.394584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.398945 (+  4361us) service_pool.cc:224] Handling call
0709 12:20:22.420533 (+ 21588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.420896 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:22.441792 (+ 20896us) log.cc:844] Serialized 14 byte log entry
0709 12:20:22.773228 (+331436us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.773700 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.773836 (+   136us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:22.786311 (+ 12475us) log.cc:844] Serialized 14 byte log entry
0709 12:20:22.788627 (+  2316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.788922 (+   295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.610204 (+821282us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18003713e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:20:23.667414 (+ 57210us) raft_consensus.cc:1685] finished
0709 12:20:23.667443 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.667584 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44381,"prepare.queue_time_us":32661,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2538,"raft.queue_time_us":176119,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":27801,"spinlock_wait_cycles":48385664,"thread_start_us":315374,"threads_started":2,"wal-append.queue_time_us":375099}
I20260709 12:20:23.630811  2512 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.799039  2512 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.685316 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:23.687825 29326 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
W20260709 12:20:23.750289  2733 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:23.663053  2743 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.802644 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.802775  2663 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:23.803275 28756 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:23.651294  2151 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.762025 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:23.708231  2581 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.812620 29321 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:23.771332  2405 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.000s
I20260709 12:20:23.776398 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.815819 28752 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:23.696020 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:23.685933  2517 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:23.780587  2533 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:23.781005 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.782433 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:23.781318  2712 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:23.662463  2615 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.785406 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.796357  2621 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:23.785876  2755 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:20:23.786496  2562 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.846148 28606 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:20:23.654428  2761 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.787398 28681 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:23.685799  2209 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:23.772235  2296 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.770088  2731 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.654181  2667 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.791189 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 111879us
I20260709 12:20:23.669575  2700 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:23.792955 28603 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:23.878902 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:23.880935 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.793529 28677 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:23.788180  2591 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:23.810863  2743 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.815573 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.817467 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:23.881588 28603 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:23.820947 28601 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:23.820055 28752 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:20:23.811776  2151 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:23.829545 29320 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:23.888411 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:23.829067 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 133127us
I20260709 12:20:23.830735 29325 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:23.697463  2684 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:23.831487 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50595.5us
I20260709 12:20:23.831828 28673 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:23.832198 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.837189 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:23.837972 29327 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:23.850085 28606 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:23.833676  2533 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.867043  2615 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:23.836977  2599 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:23.868198 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:23.823302  2405 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:23.677780  2776 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:23.898499  2517 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:23.882777 28682 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:23.686213  2759 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:23.886830 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:23.892882 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77430.2us
I20260709 12:20:23.900779 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:23.900836 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.943939 28752 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.901595  2539 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:23.902225 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:23.903169 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3123) took 1527 ms. Trace:
I20260709 12:20:23.904151  2581 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:23.904680 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 73226.5us
I20260709 12:20:23.951964 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:23.928507  2591 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:23.956630 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 1369) took 1561 ms. Trace:
I20260709 12:20:23.848934  2712 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.957310 28679 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:23.926194  2765 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:23.888072  2520 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:23.927583  1773 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.911145 29320 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:23.845659  2777 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:23.909035 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.966828 28750 raft_consensus.cc:2368] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:23.967563 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:23.967866 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:23.909682 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:23.898202 28676 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 12.
I20260709 12:20:23.923877 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:23.969065 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 59476us
I20260709 12:20:23.909226 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:23.870544  2582 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.951s	user 0.012s	sys 0.000s
I20260709 12:20:23.943145 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:23.944803 28572 leader_election.cc:400] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
W20260709 12:20:23.973909 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 50159.4us
I20260709 12:20:23.943084  2517 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.931068  2705 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:23.949327 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:23.905220  2314 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.952854 29325 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:23.957932  2678 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:23.959353  2591 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.947839 28748 rpcz_store.cc:276] 0709 12:20:22.375588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.375723 (+   135us) service_pool.cc:224] Handling call
0709 12:20:22.393138 (+ 17415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.393489 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:23.180860 (+787371us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b1800298660. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:20:23.487469 (+306609us) log.cc:844] Serialized 14 byte log entry
0709 12:20:23.832505 (+345036us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:23.854379 (+ 21874us) log.cc:844] Serialized 26 byte log entry
0709 12:20:23.854546 (+   167us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:23.854590 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.854675 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.902904 (+ 48229us) raft_consensus.cc:1685] finished
0709 12:20:23.902996 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.903117 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1184549,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":33755,"raft.run_cpu_time_us":474,"raft.run_wall_time_us":32799,"spinlock_wait_cycles":33568000,"thread_start_us":580027,"threads_started":2,"wal-append.queue_time_us":378302}
I20260709 12:20:23.957170 29317 rpcz_store.cc:276] 0709 12:20:22.394974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.395092 (+   118us) service_pool.cc:224] Handling call
0709 12:20:23.950810 (+1555718us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54007a5b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:23.956532 (+  5722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055049088}
I20260709 12:20:23.964118 28571 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.897419  2667 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.989827 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:23.961437  2697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.360s	user 0.008s	sys 0.022s
I20260709 12:20:23.974274 28572 leader_election.cc:403] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:23.947184 28682 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:23.974731 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.993263 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:23.966336  2777 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:23.972333 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:23.946045  2599 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:23.920892  2727 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:23.940881  2562 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:20:23.952366 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:23.985716 28752 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:24.005332 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:24.005648 28756 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:24.005972 28752 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:23.968374 29320 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:23.962144  2778 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:23.976811  2581 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:23.991241  2697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.397s	user 0.008s	sys 0.022s
I20260709 12:20:23.989260  2591 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:23.975433 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:23.977746  2517 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:24.029081 28750 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:23.976783  2711 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:24.000931 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:23.999037 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:23.994563 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49896.1us
I20260709 12:20:24.012964  2775 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:24.008832  2727 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.009114  2731 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:24.017148  2615 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.986469  2314 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.017575  2767 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:24.018508 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66243us
I20260709 12:20:24.019105  2539 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:24.020140  2478 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:24.006788 28752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:23.979396  2505 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:20:24.020512  2761 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:24.022127  2342 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.023777 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3111) took 1328 ms. Trace:
I20260709 12:20:24.023902 29320 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:20:23.987093  2783 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:24.027731 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:24.016534  2778 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.020164 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1268) took 1107 ms. Trace:
I20260709 12:20:24.063095 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:24.063964 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 64970.6us
I20260709 12:20:23.954586  2700 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:23.994354  2705 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:23.980472  2582 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:24.071729 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70920.3us
I20260709 12:20:24.002467  2728 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:24.003371  2777 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:24.027046  2581 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:23.964497  2765 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.001777  2678 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:20:24.013711  2599 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.078707 28750 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:24.207274  2776 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:24.171896 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:24.134157 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.211385 28752 raft_consensus.cc:606] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:24.179720 29325 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:24.211838 28752 raft_consensus.cc:614] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:24.078943 28600 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:24.210208 28601 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:24.213892 29320 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:24.214339 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.208658 28599 rpcz_store.cc:276] 0709 12:20:22.695791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.695933 (+   142us) service_pool.cc:224] Handling call
0709 12:20:22.696274 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:22.841881 (+145607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.841910 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:22.854318 (+ 12408us) log.cc:844] Serialized 52 byte log entry
0709 12:20:23.532025 (+677707us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:23.532064 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.023334 (+491270us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540022f954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:24.023383 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.023440 (+    57us) raft_consensus.cc:1685] finished
0709 12:20:24.023455 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.023714 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29115,"raft.queue_time_us":34916,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":6512,"spinlock_wait_cycles":238614272,"thread_start_us":629959,"threads_started":1,"wal-append.queue_time_us":1044950}
I20260709 12:20:24.216010 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:24.216547 28599 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:24.060560  2516 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:24.221782 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:24.222051 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:24.194820  2494 consensus_meta.cc:287] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.686s	user 0.011s	sys 0.000s
W20260709 12:20:24.197005  2790 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:20:24.153497  2735 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:20:24.076376  2520 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:24.068081  2775 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:24.245493 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:24.074561  2731 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.235780 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.217415  2667 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:24.238473 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:24.234862 28599 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:24.214828 28751 rpcz_store.cc:276] 0709 12:20:22.912968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.103853 (+190885us) service_pool.cc:224] Handling call
0709 12:20:23.104220 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.523734 (+419514us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:23.792657 (+268923us) log.cc:844] Serialized 14 byte log entry
0709 12:20:23.892569 (+ 99912us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:23.892620 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:23.892660 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.019923 (+127263us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54003e8354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:24.019983 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.020106 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78523,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":118,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":5946,"spinlock_wait_cycles":964116736,"thread_start_us":345325,"threads_started":2,"wal-append.queue_time_us":194133}
I20260709 12:20:24.251166  1773 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:24.209717  2581 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.252893  2778 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:24.254410  2582 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:24.235595  2700 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.195057  2282 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:24.242012 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:24.082471  2663 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:24.212977  2767 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.218705  2678 consensus_queue.cc:1243] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:24.209923  2705 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.082737  2711 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:24.217885  2405 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:24.075947  2759 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:24.218372  2783 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:24.136662  2533 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:24.248891 28573 leader_election.cc:400] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:24.220592  2390 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.223397  2621 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.258495 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:24.261437 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:24.238854  2516 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.083477  2615 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.246244  2728 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.250082  2731 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.247987  2775 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.272816 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:24.238672  2494 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.137815  2523 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.282202 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:24.268043  2663 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:24.275146  2791 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:20:24.315268 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:24.273784  2705 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:24.268162  2767 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.317124 29323 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:20:24.320653 28752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
W20260709 12:20:24.323513 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.265937  2282 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:24.347633 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 65492us
I20260709 12:20:24.348969 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.279592  2759 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:24.313839 28682 raft_consensus.cc:2410] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:24.285051  2783 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.279403  2711 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:24.334286  2724 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 1.427s	user 0.002s	sys 0.001s
I20260709 12:20:24.331955  2593 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:24.345103 28605 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:24.345501 28752 raft_consensus.cc:606] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:24.345710 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:24.349320 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.349592 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:24.349807 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 80907.3us
I20260709 12:20:24.350188 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.350468 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:24.322839  2728 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.372036  2656 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:24.373479  2282 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:24.351372 28606 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:24.376935 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:24.328671  2727 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:24.318826  2621 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.330509  2802 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:24.325146  2516 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.322352  2390 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:24.602604 28607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1128) took 1802 ms (client timeout 1852 ms). Trace:
I20260709 12:20:24.555645 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3109) took 2043 ms. Trace:
I20260709 12:20:24.604297 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:24.584517 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 78111.9us
W20260709 12:20:24.662034 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 285129us
W20260709 12:20:24.601532 29326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 1377) took 1172 ms (client timeout 1542 ms). Trace:
W20260709 12:20:24.571422 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 222743us
W20260709 12:20:24.663792 29326 rpcz_store.cc:269] 0709 12:20:23.429454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.518435 (+ 88981us) service_pool.cc:224] Handling call
0709 12:20:24.601306 (+1082871us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b5400587354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:24.601447 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190940416}
I20260709 12:20:24.664638 29318 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:24.606742 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:24.665607 28601 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:24.665792 28747 raft_consensus.cc:1813] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Handling vote request from an unknown peer a8342e3fcab94ce89482df67988159ea
I20260709 12:20:24.666610 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:24.486270 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 171092us
W20260709 12:20:24.661387 28607 rpcz_store.cc:269] 0709 12:20:22.799792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.799955 (+   163us) service_pool.cc:224] Handling call
0709 12:20:24.602346 (+1802391us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b54000be354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:24.602531 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38409984}
I20260709 12:20:24.668303 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:24.661566 28600 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:24.661190 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.670854 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.668833 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.673559 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:24.673923 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:24.674448 28607 raft_consensus.cc:1813] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Handling vote request from an unknown peer a8342e3fcab94ce89482df67988159ea
I20260709 12:20:24.543102 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:24.627332 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1375) took 1232 ms. Trace:
I20260709 12:20:24.544521 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:24.674919 28607 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:24.677340 28747 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:24.662223 28604 rpcz_store.cc:276] 0709 12:20:22.512742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.513084 (+   342us) service_pool.cc:224] Handling call
0709 12:20:22.531045 (+ 17961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.531369 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.531398 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.542638 (+ 11240us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.024786 (+1482148us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18004a1a00. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:20:24.322696 (+297910us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:24.324973 (+  2277us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.330346 (+  5373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.330455 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.541769 (+211314us) raft_consensus.cc:1685] finished
0709 12:20:24.541865 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.555559 (+ 13694us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":262,"prepare.queue_time_us":1990,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":21775,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":58065,"spinlock_wait_cycles":4238080,"thread_start_us":297592,"threads_started":1,"wal-append.queue_time_us":1885259}
I20260709 12:20:24.678534  2774 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:24.792018  2282 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:20:24.799798  2774 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.800297  2774 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:24.791694  2806 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:24.377432  2405 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.794621 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.802052 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:24.801676  2405 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.803231 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:24.674882 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:24.761265 28675 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 24: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:24.584913  2731 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.820053  2807 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:24.820540  2807 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.820878  2807 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:24.821122 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 134366us
I20260709 12:20:24.821393  2702 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:24.822249 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:24.823890 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1339) took 2211 ms. Trace:
I20260709 12:20:24.824604  2667 raft_consensus.cc:2764] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:20:24.825410  2499 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:24.826429  2499 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:24.826825  2499 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:24.827116  2701 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:24.377622  2712 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:24.451656  2765 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:24.820066 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:24.827664  2499 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.831384  2749 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:24.584398  2615 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:24.824262 28674 rpcz_store.cc:276] 0709 12:20:22.612971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.613104 (+   133us) service_pool.cc:224] Handling call
0709 12:20:22.642192 (+ 29088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:22.836816 (+194624us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:20:22.882714 (+ 45898us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.822530 (+1939816us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18001d55a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a89716 00007f6fe3a9a287
0709 12:20:24.822626 (+    96us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:24.822673 (+    47us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:20:24.822717 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.823668 (+   951us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54003b7254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:24.823706 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.823809 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14661,"prepare.queue_time_us":194085,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":13334,"raft.queue_time_us":16991,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7941,"spinlock_wait_cycles":470255232,"thread_start_us":193994,"threads_started":2}
W20260709 12:20:24.616503  2209 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.000s
W20260709 12:20:24.614392  2591 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
W20260709 12:20:24.589080  2803 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:20:24.845782  2731 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:24.676213 29319 rpcz_store.cc:276] 0709 12:20:23.394840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.615823 (+220983us) service_pool.cc:224] Handling call
0709 12:20:23.616107 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.796630 (+180523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.796663 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:23.796703 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:23.796732 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.612371 (+815639us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540047b8d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:24.627041 (+ 14670us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.627256 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414717312}
I20260709 12:20:24.439280  2801 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:24.375813  2523 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:24.375238  2759 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.608246  2769 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:24.902334 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 82371.7us
I20260709 12:20:24.921273 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:24.617242  2767 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:24.610039  2748 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.102s	user 0.001s	sys 0.003s
I20260709 12:20:24.505297  2737 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.674467  2800 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.902418 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 227606us
I20260709 12:20:24.935595 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:24.902616 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:24.542532  2494 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:24.909260 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.845861  2697 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:24.341409  2517 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.911206 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:24.817772 28682 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:24.588745  2663 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:24.603893  2775 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.877547  2533 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:24.885763  2712 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.691406  2802 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.935987  2742 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:24.542356  2581 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.601890  2705 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.930994 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:24.906741  2729 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:24.939472 28600 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:20:24.941805  2697 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:24.942651 28601 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:24.945312 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 271807us
I20260709 12:20:24.953469 29326 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:24.928296  2499 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:24.934899  2656 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:24.991063 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1257) took 2497 ms. Trace:
W20260709 12:20:24.927866 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 80853us
I20260709 12:20:24.938359  2801 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:24.914740  2591 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.944622  2703 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:20:24.944810  2693 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:20:25.015720 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 84850.7us
I20260709 12:20:24.990031  2743 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:24.940855 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:25.016182 28673 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:25.016347 29319 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:24.928586  2769 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.020828  2667 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.017771  2405 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.022290 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.031433 28681 raft_consensus.cc:2368] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17.
I20260709 12:20:25.030249 28749 rpcz_store.cc:276] 0709 12:20:22.467201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.467343 (+   142us) service_pool.cc:224] Handling call
0709 12:20:22.507820 (+ 40477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:22.531370 (+ 23550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.531399 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:22.531913 (+   514us) log.cc:844] Serialized 52 byte log entry
0709 12:20:22.713706 (+181793us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:23.194131 (+480425us) log.cc:844] Serialized 14 byte log entry
0709 12:20:23.400512 (+206381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.400595 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.333693 (+933098us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:24.943682 (+609989us) raft_consensus.cc:1685] finished
0709 12:20:24.964587 (+ 20905us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.964752 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252808,"prepare.queue_time_us":888154,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":230296,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":61813,"spinlock_wait_cycles":11243392,"thread_start_us":588370,"threads_started":2,"wal-append.queue_time_us":290029}
I20260709 12:20:24.989500  2663 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.914928  2209 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.038065 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:24.343281  2478 consensus_queue.cc:1175] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" responder_term: 18 status { last_received { term: 18 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: [17.13-17.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:25.041328 28599 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:24.988237  2533 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.021842 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.063800 28600 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:24.988394  2712 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:24.938364  2737 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:25.046835  2772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.011s	sys 0.019s
I20260709 12:20:24.958321  2702 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
W20260709 12:20:25.043170  2512 consensus_meta.cc:287] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.244s	user 0.000s	sys 0.023s
I20260709 12:20:25.075309  2512 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:24.551383  2751 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 11 to 13, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:25.078200 28678 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:25.070421 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:25.043905 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 103160us
I20260709 12:20:25.080881 28750 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:25.081238 28750 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.081975 28750 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.082929 28750 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:25.065128 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:25.084646 28599 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:25.067610 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1764) took 2482 ms. Trace:
I20260709 12:20:25.071132  2818 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:25.088955 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2707) took 1306 ms. Trace:
I20260709 12:20:25.089253  2342 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:25.089993  2802 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.093107 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.093814 28752 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:25.071349  2702 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:25.074007 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2791) took 2164 ms. Trace:
I20260709 12:20:24.946354  2800 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.095070 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.087649 29322 rpcz_store.cc:276] 0709 12:20:22.585434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.585747 (+   313us) service_pool.cc:224] Handling call
0709 12:20:22.586045 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.612934 (+ 26889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.612964 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:22.635327 (+ 22363us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.771543 (+136216us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:22.771597 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.067253 (+2295656us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b540007ab54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:25.067304 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:25.067347 (+    43us) raft_consensus.cc:1685] finished
0709 12:20:25.067357 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.067551 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61308672,"thread_start_us":106466,"threads_started":1,"wal-append.queue_time_us":457433,"wal-append.run_cpu_time_us":3599,"wal-append.run_wall_time_us":1467979}
I20260709 12:20:25.089334 28679 rpcz_store.cc:276] 0709 12:20:23.782940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.783206 (+   266us) service_pool.cc:224] Handling call
0709 12:20:23.783581 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.961706 (+178125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.088736 (+1127030us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54003e12d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:25.088899 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399027712}
I20260709 12:20:25.051388  2703 consensus_queue.cc:1243] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:20:25.096098 28752 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:25.094856 28755 rpcz_store.cc:276] 0709 12:20:22.909235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.912880 (+  3645us) service_pool.cc:224] Handling call
0709 12:20:22.913308 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:22.958855 (+ 45547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:22.958902 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:24.552026 (+1593124us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b2c0001c1c8. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:24.552469 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:20:24.987523 (+435054us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:24.987579 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.987661 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:25.073693 (+ 86032us) raft_consensus.cc:1685] finished
0709 12:20:25.073715 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.073944 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45009,"raft.queue_time_us":120455,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":59448,"spinlock_wait_cycles":9648896,"thread_start_us":404900,"threads_started":1,"wal-append.queue_time_us":501618}
I20260709 12:20:25.099622 28599 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:25.101022 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.047179  2816 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.101927 28677 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:25.051311  2693 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.103399 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:25.069345  2772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.011s	sys 0.020s
I20260709 12:20:25.110749 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.045809  2743 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.069716  2667 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:25.096700  2702 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:25.109903  2520 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.865s	user 0.009s	sys 0.009s
I20260709 12:20:25.057474  2663 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.125299  2581 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.162711  2745 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.127595  2705 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.164003  2663 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.164979 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:25.114050  2777 consensus_meta.cc:287] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.894s	user 0.010s	sys 0.011s
I20260709 12:20:25.142112  2712 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.143338 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2833) took 1738 ms. Trace:
I20260709 12:20:25.183676 28602 rpcz_store.cc:276] 0709 12:20:23.404775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.617512 (+212737us) service_pool.cc:224] Handling call
0709 12:20:23.617815 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.669857 (+ 52042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.143012 (+1473155us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5400217354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:25.143261 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52963200}
I20260709 12:20:25.184365 28756 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:25.143836  2209 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.145644  2533 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.094259  2697 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.108798  2816 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.107658  2728 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.150381  2800 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.151378  2693 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.108018  2516 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.152935 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2713) took 1243 ms. Trace:
I20260709 12:20:25.157354  2591 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.161041  2517 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.161796  2621 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:25.163589 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:25.128527  2711 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.222962 28606 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:25.127312  2737 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:25.123540  2767 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.164252 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.165416  2774 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.118263  2656 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.118000  2575 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:20:25.177747 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 139788us
I20260709 12:20:25.166935  2702 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.180902 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.217152  2697 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:25.187460 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.255848 28751 raft_consensus.cc:2376] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16. Re-sending same reply.
I20260709 12:20:25.255985 29325 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:20:25.193415  2763 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.396s	user 0.002s	sys 0.002s
I20260709 12:20:25.203154 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.208968 28681 rpcz_store.cc:276] 0709 12:20:23.909171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.942790 (+ 33619us) service_pool.cc:224] Handling call
0709 12:20:25.152723 (+1209933us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540019ee54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:25.152870 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430955648}
I20260709 12:20:25.177114  2520 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:25.217535 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.220650 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.204644  2505 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.229554 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:25.186995 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.235486  2807 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.188273  2777 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.273211 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.273873 29322 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:25.237437 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1135) took 1542 ms. Trace:
I20260709 12:20:25.240871 28748 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 12:20:25.242285 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.244328  2739 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.250185 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:25.250921 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.263350 28754 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:20:25.279711 29326 raft_consensus.cc:1813] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Handling vote request from an unknown peer a8342e3fcab94ce89482df67988159ea
I20260709 12:20:25.274791 28603 rpcz_store.cc:276] 0709 12:20:23.695567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.894718 (+199151us) service_pool.cc:224] Handling call
0709 12:20:23.895107 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.616011 (+720904us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:24.616360 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.944990 (+328630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:24.945716 (+   726us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:24.945759 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.237197 (+291438us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400002154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:25.237247 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.237377 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":192,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":56279,"raft.queue_time_us":17965,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":28061,"spinlock_wait_cycles":1657321728,"thread_start_us":320959,"threads_started":1,"wal-append.queue_time_us":429470}
I20260709 12:20:25.280292 29326 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:20:25.270459 28679 raft_consensus.cc:2368] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
W20260709 12:20:25.274122 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44668.4us
I20260709 12:20:25.281337 28722 leader_election.cc:400] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18.
W20260709 12:20:25.271806 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.272372 28750 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:20:25.277534 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.277751 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:25.283420 28750 pending_rounds.cc:85] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 8
I20260709 12:20:25.283731 28750 pending_rounds.cc:107] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:20:25.278676 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 3130) took 1056 ms. Trace:
I20260709 12:20:25.283946 28750 raft_consensus.cc:2889] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:25.284159 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.286688 28607 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:25.288897 28603 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:25.231588  2575 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:25.289615 28675 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:25.284849 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3140) took 1608 ms. Trace:
I20260709 12:20:25.292270 28750 rpcz_store.cc:276] 0709 12:20:23.676489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.207324 (+530835us) service_pool.cc:224] Handling call
0709 12:20:24.207647 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.080780 (+873133us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b54002a92a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f6dc0 00007f6fe3a811c0 00007f6fe3a82231 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c
0709 12:20:25.284611 (+203831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.284798 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138567552}
I20260709 12:20:25.297441 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2824) took 1938 ms. Trace:
I20260709 12:20:25.297838 28605 rpcz_store.cc:276] 0709 12:20:23.359428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.359547 (+   119us) service_pool.cc:224] Handling call
0709 12:20:23.453184 (+ 93637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:24.661854 (+1208670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.297223 (+635369us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400092254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:25.297385 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050724096}
I20260709 12:20:25.284122 28677 rpcz_store.cc:276] 0709 12:20:24.222735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.272410 (+ 49675us) service_pool.cc:224] Handling call
0709 12:20:25.278498 (+1006088us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b540019f354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:25.278626 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789339520}
I20260709 12:20:25.303273 28600 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:25.304745 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.302959 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:25.307291 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:25.307642 28677 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.307806 28675 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:25.308842 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:25.309696 29322 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:25.309968  2533 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.310540  2533 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.311717 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2796) took 1675 ms. Trace:
I20260709 12:20:25.312072 28753 rpcz_store.cc:276] 0709 12:20:23.636260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.638551 (+  2291us) service_pool.cc:224] Handling call
0709 12:20:23.639241 (+   690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:23.639654 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.639680 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:25.142449 (+1502769us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b2c0001c1c8. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:25.143270 (+   821us) log.cc:844] Serialized 572 byte log entry
0709 12:20:25.268095 (+124825us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:25.268131 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.268264 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:25.311427 (+ 43163us) raft_consensus.cc:1685] finished
0709 12:20:25.311444 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.311659 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16752000,"thread_start_us":124491,"threads_started":1,"wal-append.queue_time_us":165391}
I20260709 12:20:25.313534  2745 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.314042  2745 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:25.300141  2694 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 12:20:25.318903 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.318722 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.285019  2702 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:25.327050 29319 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:25.327301 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.327760 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:25.328027 29326 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 24: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:25.327780 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:25.323925 28676 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:25.323868 28681 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:25.277933  2727 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:25.324512 28682 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:25.333323 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.333949 28682 raft_consensus.cc:2410] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:20:25.285591  2711 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.337328 28598 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:25.337596 28676 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:25.329252 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:25.335060 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.336284 28605 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:25.338706 29326 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:25.339704 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:25.340468 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:25.345880 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.273586  2505 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.349547 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:25.351011 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.319442  2209 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.354189 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:25.351377 29325 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:25.347630 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:25.341400  2731 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:25.300468  2705 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:20:25.341894  2621 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:25.349910  2823 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:25.360994 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:25.348658  2591 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:25.330113  2739 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:20:25.335806  2357 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:20:25.330288  2729 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:20:25.376983 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:25.381281 28681 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:25.378584  2559 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:25.385172  2807 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.387084  2774 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.352604  2711 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.390015  2603 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:25.390468  2603 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.391461  2711 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.391346  2603 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.378242 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.359218  2575 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.392911 28682 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:25.393440  2575 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:25.357775  2727 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:25.388473  2777 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.396035  2816 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.357887  2533 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.397753 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2706) took 1615 ms. Trace:
I20260709 12:20:25.398133 28680 rpcz_store.cc:276] 0709 12:20:23.782636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.783166 (+   530us) service_pool.cc:224] Handling call
0709 12:20:23.783459 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.959806 (+176347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.959840 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:23.959888 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:23.959932 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.397536 (+1437604us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540024f9d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:25.397595 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:25.397700 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405007232}
I20260709 12:20:25.399564  2505 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.358239  2209 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.404768  2745 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.404902  2390 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.406148  2209 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.379333  2823 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.414722  2314 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.416306 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3134) took 1041 ms. Trace:
I20260709 12:20:25.416806 28601 rpcz_store.cc:276] 0709 12:20:24.375313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:24.666324 (+291011us) service_pool.cc:224] Handling call
0709 12:20:25.416089 (+749765us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54000a6c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:25.416248 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632647040}
I20260709 12:20:25.419366 28677 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:25.421201 28674 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:25.377622 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:25.422331 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.422322 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:25.360987  2621 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.414487 29326 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:25.424677 28677 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:25.429179 28754 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:25.431418 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:25.452039 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.452867 28675 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:25.454118 28673 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:20:25.460584 28681 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:20:25.459792 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 78996.1us
I20260709 12:20:25.464411 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:25.456400  2824 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:20:25.362041  2770 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 12:20:25.457652  2621 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:25.423029  2641 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.475719 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.430773  2591 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:25.470607 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93068.1us
I20260709 12:20:25.407878  2823 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.468582 28720 leader_election.cc:400] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17.
I20260709 12:20:25.481055 28720 leader_election.cc:403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:25.464870  2603 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:25.473089 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:25.473508 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:25.473529 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.484633 29323 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:25.474366 28681 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:25.422516  2737 consensus_queue.cc:1175] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" responder_term: 15 status { last_received { term: 15 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 15 index: 12 } }
I20260709 12:20:25.440667  2705 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:25.456756  2357 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:25.476178 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.476547 29317 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:25.474799 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.478276 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.491600 29319 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:25.479357 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:25.479358 28676 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:25.432044  2511 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:25.479575  2516 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:25.472381 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.498320 28647 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:25.480753  2641 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.498867  2342 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:25.500625  2582 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:25.501463  2342 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:25.483197  2282 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
W20260709 12:20:25.502553  2821 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:20:25.492905  2694 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:20:25.486430  2562 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:20:25.485487 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.506893 29327 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:20:25.471275  2667 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.473290  2463 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:20:25.482296 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:25.493176  2523 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.005s
I20260709 12:20:25.507555 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:25.472952  2314 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:25.485013  2466 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17.
I20260709 12:20:25.505853  2562 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:25.512567 28602 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:20:25.512425 28647 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:25.512955 28602 pending_rounds.cc:85] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 12
I20260709 12:20:25.513219 28602 pending_rounds.cc:107] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:20:25.513437 28602 raft_consensus.cc:2889] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:25.515880  2777 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.517396  2769 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.518849  2463 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:25.519435  2463 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:25.519783  2463 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.520625  2463 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.521317  2740 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:25.521771  2463 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:25.522230  2743 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:25.522341  2740 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:25.522769  2743 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:25.523699  2703 consensus_queue.cc:1175] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" responder_term: 23 status { last_received { term: 20 index: 14 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:25.524611  2569 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:25.524988  2569 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.525143  2499 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:25.525583  2499 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.525835  2569 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.526317  2499 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.527029  2569 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:25.527563  2499 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:25.528585  2591 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.494376  2357 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:25.534551  2783 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.700s	user 0.006s	sys 0.003s
I20260709 12:20:25.535197  2357 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.535004  2783 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.523826  2740 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:25.539544  2759 consensus_meta.cc:287] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.005s
I20260709 12:20:25.541360  2314 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.543547  2314 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.544318 29322 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:25.544541  2693 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:25.545027 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:25.545256  2693 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.546195 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:25.546834  2678 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:25.547343  2678 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.549281  2701 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:25.549685  2701 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:25.550030  2701 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:25.548100  2693 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:25.551844 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:25.552783  2766 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:25.547616 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:25.553011  2739 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:25.494480  2511 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.554374  2739 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:25.554694  2801 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:25.555423  2739 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.506955  2209 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:25.557324  2209 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:25.559275 28675 raft_consensus.cc:2410] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:20:25.565088 29326 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:20:25.565171 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.566277 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.551101  2478 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:25.569438 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:25.573334 29326 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:25.573881 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.575940 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.539985  2759 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.577077 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.597601 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.598244 29320 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:25.598678 29319 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:20:25.599530 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.600327 28749 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:25.488197  2704 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:20:25.512076  2562 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.567875  2511 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:25.585073 29318 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:25.586057 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.590221 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.591043 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:25.614156 29327 raft_consensus.cc:2376] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16. Re-sending same reply.
I20260709 12:20:25.592289 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:25.595799 29323 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:25.551379  2559 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:25.606855 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2704) took 1824 ms. Trace:
I20260709 12:20:25.604133 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.624614 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1771) took 2006 ms. Trace:
I20260709 12:20:25.624712 28747 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:25.625006 29321 rpcz_store.cc:276] 0709 12:20:23.618399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.666104 (+ 47705us) service_pool.cc:224] Handling call
0709 12:20:23.666354 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.813035 (+146681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.624386 (+1811351us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400533ed4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:25.624562 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335879552}
W20260709 12:20:25.583665 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 98378.1us
I20260709 12:20:25.584875 28748 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:25.560019  2760 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:25.496625  2705 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.610460 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.611109 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.611939 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.616532 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.628939 29323 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
W20260709 12:20:25.629879 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.619001 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:25.619938 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.632087 28607 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:25.621594 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:25.627209 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 106323us
I20260709 12:20:25.634361 28748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:25.634922 28748 raft_consensus.cc:606] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:25.635224 28748 raft_consensus.cc:614] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:25.635514 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.635905 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.635270 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.636816 28677 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:20:25.623070 28678 rpcz_store.cc:276] 0709 12:20:23.782018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.784485 (+  2467us) service_pool.cc:224] Handling call
0709 12:20:24.614342 (+829857us) spinlock_profiling.cc:243] Waited 970 us on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aeee 000000000036eb39 00007f6fe89ce1e0 00007f6fe8a970c4 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:20:24.614516 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:25.078634 (+464118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:25.606673 (+528039us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54001bd354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:25.606802 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068111616}
I20260709 12:20:25.628299 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:20:25.636838 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.639240 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.641160 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.641987 28750 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:25.628914 29326 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:25.645859 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.651000 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.655221 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:25.656502 28603 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:20:25.657706 28750 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:25.659056 28600 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:25.660306 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:25.662571 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.663117 28598 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:25.664724 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:25.664794 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:25.665591 28601 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:25.665702 28605 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:25.602882  2505 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.508817  2516 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.600885  2711 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:25.558246  2209 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.640192  2760 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:25.609009  2766 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.620620  2731 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 12:20:25.672123 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:25.575764  2615 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 12:20:25.624193  2478 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:25.684913 28747 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:25.691926 28752 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:25.677497 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.682219 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:25.694327 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:25.622819  2559 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:25.637020  2282 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:25.676779  2569 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:20:25.648591  2737 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:20:25.697378 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.681788 28647 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:25.684273 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:25.738883 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44626.1us
W20260709 12:20:25.719130 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47094.6us
W20260709 12:20:25.729401 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 74285.4us
I20260709 12:20:25.739780 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:25.695070  2776 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:20:25.697132  2693 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:20:25.686343  2774 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:20:25.734300  2769 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:25.711738  2766 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.750496  2559 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.785156  2807 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:25.785578  2559 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.785728  2807 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:25.786085  2766 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.721823  2421 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.721982  2523 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:25.714668  2775 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.786742  2807 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.745819  2806 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.787968  2806 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.727366  2678 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.783342  2701 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.728376  2478 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:25.789947  2806 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.705626  2783 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:25.697620  2711 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.791015  2701 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.793344 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:25.696979  2562 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.765481 28749 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:25.795710 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.711500  2760 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.792606  2711 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.799172 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:25.801136 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.801942 29326 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
W20260709 12:20:25.736747 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.765496 28600 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
W20260709 12:20:25.770637 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 88930.2us
I20260709 12:20:25.773597 28571 leader_election.cc:400] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:25.766067 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:25.812561 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46587.5us
I20260709 12:20:25.750322  2582 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:25.813277  2582 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:25.813537 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:25.816118 29319 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:20:25.817166 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.730026  2759 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:25.752346  2831 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:20:25.759310  2767 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:25.745736  2282 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.780580  2641 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.813694  2582 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:25.778402  2800 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:25.760692  2512 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:25.809199 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:25.762676  2751 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 12:20:25.845002 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:25.849212 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48819.7us
W20260709 12:20:25.912525 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 103407us
I20260709 12:20:25.852602  2767 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:25.861883  2702 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
W20260709 12:20:25.914896 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 243623us
I20260709 12:20:25.818557  2737 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:25.823526  2704 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:25.825915 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:25.853415 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.926539 28752 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:25.886476 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:25.926846 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 101002us
W20260709 12:20:25.843094 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.860661  2806 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:25.858433 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.728585  2357 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 12:20:25.888167 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.858178 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.859133 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.861325  2834 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:25.754629  2705 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:25.905956 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46606.7us
I20260709 12:20:25.906644 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.718616  2621 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:25.911571 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:25.823163  2775 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:25.916676 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:25.798732  2678 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.921489 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:25.902882  2282 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:25.849071  2573 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:25.934883 28752 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:25.857394 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:25.938674 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:25.861023  2667 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:25.910486  2800 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:25.947249 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:25.957829 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.904006  2833 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:20:25.926074  2704 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:25.976814  2777 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.977622 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:25.977686 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:25.977859 29325 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:25.936160  2591 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.978855 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:26.024842 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 86268.8us
I20260709 12:20:25.931713  2737 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.018419 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:26.034919 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:26.021934 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 74758.4us
I20260709 12:20:25.972081  2702 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:25.929629  2569 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
W20260709 12:20:26.025104 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.025583 29319 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:25.924268  2641 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:25.969938  2823 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:20:26.048393 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:26.049860 28751 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:25.954259  2776 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:26.018280 28755 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:26.022271  2704 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:25.949623  2766 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:20:25.969794  2512 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:20:26.035027 28752 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:25.941192  2806 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.027411 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:26.037927 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:25.972050  2678 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:26.039422  2603 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.003s
I20260709 12:20:26.057679 29326 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:26.059710  2739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.016s	sys 0.008s
I20260709 12:20:26.029217  2499 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:26.025661  2573 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:26.065582 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:26.066356 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:26.067575 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.040827  2641 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.102252 28747 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:26.099973 29326 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:26.042047  2702 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:26.038758  2591 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:26.083179 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:25.978883  2511 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.098228 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:26.099591 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:26.106561  2775 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:26.091686 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:26.064684  2776 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:26.013778  2767 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.045374  2122 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:20:26.077253  2816 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.078289  2777 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:26.131214  2837 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:20:26.131786  2342 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:26.080878  2615 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:26.080718  2463 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:26.110316  2641 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:26.111549  2702 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.111949  2774 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:26.142580  2678 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.146168 28748 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:26.088716  2499 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:26.162644  2516 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.167563  2466 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:26.206414  2466 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:26.207422  2466 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.167949  2816 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.210630  2816 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.210743  2833 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:26.211450  2833 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:26.201048  2499 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:26.180096 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 49959us
I20260709 12:20:26.033170  2667 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.219399  2797 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:26.219408  2667 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.225477 29322 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
W20260709 12:20:26.189867 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 90349.5us
I20260709 12:20:26.183099  2593 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:26.183972  2342 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.192591 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.193267  2739 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:26.193411  2357 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:26.080552  2740 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 12:20:26.190896 29319 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:26.230765 28678 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:26.023036  2800 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.240952 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:26.241655 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.250176 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.251935 28755 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:20:26.254452  2357 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:26.178651 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:26.281416 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.288715 29321 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:26.450203  2357 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:26.303160 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.328497 29325 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:26.447583 28755 pending_rounds.cc:85] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 12
I20260709 12:20:26.239583 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.453941  2357 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.343149  2582 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.466886  2801 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:26.467535 28673 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:26.343043  2466 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:26.338380  2562 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:26.249183  2342 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.332095  2575 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:26.329329 29326 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:26.223749 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:26.255904  2739 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.347481  2511 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:26.258821  2593 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.486644  2591 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:26.354421  2743 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:26.488637  2743 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:26.489084 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 310376us
I20260709 12:20:26.491991 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:26.494163 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 270382us
I20260709 12:20:26.495231  2705 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:26.495360  2728 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.495647 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:26.176075  2760 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.348552  2776 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.516886  2775 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:26.517455  2775 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.517872  2775 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:26.520501 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.521430 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:26.525928  2582 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.335278  2621 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.375247  2806 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.533437  2807 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:26.534015  2807 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.534461  2807 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:26.391049  2841 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
W20260709 12:20:26.336555  2843 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:20:26.337375  2845 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:20:26.393590  2842 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:20:26.257627  2833 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:26.460613 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.496166  2728 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.559549  2728 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.471938  2816 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:26.484261  2739 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.574904  2769 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.487816  2593 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.467957  2801 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.491256  2743 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.575915  2769 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.477423  2575 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:26.504779  2797 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:26.501329 28755 pending_rounds.cc:107] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:20:26.544814  2760 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:26.545809 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.551738  2499 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:26.376783  2209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.016s
I20260709 12:20:26.560811  2678 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:26.561700  2559 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:26.563845  2727 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.578915 28755 raft_consensus.cc:2889] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:26.348593  2641 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.578949  2769 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.603650  2499 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:26.595609  2678 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.605788  2749 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:26.608556  2209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.007s	sys 0.016s
I20260709 12:20:26.608405  2749 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.609778  2641 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.614318  2801 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:26.615015 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 842522us
I20260709 12:20:26.593321  2728 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:26.615535 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.619803 28751 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:26.607435 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:26.604125  2727 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.625676 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2814) took 1061 ms. Trace:
I20260709 12:20:26.626578  2727 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.598493  2575 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.632534 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.633054  2575 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.633420 28674 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:26.635898  2737 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.636315 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:26.635092  2517 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:26.642967  2517 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.645732  2517 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.647295 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.647912  2678 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:26.651466 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:26.655172  2517 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:26.655421  2767 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.626317 28754 rpcz_store.cc:276] 0709 12:20:25.564050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.564160 (+   110us) service_pool.cc:224] Handling call
0709 12:20:25.564459 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.216656 (+652197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:26.216699 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:26.216752 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:26.216796 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.625028 (+408232us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400337f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:26.625119 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:26.625394 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499344128}
I20260709 12:20:26.651513  2523 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:26.659675  2523 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.660064  2523 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.665091  2749 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.672236 29325 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:26.672374 29319 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:26.670719  2833 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:26.673205 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:26.673831 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.675650  2742 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:26.676167  2742 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.676636  2742 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:26.680162 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.683360 29320 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:20:26.686932 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:26.688629 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 59997.3us
I20260709 12:20:26.689253 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:26.689771 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:26.693199 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.693514  2743 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:26.694263  2839 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.694563  2505 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.694901  2839 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.695142  2505 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.697738  2505 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.701198  2839 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.703729 28677 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:20:26.690951 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:26.707931 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.709678 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.710513 28674 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:26.658555  2728 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.714450  2728 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.716385 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:26.718271 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.722555 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.724736  2801 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:20:26.726837 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 71625.6us
I20260709 12:20:26.727885 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:26.728673 28680 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:26.728816 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 143104us
I20260709 12:20:26.729357  2701 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:26.729804  2701 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.729882 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:26.731050  2516 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:26.731554 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:26.731762  2516 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.732807  2806 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:26.733028  2816 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:26.733531  2816 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:26.733949  2816 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:26.734490  2516 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.732836  2520 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:20:26.737756 28680 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:26.730173  2701 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:26.739409 28674 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:26.746728 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.747694 28682 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:26.748857  2727 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:26.749296  2282 consensus_meta.cc:287] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.771s	user 0.006s	sys 0.014s
I20260709 12:20:26.749657 28682 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:26.749809  2727 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.750237  2282 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.752213 28679 raft_consensus.cc:2368] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
I20260709 12:20:26.753225 28682 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:26.753487  2727 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:26.753670 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2727) took 1119 ms. Trace:
I20260709 12:20:26.754230 28679 rpcz_store.cc:276] 0709 12:20:25.634496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.635282 (+   786us) service_pool.cc:224] Handling call
0709 12:20:26.753418 (+1118136us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400299354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:26.753606 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565816704}
I20260709 12:20:26.754907 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:26.756002 28677 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:26.762429  2816 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.766155 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:26.766801  2704 consensus_meta.cc:287] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.699s	user 0.013s	sys 0.003s
I20260709 12:20:26.907975  2704 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.766494  2739 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.732134 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:26.703853  2342 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.912705 28750 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:26.914268 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 3163) took 1094 ms. Trace:
I20260709 12:20:26.914403  2342 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.914682 28750 rpcz_store.cc:276] 0709 12:20:25.820044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.887765 (+ 67721us) service_pool.cc:224] Handling call
0709 12:20:26.914024 (+1026259us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540003e154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:26.914190 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238213376}
W20260709 12:20:26.776583 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48807us
W20260709 12:20:26.915449  2859 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.006s
I20260709 12:20:26.916587 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:26.917172 28756 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:26.917481 28673 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:26.779481  2641 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:26.780108  2749 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:26.780988 28748 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:20:26.781333 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 91772.8us
I20260709 12:20:26.789080 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:26.790540  2742 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.796968 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:26.922537 28680 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:26.803654 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:26.922850  2282 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.923557  2742 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.805415  2800 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.926270  2800 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.807310 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.927251 29325 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:26.928227 28676 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:26.930037 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2729) took 1294 ms. Trace:
I20260709 12:20:26.930375 28676 rpcz_store.cc:276] 0709 12:20:25.635140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:25.636247 (+  1107us) service_pool.cc:224] Handling call
0709 12:20:25.795315 (+159068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:26.928652 (+1133337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:26.929314 (+   662us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003e21d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:26.929802 (+   488us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54003e21d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:26.929954 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2969608704}
I20260709 12:20:26.700419 29326 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:26.841214  2523 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.934350  2523 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.935137  2621 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.935721  2621 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:26.873435  2860 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:20:26.812508 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:26.938700  2702 consensus_meta.cc:287] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.688s	user 0.020s	sys 0.000s
I20260709 12:20:26.940985 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:26.941768 28756 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:26.942384 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:26.944672 28750 raft_consensus.cc:2393] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:26.946201  2520 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:26.947223  2520 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:26.948608  2520 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.950008  2816 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:26.950497 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.950870  2816 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:26.912086  2704 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:26.912153  2739 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.921484 29320 raft_consensus.cc:2368] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
W20260709 12:20:26.953472 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 221436us
I20260709 12:20:26.955019 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:26.955827  2593 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:26.961637 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:26.962239 28682 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:26.963311 28750 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:26.921765 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:26.965480 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 43864.4us
I20260709 12:20:26.959012  2701 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.804131 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:26.912626 28498 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 11 to 15, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 15 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:26.952221  2767 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:26.966820 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:26.967408  2749 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:26.923687 29318 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:26.906729  2807 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.969499 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:26.956605  2816 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.974967 28750 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:26.969564  2593 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:20:26.984740  2777 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:26.985440  2593 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:26.985942  2593 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:26.986927  2593 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.987852  2816 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:26.988029 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:26.969666  2767 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:26.989571 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:26.990056  2767 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.991384  2800 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:26.985495  2777 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:26.993687  2777 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:26.996284 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.996865 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:26.998555  2839 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:26.998488 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:26.977159  2775 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.000423 29320 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:27.001645 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:27.002140  2775 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:27.003644  2621 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:26.996266  2739 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:20:27.004387 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:27.004604 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:27.005178 28680 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:27.005980 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:27.012537  2523 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:27.013325  2523 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:27.013403 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46759.9us
I20260709 12:20:27.012697  2705 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.015056 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.015137  2705 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.015687 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:27.016147 28750 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:27.016561 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:27.017082  2775 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:27.016582  2517 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:27.017738  2775 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:27.018345  2517 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.019106  2775 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:26.939280  2702 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.017848  2593 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:27.012985 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 200830us
I20260709 12:20:27.028007 28748 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:27.026495 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:27.027557 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:27.031436 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 55060.2us
I20260709 12:20:27.032506 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:27.027647  2839 raft_consensus.cc:2764] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:20:27.034344  2702 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.035516 29318 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:26.984905  2701 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.036428 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:27.037452 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.039948 28682 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:27.039186  2801 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:27.042452  2801 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.044449 28753 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:27.044736 29320 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:27.045354 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:27.046645  2704 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.048960  2704 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.050249  2342 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:27.050843  2342 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:27.050910 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:27.051479  2704 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.051827  2641 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:27.051872  2342 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.055303  2801 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:27.052309  2641 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:27.063283  2641 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:27.065570 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.060127 28498 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 15, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 15 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.039428  2816 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:27.073982 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.074729 28749 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:27.074864  2517 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:27.075904 28754 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:27.077167  2523 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:27.074796 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.078836 28756 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:27.080634 28750 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.086823 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:27.087648 28756 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:27.090291 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.092028  2702 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.093519 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:27.094755  2209 raft_consensus.cc:2764] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:20:27.099392 28647 leader_election.cc:400] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:27.099821 28647 leader_election.cc:403] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:20:27.105650 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:27.069259  2816 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:27.110654 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.111478 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.095454  2702 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.117012 28753 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:27.114037 28754 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:27.060917  2728 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:20:27.136005 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:27.103933  2769 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.107323  2749 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:27.147423 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:27.097138  2839 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:20:27.116029  2816 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:27.165912 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.159703  2523 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:27.171721 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:27.175275 28682 raft_consensus.cc:2368] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
I20260709 12:20:27.170287 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:27.176136 28753 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:27.171613  2466 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 12:20:27.162093  2797 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:27.181061 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:27.181875 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.163831  2739 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:27.162295  2807 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.161897  2421 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:20:27.186021 28756 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:27.188553 28498 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.188762  2739 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:27.209836  2739 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:27.210451  2705 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.191386  2466 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:20:27.213064  2702 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:27.198472 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:27.215577 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68395.3us
I20260709 12:20:27.213382 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:27.187028  2769 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.199681 28749 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:27.203030 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.202502 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.204914 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.200450 28720 leader_election.cc:400] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
I20260709 12:20:27.257287 28747 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:27.259238 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:27.259883 29318 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:27.256847 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:27.216372  2421 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:27.264863 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.268210 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:27.198527  2801 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:27.254587  2839 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:27.274147 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.279909 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.191962  2523 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:27.199543  2797 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:27.283941 28607 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:27.277190  2728 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.271970  2742 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.284770 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.297467 28673 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:27.284229 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.300463  2520 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.304155  2833 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.267195  2727 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 12:20:27.302268 28748 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:27.277201 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:27.315532 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:27.270996  2705 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.252565  2704 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:20:27.319615 28753 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
W20260709 12:20:27.320251 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 128250us
I20260709 12:20:27.315287  2728 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.338219  2562 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:27.340374  2728 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:27.332994  2520 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.351336  2520 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:27.352794  2705 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.354549 28600 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:27.357244 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.358201 28601 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:27.358094 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.358929 28605 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:27.359444 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.360249 28603 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:27.360973 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:27.361459 28606 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:27.361588 28599 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:27.358937 28598 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:27.365070 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:27.369140 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.370011 28602 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
W20260709 12:20:27.371268 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54959.1us
I20260709 12:20:27.313407  2742 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.380306 29318 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
W20260709 12:20:27.388553 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.329622  2743 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:27.284024  2801 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.412395 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.418412 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.417979 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.420487 28676 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:27.420918 28678 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:27.427393 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:27.433780  2742 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.434054  2621 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:27.434984  2702 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:27.435631  2769 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:27.316411  2839 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.435570  2702 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:27.412967  2743 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.336199  2833 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.442461 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.450214 28754 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:27.440037 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:27.462525 28607 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:27.441237 28498 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 13 to 14, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 14 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.410856  2816 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.468003 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.468650  2816 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.469949 28605 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:27.470676 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:27.471891 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.436398  2769 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:27.392252  2705 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.448341 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:27.477872 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.448825  2743 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:27.443640 28504 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 307) took 71525 ms (client timeout 15000 ms). Trace:
I20260709 12:20:27.480082 28676 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:27.477632 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.478420 28606 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:27.481204 28603 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:27.442613  2839 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:27.486006 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.439380  2801 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:27.453504  2833 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:27.478840  2863 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.270s	user 0.006s	sys 0.000s
W20260709 12:20:27.478967  2865 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.117s	user 0.000s	sys 0.002s
I20260709 12:20:27.497553 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.488349 28498 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 4 to 10, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 14 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.484833  2421 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:27.521539 28604 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:20:27.491623  2575 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:27.528234  2641 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.443087  2702 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.439595  2523 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.411118  2797 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.537318 28601 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:27.480077 28504 rpcz_store.cc:269] 0709 12:19:15.918367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.925861 (+  7494us) service_pool.cc:224] Handling call
0709 12:20:27.443317 (+71517456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:23.616669 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:23.794672 (+178003us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:23.794725 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:20:23.794743 (+    18us) tablet.cc:662] Decoding operations
0709 12:20:23.795463 (+   720us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:23.795569 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:23.795610 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:20:23.796140 (+   530us) tablet.cc:701] Row locks acquired
0709 12:20:23.796209 (+    69us) write_op.cc:260] PREPARE: finished
0709 12:20:23.796424 (+   215us) write_op.cc:270] Start()
0709 12:20:23.833166 (+ 36742us) write_op.cc:276] Timestamp: P: 1783599623796343 usec, L: 0
0709 12:20:23.834864 (+  1698us) op_driver.cc:348] REPLICATION: starting
0709 12:20:23.958823 (+123959us) log.cc:844] Serialized 1326 byte log entry
0709 12:20:24.593747 (+634924us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b
0709 12:20:25.339341 (+745594us) op_driver.cc:464] REPLICATION: finished
0709 12:20:25.558855 (+219514us) write_op.cc:301] APPLY: starting
0709 12:20:25.570563 (+ 11708us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:25.813699 (+243136us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:25.813726 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:25.815587 (+  1861us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:25.815762 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:20:25.815806 (+    44us) write_op.cc:312] APPLY: finished
0709 12:20:25.816010 (+   204us) log.cc:844] Serialized 41 byte log entry
0709 12:20:25.816180 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:25.816273 (+    93us) write_op.cc:454] Released schema lock
0709 12:20:25.816317 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:25.919214 (+102897us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:25.928012 (+  8798us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4307986,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":149960,"apply.run_cpu_time_us":6721,"apply.run_wall_time_us":398997,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16637,"num_ops":3,"prepare.queue_time_us":209236,"prepare.run_cpu_time_us":36579,"prepare.run_wall_time_us":1529521,"raft.queue_time_us":184245,"raft.run_cpu_time_us":15722,"raft.run_wall_time_us":181338,"replication_time_us":1479892,"spinlock_wait_cycles":6822784,"thread_start_us":1489805,"threads_started":4,"wal-append.queue_time_us":1089108,"wal-append.run_cpu_time_us":28250,"wal-append.run_wall_time_us":1920532}]]}
I20260709 12:20:27.486943  2769 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.547435 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.517961  2833 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:27.555960 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 232812us
I20260709 12:20:27.568064 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:27.545097 28498 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 17, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.546561 28605 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:27.591187 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:27.536947  2739 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:27.592294 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 154822us
I20260709 12:20:27.593384 28677 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:27.543901  2816 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:20:27.602676 29318 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:20:27.584504  2702 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:27.602855 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:27.602540 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:27.606415 28605 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 12:20:27.610549 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.613152 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.613504 29320 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:20:27.614080 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:27.591607  2839 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.621963 28599 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:27.623869 28602 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:27.632771 29325 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:27.606135  2704 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:20:27.639886 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51306.5us
I20260709 12:20:27.640286 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.647136 28754 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:20:27.591750  2833 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:27.651021 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48246.7us
I20260709 12:20:27.660768 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:27.652608 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 267053us
I20260709 12:20:27.582551  2575 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.678809  2575 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:27.641541  2520 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:20:27.641109  2875 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 12:20:27.675854  2842 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:20:27.676292 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:27.676648  2641 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:27.633141  2874 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:20:27.679526 29325 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:27.681401 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:27.701556 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 228146us
I20260709 12:20:27.623754 28498 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.685954 28573 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:27.696426 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.721499 28720 leader_election.cc:400] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
I20260709 12:20:27.700208 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:27.722482 28756 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:27.675256 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:27.699458 28755 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:27.643623  2801 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.724352 28752 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:20:27.724586 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.725484 28754 raft_consensus.cc:2410] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:27.722849 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:27.729570 28498 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 17, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.718479 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.737947 28605 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:20:27.747078 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 373947us
I20260709 12:20:27.741616 28498 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 13, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 13 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.612545  2421 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.746282 29327 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:27.728323  2562 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:27.731894  2749 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:27.745085 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.751225 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.751405 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.751940 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:27.649231  2839 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.755949 28682 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:27.718572  2704 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:27.761169 28678 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:27.762750 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.764024 29290 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:27.764770  2877 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:27.765375  2877 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.766196  2575 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:27.767617  2877 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:27.772675 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 86835.9us
W20260709 12:20:27.758430 29292 leader_election.cc:336] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.532s (SENT)
I20260709 12:20:27.775058 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:27.753928  2816 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:27.789098 28498 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 15, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 15 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.767949  2575 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:27.735360  2801 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:27.800932 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:27.813988 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:27.815913 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:27.809716 28498 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 12, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 12 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.821725 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:27.822898 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:27.827009 28605 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:20:27.818609  2883 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.090s
W20260709 12:20:27.831027 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 154819us
I20260709 12:20:27.830209 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:27.845835  2880 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:27.847759  2881 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:20:27.848702  2593 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:27.849216  2593 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:27.849704  2593 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:27.821102  2520 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:27.852785  2520 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:27.853394  2520 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:27.823500  2728 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:27.855022  2728 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.855473  2728 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:27.821085  2517 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:20:27.861017  2727 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:27.861593  2727 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:27.862776  2727 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.829236  2767 raft_consensus.cc:2764] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:20:27.866274  2767 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:27.868918 28754 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:20:27.869324 28754 pending_rounds.cc:85] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 10
I20260709 12:20:27.869529 28754 pending_rounds.cc:107] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:20:27.869748 28754 raft_consensus.cc:2889] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:27.872360 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:27.874702 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:27.876616 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:27.877490 28756 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:27.879128 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 127116us
W20260709 12:20:27.880337 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 114695us
I20260709 12:20:27.830303 28498 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 13 to 15, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 15 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.832789  2816 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:27.820971  2705 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:20:27.846225  2883 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.837405  2739 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:27.915778 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.882776 28498 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index -1 to 11, term changed from 11 to 19, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129), NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 19 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:20:27.884980  2801 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:27.924925 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.925302 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.882396  2621 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.926309  2621 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.939149 28498 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.900998  2769 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:27.941810 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:27.942436 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.943318 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:27.948153 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:27.948836 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.948695 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:27.948235 28605 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:20:27.950111 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.951834 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:27.953400 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 116547us
I20260709 12:20:27.957084 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:27.957834 28751 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:27.935506  2833 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:27.929981  2883 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.977141 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:27.975348 28498 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 15, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 15 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.980986 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:27.884826  2704 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:27.987339 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:27.988152 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47572.3us
I20260709 12:20:27.990613 28498 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.996843 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:27.999995 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:28.001996 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:27.997736 28603 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:28.005079 28756 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:20:28.006033 28750 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:27.979188  2896 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.985452  2562 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:28.005985 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 133702us
I20260709 12:20:28.008172 28498 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:27.987821  2760 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:28.013016 28573 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:27.993083  2517 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:28.018283 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.019126 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:28.004132  2739 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:28.019183 28601 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:28.004278  2899 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:20:28.024964  2890 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:20:28.027659 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:28.029033  2743 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260709 12:20:28.028839 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.087111 28599 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:28.029729  2901 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:28.029665 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.012625  2896 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.030580 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.088546 28751 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:28.030789  2705 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:28.083894 28498 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 9 to 18, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:28.107537 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:28.108001 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.109120 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:28.114265 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 114345us
I20260709 12:20:28.110008 28601 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:28.126410 28498 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:28.149158 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.092949  2871 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:28.161921  2871 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:28.153862 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.162643  2421 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:28.154691 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.116612  2641 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:28.166162 28751 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:28.020295  2562 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.163220  2593 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.169697 28498 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 13 to 14, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 14 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:28.147130  2705 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:28.155467 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:28.111178  2899 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:28.158497  2906 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:28.093451  2743 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.189399 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:28.189518  2743 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:28.175617 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:28.190286  2775 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:28.191198 28748 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:28.175807 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:28.179183  2894 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:20:28.180070  2593 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:28.181685  2897 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:20:28.181169  2899 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.174182  2641 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:28.164044  2739 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:28.190729  2775 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:28.163216  2421 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.192528  2742 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:28.192961 29326 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:20:28.193149  2833 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:28.193881  2769 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:28.194391  2892 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:28.196064  2466 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.197036  2896 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:28.198253  2895 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:20:28.092909  2702 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.200626 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:28.201368 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 104761us
I20260709 12:20:28.288125 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:28.203012  2767 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.206159 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:28.213712 28498 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:28.289192  2767 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.290512 28498 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:28.291918  2767 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:28.292192 28498 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 11 to 14, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 14 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:28.293905 28498 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:28.219372 28756 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:28.231876  2760 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:28.297039  2760 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:28.247771 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:28.298260 29318 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:28.298651 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:28.300208 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 99641.4us
I20260709 12:20:28.253690 28675 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:20:28.255221 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 121765us
I20260709 12:20:28.202108  2880 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:28.204279  2839 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:28.304028 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:28.282461 28599 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:28.283901 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:28.304076 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 284983us
I20260709 12:20:28.248764 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:28.305903 29325 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:28.250669  2883 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:28.299654 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:28.308014 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:28.311748 28756 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:28.310320  2880 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.314600  2520 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.315917  2880 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:28.280875  2621 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:28.339098 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.349014 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:28.349154 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 61157.2us
I20260709 12:20:28.303587  2743 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:28.283507  2466 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.321388 28604 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:28.311014 28606 raft_consensus.cc:2376] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13. Re-sending same reply.
I20260709 12:20:28.349592 29318 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:28.274113  2593 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:20:28.363258 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.318346  2769 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:28.378909 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 396420us
I20260709 12:20:28.368877 28599 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:28.381537 28755 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:28.389899 28756 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:28.371223 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:28.302923  2702 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.360126  2896 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:28.360591  2915 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:28.369354  2895 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:28.398070 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:28.362726  2907 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.378664  2871 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.325132  2705 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.393697  2520 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:28.434019  2884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.026s
I20260709 12:20:28.439597 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.429483  2523 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:28.442533  2421 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:28.442759  2728 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.000s
I20260709 12:20:28.447166  2902 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:28.448462 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.450088  2801 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:28.452996  2466 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:28.454855  2816 consensus_meta.cc:287] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 12:20:28.456401 28756 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:20:28.440393  2911 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:20:28.458501 28606 raft_consensus.cc:2368] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:28.445310 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:28.488165 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:28.488715 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43679.2us
I20260709 12:20:28.434682  2896 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:28.399161  2641 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.473313 28599 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 13: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:28.470163  2884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.010s	sys 0.026s
I20260709 12:20:28.383453  2739 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.488950 28755 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:28.491236 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:28.472892 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 101933us
I20260709 12:20:28.394325  2775 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.457523  2915 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.494946 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:28.483872  2801 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:28.461099 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 151833us
I20260709 12:20:28.487596  2816 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:28.507690 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2856) took 1035 ms. Trace:
I20260709 12:20:28.508723 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.501710  2562 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:28.510113 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:28.502466 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:28.512871 28756 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:20:28.513206 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:28.513824 28606 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:28.514860 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:28.491671  2466 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:28.483004  2728 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.501991  2884 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:28.508796  2926 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:28.468912  2907 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.520700 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:28.525657 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:28.527809 28755 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:28.530090 28750 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:28.532836 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:28.508329  2517 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:28.534926 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:28.535691 28599 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 18
W20260709 12:20:28.538877 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 53791.7us
I20260709 12:20:28.540043  2935 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:28.512359  2914 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:28.511487  2923 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:28.517318  2562 raft_consensus.cc:2764] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:20:28.524607  2775 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:28.547356 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:28.559383 28756 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:28.518214  2466 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.550113 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:28.546533 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:28.524739  2926 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:28.530330  2884 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:28.563480 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 47857.3us
I20260709 12:20:28.548952  2769 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:28.568691 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:28.547895  2886 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.549512  2742 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:28.561506  2935 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:28.587952 28601 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:20:28.574452 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:28.577719 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:28.579388  2922 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:20:28.574658  2562 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:28.555190  2923 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.598452  2923 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:28.588410  2915 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:28.600005 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58639.7us
I20260709 12:20:28.561869  2466 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:28.612030 28648 leader_election.cc:400] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:28.521708  2902 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:20:28.613289 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:28.578637  2925 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:20:28.563694  2743 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:28.569777  2769 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:28.596944  2935 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:28.576929  2928 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:28.556459  2801 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.636790  2935 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.637828  2801 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:28.638160  2935 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:28.639923 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.640621  2880 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:28.615535  2915 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:28.641419 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:28.642387  2930 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:20:28.577329  2917 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:28.643603  2917 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.644786  2807 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:28.596266  2742 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.585085  2728 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:28.617756  2562 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:28.630815 28602 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:20:28.632802 28600 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:28.632973 28606 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
W20260709 12:20:28.635725 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 61338.8us
I20260709 12:20:28.636864 28604 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:28.657862 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:28.641207  2880 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.645215  2807 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:28.626713  2884 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.627677  2926 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.626134  2907 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:28.642513 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:28.657613 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:28.663416 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.664076 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.646608  2769 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:28.643620  2899 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:28.665431 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.561990  2896 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:28.681007 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 317164us
I20260709 12:20:28.648178  2742 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:28.694031 28599 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:28.706321 28682 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:28.706966 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.705986 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:28.713095 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:28.708251 28674 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:28.709515 28676 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:28.683036 28601 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:20:28.712469 28679 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:28.711565 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:28.715782 28680 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:28.600111  2886 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.670898  2575 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.624809  2743 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.721311  2937 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:28.721693  2886 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:28.722043  2743 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:28.723212 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 197282us
I20260709 12:20:28.680182  2915 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:28.721745  2937 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:28.728535 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 53063.6us
I20260709 12:20:28.705967  2704 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:28.563652  2914 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.718573 28751 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:28.659010  2523 raft_consensus.cc:2764] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:20:28.709136  2899 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.712548  2883 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:28.765560 29292 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:28.722379  2916 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:20:28.730651  2937 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:28.770797  2739 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:20:28.776623  2742 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:28.778525 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70749.2us
I20260709 12:20:28.747144  2884 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:28.727761  2917 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:28.760731  2883 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:28.781929 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:28.760890  2899 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:28.722930  2575 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.722882  2705 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:20:28.730715  2906 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:20:28.800077 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:28.735993 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:28.812083 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:28.812505  2883 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:28.746707  2915 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.813023 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:28.719796  2871 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 12:20:28.780558  2910 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:28.872543 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:28.898909 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:28.895893 29321 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:28.879139  2943 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:28.902889 28750 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:20:28.905586 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:28.887095  2704 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:28.914141 28748 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:28.884320 28751 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:20:28.873394 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:28.890715 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.889207  2593 consensus_queue.cc:1243] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:20:28.914743 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 101786us
I20260709 12:20:28.906666  2641 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:28.918701  2641 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:28.919063  2641 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:28.919540  2641 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:28.900878  2948 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:20:28.918725  2742 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:28.921201  2889 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:28.921693  2889 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:28.921738  2948 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:28.922207  2948 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:28.922252 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.922586  2889 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:28.923487 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.923640  2889 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:28.924448  2816 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:20:28.925325 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.926487 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.927767 28607 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:20:28.923130  2948 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:28.918965 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:28.964246  2933 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
W20260709 12:20:28.970166  2942 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:20:28.969797  2704 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:28.971757  2945 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 12:20:28.973393  2938 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:20:29.027834 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 122319us
I20260709 12:20:29.036175 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.036690 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:29.036944 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:28.932963  2621 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:20:29.051321 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.058596 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:29.061775 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 381008us
I20260709 12:20:29.063414 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.064044 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:28.976765  2880 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:29.065004 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:29.053341 29292 connection.cc:256] RPC call timeout handler was delayed by -1.0733141829998658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 12:20:29.085783 29292 connection.cc:256] RPC call timeout handler was delayed by -1.0409141829998134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:20:29.086223 29292 connection.cc:256] RPC call timeout handler was delayed by -1.0337141829998018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 12:20:29.068702 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:29.079614 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:29.088997 28751 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:29.047622  2902 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.070539  2749 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.108804  2935 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:29.109383  2935 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:29.110348  2935 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.111433  2727 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.108560  2927 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:29.113155  2927 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 12:20:29.113791  2944 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 12:20:29.113174  2947 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:29.116876 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.117506  2877 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:29.118203  2877 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:29.088973  2948 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.090978  2943 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:29.119829 29292 leader_election.cc:336] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.852s (SENT)
I20260709 12:20:29.117619 28602 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:29.107249 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:29.128194 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:29.101320  2621 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:29.178812 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 293801us
I20260709 12:20:29.102778  2914 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.179668 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:29.105858  2951 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:29.190688 28673 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:29.130276  2906 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:29.209561 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:29.213094 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 142147us
I20260709 12:20:29.215544  2965 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:29.102535  2902 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.119818  2749 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.119161  2466 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.187870  2927 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:20:29.223120 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.229324 29323 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:20:29.229074 28722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.999s (SENT) [suppressed 9 similar messages]
I20260709 12:20:29.223150  2950 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.216742  2705 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:29.241498 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.180536  2917 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:20:29.244982 28601 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:29.220425  2575 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:29.216147  2965 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.249547 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:29.233482  2968 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:29.253013  2968 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.255352  2968 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.258215  2593 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:29.258652  2593 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:29.259605  2593 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:29.260681 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 160309us
I20260709 12:20:29.194074  2914 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:20:29.260847  2958 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:29.223351  2915 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.267582  2958 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:29.268098  2775 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.000s
W20260709 12:20:29.270615  2801 consensus_meta.cc:287] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.632s	user 0.002s	sys 0.006s
I20260709 12:20:29.242237  2743 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:29.270766  2760 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.973s	user 0.009s	sys 0.003s
I20260709 12:20:29.271211  2743 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.271379  2760 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.233474  2621 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.201718  2951 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.275421  2951 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.178952  2943 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.273620  2743 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.262754 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:29.268026  2958 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:29.277279 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:29.306964 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44230.1us
I20260709 12:20:29.249300  2704 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:29.267971  2959 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:20:29.266629  2923 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.000s
I20260709 12:20:29.273622  2749 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:29.323074  2769 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.000s
I20260709 12:20:29.323477  2923 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.310525  2593 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.264528  2641 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.324402  2965 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:29.312011  2833 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:29.311690  2421 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:29.241514  2950 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.320082  2760 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.327286  2839 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:20:28.508378 28598 rpcz_store.cc:276] 0709 12:20:27.471957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.488859 (+ 16902us) service_pool.cc:224] Handling call
0709 12:20:27.526556 (+ 37697us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:27.527020 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:20:27.779874 (+252854us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.253321 (+473447us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:28.456518 (+203197us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b2c00058028. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:28.474254 (+ 17736us) log.cc:844] Serialized 52 byte log entry
0709 12:20:28.474420 (+   166us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:28.474654 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 12:20:28.486204 (+ 11550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:28.486296 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:28.507446 (+ 21150us) raft_consensus.cc:1685] finished
0709 12:20:28.507467 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:28.507608 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58983,"prepare.queue_time_us":325659,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2468,"raft.queue_time_us":117846,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":1573,"spinlock_wait_cycles":9776256,"thread_start_us":615495,"threads_started":2,"wal-append.queue_time_us":501722}
I20260709 12:20:29.341252 28600 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:29.230197  2877 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:29.352454 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 123388us
I20260709 12:20:29.315977  2704 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.348690  2421 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.361569  2943 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.361843  2702 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.365025 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.367290 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:29.369199  2421 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.370421 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.374738 28599 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:29.380128 28752 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:29.329576  2769 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.384240 29318 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:29.385563  2797 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:29.385972  2797 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:29.386459  2950 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.386860  2797 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.388121  2797 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.351755  2833 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.390116 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.391321 28602 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:29.376389  2884 consensus_meta.cc:287] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.004s
I20260709 12:20:29.357578  2896 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:20:29.358795  2907 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:20:29.393855  2902 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.397109 29323 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:29.383222  2889 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:29.404537  2466 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:29.405323  2704 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.407027  2641 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:29.407681 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.408272  2917 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:29.408768  2917 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.410847  2917 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:29.411135  2877 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:29.412539  2926 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.419977  2833 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:29.422904  2899 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.004s
I20260709 12:20:29.423521  2899 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:29.425112  2883 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.002s
I20260709 12:20:29.425683  2883 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.426667 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:29.430073  2923 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:29.430186  2969 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:20:29.432791 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.433442 28602 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:29.388151  2769 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.449236 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:29.451320 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.452809 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.454034 28601 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:29.455018 28750 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:29.455276 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:29.413432  2641 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.456725 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:29.457901 28598 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.446434  2883 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:29.459759 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.461972 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:29.526439 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.529667 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.530253 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:29.530901 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60860.4us
I20260709 12:20:29.529846 29318 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:29.533527 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:29.534161 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 174888us
I20260709 12:20:29.534358  2883 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:29.535018 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:29.454522  2906 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:29.462867  2923 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:29.540037  2896 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:29.528129  2892 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:29.546370 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:29.541877 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.529739  2904 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:29.460000  2641 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:29.552649 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.558152 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.567101 28603 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:20:29.567863 28752 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 3180) took 1351 ms (client timeout 1695 ms). Trace:
I20260709 12:20:29.591440 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:29.537564  2884 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:29.549319 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.601264  2704 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:29.601966 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.602559 28679 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:29.595654 28603 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:29.602909 28601 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:20:29.603345 28601 pending_rounds.cc:85] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 12
I20260709 12:20:29.603569 28601 pending_rounds.cc:107] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:20:29.603853 28601 raft_consensus.cc:2889] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:29.604523  2904 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.603529 28603 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.605563 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.606117 28603 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:29.606168 28677 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:29.538525  2562 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.607156  2562 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.607506  2807 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.609340  2562 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:29.609849  2562 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:29.610180 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.610818 29321 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:29.611405 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.612448 28673 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:20:29.612798 28673 pending_rounds.cc:85] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 8
I20260709 12:20:29.613019 28673 pending_rounds.cc:107] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:20:29.613242 28673 raft_consensus.cc:2889] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:29.615269  2958 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.616847  2883 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:29.618995 28680 raft_consensus.cc:1217] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Deduplicated request from leader. Original: 16.9->[18.10-19.11]   Dedup: 18.10->[19.11-19.11]
I20260709 12:20:29.619501 28680 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: [18.10-19.11]
I20260709 12:20:29.565560  2899 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.566819  2421 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.622017 28603 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:20:29.622359 28603 pending_rounds.cc:85] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 10
I20260709 12:20:29.622557 28603 pending_rounds.cc:107] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:20:29.622762 28603 raft_consensus.cc:2889] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:29.622888  2421 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:29.623319  2924 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:20:29.550680  2910 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:29.623836  2910 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:29.624195  2910 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:29.604781 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.624754 28682 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 13.
I20260709 12:20:29.624693  2906 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.628420  2930 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:29.568856  2923 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.555817  2833 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.629534  2833 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.630544  2923 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.631847  2833 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.632237  2621 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:29.632682  2621 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:29.628942 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:29.633476  2621 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.634455 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:29.634904  2621 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:29.596726 28752 rpcz_store.cc:269] 0709 12:20:28.249796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.271790 (+ 21994us) service_pool.cc:224] Handling call
0709 12:20:29.567695 (+1295905us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002d69d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:29.567807 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350843264}
I20260709 12:20:29.635772  2928 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:29.636209  2928 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.636823  2950 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:29.633850  2816 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:29.637320  2950 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.637753  2816 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:29.638352  2816 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.639400  2950 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.641744  2889 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:29.560336  2954 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:20:29.600834  2884 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.648487  2884 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:29.649791 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.636561  2928 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.650436 28599 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:29.650445  2912 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.651670  2912 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.654453  2912 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:29.658177  2937 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.858s	user 0.011s	sys 0.000s
I20260709 12:20:29.658617  2937 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.659686 28750 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: [21.15-23.16]
I20260709 12:20:29.660837 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:29.661194 28749 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:29.661819  2816 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.664325 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:29.668735 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.669359 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:29.669584 28602 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 12:20:29.670434  2979 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
W20260709 12:20:29.648145 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.602627 28605 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:29.601801  2704 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:29.673166 28607 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:29.637600  2641 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.676415 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3171) took 1296 ms. Trace:
I20260709 12:20:29.677772 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:29.684790 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.678619 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.687290 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.687719 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:29.688416 28752 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
W20260709 12:20:29.678573 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44198.7us
I20260709 12:20:29.684109 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.690701 28571 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:29.685992 28603 rpcz_store.cc:276] 0709 12:20:28.380451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.633965 (+253514us) service_pool.cc:224] Handling call
0709 12:20:28.634344 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:29.566997 (+932653us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540015d220. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f6dc0 00007f6fe3a811c0 00007f6fe3a82231 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c
0709 12:20:29.623141 (+ 56144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.676362 (+ 53221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755797248}
I20260709 12:20:29.692215 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.693534 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.694283 28674 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:29.698691 28681 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:29.698938 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.699338 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1390) took 1037 ms. Trace:
I20260709 12:20:29.700389 28750 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:29.702899 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.705601 28603 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:29.705972 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.628836  2807 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:29.709236 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.711030 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:29.699662 28681 rpcz_store.cc:276] 0709 12:20:28.662373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.662480 (+   107us) service_pool.cc:224] Handling call
0709 12:20:29.698317 (+1035837us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800023a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aeee 000000000036eb39 00007f6fe89ce1e0 00007f6fe8a970c4 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:20:29.698465 (+   148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:29.699107 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.699285 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2673792}
I20260709 12:20:29.594625  2892 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:29.719063 28756 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:29.724288 28749 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:29.726138 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.727140 28599 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:29.727742 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.728204 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.728552 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:29.725965 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.736323 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.737062 28679 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.741526 28599 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:29.744411 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:29.671836 28753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:29.745352 28753 raft_consensus.cc:606] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:29.745791 28753 raft_consensus.cc:614] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:29.730090 29319 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:29.747845 28680 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:29.748559 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 202260us
I20260709 12:20:29.756796 28676 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25. Ops: []
I20260709 12:20:29.718673  2912 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.721520  2892 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:29.760133 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.724735  2903 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:29.762094 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3168) took 1479 ms. Trace:
I20260709 12:20:29.762490 28604 rpcz_store.cc:276] 0709 12:20:28.277392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.630143 (+352751us) service_pool.cc:224] Handling call
0709 12:20:28.630495 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:28.658013 (+ 27518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:29.748848 (+1090835us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b54000bed54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:29.756336 (+  7488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13996160}
I20260709 12:20:29.769191 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:29.770176 29323 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:29.771262 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.722254  2899 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:29.774659 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.775372 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.762511 29318 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:29.774233 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.794404 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.795053 28673 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:29.795933 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.796413 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:29.793890 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.798581 28680 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.801105 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:29.721977  2943 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:20:29.806384 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:29.775954  2903 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.804850 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:29.744915  2702 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:20:29.829257 29321 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.830616 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:29.840667 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.845453 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.844729 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:29.815164 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.851261 28676 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:29.807312  2883 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:29.858124 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 97482us
I20260709 12:20:29.862290 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.864142 28681 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:29.826201  2903 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:29.832022  2880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.013s
I20260709 12:20:29.823477  2924 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.850457  2562 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:29.862263 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:29.794796  2899 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:29.892678 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.921658 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.875998  2704 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:29.791666  2912 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:29.931420  2912 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:29.805091  2928 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:29.909685 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:29.919262 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.928733 28681 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:29.882231  2816 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:29.936532  2621 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:29.929303  2466 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:29.941048  2562 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:29.934862  2928 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.943284  2928 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:29.946242 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 84057.8us
I20260709 12:20:29.946898  2816 consensus_queue.cc:1059] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:29.882234  2956 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.671s	user 0.004s	sys 0.000s
I20260709 12:20:29.970103 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:29.970731 28756 raft_consensus.cc:606] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:29.971036 28756 raft_consensus.cc:614] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:29.861326  2883 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.859586  2968 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:29.953764 28679 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:29.953878 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:29.955461 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:29.985016 28676 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.961350  2904 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:29.804672  2833 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
W20260709 12:20:29.897920  2880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.014s	sys 0.020s
I20260709 12:20:29.972940 28673 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:29.950443 28680 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:29.990310 29321 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:20:29.990504 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:29.994472 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:29.992352 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:29.995784 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:29.858899  2950 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.119s
I20260709 12:20:29.999336 28756 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:29.999881 28677 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:30.002723 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:30.008911 28753 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:29.928777  2896 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:30.004712 28721 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:29.991319  2968 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:29.975162  2962 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.988463  2883 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.018791 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:29.885788  2769 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.135s
I20260709 12:20:29.999111  2958 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:29.972743  2884 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.033500 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:30.005875  2816 raft_consensus.cc:3055] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:30.043654 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:30.045671 28751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:30.046339 28751 raft_consensus.cc:606] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.018203  2621 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:30.024215  2704 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:30.027611  2562 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.062283 28753 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:30.021745  2968 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:30.055697 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 107926us
W20260709 12:20:30.055958 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 370374us
I20260709 12:20:30.031042  2951 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:30.031126  2904 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.056013 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.070995 28673 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:20:30.071434 28677 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:30.071518 28673 pending_rounds.cc:85] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 13
I20260709 12:20:30.072186 28673 pending_rounds.cc:107] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:20:29.935197  2924 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.072522 28673 raft_consensus.cc:2889] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:30.073807 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 302815us
I20260709 12:20:30.074131 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.075424 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:29.963434  2910 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:30.080667 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.042948  2816 raft_consensus.cc:740] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:30.028416  2962 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.113397 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:30.114574 28673 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:30.117025 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.074033  2562 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.119237 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:30.057284  2704 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:30.135334 28605 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:30.066994  2937 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:30.139268  2943 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:30.139714  2981 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.141605  2924 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.080313  2575 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:30.145025 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:30.110208  2904 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.163157 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.095991  2889 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:30.153898  2943 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.109784  2951 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:30.129797  2877 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:30.127811  2880 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:30.083853  2621 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:20:30.166550 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:30.172129 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.175985 28678 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:30.185869 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:30.187238 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.172566  2912 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:30.197461 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.178691  2907 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:30.166014  2981 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.190357  2937 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:30.176213  2926 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 12:20:30.238596  2984 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:20:30.211759  2928 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.204576  2912 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:30.192094  2877 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:30.229146 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.232555 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.235333 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:30.242316 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.224381 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.215510  2833 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.233438  2958 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:30.234747  2899 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.262650 29323 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:30.235468  2923 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:20:30.271571 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.246511  2912 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:30.251291  2928 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.249055  2937 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:30.273144  2988 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:20:30.262190  2884 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.263808  2807 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:30.260749  2880 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:20:30.277580  2923 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:30.286415  2807 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:30.287454  2807 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.288523  2923 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:30.289431  2923 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.263500  2833 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.294313  2833 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:30.266379  2951 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.216490  2704 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.299330  2704 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:30.278100  2962 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:30.274492  2621 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:30.269508  2877 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.302814  2907 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:30.307652  2907 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:30.308578  2907 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.309768  2907 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:30.310086  2904 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:30.312390  2892 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.004s
I20260709 12:20:30.305557  2910 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:30.283159  2937 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.346410 28676 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
W20260709 12:20:30.332572 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 214786us
I20260709 12:20:30.344123  2903 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.350625  2903 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.353686  2937 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:30.355646  2948 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:20:30.358009 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:30.360879  2996 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:20:30.361331  2928 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:30.348420  2992 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:20:30.322227  2892 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.366887  2892 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.366935  2641 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:30.372394 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:30.395241 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 170956us
I20260709 12:20:30.397344 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:30.393319 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 136474us
I20260709 12:20:30.397588 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.398330 29325 raft_consensus.cc:2368] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:30.407423 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.408465 29323 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:30.410125 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:30.411015 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.411525 29323 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:30.412073 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 226267us
I20260709 12:20:30.417382 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:30.424686 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.434139 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:30.434819 28749 raft_consensus.cc:1240] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:20:30.406798  2896 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:30.434777 28751 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:30.436250 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:30.437039 28748 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 12.
I20260709 12:20:30.442548 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:30.430810  2880 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.447932  2880 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.450874  2880 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:30.446831  2986 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.262s	user 0.001s	sys 0.001s
I20260709 12:20:30.453658  3000 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:30.420333  2797 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:30.457657  2797 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:30.458493  2797 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.439464  2896 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.460017  2896 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.462489  2883 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.465085 28755 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:20:30.409049  2910 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:20:30.467866  2923 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:30.469321  2816 consensus_queue.cc:260] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.470579  2816 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:30.418172  2930 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:30.477892 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:30.478340 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:30.479280 28602 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:30.480758 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.481796 28605 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:30.483232 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.474012  2892 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:30.489372 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.489710 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:30.490767 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:30.494307 28607 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 12.
I20260709 12:20:30.491704 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:30.495337 28604 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:30.407836  2621 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
W20260709 12:20:30.482110  2994 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.213s	user 0.003s	sys 0.000s
I20260709 12:20:30.501365 28599 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:30.502146 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:30.479990  2928 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.504844 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.508587 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:30.510782 28600 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:30.496663  2963 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.511662  2963 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.513917  2963 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:30.517529 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.520622 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:30.530093 28600 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:30.524056  2896 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.526787 28602 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:30.530243 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:20:30.522624  2999 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:30.529078 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:30.527683 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:30.489040  2950 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.543339  2896 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:30.534619  2937 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:30.543799  2950 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.489131  2889 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:30.549227 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:30.553237 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:30.544174 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.544071  2937 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.544806 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.544947 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.545408  2902 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:30.547703 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.493695  2883 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.549857 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.556793  2889 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.601966  2951 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:30.604178  2951 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.605404 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:30.611162 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.611855 29321 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.480479  2930 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.616740 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.618093 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.618670 29320 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:30.619450 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.620153 29320 raft_consensus.cc:2368] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17.
I20260709 12:20:30.503250  2892 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.557788  2968 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.627333  2968 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.534518  3003 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:30.554462  2833 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:30.628881  2833 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.629312  2833 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:30.534852  2928 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.508545  2962 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:30.594444  2884 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:30.633545  2884 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.628307  3003 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.550203 29323 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:30.636930 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.595746 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.638347 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.638651 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.639235 29323 raft_consensus.cc:2368] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:30.639758 29317 raft_consensus.cc:2410] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:30.550776 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.640748 29327 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:30.642217  2702 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.640102 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.642863  2702 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.643822 29323 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:30.595156 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:30.645895 28571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.651661 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:30.650893 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 241019us
I20260709 12:20:30.554078 28607 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:30.599982  3006 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:30.657061 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 100821us
I20260709 12:20:30.659252 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:30.673081 29322 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:30.541451 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:30.674425 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 133066us
I20260709 12:20:30.684532 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:30.654893 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:30.670403 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.691862 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.695585  2562 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.697150  2951 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:30.734349 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 83983.3us
I20260709 12:20:30.597479  2937 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.697616  2943 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.699297  2899 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:30.743767 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:30.683393  2883 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:30.689399  2968 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:30.678787  3003 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:30.764727 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 415913us
I20260709 12:20:30.692544  2816 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:30.769546 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.777976 29320 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:20:30.770780 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:30.799997 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 262490us
I20260709 12:20:30.802409 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:30.803772 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 148918us
I20260709 12:20:30.804888 28647 leader_election.cc:400] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:30.805490 28647 leader_election.cc:403] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:20:30.774084 29321 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:30.734197  2902 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:30.804054 29323 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:20:30.809132 29322 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:30.809432 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.815379 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.816277 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:30.766498  2968 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.767244  2883 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.819058 29321 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:30.687191  3006 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.777365  2816 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.824224 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.829665 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.829973  2902 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.832357 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.822865  2968 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:30.833021 28682 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:30.833971 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.834762 28675 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:20:30.836905 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:30.837535 28678 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 11.
I20260709 12:20:30.838171  2948 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:30.819058  3005 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.839223  3005 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.845127 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.822013 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.778865  2899 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:30.800082  2807 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:30.853773 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.857718  3018 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:30.858289  3018 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:30.858722  3018 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.860266  2899 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:30.863401 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:30.875967 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 216784us
I20260709 12:20:30.864487  3013 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:30.864754  2892 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.874670 29327 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:30.823112  2883 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:30.820581  3001 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:30.796698  2871 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:20:30.889948 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:30.892853 29321 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:30.853796 29317 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
W20260709 12:20:30.908394 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.847847  2816 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:30.915673 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.924901 29327 raft_consensus.cc:2368] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17.
I20260709 12:20:30.925631 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.916565 29323 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:30.844306  2884 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.850682  2930 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:30.870150  2562 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:30.932219 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.936599 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:30.939108 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 253756us
I20260709 12:20:30.940245 29327 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:30.913040  2906 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:20:30.941182 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:30.855381  2958 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:20:30.927278  2892 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:30.918713  3001 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:30.952486 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:30.954799 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.958783 29321 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
W20260709 12:20:30.946676 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:30.955286 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.929616  2702 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.934927  2928 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:30.965663 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:30.919159  3002 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:20:30.967803 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.973340 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.928836  2807 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:20:30.972153 29322 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:30.913589  3013 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:30.970026  2912 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.687s	user 0.013s	sys 0.000s
W20260709 12:20:30.988461 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 164278us
W20260709 12:20:30.995802  2923 consensus_meta.cc:287] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.003s
I20260709 12:20:30.961665  3001 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:30.997278 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.996557 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:30.968532  2562 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:30.999441 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:30.962883  2950 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:31.006431 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:31.010967 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 128842us
I20260709 12:20:31.014276 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:31.020036 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.021591 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:31.018585 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.041394 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.018967  2702 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:31.050629  2816 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:30.999396  2889 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.056295  2833 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.058259  2889 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:31.058272  2833 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:31.059099  2950 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:31.060364  2816 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:31.055301  2883 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.061419 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.062207  3026 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:31.062532  2883 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.063225  2883 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:20:31.063264  3026 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:20:31.063827  3026 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:31.065136  3010 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:20:31.065099  3026 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.068701  3002 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:31.069348 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.070089  3002 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:31.070971  3002 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:31.071605  3015 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:20:31.071681  3002 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:31.072118  3002 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:31.073419  3019 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:20:31.073807 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:31.074878  3016 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:20:31.011548  2562 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:31.076675  3023 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:31.077107  2562 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.078821 29325 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:31.079514  2871 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:31.080806  2892 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:31.065265  3006 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.083372 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.084383  3001 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.086601  3001 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:31.088811 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.002460  2912 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.089649 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.091306 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.070335  2883 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:31.095814 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.097481 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.098834 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.099537 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.099856 29317 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:31.106884 29326 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:31.109017 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:31.095669  2892 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:31.111035 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 149585us
I20260709 12:20:31.112326 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:31.103914  2958 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:31.125278 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:31.107844  2962 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:31.133409 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.106060  2928 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.130373 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:31.134354 28599 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:31.110571  2889 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.130373 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.140676  2704 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:31.143810 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:31.148545 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.148898 29320 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:31.149540 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.150451 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.151029  2797 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:31.151492 28677 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:20:31.151775 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.152061 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.152511 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.171343 28680 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:31.153244 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.166941 28606 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:31.154019  2833 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:31.148538  2769 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:31.159643  3005 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:31.108009  2883 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:31.165912 28599 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:20:31.122330  2923 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:31.187232 28678 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:31.162635  3027 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:31.206729 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.207368 28678 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:20:31.186868  2769 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:31.174069  3000 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:31.213276 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:31.200476  2923 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:31.221515 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 200012us
I20260709 12:20:31.219785 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.167232  2928 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.217685 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.224143 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.221956 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.221171 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:31.223160 28606 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 13: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:31.225041 28601 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.201870  2704 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:31.188905  2883 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:31.229051  3033 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:31.230482 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:31.126515  3002 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.217566  2769 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.235201 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.197418  2833 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.233026  2883 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.238801  2948 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:31.240337  2948 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:20:31.240841  2948 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:31.241160  2948 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:31.241974  2948 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.243132  2948 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:31.243937 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.238930 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:31.246734  2871 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:31.247051 28648 leader_election.cc:400] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16.
I20260709 12:20:31.247134  2871 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:31.247696  2871 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.248708 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.253137  2896 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.238993  3013 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.253661  2896 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.254024  3013 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:31.254783  3013 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.255820  2896 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:31.256639 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.258021 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.270613  3017 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:31.271102  3017 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:31.223489  2923 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.220497  3027 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:31.286230 28753 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:20:31.286656 28753 pending_rounds.cc:85] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 15
I20260709 12:20:31.286863 28753 pending_rounds.cc:107] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:20:31.287086 28753 raft_consensus.cc:2889] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:31.236644  3033 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:31.274272  2963 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:31.299913 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:31.229879  3001 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:20:31.224052  3000 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.300635 28748 raft_consensus.cc:2376] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17. Re-sending same reply.
W20260709 12:20:31.301648 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 64217.7us
I20260709 12:20:31.282627  2902 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:31.318486 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.319247 28748 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:31.323433 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.324280 28749 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:20:31.290205  3036 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:31.318389 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:31.327541 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:31.328780 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 93688.8us
I20260709 12:20:31.320083  3027 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.332216  2950 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:31.332664  2950 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:31.332828  3028 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:20:31.333043  2950 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:31.333191 28756 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:31.336733  2704 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.300215  2963 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.349300  2769 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.350572  2950 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.351459  2892 raft_consensus.cc:993] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:20:31.351511  2916 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:31.356832 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:31.271909  3017 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.373059  3017 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.374724  2889 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:31.357822 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.291326  2562 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:20:31.362360 28601 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:31.358330  3033 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.363215  3006 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:31.364464  2950 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:31.364774  3018 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 12:20:31.393217 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:31.393115  3018 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.395179  3025 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:31.395465  3018 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.395584  3025 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:31.360209  2963 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.396659 28675 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:31.397358  2769 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:31.340833  3003 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.537s	user 0.003s	sys 0.005s
W20260709 12:20:31.371938  3040 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:20:31.372047  2892 raft_consensus.cc:1081] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:20:31.381160 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:31.426745 29325 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.379593 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:31.423115 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62051.3us
I20260709 12:20:31.359696 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:31.359787  3046 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:31.387517 29317 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:31.388947  3000 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:31.436101 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.389816 29319 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:20:31.383886  3035 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:20:31.392500  2797 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:31.325376  2912 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:31.445115 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.445824 28681 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:31.341154  3036 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:31.398497  3038 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 12:20:31.429953 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 70336.2us
I20260709 12:20:31.359905  2981 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:31.434785 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 77231.3us
I20260709 12:20:31.324669  2902 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.437005 28673 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:31.448485 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:31.457196 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.457520 29325 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:31.459102 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:31.460657 28680 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:31.433117  2962 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:31.466845 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.467762 28572 leader_election.cc:400] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17.
I20260709 12:20:31.468026 28721 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:31.468226 28572 leader_election.cc:403] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:20:31.469197 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.444990  2807 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:31.425964  3032 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:20:31.473142  2981 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:31.438592  2884 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:20:31.470207  3027 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:31.459861  3048 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.493806  3048 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:31.495954 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.447914  3036 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:31.488720  2928 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:31.489602  3041 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:20:31.426951  3003 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.492731  3026 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:31.465587  3005 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:31.465523  2797 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:31.422446  3033 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.470896  2704 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:31.475251  2769 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:31.477591  2950 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:31.517625 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.403539  3025 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.457844  3018 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:20:31.496691  2953 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.465384  2924 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:20:31.486197  3046 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:31.532742  3025 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.535084  3013 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:31.521924  3005 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.471288  3017 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
W20260709 12:20:31.564111  3050 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:20:31.538865 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71299.9us
I20260709 12:20:31.566646 28682 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:31.535660  2899 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:31.522261  3039 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:20:31.505679  2951 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:31.508263  2926 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.546072 28678 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 13.
I20260709 12:20:31.540359  2962 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:20:31.551566  2797 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.542388  3046 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:31.539549  2702 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:20:31.554405  2871 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.592007  2871 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.539891  2950 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.584060  3046 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.594484  2950 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.556643  3005 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:31.598644  3003 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.537684 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:31.568157 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:31.600792 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63220.3us
I20260709 12:20:31.602263 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:31.603404 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:31.569285  2924 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:31.604830  2924 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:31.604979  2702 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:31.605490  2924 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:31.606205  2981 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:31.606518 28750 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:20:31.607282  2899 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:31.607642  2899 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:31.608029 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.608807 28747 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:31.608475  2899 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.609680  2899 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.515403  2943 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 12:20:31.612592 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.582671  2926 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.614910  2926 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:31.578724  2968 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.744s	user 0.011s	sys 0.000s
I20260709 12:20:31.615320  3036 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.615566  2968 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.580708  2951 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.620834  3033 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.581857  2902 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.621565 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.622445  2902 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:31.622653  2951 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:31.623606 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.605505 28755 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:31.624971 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.605006 28748 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:31.624341 28751 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:31.584513 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.605528  2702 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:31.606292  2924 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:31.540701  2769 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:31.628710 28752 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:31.607597 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:31.577642 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 219863us
I20260709 12:20:31.636757 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:31.609697 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.635547 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.638392 28678 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:31.633561 28750 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
W20260709 12:20:31.640532 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.641294 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:31.641841 28750 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:31.642858 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.644652 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:31.644651 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:31.646313 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.647110 28678 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:31.650311 28755 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:31.653014 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:31.659356 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.624337  2902 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:31.662431 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.632845  2924 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:31.666589 28571 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:31.667347 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.669057 28678 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:31.699383 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.649997  3033 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.697409 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.703980 28750 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:31.706130 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.706694 28750 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:31.707530 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.704320 28747 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:31.708858 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.709261  2968 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:31.709378 28747 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:31.709461  2923 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.710325 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.698344  2926 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:31.711040 28747 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:31.711691  2923 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.711431  2924 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.712653  2924 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.663960  3006 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.713560  3006 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.695340  3034 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:20:31.717085  3034 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:31.717406  3034 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:31.718153  3034 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.704905  3003 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:31.719280  3034 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.719549  3003 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.719980  3003 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:31.724517  3033 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.655856  3059 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:31.709947  2769 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.662459  2951 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.661954  3000 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:31.727188 28747 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:31.730489 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.736312 28754 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:31.744637  2951 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.745501 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:31.746070 29325 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:31.746855  2951 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.747478 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:31.747879 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.748944 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:31.748878  2702 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.750166 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.750423 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.750741 29323 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:31.751278 29327 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:31.747996 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.752727  3036 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.726167  2903 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:31.758668 29325 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:31.753008 29319 raft_consensus.cc:2410] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:20:31.760478  3046 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:31.763319  3046 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:31.734176  3000 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:31.764773  3000 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.772293 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:31.729055 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:31.776043 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45615.6us
I20260709 12:20:31.782626 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:31.786403 28679 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:31.734589  2926 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:31.809640 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:31.790844 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:31.792325 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63340.6us
I20260709 12:20:31.793895 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:31.811988 28601 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:20:31.794847 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.795539 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:31.791584  2912 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:20:31.798611  3005 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.800921 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.824630 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:31.805202  2963 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.805470 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:31.828958 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:31.829556 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.829754 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.807130 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:31.725311  2883 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.817384 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.825263 29323 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:31.831211 28605 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:31.819726 28599 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:31.820679 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.781217  3059 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:31.835243 28607 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:31.827293 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:31.836071 28604 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:31.828233 28603 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:20:31.833349 28673 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:31.847180 28602 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:20:31.821372  2951 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:31.865679 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.865907 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.866595 28603 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:31.865839 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.868475 28599 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:31.857252 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:31.859083  3063 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:31.859678 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.872040 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.858605 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.873500 28753 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:31.895797 29325 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:31.897393 28605 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:31.897565 28607 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:31.899138 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.899755 28599 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18. Re-sending same reply.
I20260709 12:20:31.898756 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.848739  3059 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:31.846376  3031 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:31.851862  2926 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:31.904033 28721 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:31.914438 28599 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:31.916002 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:31.897231  3063 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:31.931516 28598 raft_consensus.cc:2368] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
I20260709 12:20:31.897959  2889 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:31.915146  3025 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:31.918656  3059 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:31.898156  2951 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:31.949028 28679 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:31.957718 28755 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
W20260709 12:20:31.970395 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 187831us
I20260709 12:20:31.968787 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.979921 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:31.980600 28603 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
W20260709 12:20:31.986711 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:31.988375 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:31.918888  3031 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.989265 28647 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:31.997792 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 93840.5us
I20260709 12:20:31.999356 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:32.013355 28680 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:32.002298 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:31.938784  2912 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:31.938689  2889 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:31.945595  2953 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17.
I20260709 12:20:31.961412  3033 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:31.967646  2963 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:31.962699  3005 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:31.941867  3063 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.018226  3001 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:31.997040 28602 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:31.993448  2902 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.011245  2871 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:32.014999  2884 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:32.000545 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:32.055413 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 54985.4us
I20260709 12:20:32.028462  2889 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:32.021394  2899 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:32.068789  2899 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.069218  2899 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.071161 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:32.021574  2962 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:32.072398 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:32.072901  3065 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 12:20:32.072976 28750 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
W20260709 12:20:32.073556 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.074064 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.023486  2912 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:31.999328  3031 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.058871 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:32.064810 28600 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:32.066992  3053 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:32.045990  3001 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:32.080168 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.082527 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:32.084300 28720 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:32.086433 29325 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:32.087903 28682 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:32.089797 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:32.090361 28753 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:32.092689 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.093262 28750 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:32.094106 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.094628 28750 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:32.095436 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.096089 28750 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:32.097530 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.098018 28750 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:32.098749 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.098954 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:32.099261 28750 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:32.099611 28756 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:32.052757  2871 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.104292  2871 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.105238 28753 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:20:32.105819  2951 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.111693  2899 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.112975 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:32.114537 28749 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:32.119451 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:32.124831 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:32.126286 29325 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:32.128484 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:32.136570 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:32.074893  3049 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:32.144029 28749 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:20:32.079071  2958 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.075083  2962 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:32.117079  3001 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:32.082680  3053 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:32.122852  3033 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:32.149585 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:32.055419  2902 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.129344  2884 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:20:32.160679 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.134598  3051 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:32.170413 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:32.148278  2953 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:32.176987  2953 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.177450  2953 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:32.164004  2883 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:32.176514  3033 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:20:32.180824 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.189112 28756 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:32.190598 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:32.154004  3000 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.157159  2958 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.192994  2963 raft_consensus.cc:2764] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 12:20:32.199350  2884 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:32.158835  2769 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 12:20:32.350642  2903 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:32.185925  2896 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.119s
W20260709 12:20:32.315239 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 190974us
W20260709 12:20:32.319914 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 188781us
I20260709 12:20:32.166939  3063 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:32.363577  3067 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:32.360790 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 98961.4us
I20260709 12:20:32.368947 29327 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:32.426198 29327 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:32.425823  3067 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.427052 29327 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.427767 29327 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:32.165558  2912 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.170044  3025 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:20:32.429557  3067 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.420717 29323 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:32.401810 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:32.371173  3018 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:20:32.374220  3003 consensus_meta.cc:287] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.654s	user 0.015s	sys 0.003s
I20260709 12:20:32.421550  2903 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:32.449668  2958 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.390313  3033 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:20:32.424932 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:32.314867  2962 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.413635  2906 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:20:32.461017  3006 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:32.463095  2902 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.432900  3063 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:32.464496  3063 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:32.465519 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.467900 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:32.436267 28749 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:32.303996  3053 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.444324 29327 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:32.448015  2833 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:32.449350  2903 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.377465  3049 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:32.484086 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:32.486267 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:32.443662  2943 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:32.440963  3018 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:32.469276  2949 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.477803  3013 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:20:32.501278 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 56571.1us
I20260709 12:20:32.448271  2871 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.486766  3053 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:32.438730  3082 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.064s
I20260709 12:20:32.488579  2958 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:32.473793  3003 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.518481  3002 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.518877  2871 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:32.500072  3001 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.525389  2948 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:32.525969  3001 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:32.504248  3013 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:32.526548  3059 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 12:20:32.526840  3013 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:32.533703 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.547344 28604 raft_consensus.cc:2368] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17.
W20260709 12:20:32.551064 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:32.547334  3075 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:20:32.498948  2949 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.530777  3083 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:32.530891  3085 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:32.566076 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:32.568382 28754 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:32.572800 28748 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:32.530773  3086 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:20:32.509264  2884 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.585232 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:32.545176  2958 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:20:32.527101  3059 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.586107 28600 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:32.585216 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:32.594933 28748 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.562741  3083 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:32.586810 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 148005us
I20260709 12:20:32.567849  3085 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:32.600466 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.602669 28752 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3202) took 1316 ms. Trace:
I20260709 12:20:32.563644  3033 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:20:32.603191 28752 rpcz_store.cc:276] 0709 12:20:31.286183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.286305 (+   122us) service_pool.cc:224] Handling call
0709 12:20:31.301388 (+ 15083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:31.633260 (+331872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.602423 (+969163us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54001c4654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:32.602591 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752165760}
I20260709 12:20:32.616122 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:32.616802 29319 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:32.618309 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 140908us
I20260709 12:20:32.585450  3000 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:32.635958 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.636791 28749 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:32.639112 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.563531  3049 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.600844  3005 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:32.603705  3085 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:32.659904 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.644796 28600 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:32.685565 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.686303 28748 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
W20260709 12:20:32.684540 29321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.005s	sys 0.008s
I20260709 12:20:32.687325 28755 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:32.696883 29321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.006s	sys 0.009s
I20260709 12:20:32.645511 28606 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:32.694983 28647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.014s
W20260709 12:20:32.697965 28647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.000s	sys 0.014s
W20260709 12:20:32.698827 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 571564us
I20260709 12:20:32.734395  3082 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:32.731505  2892 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.785612 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:32.780390 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 145278us
I20260709 12:20:32.786216 28679 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:32.781764 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:32.782907  3088 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.728608  3097 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:32.699947  3067 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:32.731776  2949 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:32.796981 28677 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:32.724555  3003 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.639014  2962 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 12:20:32.758400  3006 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:32.785801  3001 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.784780 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:32.785869  3084 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.712134  3079 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:20:32.788038 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:32.788851 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:32.737900  3086 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:32.801110  3077 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:20:32.789394 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3207) took 1126 ms. Trace:
I20260709 12:20:32.783717 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:32.793147 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:32.855679 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.815349 28681 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:32.821496 28751 rpcz_store.cc:276] 0709 12:20:31.663044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.721314 (+ 58270us) service_pool.cc:224] Handling call
0709 12:20:32.457595 (+736281us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b5800101a98. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:20:32.457862 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.458136 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:32.558168 (+100032us) log.cc:844] Serialized 14 byte log entry
0709 12:20:32.789121 (+230953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:32.789173 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:32.789220 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.789278 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.789353 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105717,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":478,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4031,"spinlock_wait_cycles":12441344,"thread_start_us":330209,"threads_started":2}
W20260709 12:20:32.887099  3089 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:20:32.800904  3096 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:32.798794  3097 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.892935  3096 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.894639  3097 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.788672 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:32.811928  3006 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.657761  2953 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.895709  3096 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:32.786180  3087 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.228s	user 0.004s	sys 0.003s
I20260709 12:20:32.787156 29320 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.807227 28754 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:32.784631  3082 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:32.910496 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:32.911239 28751 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:32.688925  3005 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:32.814364 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.815414  3001 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.793416  2892 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:32.897161  3099 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:20:32.897310  2953 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.799800 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:32.881832 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:32.792388 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:32.940495 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58790.2us
W20260709 12:20:32.897944  3094 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:20:32.946674 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.925197 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1735) took 1179 ms. Trace:
W20260709 12:20:32.809566 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 323373us
I20260709 12:20:32.932704 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:32.936059 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:32.689244  3083 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.949738 28603 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:32.952756 29320 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:32.954326  3059 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:32.955435  3107 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:32.955734  3106 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:32.956156  3106 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.956550  3106 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:32.956050  3107 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.959000  3107 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.959523  3107 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:32.959839  3107 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:32.960155  3107 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:32.858306  3048 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:32.955435 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 163086us
W20260709 12:20:32.934756  3031 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.806s	user 0.004s	sys 0.008s
I20260709 12:20:32.948026 29317 rpcz_store.cc:276] 0709 12:20:31.745990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.748531 (+  2541us) service_pool.cc:224] Handling call
0709 12:20:32.924423 (+1175892us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:20:32.924655 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.924836 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.924862 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:32.924905 (+    43us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:32.924939 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.924998 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:32.925105 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7679744}
I20260709 12:20:32.798642  3088 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.898280  3033 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:32.962356 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 173755us
I20260709 12:20:32.985440 28647 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:32.985991 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:32.899058  3103 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.897208  3006 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:32.998536  3108 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:32.998430 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:32.999537  3102 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:20:32.999459 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:33.010885 28603 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:32.898059  3086 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:32.971418  2562 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:33.023772 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.024559 29319 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:33.025348 29320 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:33.025506 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:33.025897 28751 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:33.026811 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.027901 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:33.028450 28751 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:33.029114 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.030431 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.031453 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:33.033046  3092 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:20:33.033267  3067 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:33.018268  3006 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:33.036911 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.037915 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:32.860127  3084 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.043956 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.049068 28754 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
I20260709 12:20:33.051493  3026 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:33.051952  3026 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:33.053475  3081 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:33.053746  3026 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.054050  3081 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.061969  2892 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:33.063319  2896 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:33.063966  2896 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:33.064245  3070 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:33.064653  3070 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:33.035202  2562 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:33.065140  2562 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:33.064942  2896 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.065546  3070 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.066776  3070 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:33.041842 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.046519 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:33.063444  2958 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:33.045315 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:33.068423 28602 raft_consensus.cc:2376] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18. Re-sending same reply.
I20260709 12:20:33.068646 28600 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:33.044565 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3210) took 1342 ms. Trace:
I20260709 12:20:33.069417 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:33.069813 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 84469.2us
W20260709 12:20:33.034909  3094 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:33.069687 28750 rpcz_store.cc:276] 0709 12:20:31.702175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.099880 (+397705us) service_pool.cc:224] Handling call
0709 12:20:32.100170 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:32.120700 (+ 20530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:32.120748 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:32.456372 (+335624us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b2c0001c1c8. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:32.456880 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:20:32.577630 (+120750us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:32.577691 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.577784 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.035803 (+458019us) raft_consensus.cc:1685] finished
0709 12:20:33.035825 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.044502 (+  8677us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20098,"raft.queue_time_us":20753,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12989,"spinlock_wait_cycles":15597440,"thread_start_us":119195,"threads_started":1,"wal-append.queue_time_us":342295}
I20260709 12:20:33.072365 28751 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:33.077028 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:33.087194 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1861) took 1285 ms. Trace:
I20260709 12:20:33.088748 28678 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 25: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:33.095527 28600 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:33.097994 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:33.099017 28679 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:33.088385 29321 rpcz_store.cc:276] 0709 12:20:31.802252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.802465 (+   213us) service_pool.cc:224] Handling call
0709 12:20:31.802844 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:31.902381 (+ 99537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:31.902413 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:31.923750 (+ 21337us) log.cc:844] Serialized 26 byte log entry
0709 12:20:32.697347 (+773597us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:32.697401 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.699106 (+  1705us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.086980 (+387874us) raft_consensus.cc:1685] finished
0709 12:20:33.087000 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.087137 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12371,"raft.queue_time_us":117919,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":15483,"thread_start_us":797050,"threads_started":2,"wal-append.queue_time_us":811251}
I20260709 12:20:33.081012  2958 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:33.105536  2958 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.106586  2958 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:33.107038  3081 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.108458 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.110265 28605 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:33.111367 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.097383  3048 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:33.112735  3048 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.112898 28602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:20:33.113612 28602 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:33.113982 28602 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:33.114823  3048 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.115796 28605 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 12:20:33.117007  3090 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
W20260709 12:20:33.124347 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.124663 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.007258  3033 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:32.993993  3031 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:33.118675  3105 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:20:33.119366  3095 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 12:20:33.112879 28679 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:33.046774  3006 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:33.121577 28602 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:33.128000 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 128526us
I20260709 12:20:33.116537 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.154866 28605 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:20:33.155129 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 183296us
I20260709 12:20:33.166996 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:33.169474 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.170361 28601 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:33.168381 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:33.018468  3108 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.177839 28754 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:20:33.177873 28750 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:20:33.182499 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:33.180892 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:33.006532  3103 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.186071 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:33.178547  3002 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.655s	user 0.002s	sys 0.008s
I20260709 12:20:33.189440 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:33.190043 28750 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:33.190371 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:33.190348 28750 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:33.193455 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:33.194648 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:33.152746  3048 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:20:33.192276 28750 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.202104 28674 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:20:33.191150 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
W20260709 12:20:33.200062 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.184926  2896 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:33.174274  2907 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:33.071370  3082 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.210474 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:33.202200 28750 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:33.085856  3112 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.133s
W20260709 12:20:33.184399  2924 consensus_meta.cc:287] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.471s	user 0.011s	sys 0.003s
I20260709 12:20:33.205752 29322 raft_consensus.cc:2368] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:33.202754 28674 pending_rounds.cc:85] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 10
I20260709 12:20:33.220043 28674 pending_rounds.cc:107] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 17.11
W20260709 12:20:33.196846 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 209620us
I20260709 12:20:33.183363  3026 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.200584 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:33.223315 29321 raft_consensus.cc:2368] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17.
I20260709 12:20:33.220809 28674 raft_consensus.cc:2889] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.217026 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3191) took 1167 ms. Trace:
I20260709 12:20:33.224042 28599 rpcz_store.cc:276] 0709 12:20:32.049326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.049570 (+   244us) service_pool.cc:224] Handling call
0709 12:20:32.049945 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:32.057063 (+  7118us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:20:32.057092 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:32.057424 (+   332us) log.cc:844] Serialized 26 byte log entry
0709 12:20:32.597008 (+539584us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:32.597073 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:32.601708 (+  4635us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:33.216796 (+615088us) raft_consensus.cc:1685] finished
0709 12:20:33.216821 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.216965 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6691,"raft.queue_time_us":7379,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":9707,"thread_start_us":474216,"threads_started":1,"wal-append.queue_time_us":636147}
I20260709 12:20:33.227257 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:33.232157  3091 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 12:20:33.262271 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:33.253633  3001 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.254561  2562 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.233835  3113 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
W20260709 12:20:33.257288  3109 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:20:33.233135  3110 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:33.224260  3100 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.237349  3026 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:33.268887  2926 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.333s	user 0.004s	sys 0.009s
I20260709 12:20:33.251940 28573 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:33.283440 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:33.252578 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:33.284135 29321 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:33.260489  2889 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.139s	user 0.013s	sys 0.000s
I20260709 12:20:33.247488  3033 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.252849  3118 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:33.262025 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:33.248708  3018 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.270116  3002 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:33.277137  3000 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.291486  3003 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:33.299226  3000 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.280759  3110 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.301712  3000 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.292068  2889 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.303260  3110 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.304183  3119 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:33.304395  2889 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.304723  3018 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:33.306061  3026 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:33.306738  3013 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.000s
I20260709 12:20:33.307159  3013 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.307794 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.307917  3124 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:20:33.279277  3001 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.215123  2943 consensus_meta.cc:287] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.722s	user 0.012s	sys 0.000s
I20260709 12:20:33.236282  3006 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.278518 29322 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:20:33.325141 29322 pending_rounds.cc:85] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 12
I20260709 12:20:33.325505 29322 pending_rounds.cc:107] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:20:33.325802 29322 raft_consensus.cc:2889] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.273936 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:33.326679 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 52853.8us
I20260709 12:20:33.267138  2833 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.286682 28751 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:33.270397  3081 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:20:33.275959  3053 consensus_meta.cc:287] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.756s	user 0.013s	sys 0.000s
I20260709 12:20:33.303411 29318 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:33.391909 28722 leader_election.cc:400] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
I20260709 12:20:33.392796 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:33.392849 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.268723 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:33.309933 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.305544 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2892) took 1526 ms. Trace:
I20260709 12:20:33.394138 28599 raft_consensus.cc:2376] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17. Re-sending same reply.
I20260709 12:20:33.395015 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.263856 28607 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:33.328482  3033 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:33.373870  3003 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:33.402148 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.293196  3005 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.293552  3097 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:33.298710  3034 consensus_meta.cc:287] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.576s	user 0.013s	sys 0.002s
I20260709 12:20:33.388659 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.410005 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.292094  2926 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:33.311465 28750 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:33.395573 28599 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:33.397070 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.394321 28753 rpcz_store.cc:276] 0709 12:20:31.779611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.106747 (+327136us) service_pool.cc:224] Handling call
0709 12:20:32.106970 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.107176 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:20:32.371620 (+264444us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.305042 (+933422us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b1800493000. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f23a
0709 12:20:33.305219 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:33.305267 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:33.305310 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.305369 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:33.305477 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":435590,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":1407,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":5031808,"thread_start_us":446626,"threads_started":2,"wal-append.queue_time_us":319778}
I20260709 12:20:33.295387  2903 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.110s
W20260709 12:20:33.400636 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 200653us
I20260709 12:20:33.386631  3081 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:33.279142  3100 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:33.422284 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:33.409201 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 118824us
I20260709 12:20:33.444602 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:33.409030 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 187958us
I20260709 12:20:33.309391  3002 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.397563  3000 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.397080  3096 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.408041  2892 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:33.448000 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.448112 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:33.393605  3110 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:33.387490  2943 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:33.402446  3026 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:33.399705 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:33.405301 29321 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:20:33.388240  2896 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:33.437929 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:33.448761 28752 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:33.426035  2907 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:33.454869 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:33.390208  2833 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.410996  2924 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.454843 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 55168.4us
I20260709 12:20:33.460084 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:33.386629  3001 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.427919  3088 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.456987 28598 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:33.462393 29322 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:20:33.461383  2951 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:33.410245  3033 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.465009 28599 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:33.304777  3119 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.445182  3084 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.469512 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:33.445370  3086 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.475631 28600 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:20:33.476341 28749 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:33.468394  3110 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:33.435235  3031 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.475723 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:33.482779  3110 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.479772 28600 pending_rounds.cc:85] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 10
I20260709 12:20:33.486410 28600 pending_rounds.cc:107] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:20:33.490682 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:33.491313 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.491743 28752 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:33.471438  2907 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.471390  2924 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.459995  3000 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.470773  3097 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:33.474828  3013 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.486685 28600 raft_consensus.cc:2889] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:33.459839  3096 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.504345  2562 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:33.519865 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.515486  3000 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:33.503973  3085 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.805s	user 0.007s	sys 0.002s
I20260709 12:20:33.516307  3097 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.466565  3026 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:33.505900  3111 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:20:33.487875  3088 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:33.492471  3108 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.506312  3129 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:33.535239  3129 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:33.536173  3129 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.537248  3129 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:33.538461 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3199) took 1114 ms. Trace:
I20260709 12:20:33.507922  2892 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:33.538834 28604 rpcz_store.cc:276] 0709 12:20:32.421675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.424587 (+  2912us) service_pool.cc:224] Handling call
0709 12:20:33.536272 (+1111685us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b54000a7154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:33.536395 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222489984}
I20260709 12:20:33.507454  2951 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:33.539368  3119 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:33.539717 28607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3194) took 1383 ms (client timeout 1692 ms). Trace:
W20260709 12:20:33.527312 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51680us
I20260709 12:20:33.528086  3112 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:33.528388  3117 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.479116  3081 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.544127  3002 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:33.544391  3081 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:33.544772  3112 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:33.528120  3130 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:33.545502  3130 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:33.545876  3130 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:33.533946  2833 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:33.534319  3083 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:33.526563  2896 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:33.552989 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.534500  2924 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.534516  3088 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:33.542126  3001 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:33.540129 28607 rpcz_store.cc:269] 0709 12:20:32.155968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.156112 (+   144us) service_pool.cc:224] Handling call
0709 12:20:33.539560 (+1383448us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003dbdd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:33.539666 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422794112}
I20260709 12:20:33.551929 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:33.539935  2951 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:33.476368  3003 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:33.563971  3033 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.565006  3112 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:33.566460 29292 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:33.574769 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:33.576308 28682 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:33.576956 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:33.577554 28673 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:33.582489  2958 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:33.582958 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.582489 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:33.609571 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 162989us
I20260709 12:20:33.624330 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
I20260709 12:20:33.625154 28676 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
W20260709 12:20:33.623863 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.583053 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:33.627656 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:33.626865 28677 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:33.630875 28673 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:20:33.632037 28756 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:33.633632 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:33.634981 28681 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:33.633615 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:33.637171 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:33.643497 28677 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:33.526990  3085 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.560369  3108 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:20:33.583113  3118 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:33.654403 28756 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:20:33.655133 28676 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:33.578176  3112 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:33.628712  3097 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.633594  2903 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:33.667153  3140 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.667778  3125 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:33.667850 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:33.669612 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:33.630528  3106 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.005s
I20260709 12:20:33.679113 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:33.747679 29327 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:33.748176 29317 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:33.747701 29321 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:33.749449 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:33.749667 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:33.560806  3124 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
W20260709 12:20:33.635741  3107 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.002s
W20260709 12:20:33.706295 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.666483  3128 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:20:33.559041  3117 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.737994  2883 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.739534  3097 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.750550 29321 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
W20260709 12:20:33.697078  3146 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:20:33.756568  3140 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.738932  3088 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.765926  3085 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:33.767251  3026 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.770335  3130 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:33.777796 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 110022us
I20260709 12:20:33.750200 29317 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:33.671705  2958 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:33.780213 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:33.791385  3096 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.792815  3112 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.780892  3083 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:33.777151  2903 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.781920  3125 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.796095  2889 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:34.210358  2889 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:34.211319  2889 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:34.215096 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.125586 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.223131 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1751) took 1236 ms. Trace:
I20260709 12:20:34.223659 29320 rpcz_store.cc:276] 0709 12:20:32.986875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.988558 (+  1683us) service_pool.cc:224] Handling call
0709 12:20:33.025085 (+ 36527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.026087 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.222871 (+1196784us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b540007ab50. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:34.223058 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82978560}
I20260709 12:20:33.882021  3154 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:34.375547  3149 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:20:34.375169  3154 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.785563  2769 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:33.880862  3129 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:33.804765 28572 leader_election.cc:336] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.694s (SENT)
I20260709 12:20:34.212353  2889 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:34.381409 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:34.433724 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 628947us
I20260709 12:20:34.435832 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:34.439086 28677 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:34.216517  3081 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:33.783061  3107 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.465981 28679 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:33.881676  2926 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.353518  3096 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.451159 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:34.467356 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:33.885265  3097 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:33.779973  3106 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.497001 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.360081  2958 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.481246  2903 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.468497  3081 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.797205  2883 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:33.881747  3142 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:33.780210  2951 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.487543 28681 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:34.439738  3083 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.451673  3145 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:34.510923 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2915) took 1344 ms. Trace:
I20260709 12:20:34.482641  3085 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:34.579592  3127 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.101s	user 0.006s	sys 0.011s
I20260709 12:20:34.492146  3096 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.524631  3100 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.582273  3025 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:34.584494  2912 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:34.588479  3096 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.588562  3100 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.589215  3100 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.591886  3100 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.514190  3108 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:34.592964 28747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 2893) took 2813 ms (client timeout 1641 ms). Trace:
W20260709 12:20:34.593405 28747 rpcz_store.cc:269] 0709 12:20:31.779997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.790522 (+ 10525us) service_pool.cc:224] Handling call
0709 12:20:34.592722 (+2802200us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54001c5554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:34.592863 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3666913152}
I20260709 12:20:34.534104 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3196) took 2257 ms. Trace:
I20260709 12:20:34.594461 28606 rpcz_store.cc:276] 0709 12:20:32.276522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.355557 (+ 79035us) service_pool.cc:224] Handling call
0709 12:20:32.355890 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.700142 (+344252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.533809 (+1833667us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54000a7b54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:34.534028 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665525504}
W20260709 12:20:34.534950 29323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1741) took 2449 ms (client timeout 1906 ms). Trace:
W20260709 12:20:34.595570 29323 rpcz_store.cc:269] 0709 12:20:32.085198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.085909 (+   711us) service_pool.cc:224] Handling call
0709 12:20:34.534686 (+2448777us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54006c1bd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:34.534834 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672354048}
I20260709 12:20:34.535682 29326 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:34.598296 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1869) took 2230 ms. Trace:
I20260709 12:20:34.598654 29326 rpcz_store.cc:276] 0709 12:20:32.368051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.368676 (+   625us) service_pool.cc:224] Handling call
0709 12:20:34.535420 (+2166744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.596773 (+ 61353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.598071 (+  1298us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54006c1bd0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:34.598211 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4982302592}
I20260709 12:20:32.476876 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:34.584679  3085 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.602280  3083 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.602880  3085 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:34.605516  3083 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:34.536923  3153 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
I20260709 12:20:34.537367  2943 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:34.608348  2943 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.610561  2943 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.611287 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2801) took 1037 ms. Trace:
I20260709 12:20:34.538543 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:34.612721 28756 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:34.578579  3152 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 12:20:34.538970 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.615957 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2950) took 1576 ms. Trace:
I20260709 12:20:34.539748 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.617274 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.616303 28599 rpcz_store.cc:276] 0709 12:20:33.039398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.477284 (+437886us) service_pool.cc:224] Handling call
0709 12:20:33.477625 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:33.578824 (+101199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.578852 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:33.613163 (+ 34311us) log.cc:844] Serialized 52 byte log entry
0709 12:20:33.781785 (+168622us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:33.859465 (+ 77680us) log.cc:844] Serialized 14 byte log entry
0709 12:20:33.859736 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.859811 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:34.577991 (+718180us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:34.615706 (+ 37715us) raft_consensus.cc:1685] finished
0709 12:20:34.615784 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.615905 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70601,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":24420,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":171,"spinlock_wait_cycles":17369728,"thread_start_us":247834,"threads_started":2,"wal-append.queue_time_us":772337}
I20260709 12:20:34.618278 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.619287 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.540400 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1450) took 1358 ms. Trace:
I20260709 12:20:34.620577 29322 rpcz_store.cc:276] 0709 12:20:33.181870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.401327 (+219457us) service_pool.cc:224] Handling call
0709 12:20:33.454020 (+ 52693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.473269 (+ 19249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.540161 (+1066892us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b540036abd0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:34.540330 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52216064}
I20260709 12:20:34.616242 28753 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:20:34.626125 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.626875 28753 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:34.627844 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.611698 28678 rpcz_store.cc:276] 0709 12:20:33.573592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.579973 (+  6381us) service_pool.cc:224] Handling call
0709 12:20:33.580267 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:33.581345 (+  1078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:33.581371 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:33.612478 (+ 31107us) log.cc:844] Serialized 26 byte log entry
0709 12:20:33.780992 (+168514us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:33.781048 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:33.781116 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:34.611032 (+829916us) raft_consensus.cc:1685] finished
0709 12:20:34.611073 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:34.611224 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":727,"raft.queue_time_us":1186,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":23138,"thread_start_us":113367,"threads_started":1,"wal-append.queue_time_us":248610}
I20260709 12:20:34.541832  3081 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.543058  3130 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.544238  3140 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:20:34.498632  3124 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:20:34.631337  3124 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:34.631729  3124 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:34.544804 28677 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:20:34.449927  3129 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.634145  3129 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.546545  2958 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.634804  3124 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.563761 28603 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:34.449944 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1749) took 1655 ms. Trace:
I20260709 12:20:34.568254 28751 rpcz_store.cc:276] 0709 12:20:33.166246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.180738 (+ 14492us) service_pool.cc:224] Handling call
0709 12:20:33.180973 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.330033 (+149060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.510617 (+1180584us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540003f554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:34.510851 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242619264}
I20260709 12:20:34.570084  3068 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:34.573789  3145 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.574903  2899 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.526803 28602 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.447985  2769 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.592538  3108 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.531313 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1176) took 2715 ms. Trace:
W20260709 12:20:34.557346 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.620255 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.643811 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42096 (request call id 2936) took 1622 ms. Trace:
I20260709 12:20:34.644066 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 3224) took 1257 ms. Trace:
I20260709 12:20:34.642442 28601 rpcz_store.cc:276] 0709 12:20:31.815828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.839526 (+ 23698us) service_pool.cc:224] Handling call
0709 12:20:31.874050 (+ 34524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.170878 (+1296828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.530979 (+1360101us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400217854. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:34.531209 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2980723584}
I20260709 12:20:34.639583 28756 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:20:34.638049 29318 rpcz_store.cc:276] 0709 12:20:32.779680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.782376 (+  2696us) service_pool.cc:224] Handling call
0709 12:20:34.434793 (+1652417us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400680e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:34.434989 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103775616}
I20260709 12:20:34.639547  3068 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:34.644562 28749 rpcz_store.cc:276] 0709 12:20:33.386768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.388585 (+  1817us) service_pool.cc:224] Handling call
0709 12:20:34.643906 (+1255321us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b5400305f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:34.644006 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102957952}
I20260709 12:20:34.644260 28602 rpcz_store.cc:276] 0709 12:20:33.019469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.112786 (+ 93317us) service_pool.cc:224] Handling call
0709 12:20:34.526654 (+1413868us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4c004d8180. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe1d4ba20 00007f6fe1d5ca29 00007f6fe1d5d13f 00007f6fe1d212ab 00007f6fe1d4ef3c 00007f6fe1d4f3fe 00007f6fe1fdc88b 00007f6fe39db495 00007f6fe3a2c30f 00007f6fe3a76a55 00007f6fe8a46cd0
0709 12:20:34.641575 (+114921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8638720}
W20260709 12:20:34.662504 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.502326  2926 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.655733 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:34.566636  3142 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:34.651182  2797 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.030s	sys 0.025s
I20260709 12:20:34.652366  3081 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.655445  3124 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:34.686445 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3188) took 2753 ms. Trace:
I20260709 12:20:34.687143 28598 rpcz_store.cc:276] 0709 12:20:31.933303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.973234 (+ 39931us) service_pool.cc:224] Handling call
0709 12:20:32.010795 (+ 37561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.472971 (+1462176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.686116 (+1213145us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400216454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:34.686364 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3325297408}
I20260709 12:20:34.690851 28752 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:34.691612 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.691958 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.654299  3100 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:34.694890 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:34.680838  2797 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.031s	sys 0.025s
I20260709 12:20:34.668656  3083 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.706756 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:34.710517 28749 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:34.703275 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.698547 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3234) took 3451 ms. Trace:
W20260709 12:20:34.711373 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.707806 28748 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:34.712471 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1348) took 2107 ms. Trace:
I20260709 12:20:34.716763 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1347) took 2102 ms. Trace:
I20260709 12:20:34.711313 28674 rpcz_store.cc:276] 0709 12:20:31.243213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:31.262406 (+ 19193us) service_pool.cc:224] Handling call
0709 12:20:31.263410 (+  1004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.224091 (+1960681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.688798 (+1464707us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400272c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:34.694363 (+  5565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4450461440}
I20260709 12:20:34.712891 28748 rpcz_store.cc:276] 0709 12:20:32.605543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.691740 (+ 86197us) service_pool.cc:224] Handling call
0709 12:20:32.692143 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.707594 (+2015451us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54002a51a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f6dc0 00007f6fe3a811c0 00007f6fe3a82231 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c
0709 12:20:34.712136 (+  4542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.712388 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281346304}
I20260709 12:20:34.720760  3166 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:34.717284 28755 rpcz_store.cc:276] 0709 12:20:32.601874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.604764 (+  2890us) service_pool.cc:224] Handling call
0709 12:20:32.687071 (+ 82307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:32.696371 (+  9300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.703992 (+2007621us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54002d5ad0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:34.704165 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188350208}
I20260709 12:20:34.736703 29322 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:20:34.737087 29322 pending_rounds.cc:85] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 13
I20260709 12:20:34.737330 29322 pending_rounds.cc:107] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:20:34.737587 29322 raft_consensus.cc:2889] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:34.743077 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.696281  3158 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:34.746840 29323 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:34.743870 29326 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:20:34.747786 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.744081 28748 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:34.744215 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.694857  3026 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.736465  2562 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:34.750509  2562 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.753708  2562 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:34.755905  2562 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:34.757594  2926 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.759327  3107 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:34.767827 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 284234us
I20260709 12:20:34.772047 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:34.736516  2833 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.774726 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:34.693229  3081 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.743373  3085 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.776260 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:34.780002 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:34.738168  3129 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:34.709892  3100 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.786039 29326 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:34.733039  3083 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.788630 29326 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:20:34.792227 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 341214us
W20260709 12:20:34.782665 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 346874us
I20260709 12:20:34.799307 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:34.800587 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:34.779984  3157 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:34.811784  3157 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:34.704445  3068 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.812270  3157 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.812727  3068 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:34.814399  3157 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.814921  3157 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:34.815246  3157 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:34.787082  3085 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.806488  3083 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.808830  3100 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.784073  3129 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.780525  2833 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.808125  3145 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.818746 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:34.785621  3088 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:34.784368  3118 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.820492 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:34.808658  3081 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.809234  2889 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.768684  3026 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.815595  3157 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:34.804699  3140 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.803144  3106 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.784601  3107 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:34.833437 29326 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:34.769302  3158 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.838757 28572 leader_election.cc:400] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17.
W20260709 12:20:34.841975 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 165169us
I20260709 12:20:34.826092  3100 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:34.849926 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:34.858242 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:34.862308 28678 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:34.851842 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:34.863101 28682 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:34.850293 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:34.837178  3108 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.836841  3081 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:34.865209 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:34.860105 28674 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:34.870726 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:34.872910 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:34.847736 28572 leader_election.cc:403] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:20:34.865918 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 65414.7us
I20260709 12:20:34.874459 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:34.841989  2951 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:34.876030  3160 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:34.877628  3129 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:34.878985  3085 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.841506  2889 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.849332  3162 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:20:34.836759  3118 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.848137  3107 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.846276  3140 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.895148 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:34.895923  3026 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:34.895983 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:34.922204 29317 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:34.896863  3142 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.898851 29322 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:20:34.847764 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 110706us
W20260709 12:20:34.903311 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 64734.9us
I20260709 12:20:34.927973 28572 leader_election.cc:400] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:34.884521  3083 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:34.908504 28674 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:34.908794 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:34.911617 28749 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:20:34.857885  3088 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:34.865382  3100 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.930392  3026 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.935760  3026 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.937779  3158 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.939586 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:34.914249  3113 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:20:34.912667 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:34.854051  3161 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:34.869177  3168 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:34.954242 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.954577 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:34.955062 28756 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:34.913316 28682 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:34.897907  2769 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:34.899812  2951 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:34.912384  3032 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:34.913045  2953 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 16. Current term is 17.
I20260709 12:20:34.951131 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.961287 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:34.961831 28755 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:34.930429 28676 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:34.903123  3173 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:34.905611  3160 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:34.944012 28571 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.677s (SENT) [suppressed 23 similar messages]
I20260709 12:20:34.897666  3081 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.944386 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:34.946121 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:34.949761 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:34.950626 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:34.953549  3131 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:34.952311 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.952251 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:35.003353 28753 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 24: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:35.003458 28752 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:34.902089  3108 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:34.962693 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:34.963591 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:34.948734 29292 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:35.010057 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 61434.5us
I20260709 12:20:35.011039  3070 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:20:35.011361 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 67390.1us
I20260709 12:20:35.011564  3070 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:35.012573  3070 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:34.941059  2896 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:34.966318 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:35.015547  2896 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:35.016081 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49884us
I20260709 12:20:34.967615  2953 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:34.951785 28678 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:20:34.948179  3170 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 12:20:35.018502  3170 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:34.937826  3005 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
W20260709 12:20:34.986663 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 111295us
I20260709 12:20:35.020974 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:34.938653  3096 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:20:34.989840  3154 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.024451 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:35.025131 28676 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:35.026857  3170 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:35.027365  3170 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.027693  3170 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:35.028667 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.029188  3154 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:35.030023 28601 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:20:35.031311  3118 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:34.958521  3032 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:35.032768  3005 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:35.032516  3032 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.033284  3005 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.033860  3032 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:34.974714 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:35.036276 28748 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:35.035905  3161 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:35.037186 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.038318 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:34.957633  2797 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:35.039352 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.039948 28682 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:35.041194 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.041795 28680 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:20:35.043699 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:35.044450 28675 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:34.976898 29317 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:35.045926 29325 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:34.977527  2833 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:34.979126  3173 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.956569  3168 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:35.069643  3168 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:34.999886 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1746) took 2221 ms. Trace:
I20260709 12:20:34.977592 28673 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 25: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:35.070608  3081 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:35.070990 28603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3203) took 2648 ms (client timeout 1772 ms). Trace:
I20260709 12:20:35.071523 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:34.958283  2951 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:35.072269 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.072604  2951 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:35.072703 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:35.004011 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:34.955610  3163 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:35.004768 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.074684  3100 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:35.074851  3163 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:35.017496  2953 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.075314  3163 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:34.979092  3171 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:20:35.016460  2896 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.051004 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.053081 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:35.098024 28676 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:35.098487 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:35.098946 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.099596 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:35.099836 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:35.099985 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.101222 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:35.101715  3131 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.102067 29321 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:20:35.102478  3131 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:34.974218  3098 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 12:20:34.998450  3179 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:35.059345 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.104521 28680 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:35.104398  3179 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.105422 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.106187 28680 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:35.057324  3088 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.106590  3118 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:35.107124 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:35.108665 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:35.065903  3141 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:35.106621  3179 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.110205 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.068599  2833 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:35.111116 28682 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 25: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:35.110991  3131 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.111017  2833 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.113580  2833 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.057976  3108 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.114615 29320 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:20:35.116333 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:35.117334 28682 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:20:35.073365  3160 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.121155 28601 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:20:35.076834 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.122447 28602 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:35.077346 28599 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:35.070863 29327 rpcz_store.cc:276] 0709 12:20:32.778670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:32.778827 (+   157us) service_pool.cc:224] Handling call
0709 12:20:32.779230 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:33.748395 (+969165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:34.999618 (+1251223us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54006e0d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:34.999815 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226587904}
I20260709 12:20:35.048471 28674 raft_consensus.cc:2410] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:20:35.071542 28603 rpcz_store.cc:269] 0709 12:20:32.423081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.023350 (+600269us) service_pool.cc:224] Handling call
0709 12:20:35.070670 (+2047320us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540022f954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:35.070912 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3538604288}
I20260709 12:20:35.105464  3175 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:35.067786  3005 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:35.177424 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 268668us
I20260709 12:20:35.178460 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.179358 28598 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 13.
I20260709 12:20:35.177690 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:35.183892 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:35.184679 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:35.186163 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:35.189615 28599 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:35.185721 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:35.119189 28680 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:35.062140 28678 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:35.124334 29317 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:35.076996  2884 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.115504  3108 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:35.173125  3140 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:35.058279  2769 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:35.193898 28679 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:35.200157 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.195358 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.196014  2948 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:35.195375 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:35.190975 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:35.209538 29321 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:35.212872 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.213464 28678 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:35.214336 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.214869 28678 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
W20260709 12:20:35.217298 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.217922 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:35.218214 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.201231 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 184470us
I20260709 12:20:35.203297 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.219165 28603 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:35.205196 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.219600 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:35.220057 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:35.198372  2797 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:35.197382  3162 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:35.198685  3141 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:35.190909  3083 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:35.199457  2896 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:35.176764  3138 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:20:35.230823 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.212555  2948 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.226970 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:35.221761  3100 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:35.221349  3068 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:35.199908  2884 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.226719  2907 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:35.232810  3188 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:20:35.229179  2926 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:35.225723  3175 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:35.230046  3106 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:35.231317  3141 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.252372  3100 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.230551  2953 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.263880  3131 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:20:35.228932  3162 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:35.266705 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 54351.5us
I20260709 12:20:35.228163  3173 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.230774  3107 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:35.268349 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.291590 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.224610  3171 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:20:35.249570  2948 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:35.222059  3176 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:20:35.208813  2769 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.254889  3068 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.267645  2926 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:35.260262  2907 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.274426  3131 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.270985  3141 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:35.278501 28682 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
W20260709 12:20:35.288935 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.325256 28682 pending_rounds.cc:85] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 12
I20260709 12:20:35.290839 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.325707 28682 pending_rounds.cc:107] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:20:35.231456  3160 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:20:35.327102 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.268843  3175 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.263708  3189 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:35.312855 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:35.330475 29323 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
I20260709 12:20:35.313179 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.331802 28603 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:35.272836  3100 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:35.333099 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.334393  2884 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.334791  3175 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:35.297361  3162 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:20:35.336941 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.326010 28682 raft_consensus.cc:2889] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:35.259449  3190 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:20:35.326629 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:35.292799 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.321888  2907 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:35.315944  3068 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:35.319756  2926 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:35.317729  3179 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.345871 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:35.327804 28598 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:35.346236 28756 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:35.341890 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:35.342464 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:35.341058 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:35.348070 28751 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:20:35.358487 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.370059 28648 leader_election.cc:336] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.579s (SENT)
I20260709 12:20:35.370568 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:35.374505 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.377367 28603 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:35.336544  3189 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.394003 28602 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:35.394119 28748 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:35.396193 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:35.396346 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.398890 28598 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
W20260709 12:20:35.401247 28648 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.692s (SENT)
I20260709 12:20:35.396418  3070 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:20:35.396627  3067 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:35.414330  3067 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.419895 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.391009  3032 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:35.325214  3083 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.435166 28603 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:35.329946  3131 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.398818  3124 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.395226  3189 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:35.461853 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.465085 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.465798 28601 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:35.469314  2889 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.475900  3117 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.482824 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.396502  3108 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:20:35.448962  2769 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.394538  3179 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.505570  3179 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.506695  3168 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:35.509429  3157 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.662s	user 0.014s	sys 0.000s
I20260709 12:20:35.510406 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.511041 28601 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:35.511947 28606 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:35.512472 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.513049 28600 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:35.514816 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.509930  3157 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.517885 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.518668 28600 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:35.416414  3067 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.521591 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.522316 28598 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:35.524227 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.431327  3193 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:35.529713 28749 raft_consensus.cc:2410] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:20:35.526809 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:35.443722  3032 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:35.436381  2797 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:35.536614 28605 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 25: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:35.536419 28676 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:35.436266  3070 consensus_queue.cc:1059] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.093s
I20260709 12:20:35.539646 28602 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:20:35.534855  3032 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:35.563529  3100 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.565631  2926 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.567023 28607 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:35.525485  3124 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.599337  2797 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.601065  3141 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:35.601570  3163 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.006s
I20260709 12:20:35.602079 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.575037  2962 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.605213 28600 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:35.605623 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.612864 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.611536 28604 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:35.637380 28606 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:35.637821 28604 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:35.609433  3170 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.009s
W20260709 12:20:35.644084 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 336557us
I20260709 12:20:35.644788 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:35.647900 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.650098 28572 connection.cc:256] RPC call timeout handler was delayed by -1.3750802340000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26280000000000003s for a response
I20260709 12:20:35.652051 28680 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:35.658951 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.646183 28604 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.660749 28604 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:35.638986  2926 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:35.670400 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.649015  3067 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.674770 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.606503  3068 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.607726  3032 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.656374  2951 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.679061  2951 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.679414 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:35.679952 28675 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:35.680408  3068 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:35.681205  2951 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.681066  3067 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.682992  3032 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.683326  3067 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:35.685392 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.685837  3168 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.685961 28598 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:35.686887 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.687604  2948 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.688918 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:35.689465  3141 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.690011 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:35.687919 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.691218 28598 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 13.
I20260709 12:20:35.691516  2833 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:35.691931  2833 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:35.692209 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.691159 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:35.693013 28598 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:35.693533  2951 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:35.693957  2951 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.694309  2951 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:35.700740  3189 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.651157  3170 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.609213  3162 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:35.710958 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:35.703886 28673 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:35.703294 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.704488 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.732781 28675 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
W20260709 12:20:35.775034 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.735567 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:35.734575 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.639464  3163 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:35.776304 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.673866  2562 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:20:35.677557  2884 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 12:20:35.702874  2951 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.704016  2963 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:20:35.728730  3100 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:35.801265 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.802131 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:35.692299  2833 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:35.738395  2769 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:20:35.673753  2899 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 12:20:35.703969  3170 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.707862  3157 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:35.807638 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:35.783393 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.659132  3194 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.991573  3194 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.662561  3179 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.144s
I20260709 12:20:35.644281  2962 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.994099 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:35.807744 28571 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:35.826575 28603 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
W20260709 12:20:35.912822 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.692319  3154 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:35.704561  3189 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.003517  3189 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:36.003878  2962 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:35.986151  3131 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:35.988837  2907 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.002s
I20260709 12:20:36.004408  2962 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:35.661420  3106 consensus_queue.cc:1175] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a8342e3fcab94ce89482df67988159ea" responder_term: 18 status { last_received { term: 17 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 17 index: 9 } }
I20260709 12:20:36.006640  2907 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:35.995263 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:36.007992 28678 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:35.706131  3124 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:35.994908 28680 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 25: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:35.998122 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:35.734339  3160 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:35.656056  3175 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.000933  3154 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:35.815727  3168 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:36.005445 28572 leader_election.cc:336] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 2.628s (SENT)
I20260709 12:20:36.004156 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.014492 28598 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:36.006775  2962 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:36.010192 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:36.011247 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:35.989792  3162 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.007601  3005 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.004065  3189 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.026072 28680 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:36.024725 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 217059us
I20260709 12:20:36.027407 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.017146  3154 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:36.012851  3160 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:36.043697 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.044593 28598 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:36.039891  3160 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:36.023555  3168 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.054399 28678 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:36.054698 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.057149 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:36.057317 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:36.058032 28678 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
I20260709 12:20:36.058223 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.059168 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:36.029242  3205 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:36.025527  3005 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.059603 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.072402 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.074469 28598 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:36.083405 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.090246 28604 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 15: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:36.090600 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.073376 28678 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:36.093751 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:36.095156 28598 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:36.090850 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 62760.3us
I20260709 12:20:36.101215 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.102872 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.088974  2948 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.105912 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.092397 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.110761 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.115595 28604 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:36.115826  3031 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:20:36.119159 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.109408  3163 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.110960  2951 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:36.117064  3206 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:20:36.112063 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.128830 28598 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:36.113242 28571 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
W20260709 12:20:36.124045  3209 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:20:36.120527 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.129746 28571 leader_election.cc:403] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:20:36.131875 28604 raft_consensus.cc:2410] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:20:36.135432 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.121467  2907 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.138497 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1889) took 1191 ms. Trace:
I20260709 12:20:36.138866 29320 rpcz_store.cc:276] 0709 12:20:34.946910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.947020 (+   110us) service_pool.cc:224] Handling call
0709 12:20:34.947293 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.114943 (+167650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.138288 (+1023345us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400458654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.138441 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384006912}
I20260709 12:20:36.140327 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:36.141264 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.142465 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:36.143090 29320 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:36.140630  3125 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.121134  3205 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:36.144814 28675 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:36.136318  3106 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:36.132488  3175 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.146445 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:36.146255 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:36.139523  3110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.653s	user 0.038s	sys 0.079s
I20260709 12:20:36.121140  2833 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.133541  2962 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:36.145474 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.153254 28675 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:20:36.151954  3128 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:36.165723 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:36.168973 28604 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:36.169607 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:36.170459 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:36.163995 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.186540 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:36.187191 28601 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 18 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:20:36.187295 28598 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:36.177832 29320 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 14.
W20260709 12:20:36.183758 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.189568  3157 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:36.190028  3157 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:36.190348  3157 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:36.192546  3154 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:36.151677  3110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.665s	user 0.038s	sys 0.079s
I20260709 12:20:36.169684  2833 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.153780  3218 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:20:36.198406  2958 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:36.154609  3189 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.172780  3128 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:36.153947  3205 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:36.198957  2958 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.199817  3128 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.173852  3005 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.203197 29321 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:20:36.160297  3168 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.196146  3025 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:20:36.160148  3160 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:36.215711 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:36.216775 29327 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:36.216872  3160 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:36.221434 28598 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:36.222324 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 1881) took 1402 ms. Trace:
I20260709 12:20:36.222702 29326 rpcz_store.cc:276] 0709 12:20:34.819989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.820166 (+   177us) service_pool.cc:224] Handling call
0709 12:20:36.222185 (+1402019us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b5400790254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.222273 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15500032}
I20260709 12:20:36.229329 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 1442) took 1169 ms. Trace:
I20260709 12:20:36.229856 28673 rpcz_store.cc:276] 0709 12:20:35.059790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.072481 (+ 12691us) service_pool.cc:224] Handling call
0709 12:20:36.229069 (+1156588us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540019ee54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.229251 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449768320}
W20260709 12:20:36.264818 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.268515  2958 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:36.269479 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.271411  3154 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:36.275707  3082 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:36.278270  3106 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
I20260709 12:20:36.291627 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3265) took 1272 ms. Trace:
I20260709 12:20:36.292053 28679 rpcz_store.cc:276] 0709 12:20:35.018916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.040534 (+ 21618us) service_pool.cc:224] Handling call
0709 12:20:35.193454 (+152920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.199584 (+  6130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.291421 (+1091837us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400272750. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.291552 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350899584}
I20260709 12:20:36.294677 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1192) took 1292 ms. Trace:
I20260709 12:20:36.295080 28599 rpcz_store.cc:276] 0709 12:20:35.002046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.003776 (+  1730us) service_pool.cc:224] Handling call
0709 12:20:36.294494 (+1290718us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b54000bf254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.294617 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8706944}
I20260709 12:20:36.298436 29320 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:36.299068  3025 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:36.300841  3182 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:36.301275  3182 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:36.302146  3182 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.303252  3182 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:36.304682 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.296226 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:36.306572 28599 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:36.307121 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:36.307447 28599 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.307276 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:36.321115 28599 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:36.322423 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:36.322014  3157 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.371950 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:36.372732 28750 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:36.374035 28750 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:36.376403 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:36.376739  3026 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.377291 28752 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:36.377691 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1188) took 1438 ms. Trace:
I20260709 12:20:36.378077 28605 rpcz_store.cc:276] 0709 12:20:34.939234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.939356 (+   122us) service_pool.cc:224] Handling call
0709 12:20:36.377494 (+1438138us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400217d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.377634 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366763904}
I20260709 12:20:36.379199 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.379439 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:36.379885 28605 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:36.339293 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:36.385699 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.347785 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:36.388322 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:36.388882 28679 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:36.389592 28752 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:36.385922 28747 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:20:36.353595 28756 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:36.340399 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:36.393204 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:36.394371 28750 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:36.322516 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:36.396255 28751 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:36.398547 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:36.310186  3162 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:36.402163 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:36.402859 28752 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.313024  3136 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:36.370760  3154 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:36.415551 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.417623 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1892) took 1125 ms. Trace:
I20260709 12:20:36.387670  3168 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:36.423712 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.424921 28679 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:36.405726  3018 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:36.404070  3166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.683s	user 0.020s	sys 0.018s
I20260709 12:20:36.418087 29322 rpcz_store.cc:276] 0709 12:20:35.292544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.294858 (+  2314us) service_pool.cc:224] Handling call
0709 12:20:35.314899 (+ 20041us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:35.315350 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:35.315391 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:35.321144 (+  5753us) log.cc:844] Serialized 26 byte log entry
0709 12:20:36.387436 (+1066292us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18003818e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:20:36.411323 (+ 23887us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:36.411383 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.411474 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.413039 (+  1565us) raft_consensus.cc:1685] finished
0709 12:20:36.413056 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.417456 (+  4400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185,"raft.queue_time_us":3972,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2603,"spinlock_wait_cycles":2736896,"thread_start_us":23655,"threads_started":1,"wal-append.queue_time_us":1090218}
I20260709 12:20:36.443186 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:36.401618  3162 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:36.454964  3162 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.417971  3163 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.466609 28682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2814) took 1347 ms. Trace:
I20260709 12:20:36.467988 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1893) took 1124 ms. Trace:
I20260709 12:20:36.438843  3157 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.428054  3168 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:36.477126 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 2951) took 1029 ms. Trace:
I20260709 12:20:36.477670 28603 rpcz_store.cc:276] 0709 12:20:35.447447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.447919 (+   472us) service_pool.cc:224] Handling call
0709 12:20:36.476952 (+1029033us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54000bed54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.477072 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692990208}
I20260709 12:20:36.475447 29323 rpcz_store.cc:276] 0709 12:20:35.343918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.416623 (+ 72705us) service_pool.cc:224] Handling call
0709 12:20:35.444145 (+ 27522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:35.647080 (+202935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:35.647112 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:35.647554 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:20:36.020808 (+373254us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:36.020848 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.467465 (+446617us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540007ab54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.467537 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.467606 (+    69us) raft_consensus.cc:1685] finished
0709 12:20:36.467624 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.467908 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2315,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7252,"spinlock_wait_cycles":465836416,"thread_start_us":352042,"threads_started":1,"wal-append.queue_time_us":394661}
I20260709 12:20:36.478349  3168 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.426319  3154 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.478933 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2931) took 1526 ms. Trace:
I20260709 12:20:36.473839 28682 rpcz_store.cc:276] 0709 12:20:35.119519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.119770 (+   251us) service_pool.cc:224] Handling call
0709 12:20:35.120090 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.337733 (+217643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.466221 (+1128488us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54003e21d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.466504 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363545472}
I20260709 12:20:36.480621  3154 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.479599  3163 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:36.483246  3163 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.449110  2958 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:36.484462  2958 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:36.451804  3166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.730s	user 0.021s	sys 0.019s
I20260709 12:20:36.488620 29319 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:36.488652  3166 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:36.489545 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1759) took 1392 ms. Trace:
W20260709 12:20:36.489827 29319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 1439) took 3312 ms (client timeout 2628 ms). Trace:
I20260709 12:20:36.490417 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1752) took 2854 ms. Trace:
W20260709 12:20:36.490295 29319 rpcz_store.cc:269] 0709 12:20:33.177733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.180602 (+  2869us) service_pool.cc:224] Handling call
0709 12:20:36.489653 (+3309051us) spinlock_profiling.cc:243] Waited 3.29 s on lock 0x7b5400533ed4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.489769 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7575681280}
I20260709 12:20:36.489979  3166 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.491215  3130 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.491707  3130 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:36.492537 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:36.452780  3223 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:20:36.439980 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:36.458652  2883 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.468837 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3252) took 1609 ms. Trace:
I20260709 12:20:36.460287  3128 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:36.497706 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:36.470953  3083 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 12:20:36.508644 28756 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:36.508772  3162 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.510274 29318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1873) took 1769 ms. Trace:
I20260709 12:20:36.510660 28603 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:36.510645 29318 rpcz_store.cc:276] 0709 12:20:34.740288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.740575 (+   287us) service_pool.cc:224] Handling call
0709 12:20:34.740887 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:34.741865 (+   978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.741911 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:36.201285 (+1459374us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b2c000eb598. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:36.201685 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 12:20:36.255438 (+ 53753us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:36.255478 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.255559 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:36.509854 (+254295us) raft_consensus.cc:1685] finished
0709 12:20:36.509876 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.510069 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":561,"raft.queue_time_us":680,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":17782,"spinlock_wait_cycles":5873024,"thread_start_us":53377,"threads_started":1,"wal-append.queue_time_us":86079}
W20260709 12:20:36.513459 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.488268  2958 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.490864 29325 rpcz_store.cc:276] 0709 12:20:33.636510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:33.636645 (+   135us) service_pool.cc:224] Handling call
0709 12:20:33.667815 (+ 31170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.046283 (+1378468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.490211 (+1443928us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54007a67d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.490361 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3168855808}
I20260709 12:20:36.479277 28755 rpcz_store.cc:276] 0709 12:20:34.952215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.007199 (+ 54984us) service_pool.cc:224] Handling call
0709 12:20:35.007482 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.071354 (+ 63872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:35.071382 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:35.071422 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:35.071450 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.478724 (+1407274us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b54000361d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.478763 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.478878 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146455936}
I20260709 12:20:36.505529 28681 rpcz_store.cc:276] 0709 12:20:34.859243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.866987 (+  7744us) service_pool.cc:224] Handling call
0709 12:20:34.867265 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:34.949393 (+ 82128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:34.949439 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:34.949499 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:34.949546 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.468561 (+1519015us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54003755d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.468622 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.468769 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188393344}
W20260709 12:20:36.505535 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 92792.3us
I20260709 12:20:36.489898 29317 rpcz_store.cc:276] 0709 12:20:35.096663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.103294 (+  6631us) service_pool.cc:224] Handling call
0709 12:20:35.103669 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.193156 (+ 89487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.489325 (+1296169us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400568954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.489485 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46871936}
I20260709 12:20:36.474224  3106 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:36.524425 28755 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:20:36.525785 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.530005 28756 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:20:36.444283 28752 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:36.535157 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:36.463742  3103 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.470500  3018 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:36.539059 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69077.1us
I20260709 12:20:36.522258  3163 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:36.545893 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.545886 28603 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:20:36.550472 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.552416 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 1450) took 1070 ms. Trace:
I20260709 12:20:36.554558 28676 rpcz_store.cc:276] 0709 12:20:35.481533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.482543 (+  1010us) service_pool.cc:224] Handling call
0709 12:20:36.552208 (+1069665us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b5400251054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.552342 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121803008}
I20260709 12:20:36.560940 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 3263) took 1554 ms. Trace:
I20260709 12:20:36.561339 28674 rpcz_store.cc:276] 0709 12:20:35.006990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.007218 (+   228us) service_pool.cc:224] Handling call
0709 12:20:36.552102 (+1544884us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b54000c8354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:36.560875 (+  8773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43461888}
W20260709 12:20:36.547607  3059 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:20:36.564221 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:36.570518 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:36.578056 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:36.582810 28603 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:36.584712 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:36.551945  2896 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.553773  3106 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:36.553375  3171 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:36.553661  3163 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:36.607718 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:36.608596 29319 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:20:36.588603 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:36.560756  2958 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.590793 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:36.580715  2963 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:36.565461  3164 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:36.592415 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:36.618961 29318 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.573311  3103 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.575613  3082 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:36.605792 28721 connection.cc:256] RPC call timeout handler was delayed by -1.0441941049998604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 12:20:36.611846 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:36.591650 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:36.623952 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:36.625808 28752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:36.622192 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:36.626130 29317 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:36.626390 28752 raft_consensus.cc:606] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:36.626995 29325 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 22 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:20:36.592676  3160 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:36.583609  3154 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 12:20:36.605118  3118 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:36.639765 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:36.589576  2896 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.641333 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:36.645934 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:36.586647  3026 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:20:36.657136 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:36.623170  3164 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:36.620554  2889 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:36.646780 29323 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:36.653715  3018 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.654119  2896 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.680747  3106 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.684461  3163 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.686434 29318 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:36.644153 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:36.658030 29325 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:36.657158 29319 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:20:36.623070  3171 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:36.643065  3118 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:36.620736  3212 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:36.630511  2892 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.638213  3113 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:36.658685  3140 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:36.693267  3140 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:36.693883  3140 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:36.620891  2958 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.658919  3194 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.692989  2892 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.695994  2958 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.635438  3082 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.698277  3082 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:36.698771  3229 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 12:20:36.690603  3118 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.699630  3171 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:36.631580  3103 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.704277  3103 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:36.696066  2892 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.715067  3130 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.715619  3164 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:36.721539  3164 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:36.771195 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.774938 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2974) took 1039 ms. Trace:
I20260709 12:20:36.775923 28605 raft_consensus.cc:2410] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 12:20:36.777323 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.775648 28604 rpcz_store.cc:276] 0709 12:20:35.734909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:36.183830 (+448921us) service_pool.cc:224] Handling call
0709 12:20:36.184191 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:36.184465 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:36.582327 (+397862us) log.cc:844] Serialized 14 byte log entry
0709 12:20:36.774054 (+191727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:36.774183 (+   129us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:36.774344 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.774486 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.774734 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":474447,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":575470,"threads_started":2}
I20260709 12:20:36.644907 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:36.802481 28750 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:20:36.803607 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 158623us
I20260709 12:20:36.807717 28754 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:20:36.810225 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.805790 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:36.811272 29318 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:36.799625 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:36.813040 28755 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:36.811887 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:36.818341 28752 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:20:36.821522  2883 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.822408  2883 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.823248 28752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:36.824309 28752 raft_consensus.cc:606] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:36.825207 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:36.826048  2883 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.810393 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:36.688194  2889 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:36.827636  2889 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:36.828857 28751 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:36.831125 28751 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:36.833527 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:36.833630 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:36.836733 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.839231  2958 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:36.847759 28673 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:36.850158 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:36.852855  2896 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:36.853806  2896 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.857134  2896 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:36.858016  2896 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:36.860180  2896 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:36.860792  2896 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:36.860180  2943 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:20:36.865348 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3262) took 1887 ms. Trace:
I20260709 12:20:36.865896 28677 rpcz_store.cc:276] 0709 12:20:34.977743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.977878 (+   135us) service_pool.cc:224] Handling call
0709 12:20:34.978159 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.047023 (+ 68864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:35.047053 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:35.047091 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:35.047119 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.864840 (+1817721us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b540013fe54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.864916 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:36.865168 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157976320}
I20260709 12:20:36.867489  2926 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.868981 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:36.869392 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.870033 28752 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
I20260709 12:20:36.868746  2926 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.872100  2892 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:36.877127  2926 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:36.878777  3082 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:36.879289  3082 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:36.879721  3082 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:36.880645 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.858819 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 2956) took 1348 ms. Trace:
W20260709 12:20:36.879725 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 443605us
I20260709 12:20:36.884001 28607 rpcz_store.cc:276] 0709 12:20:35.510629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:35.511806 (+  1177us) service_pool.cc:224] Handling call
0709 12:20:35.512056 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:35.567436 (+ 55380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:36.858228 (+1290792us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b5400233a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:36.858593 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125927168}
I20260709 12:20:36.931187 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:36.931931 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.932024 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:36.940284 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:36.945231 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:36.948798  3130 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:36.949309 29321 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:36.953650 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:36.958370  3103 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:20:36.960686  3103 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:36.961284  3103 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:36.962832  3103 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:36.967633 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76095.8us
I20260709 12:20:36.968274  3108 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:36.968892  3108 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:36.969343  3108 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:36.969982  3141 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:36.970367  3148 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:36.970726  3141 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.971167  3148 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:36.973714 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:36.977937 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:36.945267 28748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:36.994485 29318 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:36.997751 28748 raft_consensus.cc:606] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:37.000620 28748 raft_consensus.cc:614] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:37.001893 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:37.002684 28748 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:20:37.004544 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.005633  2896 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.008669  2896 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.008862 28754 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:37.009433  3141 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:37.009776  2896 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:37.010083 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:37.010462  2896 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:37.011116  2896 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:37.012727 28755 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:37.016770 28747 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:37.017364 28751 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
I20260709 12:20:37.020788 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:37.021960 28750 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:37.023280 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:37.030269  3148 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:37.031570  3228 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.582s	user 0.002s	sys 0.000s
I20260709 12:20:37.032186 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.033980 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.037420  3163 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:37.039115 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.041826 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.042834 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:37.043015 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.044354 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.044718 28754 raft_consensus.cc:2368] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:37.045195 28675 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:20:37.045495 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.046182 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.047001 28675 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:20:37.047964 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.048916 28677 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:20:37.050004 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:37.050510 28675 raft_consensus.cc:2410] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:20:37.050719 28677 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:37.051530 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.016177 28755 raft_consensus.cc:3055] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:37.053776 28755 raft_consensus.cc:740] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:37.056855 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.037442 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.061928 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.059814 28676 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
W20260709 12:20:37.067066 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 93582.4us
I20260709 12:20:37.067350  2962 raft_consensus.cc:2764] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:20:37.067624 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:37.068475 28749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1360) took 2118 ms (client timeout 1717 ms). Trace:
I20260709 12:20:37.069880  3182 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:37.072980  3113 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:37.068926 28749 rpcz_store.cc:269] 0709 12:20:34.950165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:34.950405 (+   240us) service_pool.cc:224] Handling call
0709 12:20:37.060865 (+2110460us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54001c3c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:37.068251 (+  7386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267775872}
I20260709 12:20:37.068120 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:37.079101  3083 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:37.079497  3083 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.079825  3083 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:37.083513 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
W20260709 12:20:37.030320  3226 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.577s	user 0.002s	sys 0.000s
W20260709 12:20:37.084898  3184 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.631s	user 0.002s	sys 0.003s
I20260709 12:20:37.085537 28674 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:20:37.085897 28674 pending_rounds.cc:85] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 9
I20260709 12:20:37.086123 28674 pending_rounds.cc:107] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:20:37.086380 28674 raft_consensus.cc:2889] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:37.086825 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:37.087982 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:37.089381 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:37.089933 28754 raft_consensus.cc:1240] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:37.092283 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:37.093056  2958 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:37.093367 28753 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:20:37.095779 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.097028  3234 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:37.098933 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:37.099833 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.100266 28748 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
W20260709 12:20:37.100169  3128 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.007s
I20260709 12:20:37.109931 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.107187 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:37.110450 28677 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:37.113054  3168 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:37.113269 29318 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:37.122710  3171 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:37.128592  3212 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:20:37.128804 28755 consensus_queue.cc:260] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:37.129951 28755 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:37.135655 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 180667us
I20260709 12:20:37.144378  2962 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.145361  2962 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.160763  2903 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:37.161573  2903 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:37.164096  2903 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.134786 28749 raft_consensus.cc:606] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.181886 28749 raft_consensus.cc:614] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:37.103709 29323 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:37.184129 28502 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 8 to 9, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 9 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.189704  3140 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:37.193907 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.189730 29322 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:37.197917 28679 raft_consensus.cc:1240] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:37.198771  3140 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:37.199155 28498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 233) took 20954 ms (client timeout 15000 ms). Trace:
W20260709 12:20:37.184291 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 85493.9us
I20260709 12:20:37.107930  3082 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.201355 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.202602  3082 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:37.203003 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:37.203949  3168 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:37.204684  3182 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:37.205150  3182 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:37.205534  3182 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:37.130913  2896 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.209192 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:37.210497 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 69596.1us
I20260709 12:20:37.210698  2896 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:37.212829  3026 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:37.213830  3026 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:37.214155  3026 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:37.215232  3026 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:37.215730 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 148220us
I20260709 12:20:37.216328 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:37.216672 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.217108 28599 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:37.188004 28502 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.224725 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.112322  2889 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.228193 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:37.222903 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:37.239339 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:37.249191 28755 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:37.255712 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:37.262382 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44509.7us
I20260709 12:20:37.262954  3164 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:37.263706  3164 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:37.265885 28502 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 9 to 12, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 12 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
W20260709 12:20:37.266988 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50495us
I20260709 12:20:37.272675 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:37.273522 28598 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:37.273861 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet a5dc72678108404787b2aa034d4a7243 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:54532
I20260709 12:20:37.275350  3118 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:37.276649 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 331668us
I20260709 12:20:37.277510  3118 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.277779 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:37.278239  3118 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:37.278636  3118 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.279023  3118 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:37.280570 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:37.281157 28602 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:37.284371 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.285312 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.262252 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:37.268072 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:37.250771  3026 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:37.294661 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.305213 28605 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:37.307107 29325 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:37.307574 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:37.289453  3164 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.309378 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.291708  2883 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:37.268237 28502 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:37.294706  3212 raft_consensus.cc:2764] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:20:37.304975  3168 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:37.317673 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.330971  3171 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:37.331549  3171 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:37.335635 28605 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:37.334084 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.337405 28602 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:37.315333  3103 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:37.319433  2889 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:20:37.310513  3140 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 12:20:37.351251 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 139409us
I20260709 12:20:37.353283 28679 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:37.341183  3103 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:37.359935  2896 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:37.360870  2896 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:37.361259  2896 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:37.362272  2896 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.367194 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.368072  3082 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:37.358361  3108 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.370683 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.371034  3108 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.371330 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:37.371861 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:37.199551 28498 rpcz_store.cc:269] 0709 12:20:16.245041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:16.274965 (+ 29924us) service_pool.cc:224] Handling call
0709 12:20:16.507822 (+232857us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b540002c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e9090 00007f6fe3a87f3a 00007f6fe983de9c 00007f6fe993c04e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc 00007f6fe7dfc392 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:37.198921 (+20691099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:28.745911 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:28.777209 (+ 31298us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:28.777261 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:20:28.777281 (+    20us) tablet.cc:662] Decoding operations
0709 12:20:28.929672 (+152391us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:28.929803 (+   131us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:28.929831 (+    28us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:20:29.034738 (+104907us) tablet.cc:701] Row locks acquired
0709 12:20:29.072178 (+ 37440us) write_op.cc:260] PREPARE: finished
0709 12:20:29.099498 (+ 27320us) write_op.cc:270] Start()
0709 12:20:29.179528 (+ 80030us) write_op.cc:276] Timestamp: P: 1783599629089764 usec, L: 0
0709 12:20:29.190241 (+ 10713us) op_driver.cc:348] REPLICATION: starting
0709 12:20:29.302135 (+111894us) log.cc:844] Serialized 9606 byte log entry
0709 12:20:30.052677 (+750542us) op_driver.cc:464] REPLICATION: finished
0709 12:20:30.410684 (+358007us) write_op.cc:301] APPLY: starting
0709 12:20:30.430848 (+ 20164us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:31.085825 (+654977us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:31.085944 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:31.397209 (+311265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:31.397604 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:20:31.397670 (+    66us) write_op.cc:312] APPLY: finished
0709 12:20:31.398219 (+   549us) log.cc:844] Serialized 212 byte log entry
0709 12:20:31.585038 (+186819us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:31.652496 (+ 67458us) write_op.cc:454] Released schema lock
0709 12:20:31.696679 (+ 44183us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:31.815111 (+118432us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:31.821990 (+  6879us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":288174,"reported_tablets":41,"spinlock_wait_cycles":36380032,"child_traces":[["op",{"apply.queue_time_us":343709,"apply.run_cpu_time_us":47918,"apply.run_wall_time_us":1377491,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104207,"num_ops":24,"prepare.queue_time_us":224499,"prepare.run_cpu_time_us":17952,"prepare.run_wall_time_us":651972,"raft.queue_time_us":380690,"raft.run_cpu_time_us":24376,"raft.run_wall_time_us":263502,"replication_time_us":862226,"thread_start_us":808069,"threads_started":5,"wal-append.queue_time_us":268195,"wal-append.run_cpu_time_us":28549,"wal-append.run_wall_time_us":2475650}]]}
I20260709 12:20:37.355893 28502 catalog_manager.cc:5697] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 5 to 11, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 11 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.378916 28678 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:37.379331 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:37.379987 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.383229 28678 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:37.384057 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.385210 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.385704 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:37.386229 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.380127 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.387806 28674 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:37.388650 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.389667 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.387292 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.381141 28502 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:37.379981 28749 raft_consensus.cc:606] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:20:37.393445 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.396557 29323 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:37.393481 28673 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
W20260709 12:20:37.351701  3106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.008s	sys 0.020s
I20260709 12:20:37.352300  3130 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.406335 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.409996 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:37.392314  3103 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:37.405766  3168 raft_consensus.cc:2764] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 12:20:37.406881  3106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.009s	sys 0.021s
I20260709 12:20:37.412621 28682 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:37.427518 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.428712 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:20:37.339958  3171 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.439522 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:37.440686 28599 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:37.439520 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.449034 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:37.449232  3256 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:20:37.449909 29320 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:37.450780 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.450914  3249 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:37.451879 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.451747  3249 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.452970 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.453658 29327 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
W20260709 12:20:37.454196 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.454519 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.455583 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:37.456043 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:37.456560 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.456909 29322 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:37.457355 29326 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:37.458184 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.458825 29326 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:37.444240 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:37.465969 29319 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:20:37.467047 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.468734 29325 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:20:37.433080  3130 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.470072 29325 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:37.471694  3130 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.459538 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:37.479727 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 227880us
I20260709 12:20:37.480525 29323 raft_consensus.cc:2410] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:20:37.512154 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.519178 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.519654 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.520869 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:37.521888 28648 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.521962  3163 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:37.522921 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.526839  3118 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.454663  3249 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.530107  2962 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:37.539836 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 103184us
W20260709 12:20:37.536182 28572 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.512s (SENT)
I20260709 12:20:37.545708 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:37.546185 29322 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
W20260709 12:20:37.547099 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 233366us
I20260709 12:20:37.545475  3234 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:37.551364  3234 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.551740  3234 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:37.552601  3212 raft_consensus.cc:993] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:20:37.553208  3212 raft_consensus.cc:1081] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:20:37.557159 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:37.557536  3163 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:37.558395 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:37.560860  3005 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:37.561283  3005 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:37.561669  3005 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:37.565029  3097 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:37.565479  3097 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.565837  3097 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:37.571512 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:37.573186  3168 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:37.574831 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.579746 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:20:37.580960 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44929.2us
I20260709 12:20:37.580991  2903 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:37.582178 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.580005 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.531975  3182 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.524168  3083 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:37.584882  2896 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:37.599332 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:37.599478  3083 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:37.620042 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 98261.9us
I20260709 12:20:37.689368 28675 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:37.690384 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67421us
W20260709 12:20:37.681919 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 85557.9us
I20260709 12:20:37.627020 29325 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:20:37.708741 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.725445 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.689244  2903 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:37.728895  2903 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.730757 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:37.732695 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:37.735061  3118 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:37.740576  3260 tablet_replica.cc:333] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:20:37.745900 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.748962 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:37.749796 28675 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:37.751708  3194 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:37.752445  3194 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:37.759336 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.760610  2903 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:37.761648  3194 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:37.774658 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 399622us
I20260709 12:20:37.789767 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.790671  2883 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:37.790732  3097 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.791178  2883 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:37.791646  2883 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:37.782444 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.793411 29326 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:37.777956  3163 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:37.807273 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:37.807958 28676 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:37.812379 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.800683 28502 catalog_manager.cc:5697] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 8 to 10, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 10 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:37.815948 29326 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:37.819469 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:37.820998 29321 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:20:37.823904  3163 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:20:37.815382  3103 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.825686  3097 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:37.852366 29326 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:37.852860 29326 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:37.853855 29326 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.854936 29326 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:37.857386  3168 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:37.885653 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 135211us
W20260709 12:20:37.887498 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.889737 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 151294us
I20260709 12:20:37.864172  3005 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:37.907516 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.910933 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 329219us
W20260709 12:20:37.910379 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 176415us
I20260709 12:20:37.903290  3182 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:37.915268 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:37.930451  3005 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.928604 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:37.932657 29327 raft_consensus.cc:2410] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:37.932092  3168 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:37.938409 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.942523 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:37.935222  3264 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:37.952309 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:37.936133  3026 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.003s
I20260709 12:20:37.958457  2883 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:37.960698 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:37.964509  3171 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:37.964931  3171 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.965286  3171 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:37.965452  2883 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:37.967226  3264 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:37.968312  3264 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:37.971612 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:37.971944 28756 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:20:37.972362  3234 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:37.974838  3234 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:37.975414  3234 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:37.980396 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:37.980960 28573 leader_election.cc:336] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.504s (SENT)
I20260709 12:20:37.981526 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:37.982259 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.982657 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:37.984732  3194 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:37.986825 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.987913  3083 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:37.988694  3182 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:37.989560  3173 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:37.987519  3275 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:37.990056  3173 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.990319  3275 consensus_queue.cc:1243] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 22.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:20:37.990485  3173 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:37.990952  3275 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:37.991372  3275 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:37.992362 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:37.960623  3103 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:37.994518 28676 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:37.999487 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:37.992775 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:37.995036 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:37.998382 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:38.006767 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.006922 28751 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:38.007388 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:38.009318 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45300.4us
I20260709 12:20:38.010329 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:37.976190  3234 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:38.014278 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:38.021792  3182 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:38.022379  3182 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:38.023384  3182 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.023873 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:38.013384  3194 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:38.017814  3262 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:37.992414  3275 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:38.024410  3269 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:20:38.049094 28648 connection.cc:256] RPC call timeout handler was delayed by -1.1778362709999328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 12:20:38.024631  3026 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:38.049966 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:38.025115  2962 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:38.050951  3083 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:38.051242  2962 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:38.052305 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:38.026392  3271 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:20:38.025295  2892 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:38.050518  3026 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:38.027199 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45072.8us
I20260709 12:20:38.054366  3026 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.055248 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:38.036767 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44074.9us
I20260709 12:20:38.052201  2962 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.058115 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:38.066002 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.073037 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51619.5us
W20260709 12:20:38.045790  3268 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 12:20:38.077096 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:38.043258  3265 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
W20260709 12:20:38.043818  3266 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.161s	user 0.001s	sys 0.004s
I20260709 12:20:38.028594  3212 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.053489  2892 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:38.024991  3194 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:38.113132  3194 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.040975  3234 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.124155  3106 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:38.124895  3106 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.127625  3106 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:38.137564  3171 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:38.087193 29292 connection.cc:256] RPC call timeout handler was delayed by -1.367470486000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 12:20:38.080269  3110 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:38.107335  2903 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.109787  2883 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:20:38.110281 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58044.2us
I20260709 12:20:38.147266 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:38.149019 28720 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.525s (SENT)
I20260709 12:20:38.040108  3275 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:38.071316  3083 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:38.151899 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.153499 28680 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:38.142041  3110 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.155882  3083 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:38.163547 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.164199 29327 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:38.166553 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.166729  2892 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.167323 29327 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:38.162542  3083 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:38.175612 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:38.140331  3212 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:38.208140 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46509.5us
I20260709 12:20:38.208244 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:38.208694 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.195535 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.214118 28598 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:20:38.156788  3005 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.222625 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 63100.7us
I20260709 12:20:38.224324 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.224925 29326 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:38.228066 29326 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:38.149736  2903 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.161793  3106 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.239552 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.240067 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.241868 29318 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:38.242915 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:38.243547 29319 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:38.244243 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.244719 28677 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:38.245239 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.246054 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.247074 29323 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:38.249567 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.250545 29326 raft_consensus.cc:2410] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:20:38.256793 29321 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:38.257381 29320 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:38.247671 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.257244 29327 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:38.170555  3110 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:38.176323  3164 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:20:38.261209 29325 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:38.176182  3141 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:20:38.265983 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:38.266031 29322 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 12:20:38.269623 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.275264 28677 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:38.232372  3182 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:20:38.238837  3005 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:38.292539 29290 leader_election.cc:336] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.717s (SENT)
I20260709 12:20:38.294245  3182 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:38.294719  3182 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:38.294756 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:38.296154 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:38.296555 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:38.298045 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:38.298354 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:38.304831 29325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:20:38.304976  3264 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:38.305464  3264 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:38.306151 28681 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:38.306447  3264 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.308599 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:38.309719 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:38.311054 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.295784  3182 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.324103 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.324211 28598 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:38.274462  3106 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.353259 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:38.353921 28602 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:20:38.287699  3171 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:38.359457 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:38.361821 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 186261us
I20260709 12:20:38.363857 29319 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
W20260709 12:20:38.364822 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.317442  3277 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:38.366583 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:38.365998 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:38.367362 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.368518 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.376010 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.384063 29319 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:38.384581 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:38.328665  3168 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:20:38.387924 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.389020 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:38.390607 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.391726 28756 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
I20260709 12:20:38.378988 28749 raft_consensus.cc:2376] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25. Re-sending same reply.
W20260709 12:20:38.393653 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 223339us
I20260709 12:20:38.396833 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.398377 28677 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:38.387111 29292 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:38.402725 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.405449 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:38.407279 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53844.7us
I20260709 12:20:38.409423 28681 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:38.415799 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:38.416088 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.417042 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.417838 28749 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:38.391155  3168 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.433609 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:38.328303  3163 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
W20260709 12:20:38.426046 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.429859 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:38.407773  3264 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:38.440186 28573 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.642s (SENT)
I20260709 12:20:38.442094 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.442757 28749 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:38.445129 28677 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:38.390175  2937 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.228s
I20260709 12:20:38.447407  3163 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:38.447858  3163 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:38.448809  3163 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.439904 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:38.450387 28598 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:38.447443 28603 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:38.451646 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:38.454993 28681 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:20:38.418705  2896 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:38.455950 28677 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:38.456828 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.466511 28755 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:38.467512 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.468469  3234 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:38.469859 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:38.471519  3234 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.472218  3234 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.475033  3234 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:38.461220 28602 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:38.439049  3168 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:38.476718 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:38.411010  3083 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.451108  3260 raft_consensus.cc:2243] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.476826 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.450016  3163 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:38.477605 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:38.478137 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:38.479449 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:38.479523 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:38.455143  3182 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:38.489352 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:38.496785 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.497422 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:38.497608 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 72522.9us
I20260709 12:20:38.514640 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:38.493680 29319 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:38.510394  3298 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:38.517688  3296 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:38.518381 28720 leader_election.cc:336] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Timed out: RequestConsensusVote RPC to 127.26.205.130:42113 timed out after 1.536s (SENT)
I20260709 12:20:38.518277  3296 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.520000 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:38.520718 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 105356us
I20260709 12:20:38.521606  3292 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:38.521974 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:38.522558  3171 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:38.486671  3118 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.523130  3171 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.525146  3171 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:38.520628  3026 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:20:38.525403 28750 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:20:38.526674  3260 raft_consensus.cc:2272] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.527292 28721 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:38.528095  3026 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:38.528501  3026 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.528661  2903 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:38.529001  3026 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:38.529543  3106 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:38.529551  3212 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:38.530031  3005 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:38.528549 29325 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:38.533582 29325 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:38.546479 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:38.498355  3261 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:38.549974 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 134885us
I20260709 12:20:38.555049 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:38.557217 28749 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:38.559980  3234 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:38.561312 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:38.523677  3118 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.545565  3103 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:38.558405  3171 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 12:20:38.566606 28676 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 12:20:38.596343 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:38.611469 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.509409  3173 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:38.611763 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.552224  3296 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:38.613785 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.581699  3234 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:38.618379 29319 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:38.628332 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:38.629735 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.549527  3262 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 12:20:38.633863 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 178255us
I20260709 12:20:38.563865  3292 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:38.632248 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.635797 29318 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:38.635842 29320 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:38.636889 28573 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.694s (SENT)
W20260709 12:20:38.638103 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.581264  2903 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:38.645289 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:38.648962 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 87754.7us
I20260709 12:20:38.646109 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:38.554584  3291 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:20:38.646266 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.651575 29327 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:38.650480 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:38.649684 28682 raft_consensus.cc:2376] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19. Re-sending same reply.
I20260709 12:20:38.621513  3106 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.687397 29317 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:38.563048  3212 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:20:38.687783 28678 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:38.652496 28681 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
W20260709 12:20:38.688148 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 166274us
I20260709 12:20:38.687698 28675 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:38.695245 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.696029 28682 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:38.698695 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48320.2us
I20260709 12:20:38.564124  3261 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.633328  2883 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 12:20:38.689229  3293 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:20:38.703311  3289 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
W20260709 12:20:38.708700 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.710649 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:38.709796 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:38.723624 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:38.741765 28682 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:38.707722  3263 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:38.754501 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:38.755172 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.749570 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:38.747562 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 126186us
I20260709 12:20:38.697593  3234 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:20:38.764175 29318 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
W20260709 12:20:38.775872 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 125479us
I20260709 12:20:38.706566  3171 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:20:38.694861  3106 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.751809  3275 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:20:38.795811  3315 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 12:20:38.799782  3148 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:38.794480 29325 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.810657 28751 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
W20260709 12:20:38.781019 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53649.8us
W20260709 12:20:38.789049 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 82035.1us
I20260709 12:20:38.779085 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:38.793282  2937 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:38.756877  3319 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:38.752846  3263 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:38.794436 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:38.780462 29317 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:38.765024  3083 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:38.778754  3260 ts_tablet_manager.cc:1916] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:38.746438  2903 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 12:20:38.842862 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48517.2us
W20260709 12:20:38.855494 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 78395.1us
I20260709 12:20:38.779663  3118 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:38.856312 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:38.763906  3277 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 12:20:38.860921 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:38.865281 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 101649us
I20260709 12:20:38.855149  3164 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:38.873293  3314 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:38.874135 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 95147.7us
I20260709 12:20:38.867107  2937 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:20:38.871217  2903 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 12:20:38.882999 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71209.6us
I20260709 12:20:38.875885  3164 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:38.897380 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 98644.1us
I20260709 12:20:38.868768  3083 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:20:38.896588  2937 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.911747 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:38.901778  3164 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:38.896679  3173 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:38.901388  3319 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:38.912707 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57476.8us
I20260709 12:20:38.907909  3277 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:38.920744 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:38.921802 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 65579us
I20260709 12:20:38.924993 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:38.913749  2937 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:38.926219  2903 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:38.927843  3103 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:38.933192  2903 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:38.933377  3103 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.933810  3103 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:38.934123  2903 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:38.934664 29325 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:38.935547  2903 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:38.937041  3316 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 12:20:38.938862  3312 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.078s	user 0.001s	sys 0.001s
I20260709 12:20:38.900017  3313 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.176s
I20260709 12:20:38.907395  3234 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:20:38.947450 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:38.884140  3263 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:38.923246  3277 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:38.954927 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:38.958814 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:38.965262  3329 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:20:38.965979  3310 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 12:20:38.966578  3306 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:20:38.967074  3325 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:20:38.970759  3320 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:38.973809  3106 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:38.958837  3291 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:38.946652  3083 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:39.016898  3083 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:39.017803  3083 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.015367  3320 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:38.984901  3263 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.019129  3083 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:38.922314  3005 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:20:39.019547  3320 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.020809  3320 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:38.965150  3326 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:38.953806  3097 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:38.997996  3329 consensus_queue.cc:1243] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:20:39.017856  3311 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:20:38.960322  3182 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:39.028416 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 162463us
I20260709 12:20:39.000121  3313 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:20:39.035538 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 88186.1us
I20260709 12:20:39.036840 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:39.037501  3261 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.038199  3261 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:39.038736 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:39.040176  3026 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.511s	user 0.003s	sys 0.006s
I20260709 12:20:39.040657  3026 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.042881  3026 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.029834  3182 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:39.044759  3291 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:39.046638  3182 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:39.047281 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 142558us
I20260709 12:20:39.047565 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:39.048012 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.051133 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:39.053776 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.054201 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.031095  3313 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.055292 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:39.055708 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 177554us
W20260709 12:20:39.056769 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.029939  3275 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:39.059193 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 61070.8us
W20260709 12:20:39.060942 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 108564us
I20260709 12:20:39.058532 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.061645 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:39.062510 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.063642  3331 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:39.063949 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.064644  3330 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.061697 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.065480 28573 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
I20260709 12:20:39.068661  3331 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:20:39.069217  3331 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:39.069339 28750 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:20:39.069628 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:39.070292 28752 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
I20260709 12:20:39.070453 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:39.071158 28756 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:20:39.070272  3331 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.073261 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:39.074705 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:39.075330 28756 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:39.075711  3330 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:39.081509 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.056392  3026 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:20:39.056229  3313 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.053093  3182 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:20:39.053198  3118 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 12:20:39.084909  3026 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.085259  3314 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:39.087308  3291 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:39.101753  3194 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:20:39.115350  3297 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.115422  3118 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:39.118570 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 53968.9us
I20260709 12:20:39.095654  3340 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:39.052266  3277 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.129839 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.109931  3026 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:39.099195  3338 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:39.097433  3333 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:39.143599 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:39.147293 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 85696.7us
I20260709 12:20:39.149789 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.149591 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.149515 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:39.152673 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.153512 28678 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:39.156239  2962 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:39.156010  3164 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:39.156674  2962 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:39.157014  3332 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:39.157960  3332 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:39.157647  2962 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.158255  3164 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:39.158919  3164 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:39.159261  3164 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:39.159395  3318 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:39.159806  3318 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:39.160588  3335 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:39.161072  3335 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:39.160673  3318 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.162014  3318 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:39.161842  3335 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.163153  3335 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.163329  3264 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:39.163743  3264 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:39.097532  3326 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:20:39.134964  3182 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.100271  2937 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:39.101646  3103 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.108943  3337 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 12:20:39.099514  3275 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:39.158399  3332 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.155953  3329 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.158941  2962 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:39.208719 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 78154us
I20260709 12:20:39.202201  3338 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.204789  3314 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:39.160175  3164 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.210018  3332 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:20:39.234932 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 85480us
I20260709 12:20:39.204757  3182 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.213865  3341 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:39.210433  3329 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:39.250692 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.255182 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 173971us
W20260709 12:20:39.258739 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 109040us
I20260709 12:20:39.261281 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.241995  3341 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.265718 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:39.271953 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62345.6us
W20260709 12:20:39.274209 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.233053  3313 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.283349 29290 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.265143  3298 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:39.265983  3350 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.268297  2892 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.290920 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.227211  3338 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:39.295565 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 146214us
W20260709 12:20:39.285684  3163 consensus_meta.cc:287] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.004s
I20260709 12:20:39.297147 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:39.297881 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.299296 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.272537  3341 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:39.305070 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:39.289101  3298 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.304781 28680 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:39.305691 28674 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:39.305243 28677 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:20:39.303836 29323 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:39.297057  3337 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:39.292912  3292 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.355024 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:39.344455 28673 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:20:39.339749 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 82832.3us
I20260709 12:20:39.351542  3097 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:39.305691  3298 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.354951 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:39.349248 28679 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:39.364727 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:39.376957 28754 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:39.367654  3097 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:39.300238  3348 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 12:20:39.391330 28748 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:20:39.367769  2896 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.394114 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.397892 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.381053  3103 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:39.379441  3163 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.308591  2892 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.382774  2937 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:39.402135 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:39.402997 28754 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.304313  3350 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.292197  3314 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:39.412603 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.427646 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.405702  3163 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.431495  3163 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.433527  3354 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:39.434080  3354 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.436290  3083 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:20:39.437104  3110 consensus_meta.cc:287] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.149s	user 0.008s	sys 0.005s
I20260709 12:20:39.437537  3110 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.437767  3083 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:20:39.439095  2903 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 12:20:39.439584  3110 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:39.440552  3168 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.910s	user 0.013s	sys 0.000s
I20260709 12:20:39.440747  3355 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:39.448961 28754 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:39.441043  3168 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.455520  3338 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:39.455873  3313 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:39.456883  3168 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.450234 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:39.457816 28674 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
W20260709 12:20:39.453742 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.459038 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.459600 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:39.457001  3353 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:20:39.459909 28747 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:39.403373  3331 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:39.468250 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.414106  3182 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.471441 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.472301 28677 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:39.440590  3327 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.475265 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:39.475523 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:39.476780 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:39.477743 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:39.478323 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:39.451807  3326 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:20:39.468973  3110 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:20:39.400799  2896 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.508049  3329 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:39.515280  3343 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:20:39.517685 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:39.539166 28677 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:39.486393  3182 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:39.553094  3182 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:39.554116  3356 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.554849  3356 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.556332  2896 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:39.560232  3356 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.469009  3313 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:39.566251 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.579159  3347 log.cc:927] Time spent T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:20:39.588609  3350 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:39.588788  3298 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:39.590481  2892 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.589859 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.463315  3173 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:20:39.592375  3298 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:39.631598 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.532866  3331 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:39.486034  3344 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:39.635874 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 157640us
I20260709 12:20:39.637353 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:39.532661  3348 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:39.533267  3354 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.658011 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.617870  3313 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.631114  3356 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:39.638739  3344 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:39.674692 29325 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:39.674811 29326 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:39.554141  3182 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:39.675843 29318 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:20:39.568383  3332 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:39.660238  3118 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
I20260709 12:20:39.666517  3292 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:39.695883 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:39.696650 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:39.699172 29319 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:39.702734 29318 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:39.703246 29318 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:39.692178  3297 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.001s
I20260709 12:20:39.681522  3298 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:39.708731 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71481.3us
I20260709 12:20:39.682253  3344 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:39.710932 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:39.722826  3359 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:20:39.723592  3097 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:39.724555  3352 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 12:20:39.728063  3026 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.003s
I20260709 12:20:39.728554  3264 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:39.729636  3318 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.003s
I20260709 12:20:39.684525  3260 ts_tablet_manager.cc:1929] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 12:20:39.730299  3260 log.cc:1199] T a5dc72678108404787b2aa034d4a7243 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/a5dc72678108404787b2aa034d4a7243
I20260709 12:20:39.731644  3260 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54532 (request call id 1) took 2512 ms. Trace:
I20260709 12:20:39.692919  3356 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:39.735201  3356 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:39.736670  2892 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:39.737118  2892 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:39.737226  3313 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:39.738685  3322 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:39.739121  3322 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:39.739431  3332 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:39.741444  3320 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.000s
I20260709 12:20:39.695366  3118 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:39.742471 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:39.743065 29326 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.743170 29327 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 12:20:39.744424 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:39.744881 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:39.714493  3297 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:39.745604 29321 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:39.745069 29320 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:39.745625 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.729595  3264 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:39.763033 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.767953 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1391) took 1291 ms. Trace:
I20260709 12:20:39.768368 28751 rpcz_store.cc:276] 0709 12:20:38.476773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.477191 (+   418us) service_pool.cc:224] Handling call
0709 12:20:39.767757 (+1290566us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001c4154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:39.767866 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330269056}
I20260709 12:20:39.660598  3348 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.753100  3141 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:39.753566 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:39.770583  3148 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.771162  3261 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:39.771234 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:39.772059  3141 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:39.771819  3261 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.772254 28680 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:20:39.773777  3292 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.774149 29325 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:39.774261  3292 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.711802 29318 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.775560 29318 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.779469 28681 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:20:39.732015  3260 rpcz_store.cc:276] 0709 12:20:37.225138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:37.260853 (+ 35715us) service_pool.cc:224] Handling call
0709 12:20:37.570196 (+309343us) ts_tablet_manager.cc:1151] Deleting tablet a5dc72678108404787b2aa034d4a7243
0709 12:20:37.578070 (+  7874us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:39.098740 (+1520670us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:39.670213 (+571473us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:39.731561 (+ 61348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519737,"tablet-delete.queue_time_us":295253,"thread_start_us":125861,"threads_started":1}
I20260709 12:20:39.781401 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet a5dc72678108404787b2aa034d4a7243 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:20:39.781994 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:39.783630 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:39.784184 28604 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19. Re-sending same reply.
I20260709 12:20:39.785348  3313 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.785531 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:39.785876  3313 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.787108 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:39.770798  3348 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.780777  3141 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:39.788376  3313 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:39.793195  3277 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:39.793267 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:39.788635 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:39.756625 29317 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:39.789522 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:39.790683 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:39.791340 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:39.792858 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:39.800329 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:39.801440 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.788856 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:39.803160 29323 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:39.803429 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:39.804091 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.805277 28755 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:39.806793 29321 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:39.808921 28606 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:39.807011 29326 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:39.816469 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:39.817641 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.817602 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.752671 29319 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:39.824839 29318 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:39.825430 28607 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:39.859711 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:39.850931 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.774006  3261 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.867216 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:39.789960  3346 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.574s	user 0.000s	sys 0.002s
I20260709 12:20:39.872618 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:39.869954 28680 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
W20260709 12:20:39.875383 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 420940us
I20260709 12:20:39.877542 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:39.874540 29327 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:39.776345  3292 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:39.816203  3320 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:39.890182 29323 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:39.890928 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:39.893141 29325 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
W20260709 12:20:39.893234 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.893301 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:39.894044 29323 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:39.816949  3313 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:39.898013 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:39.898962 29325 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:39.911675 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:39.800549  3026 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.912330 29327 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:39.914481 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:39.931844 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:39.932168 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:39.896970  2962 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.003s
I20260709 12:20:39.889897  3331 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:39.934437 28607 raft_consensus.cc:1217] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Deduplicated request from leader. Original: 15.13->[16.14-16.14]   Dedup: 16.14->[]
I20260709 12:20:39.932720 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:39.938472 28607 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:20:39.867063  3348 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:20:39.875880  3326 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:20:39.938668 29327 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:39.895375  3292 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:39.740000  3322 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.960812 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:39.963305 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:39.964401 28599 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.904634  3313 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:39.962059 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 466044us
I20260709 12:20:39.881238  3261 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 12:20:39.981441 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.982161 28749 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 26: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:39.940202  3330 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:39.983939 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:39.986527 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:39.994094 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:39.990785 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:39.738029  2892 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:39.935794  3320 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:39.938372  3234 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:40.026243  3234 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:40.026829  3234 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:39.991233 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:39.991722 28756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.038s	sys 0.046s
I20260709 12:20:39.960947  3334 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:40.029008 28756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.039s	sys 0.046s
I20260709 12:20:39.995903 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.035902  3234 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:39.961382  3292 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.960981  2937 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:40.018325 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:39.999071 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.022634 29325 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 26.
W20260709 12:20:40.020857 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.029035  3334 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:40.010195 28682 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:40.037333  3320 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.037860 28598 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:40.059774 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.082036 28600 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:39.973196  3313 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:39.993706  3330 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.040748 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.098368 28599 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:39.985653  3356 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:20:39.995208  3327 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.004s
W20260709 12:20:40.075320 29292 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.840s (SENT)
I20260709 12:20:40.128391 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.075911 28605 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 12:20:40.065521 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.062004  3341 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.757s	user 0.005s	sys 0.006s
I20260709 12:20:39.972043  3110 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 12:20:40.101431 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:40.103852 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.070263  3292 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.105432 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:40.040936  3291 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:40.124775 28674 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:20:40.132622 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:40.149750 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 100198us
I20260709 12:20:39.992486  3348 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.110s
I20260709 12:20:40.156493 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.080583  3334 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:40.106072  3330 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:40.114981 28648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.558s (SENT) [suppressed 59 similar messages]
I20260709 12:20:40.172488 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.106829  3356 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:40.154773  3327 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:40.198573 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 131958us
I20260709 12:20:40.203173 28598 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:40.086185  2937 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.160760  3337 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:40.211740 28606 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:40.162424  3182 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:40.222432 28605 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14.
I20260709 12:20:40.157678  3341 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.195499  2962 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:40.243921 28599 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:40.249075 29325 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:20:40.217921  3097 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:40.257731 29292 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.148s (SENT)
I20260709 12:20:40.238193  3373 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.271113 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 156163us
I20260709 12:20:40.269225 29317 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:20:40.269855 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:40.275687 29322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.033s	sys 0.059s
W20260709 12:20:40.281446 29322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.033s	sys 0.060s
W20260709 12:20:40.267133 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 337874us
W20260709 12:20:40.284173 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.270727 28748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.005s
W20260709 12:20:40.270797  3264 consensus_meta.cc:287] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.001s
W20260709 12:20:40.287214 28748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.005s
I20260709 12:20:40.279438 28598 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:40.237995  3182 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.305210 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 2967) took 1732 ms. Trace:
I20260709 12:20:40.253350  2962 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.315378 28753 rpcz_store.cc:276] 0709 12:20:38.550193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.551331 (+  1138us) service_pool.cc:224] Handling call
0709 12:20:38.551740 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:38.581688 (+ 29948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:38.581717 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:38.610323 (+ 28606us) log.cc:844] Serialized 26 byte log entry
0709 12:20:39.097897 (+487574us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b180045aa80. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:20:39.210803 (+112906us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:39.787873 (+577070us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b180045aa80. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:20:39.789300 (+  1427us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:40.171121 (+381821us) log.cc:844] Serialized 14 byte log entry
0709 12:20:40.190774 (+ 19653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.190890 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.190947 (+    57us) raft_consensus.cc:1685] finished
0709 12:20:40.190965 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.282380 (+ 91415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9579,"prepare.queue_time_us":185661,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":709,"raft.queue_time_us":75615,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":8690,"spinlock_wait_cycles":18582400,"thread_start_us":495390,"threads_started":2,"wal-append.queue_time_us":582250}
I20260709 12:20:40.363983 28599 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:40.312850  3337 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:40.323148  3164 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:40.356855  3377 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:20:40.378615 28600 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:40.370288 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.347152  3110 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.381050 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71830.7us
W20260709 12:20:40.399884 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.428208 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.379318  3287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.356s	user 0.008s	sys 0.032s
I20260709 12:20:40.283214  3356 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.370923  3314 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:40.430195 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.443334 28598 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 24: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:40.443235 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:40.431619  3287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.008s	sys 0.033s
W20260709 12:20:40.450585 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 194969us
I20260709 12:20:40.463143 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:40.463937 29325 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:40.465023 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.467211 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:40.383085  3263 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:20:40.443589  3234 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.479167  3341 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:40.479660  3375 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 12:20:40.479961  3380 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:20:40.480263  3277 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
W20260709 12:20:40.480551  3387 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:20:40.480832  3382 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:20:40.394667  3110 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:40.466331  3390 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:20:40.473750  3173 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.490948 28598 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:40.312104  3376 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.173s
I20260709 12:20:40.494247 29325 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
W20260709 12:20:40.479192  3388 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:20:40.491851 28600 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
W20260709 12:20:40.504545 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 257971us
I20260709 12:20:40.504292  3173 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:40.502188  3379 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
W20260709 12:20:40.506171  3298 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.000s
I20260709 12:20:40.510252  3110 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.278656  3373 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.443770  3357 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
W20260709 12:20:40.526404 29292 leader_election.cc:336] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.151s (SENT)
I20260709 12:20:40.543339 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.521281  3097 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:40.530628  3026 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.530654  2937 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.528765  3376 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:40.539418 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3260) took 1137 ms. Trace:
I20260709 12:20:40.512692  3292 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.552804 28748 rpcz_store.cc:276] 0709 12:20:39.402499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.404069 (+  1570us) service_pool.cc:224] Handling call
0709 12:20:39.452454 (+ 48385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:39.631269 (+178815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:39.631338 (+    69us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:39.641666 (+ 10328us) log.cc:844] Serialized 52 byte log entry
0709 12:20:40.303639 (+661973us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:40.303698 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.303791 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.539092 (+235301us) raft_consensus.cc:1685] finished
0709 12:20:40.539125 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.539333 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46126,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":782843,"threads_started":2,"wal-append.queue_time_us":797509}
W20260709 12:20:40.542104  3148 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.000s
I20260709 12:20:40.541697  3330 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.512846  3374 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:40.467515  3314 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:40.529582  3344 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.003s
W20260709 12:20:40.557710 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 90500.1us
I20260709 12:20:40.548615  3298 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:40.548312  3341 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:40.552700  3376 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:40.571081 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48631.3us
W20260709 12:20:40.573676  3383 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 12:20:40.574467  3384 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:20:40.575766 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3263) took 1111 ms. Trace:
I20260709 12:20:40.576141 28754 rpcz_store.cc:276] 0709 12:20:39.464861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.481096 (+ 16235us) service_pool.cc:224] Handling call
0709 12:20:39.481445 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:39.675693 (+194248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:39.675738 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:39.676417 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 12:20:40.024113 (+347696us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:40.024162 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:40.024257 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.575467 (+551210us) raft_consensus.cc:1685] finished
0709 12:20:40.575490 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.575689 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30637,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":61,"thread_start_us":529878,"threads_started":2,"wal-append.queue_time_us":679709}
I20260709 12:20:40.577333  3373 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.555231  3182 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:40.568010  3344 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.581552  3173 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.582587 28601 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:40.582818  3344 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.551070  3097 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.585458  3292 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.585651  3097 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:40.559612  3148 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:40.567107  3374 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:40.590214  3374 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.577216 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.593897 28602 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:40.583884 28676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2859) took 1294 ms. Trace:
I20260709 12:20:40.587818  3314 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:40.587826  3330 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.595094 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:40.595702 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.597848 28603 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:40.601881 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3264) took 1136 ms. Trace:
I20260709 12:20:40.608639 29323 raft_consensus.cc:2368] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19.
I20260709 12:20:40.610100 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.598884 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.594714 28676 rpcz_store.cc:276] 0709 12:20:39.289899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.290025 (+   126us) service_pool.cc:224] Handling call
0709 12:20:39.302329 (+ 12304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:39.383644 (+ 81315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:39.383678 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:39.384303 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:20:39.868420 (+484117us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:39.890994 (+ 22574us) log.cc:844] Serialized 14 byte log entry
0709 12:20:39.891208 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.891281 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.583672 (+692391us) raft_consensus.cc:1685] finished
0709 12:20:40.583691 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.583823 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58079,"prepare.queue_time_us":26856,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":87400,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":21544,"thread_start_us":407420,"threads_started":1,"wal-append.queue_time_us":861786}
I20260709 12:20:40.612914 29323 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:40.613384 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.621476  3341 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.602394  3376 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.622126  3341 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.623065  3376 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.623440  3313 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.624647 29321 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:40.625049 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.625370  3337 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:40.625860  3337 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.626138 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:40.626792 29326 raft_consensus.cc:2368] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19.
I20260709 12:20:40.626690 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.627852  3337 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:40.627974 29326 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 12:20:40.629181 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.628244 29321 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:20:40.630192 28602 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:40.630504 29327 raft_consensus.cc:2368] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:40.630860 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:40.624217  3341 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:40.632241  3406 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:40.635169 29327 pending_rounds.cc:85] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 13
I20260709 12:20:40.635617 29327 pending_rounds.cc:107] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:20:40.635780 29320 raft_consensus.cc:2368] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:40.608974 28750 rpcz_store.cc:276] 0709 12:20:39.465165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.517576 (+ 52411us) service_pool.cc:224] Handling call
0709 12:20:39.517947 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:39.518347 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:39.518387 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:39.518943 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:20:39.879856 (+360913us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:39.879919 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:39.880009 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:40.601661 (+721652us) raft_consensus.cc:1685] finished
0709 12:20:40.601683 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:40.601823 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13463,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":323225,"threads_started":1,"wal-append.queue_time_us":562004}
I20260709 12:20:40.635861 29327 raft_consensus.cc:2889] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:40.598371  3344 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.651871 28604 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
W20260709 12:20:40.653810  3386 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 12:20:40.656347 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.656849 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.657018 28602 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:40.657933 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.658454 28602 raft_consensus.cc:2376] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18. Re-sending same reply.
I20260709 12:20:40.658540 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.659330 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.659729 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.661002 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.661592 28600 raft_consensus.cc:2376] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18. Re-sending same reply.
I20260709 12:20:40.662560 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.663612  3313 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:40.660015 28602 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:40.667357 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.668408 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.669421 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.670383 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.671180 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.671422 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.672211  3326 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:40.672879  3326 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.673542 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.673735 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.674155 28599 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:40.674947 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.675021 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.676090  3334 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.677315 28678 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:40.678571  3334 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.675145  3326 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.679754  3355 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.680291  3355 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.672267 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.683856 28598 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:40.684245 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.676188 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.679517  3344 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.685810 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.676107 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.687108 28722 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.697181 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.695252 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.700634 28599 raft_consensus.cc:2376] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20. Re-sending same reply.
I20260709 12:20:40.687332 28602 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:20:40.683246  3326 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:40.703933 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.704324 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.704555 28600 raft_consensus.cc:2410] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:20:40.694653  2962 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:40.690424  3355 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:40.709298 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.709946 28600 raft_consensus.cc:2376] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18. Re-sending same reply.
I20260709 12:20:40.710147 28599 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:40.700008  3406 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:40.705638 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:40.689633  3407 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:40.713511 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:40.715292 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.716405 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.717875 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:40.718677 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.719247 28599 raft_consensus.cc:2376] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 14. Re-sending same reply.
I20260709 12:20:40.720311  3313 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:40.720746  3313 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:40.721127  3313 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:40.707937  3320 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:20:40.718122  2962 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:40.722702  2962 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:40.723026  2962 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.726832 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.727713 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:40.728915 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.729754 28599 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
W20260709 12:20:40.731346 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.732197 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.729394 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.733712 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.733940 28600 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 16: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:40.735682 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.735517 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.706809  3326 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.729789  3292 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:20:40.729743  3350 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:40.729693  3341 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:40.728534  3164 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:40.740504 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.716907  3344 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:40.742534 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:40.742033  3358 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:40.750234 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:40.740288  3369 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.780s	user 0.000s	sys 0.011s
I20260709 12:20:40.752167 28721 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.747465  3291 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:20:40.754587 28600 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:40.756870 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:40.757529 28603 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:40.740836  3407 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.759920  3373 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:40.759781  3407 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.760347 28603 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: []
I20260709 12:20:40.761062 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.761898 28600 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:20:40.762848 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.747611  3173 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:40.756742  3350 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:40.756304  3026 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:40.749788  3314 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:40.767091  3322 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.760461  3373 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:40.767410  3350 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.751087  3164 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.770812  3164 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.757720  3110 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:20:40.773051 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.773626 28753 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.749704  3358 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:40.774889 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.761582  3372 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:40.775699  3372 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:40.776834 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.776676  3372 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.768211  3373 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.778349  3407 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:40.778806 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.771410 28605 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:20:40.780138 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.766099 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.774618  3358 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.768574  3341 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:40.773682 28756 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:40.781383 28754 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:40.789335 28754 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:40.781383 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.791412 28751 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:40.786576 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.786486 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.787508 28605 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:40.786664 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.794459 28752 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:40.793111 28747 raft_consensus.cc:2376] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19. Re-sending same reply.
I20260709 12:20:40.795363 28603 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:40.795581 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.803527 28607 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:40.807111 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.807693  3344 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:40.810308  3314 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:40.790318 28754 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.751596  3406 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:20:40.831691 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:40.811581 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46607.1us
I20260709 12:20:40.834270 28605 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:40.822011 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.852097 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:40.813472 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.837376 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:40.814338 28600 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:20:40.863548 29319 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:40.857288 28754 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:40.838238 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:40.839188 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:40.865723 28676 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:40.859359 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:40.832931 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.814807 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:40.824390 28675 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:40.818915 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:40.873085 28681 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:40.874920 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.876418 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:40.878082 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.879503 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.879952 29321 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:40.880170 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:40.880909 29323 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 26: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:40.878352 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.881603 29326 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:40.883455 28677 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:40.887208 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.891533 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:40.892483 28747 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:40.894227 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:40.903036 29320 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:40.906697 29327 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:20:40.897639 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:40.896135 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:40.917944 28753 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:20:40.918556 28754 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:40.921077 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.898020 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.918623 28752 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:20:40.917483 29318 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:40.902822 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.922219 29323 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:40.925020 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.926620 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:40.927460 29321 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:40.930668 28752 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:40.891760  3341 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:40.931433  3341 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:40.932410  3341 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.932925 28752 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:40.933495  3326 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:40.937042 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:40.937095 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51059.5us
I20260709 12:20:40.938014 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:40.938128 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:40.939433 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:40.939697 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:40.873962  3398 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.941146 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.941262 29319 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:40.948979 29318 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:40.935783  3263 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:40.910780  3338 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:40.898844  3327 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:40.955946 28605 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:40.957489 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:40.958509 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1220) took 1164 ms. Trace:
I20260709 12:20:40.959100 28601 rpcz_store.cc:276] 0709 12:20:39.791270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.792901 (+  1631us) service_pool.cc:224] Handling call
0709 12:20:40.955388 (+1162487us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b5400121bd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:40.955585 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813011200}
I20260709 12:20:40.936491  3164 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:40.833969  3305 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 12:20:40.967669 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:40.968659  3234 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:40.969506  3234 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.963315  3372 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:40.973032 28572 leader_election.cc:400] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19.
I20260709 12:20:40.972973  3372 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:40.975396  3372 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:40.976689  3277 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.977468  2892 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:40.977365  3277 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:40.980758  3305 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:40.981148  3305 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:40.955745  3275 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:40.981541 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:40.981959  3275 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:40.982331 28600 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:40.982437  3275 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:40.983563  3407 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:40.983973  3407 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:40.962134  3408 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:20:40.968811  3110 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.976241 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:40.980116  3277 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:40.992872 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53502.9us
I20260709 12:20:40.958251  3373 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.961417  3350 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:40.972213  3234 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:41.027638 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:40.958894  3337 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:40.960399  3291 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:41.033267 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 65632.1us
I20260709 12:20:41.035228 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:40.958813  3263 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:41.036618 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.038205 28600 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:41.039860  3313 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:41.042060 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 74948.9us
I20260709 12:20:40.994257  3338 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:41.047873 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71762.5us
I20260709 12:20:41.048290 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:41.050344 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:41.050822 28679 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:20:41.052289 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.053856 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:41.054418 28600 raft_consensus.cc:2376] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16. Re-sending same reply.
I20260709 12:20:41.054797 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:41.056034 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:41.056875 28601 raft_consensus.cc:2410] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:20:41.033111  3314 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.049233 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.035521  3334 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:41.035076  3344 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:40.954633  3398 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.035184  3348 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.035017  3327 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:41.064318 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:41.071717 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:40.995425  3110 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.044595  3330 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:41.100811 28747 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:41.108045 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:41.118983 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 45296.4us
I20260709 12:20:41.120636 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:41.213438 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 92886.9us
I20260709 12:20:41.213671 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:41.217751 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.232089 28679 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:41.238345 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1799) took 1285 ms. Trace:
W20260709 12:20:41.243220 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.244657 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.067703  3277 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:40.984902  3407 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.237756 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.251181 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.238842 29317 rpcz_store.cc:276] 0709 12:20:39.818794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.899546 (+ 80752us) service_pool.cc:224] Handling call
0709 12:20:39.899841 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:40.280677 (+380836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.079046 (+798369us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400680e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:41.104268 (+ 25222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848776448}
W20260709 12:20:41.252359 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 203114us
I20260709 12:20:41.268724 28572 leader_election.cc:400] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19.
I20260709 12:20:41.043718  3373 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.269908 28680 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 14: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:41.271061 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 54957.3us
W20260709 12:20:41.272253 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.266914 28673 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:41.061740  3350 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:41.076478  3164 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:41.234551 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:41.286142 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51684.1us
I20260709 12:20:41.286818 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:41.283326 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.128204  3337 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:41.289374 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:41.260187 28681 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
W20260709 12:20:41.299255 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 61608.8us
I20260709 12:20:41.303061 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:41.304140 28679 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 26: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:41.302719 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:41.235018  3334 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:41.311745 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:41.318346 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.271610  3401 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:41.049614  3291 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:41.291837  3261 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.067077  3314 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.075564  3344 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:41.291594  3354 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.368582  3354 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.371640  3354 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.213212  3348 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.374224  3348 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.333197 29318 raft_consensus.cc:2393] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:41.320737  3421 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:20:41.308017  3327 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:41.390235  3398 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.394313 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.264786  3330 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.267705  3341 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 12:20:41.397907 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.296900  3376 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:41.361022 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.409116  3334 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:41.413240 29319 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:20:41.422570 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.438175  3330 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.442004  3291 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:41.443441  3110 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.444554  3263 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:41.446703  2962 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.723s	user 0.006s	sys 0.005s
I20260709 12:20:41.447149  2962 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.450383 28753 raft_consensus.cc:1240] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24. Ops: []
I20260709 12:20:41.322109  3118 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:41.399302  3401 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:41.399358  3261 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.458365  3313 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:41.399659  3164 raft_consensus.cc:2764] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:20:41.460788 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.343675  3358 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:41.470537 28679 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:41.475987 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:41.494547 29325 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:41.451359  3173 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:41.461673  3292 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:20:41.498224 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 449015us
I20260709 12:20:41.499276 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.500236  3337 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:41.501323 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.464030  3118 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:41.468824  3327 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:41.508644 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.512460 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.533574 28673 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:41.468648  3376 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:41.471750  3358 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.531620  3313 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:41.536373 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.537467 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.537958 28673 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:20:41.534547 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 441515us
W20260709 12:20:41.540334 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.469135  3275 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.545555 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.531816  3118 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:41.548463 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.554605 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.557114  3330 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:41.557803  3330 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:41.566111  3261 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.567387  3401 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.571653  3314 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:41.574051  3275 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.536545  3358 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:41.541882  3337 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:41.583743 28673 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:41.512190  3173 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.581944 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.546653  2962 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.549551  3234 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:41.593061 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 290436us
I20260709 12:20:41.552690  3344 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:41.560384  3330 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:41.588137 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.508492  3350 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.582834  3357 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:41.597891  2892 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
I20260709 12:20:41.623723 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.585378  3313 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:41.632766 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:41.633026 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.633694 28753 raft_consensus.cc:2410] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:20:41.634195 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:41.635222 28677 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:41.596218  3341 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:20:41.609894  3168 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.029s	sys 0.027s
I20260709 12:20:41.598109  3373 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.638449 28756 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 14.
I20260709 12:20:41.637099 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:41.639978 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 353202us
I20260709 12:20:41.641383 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:41.642068 29326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.003s	sys 0.010s
W20260709 12:20:41.642664 29326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.003s	sys 0.010s
I20260709 12:20:41.643184 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.645128 29319 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:41.611055  3182 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:41.635054  3083 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.002s	sys 0.010s
W20260709 12:20:41.630182  3349 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.013s	sys 0.026s
I20260709 12:20:41.650609 28753 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:41.630492  3430 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:41.640519  3168 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.030s	sys 0.027s
W20260709 12:20:41.650772 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 256579us
I20260709 12:20:41.586097  3376 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.642230  3261 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.639750  3277 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:41.670358 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:41.640743  3327 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:20:41.603122  3234 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:41.666426 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:41.644764  3164 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:41.672748 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:41.652285  3083 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.002s	sys 0.010s
I20260709 12:20:41.677685 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.678028 28753 raft_consensus.cc:2410] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 23 because replica has last-logged OpId of term: 21 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
W20260709 12:20:41.664764  3322 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.897s	user 0.012s	sys 0.000s
I20260709 12:20:41.636802  3357 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:41.667619  3349 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.013s	sys 0.027s
I20260709 12:20:41.696921 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.723789 29319 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
W20260709 12:20:41.697950 28604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1223) took 1802 ms (client timeout 1972 ms). Trace:
I20260709 12:20:41.698624 28598 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:41.703454  3357 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.690748  3373 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:41.691679 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:41.710528  2892 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:20:41.730372 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 89066.7us
I20260709 12:20:41.730823 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.718282 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.720045 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.733091 29322 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:41.724721 28604 rpcz_store.cc:269] 0709 12:20:39.895266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.896835 (+  1569us) service_pool.cc:224] Handling call
0709 12:20:41.697740 (+1800905us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54000a8554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:41.697880 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517780224}
W20260709 12:20:41.728657 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 417118us
I20260709 12:20:41.711962  3173 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.679368  3298 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:20:41.735286 28572 leader_election.cc:400] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:41.736810  3277 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.730836  3327 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:20:41.737390  3291 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:20:41.745465 28572 leader_election.cc:403] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:41.738749 28648 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:41.748805 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.750083 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.718721  3326 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.780682  3326 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:41.784900 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 50070.2us
I20260709 12:20:41.785036 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.726994  3373 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.788187  3373 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:41.791409  3164 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:41.791760  3141 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:41.792768  3355 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:41.765532 29327 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:41.763301 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.766992 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.774327  3234 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:41.680653  3261 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:41.674775  3182 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.809842  3407 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:41.811872  3182 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.778525 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3007) took 1522 ms. Trace:
I20260709 12:20:41.813726  3376 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:41.814194  3376 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.758668  3350 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:20:41.814604  3376 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:41.792917 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:41.795693 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57026.7us
I20260709 12:20:41.730875  3430 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:41.816619 29323 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:41.816748  3430 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:41.817283 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.737460  2962 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:41.818022  2962 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:41.817713  3430 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.818408  2962 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:41.770243 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.820904 29320 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:41.774927  3356 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:41.744845  3337 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.752249  3341 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:41.822192  3337 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.822928  3341 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:41.776072 28607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1225) took 1836 ms (client timeout 2224 ms). Trace:
W20260709 12:20:41.824214 28607 rpcz_store.cc:269] 0709 12:20:39.940121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:39.973277 (+ 33156us) service_pool.cc:224] Handling call
0709 12:20:41.775891 (+1802614us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54003d3454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:41.776008 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1538674944}
I20260709 12:20:41.764114  3298 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:41.826020  3298 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:41.827687 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:41.828266 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.829499  3446 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:41.829798  3106 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.830029  3446 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.830273  3106 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:41.813225 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 64527.9us
I20260709 12:20:41.751734  3264 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:41.734126  2892 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:41.840847 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:41.813674 28598 rpcz_store.cc:276] 0709 12:20:40.256085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:40.702136 (+446051us) service_pool.cc:224] Handling call
0709 12:20:41.698423 (+996287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.724849 (+ 26426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:41.778349 (+ 53500us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54000a8550. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:41.778470 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290451200}
I20260709 12:20:41.835548 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.842938 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:41.843466 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 180096us
I20260709 12:20:41.844633 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.849593 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:41.831308  3439 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:20:41.848941 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:41.850723 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:41.859264 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.801846  3438 raft_consensus.cc:2764] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:20:41.820150  3118 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.802829  3164 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:20:41.865998  3164 consensus_queue.cc:1243] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:20:41.868775  3374 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:41.869212  3374 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:41.869571  3374 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:41.860213  3234 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:20:41.874838  3118 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:41.875281  3446 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.875615  3118 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:41.875880  3446 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:20:41.850040  3110 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:20:41.877677  3446 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:41.842726  3349 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:41.845773  2892 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:41.851665  3182 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:41.852725  3026 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:41.899678 28749 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: []
I20260709 12:20:41.853477  3330 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:41.845609  3442 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:41.903936 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.904747 29317 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:41.905791 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:41.839577  3358 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.889130  3446 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:20:41.856649  3264 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:20:41.908509 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:41.912664 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:41.876305  3118 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.864820  3173 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:20:41.923828 29321 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:41.925114  3358 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:41.926163  3106 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.905275  3326 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.940104 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:41.952718  3305 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.954170  3305 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:41.963677 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:41.964391  3401 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:41.964673 28676 raft_consensus.cc:2410] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 23 because replica has last-logged OpId of term: 21 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 12:20:41.965010  3401 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.967304  3401 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:41.969422 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:41.973758 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:41.974112  3349 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:41.974902 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:41.975356  3349 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:41.975752  3349 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:41.976739  3372 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:41.978031 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:41.978756  3349 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:41.980048  3349 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:41.991508 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.917136  3446 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:41.994460 29320 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:41.992347 29322 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:41.996480 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:41.993906 28681 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:42.007045 28754 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:42.008672 29321 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:42.011991 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:42.001639  3110 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:42.028623 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:42.034754 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:41.974514 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:42.042138 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 67690us
I20260709 12:20:42.043188 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:42.045300  3083 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:42.045792  3083 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.046177  3083 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:42.051044  3374 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.001499  3349 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:20:42.052256 28752 raft_consensus.cc:2368] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
I20260709 12:20:42.052377  3349 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:20:42.053213  3234 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:20:42.053555  3234 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:42.054457  3182 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:42.055397  3182 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:42.013456  3372 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.054351  3234 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:42.057269  3234 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:42.040756  3026 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:42.059638  3026 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.055634  3349 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:42.056165  3372 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:42.060593  3349 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:42.061877  3026 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:42.061507  3349 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:42.062273  3372 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:42.062850  3349 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:42.063635 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:42.064904 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:42.075220  3453 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:20:42.078915  3344 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:42.079370  3344 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:42.083112  3261 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:42.086300  3376 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.080276  3344 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.087761  3344 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:42.096987  3373 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.098258 28747 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:42.103655  2962 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:42.104800  3446 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.106184  3446 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:42.120883  3337 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:42.062613  3110 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:42.130126 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 86991.1us
I20260709 12:20:42.131294 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:42.138447 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 352243us
I20260709 12:20:42.139240 28647 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:42.170003 28572 leader_election.cc:400] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:42.170351 28572 leader_election.cc:403] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:20:42.149189 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 362780us
I20260709 12:20:42.153337 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:42.138703  3401 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:42.173450 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.137557  3376 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:42.137823  3330 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:42.138579  3234 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:42.181545 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:42.182576 29322 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:42.188759 28648 leader_election.cc:400] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
I20260709 12:20:42.189218 28648 leader_election.cc:403] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:42.192533 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.192939 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.193290 28681 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:42.193766 28680 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:42.196934 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:42.198870 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.198930 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:42.197054 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:42.230281  3354 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:20:42.232532  3291 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:42.197117  3118 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:42.235308 28752 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:42.167658  3168 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:42.151289  3437 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 12:20:42.237569  3437 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:42.237761  2962 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:42.237926  3437 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:42.238818  3437 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.240104  3437 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.230312 28747 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:42.246537 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:42.247169 29320 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:42.247799 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.252192 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.252820 28676 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:42.179903  3275 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:20:42.265218 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 95338.9us
W20260709 12:20:42.268725 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.267998 29321 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:42.265479 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.270653 28678 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:42.285979 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:42.323249 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.324357 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:42.197731  3327 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:42.326280 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:42.330744 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:20:42.333299 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.338167 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.338970 28681 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
W20260709 12:20:42.256286  3313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.012s
I20260709 12:20:42.346726 28681 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:42.246210  3358 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:42.342309 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.350411 28720 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:42.338356 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:42.345108 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 75917.2us
I20260709 12:20:42.357266 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:42.372359 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:42.358747 29292 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:42.268707  3275 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:42.346661  3313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.010s	sys 0.012s
I20260709 12:20:42.334380  2962 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:42.346143  3118 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:42.257040  3338 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 12:20:42.409888 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:42.413470 28677 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:42.392624  3298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.035s
I20260709 12:20:42.387195  3448 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:42.387061  3026 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:42.404330  3326 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
W20260709 12:20:42.416718  3431 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:20:42.431677 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.015s
W20260709 12:20:42.421736  3298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.014s	sys 0.035s
W20260709 12:20:42.432304 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.014s	sys 0.016s
I20260709 12:20:42.414953  3275 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:42.422427 29318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.007s	sys 0.016s
I20260709 12:20:42.415531  3432 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:42.412721  3313 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:42.429427 28750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.030s	sys 0.061s
I20260709 12:20:42.415308  3451 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:42.439081 28750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.030s	sys 0.061s
W20260709 12:20:42.436901 29318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.008s	sys 0.016s
I20260709 12:20:42.428010  3026 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.412914  3423 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:20:42.373373  3358 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:42.451592 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.431770  3118 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:42.453058 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:42.424944  3292 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:20:42.436098  3338 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:42.458765 29321 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
W20260709 12:20:42.461525 28753 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.010s
W20260709 12:20:42.436111  3430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.051s
I20260709 12:20:42.441403  3432 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:42.425228  3442 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:20:42.430821  3449 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:20:42.438040  3427 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:42.419678  2962 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.436316  3261 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:42.440480  3374 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:42.454509  3026 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:42.469589 28747 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:20:42.461861 28753 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.008s	sys 0.010s
I20260709 12:20:42.461181  3338 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:42.478332 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:42.470412  3430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.014s	sys 0.051s
W20260709 12:20:42.481518 29317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.003s	sys 0.018s
W20260709 12:20:42.481963 29317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.003s	sys 0.018s
I20260709 12:20:42.477336  3261 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.490945  3110 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:42.491345  3261 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:42.497148  2892 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 12:20:42.497534  3358 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:42.497814  2892 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:42.471654  3427 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:42.500253  3427 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:42.465481  3432 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:42.503360  3373 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:42.505056  3455 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:20:42.507273  3337 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.507115  3313 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.507781  3337 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.510408  3337 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:42.511197  3406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.013s	sys 0.021s
W20260709 12:20:42.511543  3406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.013s	sys 0.021s
I20260709 12:20:42.512823  3406 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:42.513160  3406 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:42.513875  3406 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.514371 29320 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:42.502992  3338 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:42.472108  3356 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
W20260709 12:20:42.435431 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 585902us
I20260709 12:20:42.523378 28676 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:42.523927 28682 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
W20260709 12:20:42.562389 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:42.582921 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.570183 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2890) took 1281 ms. Trace:
I20260709 12:20:42.550410 29318 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:42.584661 28677 rpcz_store.cc:276] 0709 12:20:41.288839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.636014 (+347175us) service_pool.cc:224] Handling call
0709 12:20:41.645603 (+  9589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.416589 (+770986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.569888 (+153299us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54001bd354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:42.570110 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765479296}
I20260709 12:20:42.515355 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:42.586236 29318 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:20:42.586433 29320 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:42.533890 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:42.588888 29325 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:42.595788 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:42.602344 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.516425 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:42.605360 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 89002.8us
I20260709 12:20:42.606961 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:42.607178 29320 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
W20260709 12:20:42.549124  3083 consensus_meta.cc:287] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.002s
I20260709 12:20:42.615149 28681 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:42.675441 29327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.015s	sys 0.002s
I20260709 12:20:42.546885  3401 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:42.541486  3173 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.676604 28749 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:42.569916  3354 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
I20260709 12:20:42.518749  2962 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:42.673166 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:42.538241  3432 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:42.676455 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:42.507128  2892 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:42.514882  3406 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:42.593071  3438 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.516537  3338 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:42.567143  3372 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:20:42.624699  3318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.008s	sys 0.019s
I20260709 12:20:42.605304  3141 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.613224  3434 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:42.695964 29327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.003s
I20260709 12:20:42.668723  3292 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:42.677173  3373 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:20:42.702973 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.567216  3164 consensus_queue.cc:1059] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.126s
I20260709 12:20:42.707409 28679 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:42.531553  3275 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.871328  3275 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:42.681941 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:42.709846 28754 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:42.529109  3376 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.168s
I20260709 12:20:42.613169  3277 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 12:20:42.669015  3437 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:20:42.668915  3357 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:20:42.526226  3026 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:42.726853 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 363949us
I20260709 12:20:42.892970 29290 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:42.605103  3355 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:42.745981  3318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.008s	sys 0.020s
I20260709 12:20:42.687867  3083 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.820382 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1815) took 1033 ms. Trace:
I20260709 12:20:42.719709  3261 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:20:42.803366 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 58105.7us
W20260709 12:20:42.797281 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.872591 28674 raft_consensus.cc:2410] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:20:42.724777  3110 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.883801  2962 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.746685  3372 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:42.889567 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 479311us
I20260709 12:20:42.864086  3358 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:42.707888  3173 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:42.867632  2892 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:42.896134 28675 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.033s
W20260709 12:20:43.001662 28675 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.000s	sys 0.034s
I20260709 12:20:42.912503 29327 rpcz_store.cc:276] 0709 12:20:41.786675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.793769 (+  7094us) service_pool.cc:224] Handling call
0709 12:20:41.794061 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.794266 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:42.148519 (+354253us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.803798 (+655279us) log.cc:844] Serialized 14 byte log entry
0709 12:20:42.819932 (+ 16134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:42.820004 (+    72us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:42.820065 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.820157 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:42.820307 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":558467,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":5436,"raft.queue_time_us":16053,"raft.run_wall_time_us":76052,"spinlock_wait_cycles":48196736,"thread_start_us":943988,"threads_started":2}
I20260709 12:20:42.896927 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:42.856307  3263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.019s	sys 0.023s
W20260709 12:20:42.879212 29323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.013s	sys 0.034s
I20260709 12:20:42.879036  3292 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:42.784788  3434 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:42.904677 28647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.019s	sys 0.013s
I20260709 12:20:42.756400  3438 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.031852 28647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.020s	sys 0.013s
I20260709 12:20:43.031903 28678 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:43.012369 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:43.034364 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:42.917696  3305 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.007990  3358 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.023380 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 406929us
I20260709 12:20:42.784021  3141 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.026677 29323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.013s	sys 0.037s
W20260709 12:20:42.945673 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:43.035490 28753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.020s	sys 0.049s
W20260709 12:20:43.077942 28753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.021s	sys 0.049s
W20260709 12:20:43.036180 28756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.011s	sys 0.033s
I20260709 12:20:43.037894 29327 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:20:43.078747 28648 leader_election.cc:336] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.524s (SENT)
I20260709 12:20:43.039021 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:42.914584 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.031s
W20260709 12:20:43.079581 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.003s	sys 0.031s
I20260709 12:20:43.079612 29325 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:43.080308 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 721595us
I20260709 12:20:43.040493 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:42.978389  3261 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:20:43.081068 28756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.012s	sys 0.033s
W20260709 12:20:43.041458 29321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.018s	sys 0.030s
I20260709 12:20:43.044160 29326 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:20:43.081923 29321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.019s	sys 0.030s
I20260709 12:20:43.036914 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:43.023039  3263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.022s	sys 0.023s
I20260709 12:20:43.001081  3337 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:42.979038  3106 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:42.910408  3430 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:43.034093  3434 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:43.079214 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:42.909952  3118 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.159s
W20260709 12:20:43.088274 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47869.8us
I20260709 12:20:42.911171  3355 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.072039  3318 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:43.010210  3372 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.096870 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:42.919343  3110 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.090324 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.076212  3341 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.025345  2892 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:43.110922 28648 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.558s (SENT)
I20260709 12:20:43.111397 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:43.111594 28598 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:43.103317 28682 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:20:43.112299 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.113302 28604 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:43.004174  2962 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.116343 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.126057 29325 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:43.094218  3437 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:43.129137 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.097609  3430 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.129410 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.137274 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:43.129823 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.130993 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:43.131757  3480 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:43.096767  3337 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.078327  3305 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.141155 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:43.128036 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:43.145665 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.146167 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.141129 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:43.114466  3422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.015s	sys 0.006s
I20260709 12:20:43.133837 28598 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:43.117306 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.149631 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.152973 28605 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:43.146243 28599 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
W20260709 12:20:43.133651  3452 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:20:43.174589 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.176463 28607 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:43.101120  3106 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.179093 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.134765  3372 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:43.123685  3354 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:43.171149 28680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.012s	sys 0.014s
I20260709 12:20:43.184643 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.158874  3277 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:43.132346  3118 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.188251 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.188503 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:43.150386  3422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.015s	sys 0.007s
W20260709 12:20:43.204387 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.102105  3451 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:20:43.214684 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.215628 28601 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:43.142541  3430 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:43.148463  3460 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:43.140920  3318 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:43.223907 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 113006us
I20260709 12:20:43.226169 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.220388 28602 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
W20260709 12:20:43.319571 28648 leader_election.cc:336] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.577s (SENT)
W20260709 12:20:43.230641 28680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.013s	sys 0.014s
I20260709 12:20:43.175972  3357 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:43.121358  3341 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.179090  3313 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:43.241242 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.138953  3330 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.084s
I20260709 12:20:43.189049  3432 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:43.328652 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.243387 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:43.225514  3474 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.344s	user 0.001s	sys 0.001s
I20260709 12:20:43.244556 28600 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:43.172819  3261 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.234620  3473 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
W20260709 12:20:43.243861  3472 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 12:20:43.360954 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2897) took 1162 ms. Trace:
W20260709 12:20:43.249316  3467 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:20:43.260689 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3285) took 1200 ms. Trace:
I20260709 12:20:43.128557  3292 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.328967  3291 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:43.264779 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:43.269230  3483 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:20:43.271265  3485 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 12:20:43.251771  3463 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 12:20:43.226972  3344 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:20:43.372560 29325 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:43.279342 28748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.009s	sys 0.010s
W20260709 12:20:43.373723 28748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.010s	sys 0.010s
I20260709 12:20:43.364262 28680 rpcz_store.cc:276] 0709 12:20:42.201364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.201541 (+   177us) service_pool.cc:224] Handling call
0709 12:20:42.202002 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:42.254009 (+ 52007us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:42.254037 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:42.343329 (+ 89292us) log.cc:844] Serialized 52 byte log entry
0709 12:20:43.320382 (+977053us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:43.320454 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.320547 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.360727 (+ 40180us) raft_consensus.cc:1685] finished
0709 12:20:43.360749 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.360895 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39485,"raft.queue_time_us":40848,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":7468,"thread_start_us":905436,"threads_started":1,"wal-append.queue_time_us":936367}
W20260709 12:20:43.271868  3479 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:20:43.294611 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2902) took 1039 ms. Trace:
I20260709 12:20:43.296499 28604 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:43.304700 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3275) took 1439 ms. Trace:
W20260709 12:20:43.311962 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.263922  3083 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.243904  3118 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.319835 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3274) took 1460 ms. Trace:
I20260709 12:20:43.320171 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:43.231348 28598 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
W20260709 12:20:43.419528 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 99998us
I20260709 12:20:43.419849 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.421671 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:43.422757 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:43.326763 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 189577us
I20260709 12:20:43.277154  3173 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.161170  3495 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:43.295392  3466 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:20:43.350700 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.348898 28674 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:43.350687 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.434901 28602 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:20:43.355604  3475 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:20:43.356769 28681 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:43.358340  3106 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.358647  3337 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.359216  3355 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.359730  3026 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.318682  3318 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.295759  3460 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:43.366952 28755 rpcz_store.cc:276] 0709 12:20:42.060246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.060374 (+   128us) service_pool.cc:224] Handling call
0709 12:20:42.060732 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.061060 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.061087 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.061533 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:20:42.445492 (+383959us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:42.445529 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.445595 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.260415 (+814820us) raft_consensus.cc:1685] finished
0709 12:20:43.260462 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.260618 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1387,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":383609,"threads_started":1,"wal-append.queue_time_us":794864}
I20260709 12:20:43.135262  3275 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
W20260709 12:20:43.427868  3476 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260709 12:20:43.252360  3277 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:43.379958 28753 rpcz_store.cc:276] 0709 12:20:41.864887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.865077 (+   190us) service_pool.cc:224] Handling call
0709 12:20:41.865374 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.865587 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:42.472622 (+607035us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.304216 (+831594us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.304300 (+    84us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:43.304366 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.304475 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.304625 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26314,"prepare.queue_time_us":94067,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":29,"raft.queue_time_us":35607,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":17880,"thread_start_us":1393277,"threads_started":3,"wal-append.queue_time_us":845117}
W20260709 12:20:43.452071  3496 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 12:20:43.382736 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.453362 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.360600  3141 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.363273  3503 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.379978 28680 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:43.377533  3451 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.385880  3488 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:43.388155  2962 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.389482  3491 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.390174 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1970) took 1145 ms. Trace:
I20260709 12:20:43.466274 29321 rpcz_store.cc:276] 0709 12:20:42.245151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.464145 (+218994us) service_pool.cc:224] Handling call
0709 12:20:42.473092 (+  8947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.480980 (+  7888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.481028 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.506276 (+ 25248us) log.cc:844] Serialized 26 byte log entry
0709 12:20:43.082433 (+576157us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:43.082489 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.082602 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.389913 (+307311us) raft_consensus.cc:1685] finished
0709 12:20:43.389935 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.390098 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11151,"thread_start_us":575738,"threads_started":1,"wal-append.queue_time_us":771931}
W20260709 12:20:43.391124  3493 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:20:43.467931  3511 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:43.392957  3486 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:20:43.403033  3427 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:43.470147  3427 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.472705 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1967) took 1286 ms. Trace:
I20260709 12:20:43.473095 29323 rpcz_store.cc:276] 0709 12:20:42.186369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.186513 (+   144us) service_pool.cc:224] Handling call
0709 12:20:42.186931 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:42.187808 (+   877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:42.187853 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:42.252220 (+ 64367us) log.cc:844] Serialized 26 byte log entry
0709 12:20:43.077841 (+825621us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:43.077885 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.077953 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.472495 (+394542us) raft_consensus.cc:1685] finished
0709 12:20:43.472515 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.472642 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":428,"raft.queue_time_us":10340,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":13254,"thread_start_us":727824,"threads_started":1,"wal-append.queue_time_us":867606}
I20260709 12:20:43.412900  3305 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.366422  3492 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.475471 28682 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:43.475342  3492 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.367440  3313 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:43.476871  3482 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.477331 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.477387  3482 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.478662 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.479656  3482 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.420989 28607 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:43.425215 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.481988 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1964) took 1495 ms. Trace:
I20260709 12:20:43.482280 28604 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:43.377458 28675 rpcz_store.cc:276] 0709 12:20:42.254797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.255401 (+   604us) service_pool.cc:224] Handling call
0709 12:20:42.260856 (+  5455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:42.261089 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:43.002098 (+741009us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.294167 (+292069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.294239 (+    72us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:43.294297 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.294386 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.294538 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62938,"prepare.queue_time_us":144086,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3932,"raft.queue_time_us":13876,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":10469,"thread_start_us":893219,"threads_started":2,"wal-append.queue_time_us":363583}
I20260709 12:20:43.434331  3083 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:43.432340 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.483376 28598 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 14.
I20260709 12:20:43.484198 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.417682 28756 rpcz_store.cc:276] 0709 12:20:41.859083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.859647 (+   564us) service_pool.cc:224] Handling call
0709 12:20:41.862402 (+  2755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.862597 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:42.408154 (+545557us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.318577 (+910423us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.319502 (+   925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.319548 (+    46us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:43.319595 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.319670 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.319783 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":105317,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":50710,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4040,"spinlock_wait_cycles":45055872,"thread_start_us":1369380,"threads_started":3,"wal-append.queue_time_us":821428}
W20260709 12:20:43.439436 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50517.7us
I20260709 12:20:43.330406  3358 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:43.441267 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1417) took 1561 ms. Trace:
I20260709 12:20:43.448076 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.437527  3354 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.433974  3357 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:43.457211 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1504) took 1493 ms. Trace:
I20260709 12:20:43.490662  3503 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.496832 28673 rpcz_store.cc:276] 0709 12:20:41.963542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.970496 (+  6954us) service_pool.cc:224] Handling call
0709 12:20:41.970854 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:41.971338 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.971363 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:41.971974 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 12:20:42.438643 (+466669us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:42.438701 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.438807 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.456965 (+1018158us) raft_consensus.cc:1685] finished
0709 12:20:43.456994 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.457144 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":799,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":465642,"threads_started":1,"wal-append.queue_time_us":747455}
I20260709 12:20:43.438798  3344 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.498422  3118 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.468506  3511 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.498677  3503 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.499449  3341 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.490183  3488 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.500396  3511 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.501366 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.501994  3488 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.502687 28600 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:43.502815  3277 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.503978 28600 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 12:20:43.477152  3313 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.322506 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 285549us
I20260709 12:20:43.505957 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:43.504304 28600 pending_rounds.cc:85] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 12
I20260709 12:20:43.482372 29319 rpcz_store.cc:276] 0709 12:20:41.987020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.987175 (+   155us) service_pool.cc:224] Handling call
0709 12:20:41.987536 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:41.987924 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.987981 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:41.988630 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 12:20:42.460353 (+471723us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:42.460393 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.460502 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.481793 (+1021291us) raft_consensus.cc:1685] finished
0709 12:20:43.481815 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.481933 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8110,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4250,"thread_start_us":471308,"threads_started":1,"wal-append.queue_time_us":985034}
I20260709 12:20:43.491196 28603 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:43.447893  3318 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:43.494426 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1963) took 1559 ms. Trace:
I20260709 12:20:43.491647 28750 rpcz_store.cc:276] 0709 12:20:41.879634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.880542 (+   908us) service_pool.cc:224] Handling call
0709 12:20:41.880920 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:41.881327 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.881367 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:41.892743 (+ 11376us) log.cc:844] Serialized 26 byte log entry
0709 12:20:42.442763 (+550020us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:42.442820 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.442914 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.441076 (+998162us) raft_consensus.cc:1685] finished
0709 12:20:43.441095 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.441210 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8153,"raft.queue_time_us":521,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":27189,"thread_start_us":549679,"threads_started":1,"wal-append.queue_time_us":814090}
I20260709 12:20:43.494987  3460 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.490548  3451 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.521670  3338 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.000s
I20260709 12:20:43.522389  3451 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.517565 28598 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:43.517071 29317 rpcz_store.cc:276] 0709 12:20:41.934854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.935020 (+   166us) service_pool.cc:224] Handling call
0709 12:20:41.935396 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:41.935780 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:41.935811 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:41.936450 (+   639us) log.cc:844] Serialized 52 byte log entry
0709 12:20:42.482387 (+545937us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:42.482442 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:42.482531 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:43.494205 (+1011674us) raft_consensus.cc:1685] finished
0709 12:20:43.494228 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.494370 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1288,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4698,"thread_start_us":545512,"threads_started":1,"wal-append.queue_time_us":1284980}
I20260709 12:20:43.519122 28601 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:43.534907 28600 pending_rounds.cc:107] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 12:20:43.535599 28600 raft_consensus.cc:2889] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:43.525333 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.525329 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.537185 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.542944 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.543674 29321 raft_consensus.cc:2410] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:20:43.544713 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.545547 28600 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:43.548103 28604 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:43.548239 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.549690 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.550899 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.551527 28604 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:43.510804  3427 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.523702  3511 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:43.498551  3344 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.565426 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.523176  3354 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.572134 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.572824 28604 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:43.569190 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:43.550818  3406 consensus_meta.cc:287] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.796s	user 0.008s	sys 0.004s
I20260709 12:20:43.537999  3451 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:43.549079  3487 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.579509 28747 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:20:43.583937 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.516655  3083 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.567112  3482 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.550331  3173 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:20:43.587001 28600 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:43.587360 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.587611 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.598017  3423 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:43.598412  3423 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:43.599207  3423 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.599419  3434 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.601037  2892 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:43.603582 28606 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 14: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:43.574402  3511 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:43.604492  3511 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:43.605999  3083 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.608556  3344 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.586912  3451 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.609074  3482 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.611009  3482 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.611353  3451 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.614235 28600 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
I20260709 12:20:43.615236 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.619865 28602 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 27 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:20:43.620095  3344 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.620638 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.620764  3344 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.621223 28602 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:20:43.622031 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.622648 28602 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:43.623001  3344 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.489867  3491 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.585979  3487 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.625406  3491 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:43.600242  3423 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:43.627990  3434 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.626111  3487 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.591113 28604 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:43.636328 28601 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:43.643385  3430 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.649473  3318 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.653613  3430 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.653756  3318 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:43.658447  3106 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:43.659070  3106 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:43.526319  3372 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 12:20:43.660005  3106 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:43.661290 28648 leader_election.cc:336] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.801s (SENT)
I20260709 12:20:43.661603  3461 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.661809 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:43.662135  3461 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.663298  3354 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.663847  3354 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:43.664503  3461 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:43.667179 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.677026 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 1966) took 1459 ms. Trace:
I20260709 12:20:43.677579 29322 rpcz_store.cc:276] 0709 12:20:42.186027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.198692 (+ 12665us) service_pool.cc:224] Handling call
0709 12:20:43.645599 (+1446907us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54002f58d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:43.645777 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784202496}
I20260709 12:20:43.637605  3482 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:43.689002  3298 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:20:43.689384  3446 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.696725  3446 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.698807  3446 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.671553  3438 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:43.707098 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 99021.7us
I20260709 12:20:43.724627 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.725194 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.710207  3372 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:43.728834 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.710276  3320 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:43.732045 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.712828  3318 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:43.734086 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.734653 28756 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:43.735994 28752 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:43.736855 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.737435 28752 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:43.738231 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.742478 28754 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:43.743728 28754 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:20:43.744724 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:43.745280  3438 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:43.745819  3438 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.748036  3438 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.748955 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.745450 28755 raft_consensus.cc:2368] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:43.734840 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.752810 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.748478  3277 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:43.756922  3277 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.759044  3277 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.759526 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3287) took 1202 ms. Trace:
I20260709 12:20:43.754266 28749 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 24: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:43.706552  3482 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.756376 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.762331  3277 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:43.762858  3277 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.763509  3482 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.766175  3318 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.768730  3508 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.351s	user 0.003s	sys 0.000s
I20260709 12:20:43.733688  3372 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.769649  3327 raft_consensus.cc:3055] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:43.770074  3327 raft_consensus.cc:740] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:43.771052  3372 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:43.770963  3327 consensus_queue.cc:260] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.729686  3491 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:43.773244  3470 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.739s	user 0.001s	sys 0.001s
I20260709 12:20:43.773563  3491 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.775673  3531 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:20:43.750735  3320 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:43.778641  3533 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:20:43.780230 28753 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:43.781476 28599 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:20:43.781747  3477 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.688s	user 0.000s	sys 0.002s
W20260709 12:20:43.781638 28678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34884 (request call id 2906) took 1496 ms (client timeout 1594 ms). Trace:
I20260709 12:20:43.782529  3277 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:43.782361 28678 rpcz_store.cc:269] 0709 12:20:42.285384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.285640 (+   256us) service_pool.cc:224] Handling call
0709 12:20:43.781384 (+1495744us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b5400251f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:43.781537 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672356736}
I20260709 12:20:43.783736 28601 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:43.772375  3327 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:43.785064 28601 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:43.786284 28601 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:43.787300 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1414) took 1908 ms. Trace:
I20260709 12:20:43.788612 28600 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:43.787736 28748 rpcz_store.cc:276] 0709 12:20:41.878755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:41.878860 (+   105us) service_pool.cc:224] Handling call
0709 12:20:41.904671 (+ 25811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:41.922767 (+ 18096us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:20:42.404482 (+481715us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.386234 (+981752us) log.cc:844] Serialized 14 byte log entry
0709 12:20:43.386419 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:43.386476 (+    57us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:20:43.386538 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.787037 (+400499us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b540003e154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:43.787095 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:43.787235 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20499,"prepare.queue_time_us":38123,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":14355,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":188,"spinlock_wait_cycles":42538112,"thread_start_us":1440987,"threads_started":2,"wal-append.queue_time_us":1035232}
I20260709 12:20:43.795650  3320 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.762888  3110 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.796219  3106 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:43.797266 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.800676 28599 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:43.759938 28747 rpcz_store.cc:276] 0709 12:20:42.556982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:42.557100 (+   118us) service_pool.cc:224] Handling call
0709 12:20:42.565918 (+  8818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.579877 (+1013959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:43.759320 (+179443us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540003e654. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:43.759474 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330292480}
I20260709 12:20:43.806838 28752 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:20:43.827664 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.828569 28599 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:20:43.829396 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.829851 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.830950 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.833326 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:43.833882 28673 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:43.833988 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.836061 28747 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:20:43.836017 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.836859 28675 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:43.832417 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.838207 28601 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:43.839315 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.786403  3492 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.841885 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.809664  3449 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.843843 28676 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:43.844902 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.845701 28680 raft_consensus.cc:2410] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:43.809320  3430 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:43.808838  3451 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:43.847939 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.851415 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:43.852856 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:43.853551 28681 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:43.854523 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.840379  3482 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.843099  3277 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.859387 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.861434 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:43.858292 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.860235 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:43.842962  3438 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:43.828707  3338 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:20:43.862030 29321 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 15.
I20260709 12:20:43.864078 28750 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:20:43.852861  3318 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.869517 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:43.873025 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.876291 28749 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:43.879166 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.879671 28682 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:43.855890  3430 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.889164 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.889870 29323 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:43.865743  3277 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.891384 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.891880  3277 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.891983 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.892535 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.893245 29325 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:43.864647  3482 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:43.893615 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:43.894937  3482 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:43.898494 28681 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 15.
I20260709 12:20:43.899330 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.899865 28681 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:43.898306 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:43.902223 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:43.850903  3449 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.856034  3451 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.935192 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:43.939596 28599 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:43.863720  3491 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.937697 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.937430 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:43.940244 28722 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:43.946830 28572 connection.cc:256] RPC call timeout handler was delayed by -1.4390097440000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
I20260709 12:20:43.940292 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:43.950549 28681 raft_consensus.cc:2368] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:43.938864  3437 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:43.868472  3438 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:43.953888 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:43.955494  3083 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:43.956300  3437 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.956774  3275 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:43.957166 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.962472 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:43.966881 28673 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:43.970535 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:43.970876  3532 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:20:43.933480  3487 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:43.972764  3487 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:43.973193  3487 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:43.976691 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:43.977860  3438 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:43.983801 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:43.985170 28674 raft_consensus.cc:2410] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:20:43.987282 28599 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:43.951583  3354 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:43.970082  3437 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:43.961191  3491 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:43.986953 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:43.988035  3423 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:43.990015  3442 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:43.989717  3318 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:20:44.011780 28722 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.018846 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:44.019461  3451 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.019920 28603 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:44.028257 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.028965 28598 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:20:44.030236  3318 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.030623  3460 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:44.030738  3318 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:44.032951  3318 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:44.034307 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.036738 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:44.037937 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.001374  2962 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:44.041312  3318 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:44.005716  3320 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:20:44.042603  3511 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.044551 28756 raft_consensus.cc:2410] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:44.012239  3442 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.046152  3442 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:44.047175  3511 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.042291 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:44.048064  3511 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:44.048463  3511 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.048828  3511 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:44.049017  3449 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.049692 28750 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:44.013904  3491 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:20:44.049556 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.061558 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.065689 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.064785  3449 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.068805 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.067091  3491 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:44.070040  3318 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:44.070865 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:44.076313 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.077405 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.081846 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.078039 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.082417 28753 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 26.
I20260709 12:20:44.083360 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.076740 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.082304 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.084489 28680 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:20:44.085224 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.085991 28749 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:44.086928 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6828c27180d54395aa62e49037e09909"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:44.087566 28749 raft_consensus.cc:606] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:44.083907 28753 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:20:44.089344 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:44.068993 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.095968 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:44.097718 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:44.098917 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:44.094916 28750 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:44.102151 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.102936 28677 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:20:44.103405 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:44.103926 28675 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:44.089028  3449 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.095861  3376 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:44.107282  3376 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.107620  3376 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:44.107692  3449 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.108233  3318 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:44.108610  3509 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:44.109383  3509 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:44.110224  3509 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.110818  3437 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.100771  3320 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:44.108667  3318 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:44.112854  3320 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.113021  3318 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:44.115412 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:44.118660 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:44.119483 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:44.113487  3320 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:44.121001 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:44.122026 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:44.067389  3487 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.116243  3330 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:44.124377  3438 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:44.133668  3083 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:44.136039 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:44.149885 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.153179 28675 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:44.127076  3275 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:20:44.157207 28682 raft_consensus.cc:2368] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:44.127591  3277 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:44.114272  3354 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:20:44.154474 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.159257 28675 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:44.163938 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.164837 28675 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 26.
I20260709 12:20:44.167622 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.168524 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:44.169000 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 47028us
I20260709 12:20:44.170037 28681 raft_consensus.cc:2368] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20.
I20260709 12:20:44.153784  3083 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.170279 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:44.174012 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.174078 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.176915 28753 raft_consensus.cc:2410] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 12:20:44.174547 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.174834 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.177990 28754 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:44.155071  3511 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.189354 28749 raft_consensus.cc:606] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:44.189883 28749 raft_consensus.cc:614] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:44.193533  3487 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.194904  3511 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.195644  3449 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:44.163046  3277 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.210708  3277 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:44.157075  3275 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.212796  3275 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:44.163367  3482 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:44.209626 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:44.223461 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53280.7us
I20260709 12:20:44.224242 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:44.230080 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:44.177479  3083 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:44.244426  3330 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:44.240841  3358 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:20:44.245726  3330 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:44.246122  3330 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:44.249424 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.254267 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:44.260658 29327 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 12:20:44.262141 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.262666 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.264896 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.265865 29326 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:44.266544 28750 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:44.241043  3449 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:44.262953 29321 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 16.
I20260709 12:20:44.280149 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:44.274470 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.275391 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:44.283612 29325 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:44.281332 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.266352 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.287485 29327 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:44.287870 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.288599 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.285575 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:44.289996 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 382428us
I20260709 12:20:44.290722 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:44.293427 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:44.294610 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:44.295706 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:44.242668  3552 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:44.243839  3448 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:20:44.287942 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.244035  3451 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:20:44.305280 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3289) took 1030 ms. Trace:
I20260709 12:20:44.317497 28607 rpcz_store.cc:276] 0709 12:20:43.275100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.275337 (+   237us) service_pool.cc:224] Handling call
0709 12:20:43.420558 (+145221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:43.481504 (+ 60946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.305087 (+823583us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000bf250. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:44.305211 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286006144}
I20260709 12:20:44.317921 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:44.295557 28632 heartbeater.cc:646] Failed to heartbeat to 127.26.205.190:43093 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.26.205.190:43093 timed out after 15.000s (SENT)
I20260709 12:20:44.292366 28573 leader_election.cc:400] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:44.260933  3437 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.312974 29323 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:44.326915 28573 leader_election.cc:403] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:20:44.277393  3344 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:44.328853 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.277130  3338 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:44.320676 28675 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:44.284957  3524 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.333228 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.249069  3118 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:20:44.285913  3449 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:44.335947 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.337658 29326 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:44.339871  3423 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:44.340188 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 60174.1us
I20260709 12:20:44.296710  3341 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:44.308058  3164 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:44.343395 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.315266  3504 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.352749  3504 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:44.354885  3504 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.267335  3358 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:20:44.323137  3488 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:44.307300  3457 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.341185 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:44.348402  3341 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.347378  3106 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:44.332332  3338 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.360919  3338 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:44.361230  3457 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.363909  3457 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.322768  3355 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:44.364717  3355 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.323145  3489 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:44.350512  3337 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:44.370460  3337 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:44.371308  3337 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.372423  3337 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:44.351874  3535 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.506s	user 0.003s	sys 0.001s
I20260709 12:20:44.341125  3524 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:44.347529  3164 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.378125  3164 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:44.379091  3524 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.329571  3344 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:44.381960  3344 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:44.383224  3291 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:44.366451  3355 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:44.383769  3291 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:44.368312  3341 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.383339  3344 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:44.341946  3449 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:44.401522  3110 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:44.412563  3110 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:44.413444  3110 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:44.411206  3492 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:44.415269  3106 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:44.415712  3106 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:44.416085  3106 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:44.400611  3430 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:44.422048 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 129784us
W20260709 12:20:44.411268 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 70188.4us
I20260709 12:20:44.423496 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:44.422662 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.425743 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:44.430058 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.431109 28750 raft_consensus.cc:2410] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:20:44.433231 28747 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:20:44.439451  3305 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:44.439482  3524 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:44.440138  3524 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:44.440528  3524 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:44.414626  3110 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:44.449265 28571 leader_election.cc:400] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 14 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:44.450210 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:44.450837  3457 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:44.451527  3489 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:44.459707  3320 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:44.410292 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 114654us
I20260709 12:20:44.395717  3164 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.366076  3376 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.436335  3106 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.480732 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.550436 29322 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:44.483297 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.553534 29318 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:44.481756 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.490609 28571 leader_election.cc:400] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:44.555850 28571 leader_election.cc:403] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:44.522473 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.556454 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 65971.9us
I20260709 12:20:44.852907 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.854840 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:44.855552 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:44.718091 28677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.033s	sys 0.051s
I20260709 12:20:44.856194 28679 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:44.856909 28677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.034s	sys 0.056s
I20260709 12:20:44.537256 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:44.503381 28502 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 308) took 67201 ms (client timeout 15000 ms). Trace:
I20260709 12:20:44.542191 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.859567 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:44.859767 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.538009 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:44.853551 28750 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
W20260709 12:20:44.765549 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:44.851902 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 303810us
I20260709 12:20:44.861197 28675 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:20:44.536589 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:44.864550 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 26.
W20260709 12:20:44.865665 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:44.523267 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:44.868549 29321 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:44.860008 29323 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
W20260709 12:20:44.894119 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 370904us
I20260709 12:20:44.896804 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.897958 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.898432 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.898728 28600 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:44.900113 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:44.900658 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.900956 28682 raft_consensus.cc:2410] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:20:44.901221 28599 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:44.904376 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.908372 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.908977 28600 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:44.475114 28498 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 21, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 21 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.911446 28498 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 16, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 16 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:44.912245 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:44.915107 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 58918.6us
I20260709 12:20:44.917588 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:44.916260 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:44.919936 28598 raft_consensus.cc:2376] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20. Re-sending same reply.
I20260709 12:20:44.920992 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.906971 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.923969 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.925567 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.926666 28599 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:44.495406  3442 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.928750 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.930670 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.930474  3524 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.931268 28601 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:44.501746  3338 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.934551  3338 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.935202  3338 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:44.936067 29320 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:44.937846 28648 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.515s (SENT)
W20260709 12:20:44.938027  3275 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.713s	user 0.002s	sys 0.007s
I20260709 12:20:44.938313 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.938521  3275 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:44.939558  3437 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:44.851243  3438 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.940759  3438 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.943094  3438 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.906312  3341 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.944000  3341 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.944913 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.945535 28602 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:44.946049  3341 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.857877  3298 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:44.940465 28676 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 26. Current term is 27. Ops: []
I20260709 12:20:44.466224  3083 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:44.952708  3450 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:44.953441  3450 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:44.953917  3450 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.954509  3083 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:44.955192 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.914232 28498 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:44.967861 28679 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:44.923074 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:44.969446 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46441.7us
I20260709 12:20:44.979013 28498 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 14 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 17 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.981083 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:44.981711 28604 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:20:44.502869  3320 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:44.991446  3320 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.992029  3320 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:44.993782  3344 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:44.528367  3277 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.994437  3344 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:44.997061  3277 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.522053  3305 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 14. Current term is 15.
I20260709 12:20:44.985688 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:44.997989 28607 raft_consensus.cc:2376] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18. Re-sending same reply.
W20260709 12:20:44.858672 28502 rpcz_store.cc:269] 0709 12:19:37.302462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:37.333483 (+ 31021us) service_pool.cc:224] Handling call
0709 12:20:44.503290 (+67169807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:38.261336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:38.532956 (+271620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:38.545561 (+ 12605us) write_op.cc:435] Acquired schema lock
0709 12:20:38.547740 (+  2179us) tablet.cc:662] Decoding operations
0709 12:20:38.794265 (+246525us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:38.842473 (+ 48208us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:38.848961 (+  6488us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:20:38.976517 (+127556us) tablet.cc:701] Row locks acquired
0709 12:20:38.976596 (+    79us) write_op.cc:260] PREPARE: finished
0709 12:20:38.976828 (+   232us) write_op.cc:270] Start()
0709 12:20:38.977041 (+   213us) write_op.cc:276] Timestamp: P: 1783599638976741 usec, L: 0
0709 12:20:38.977074 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:20:39.022520 (+ 45446us) log.cc:844] Serialized 2891 byte log entry
0709 12:20:39.726190 (+703670us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b
0709 12:20:40.648387 (+922197us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:40.787154 (+138767us) op_driver.cc:464] REPLICATION: finished
0709 12:20:41.401281 (+614127us) write_op.cc:301] APPLY: starting
0709 12:20:41.465773 (+ 64492us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:41.698506 (+232733us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:41.698557 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:42.043168 (+344611us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b18000f8f20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe37be0ec 00007f6fe380ac0a 00007f6fe380a4f7 00007f6fe380a490 00007f6fe37c1f48 00007f6fe74d61bb 00007f6fe751d5d4 00007f6fe73c98da 00007f6fe73cc3cb
0709 12:20:42.119496 (+ 76328us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:42.119853 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:20:42.119924 (+    71us) write_op.cc:312] APPLY: finished
0709 12:20:42.120356 (+   432us) log.cc:844] Serialized 73 byte log entry
0709 12:20:42.487145 (+366789us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b
0709 12:20:43.256035 (+768890us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:43.265685 (+  9650us) write_op.cc:454] Released schema lock
0709 12:20:43.265759 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:43.266215 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:43.266258 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":481828,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":483522,"apply.run_cpu_time_us":41598,"apply.run_wall_time_us":1907570,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33317,"num_ops":7,"prepare.queue_time_us":167263,"prepare.run_cpu_time_us":48928,"prepare.run_wall_time_us":2260766,"raft.queue_time_us":92834,"raft.run_cpu_time_us":15518,"raft.run_wall_time_us":278637,"replication_time_us":1785888,"spinlock_wait_cycles":129050240,"thread_start_us":2775629,"threads_started":5,"wal-append.queue_time_us":2442181,"wal-append.run_cpu_time_us":13277,"wal-append.run_wall_time_us":2566613}]]}
I20260709 12:20:44.893889  3430 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.119s
W20260709 12:20:44.987397  3291 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.603s	user 0.004s	sys 0.004s
I20260709 12:20:44.988373  3524 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.989359 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.980796 28498 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 17 to 19, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 19 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:44.524283  3164 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.526444  3376 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.528007  3106 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:44.546466  3487 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:44.546141  3489 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.001530 28498 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 11 to 13, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:45.009968 28498 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 14 to 15, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 15 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.011678 28498 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 14 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 17 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.004235 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:44.499565  3355 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:45.003366  3488 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.000s
I20260709 12:20:44.465543  3330 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.014366 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:45.021835 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:44.955940  3450 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.002038  3341 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:44.530674  3318 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.008736  3430 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.033464 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.034552 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.035111 28602 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:45.023598 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:45.016379 28498 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 22 to 24, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 24 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:20:45.014381  3110 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.002s
I20260709 12:20:45.015373  3358 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.051265 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.045781 28498 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 14 to 15, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 15 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:45.039639 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.052109 28602 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:45.053880 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.022823  3488 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:45.026732  3460 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:45.055930 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.006752  3291 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.057711 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.054065 28498 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 12 to 15, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 15 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:45.053586  3110 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:45.059067 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.074777 28606 raft_consensus.cc:2376] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19. Re-sending same reply.
I20260709 12:20:45.059391 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.026870  3275 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:45.077705 28720 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.016s	sys 0.051s
W20260709 12:20:45.078245 28720 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.016s	sys 0.051s
W20260709 12:20:45.078655 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 739712us
I20260709 12:20:45.001394  3320 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:45.067802 28599 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:45.069869 28601 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:45.096205 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:45.097371 28605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.037s	sys 0.082s
I20260709 12:20:45.014030  3487 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.080138 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:45.102269 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:45.097761 28605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.037s	sys 0.082s
I20260709 12:20:45.103219 28607 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:45.103538 28599 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.107270 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:45.093555  2962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.013s	sys 0.056s
W20260709 12:20:45.110817  2962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.014s	sys 0.056s
I20260709 12:20:45.069499  3460 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.073005 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.116194 28648 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.117632 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:45.026894  3338 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:20:45.062131  3298 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16.
I20260709 12:20:45.076877 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:45.057224  3449 consensus_meta.cc:287] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.000s
I20260709 12:20:45.016852  3489 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:45.082058  3292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.028s	sys 0.088s
I20260709 12:20:45.074834  3451 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:45.127277 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47251.1us
I20260709 12:20:45.137305 28720 leader_election.cc:400] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20.
W20260709 12:20:45.106894  3509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.016s	sys 0.055s
W20260709 12:20:45.129060 28748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.174s	sys 0.278s
W20260709 12:20:45.139761 28748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.174s	sys 0.279s
I20260709 12:20:45.112974  3442 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.126741  3460 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.124802  3275 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:45.133033  3450 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:20:45.130916 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:45.133806 28600 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:45.131573  3320 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:45.137712 28720 leader_election.cc:403] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:20:45.128690 28604 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:45.135433 28599 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:45.076539  3552 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:20:45.130652 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.145610  3450 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:20:45.139634  3509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.016s	sys 0.056s
I20260709 12:20:45.125145  3338 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.128602  3277 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:45.146061  3450 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:45.145620 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.151738 28607 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:45.133872  3553 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:45.148727 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.152127 28604 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:45.147720 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:45.155213 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:45.157392 28679 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:45.158715 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:45.158912 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:45.159678 28750 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 25: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:45.159516 28747 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:45.160609 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:45.160035 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.161556 28599 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:45.161716 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:45.159148 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:45.162256 28750 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:20:45.139333  3292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.029s	sys 0.088s
I20260709 12:20:45.150909  3338 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:45.165405 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.167698 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.173749 28607 raft_consensus.cc:2376] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20. Re-sending same reply.
I20260709 12:20:45.168725 28682 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 25: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:45.169605 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:45.163540 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:45.174885 28747 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:45.171887 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:45.172843 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.178079 28601 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
W20260709 12:20:45.155534  3182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.001s	sys 0.054s
I20260709 12:20:45.135695  3449 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.071398 28498 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:45.180572 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.150903  3492 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:45.174173 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.183123 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.157025  2962 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:45.185751 28681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.012s	sys 0.044s
W20260709 12:20:45.254168 28681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.012s	sys 0.045s
I20260709 12:20:45.254671 28601 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 25: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:45.254980 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2934) took 1109 ms. Trace:
W20260709 12:20:45.182929 29290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.025s	sys 0.034s
W20260709 12:20:45.256362 29290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.026s	sys 0.034s
I20260709 12:20:45.256167 28599 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:45.184355  3504 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:45.156500  3553 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:45.200634 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.207018 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:45.260938 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.169168  3320 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:45.267519 28498 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:45.269373  3320 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.270164 28498 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:20:45.256800 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 928079us
I20260709 12:20:45.187915 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.255467 28681 rpcz_store.cc:276] 0709 12:20:44.145496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.170547 (+ 25051us) service_pool.cc:224] Handling call
0709 12:20:44.214450 (+ 43903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:44.225196 (+ 10746us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:44.250221 (+ 25025us) log.cc:844] Serialized 14 byte log entry
0709 12:20:45.254643 (+1004422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:45.254699 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:45.254743 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.254806 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.254930 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30185,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":8369,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":19682,"spinlock_wait_cycles":508160,"thread_start_us":927691,"threads_started":1}
I20260709 12:20:45.259402 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:45.311115 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 123290us
I20260709 12:20:45.273609  3553 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:45.261234 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 54324.4us
I20260709 12:20:45.300617  3318 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.262565  3358 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:45.220290  3355 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.327625  3355 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:45.262753  3291 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.263303 28599 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:20:45.329941 28599 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: []
W20260709 12:20:45.259938  3423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.020s	sys 0.060s
W20260709 12:20:45.236166  3350 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.024s	sys 0.056s
W20260709 12:20:45.336884  3350 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.025s	sys 0.058s
W20260709 12:20:45.225052  3182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.001s	sys 0.055s
I20260709 12:20:45.171057  3456 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:45.204815  3322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.014s	sys 0.048s
I20260709 12:20:45.193933  3277 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:45.296710 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.253518  3492 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:45.217929  3451 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:45.276558 29319 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: []
W20260709 12:20:45.343741  3322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.017s	sys 0.051s
I20260709 12:20:45.344688 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1986) took 1068 ms. Trace:
I20260709 12:20:45.344614  3451 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.345080 29319 rpcz_store.cc:276] 0709 12:20:44.283688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.289417 (+  5729us) service_pool.cc:224] Handling call
0709 12:20:44.289699 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:45.343809 (+1054110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.344355 (+   546us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400690354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:45.344613 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269000960}
W20260709 12:20:45.252712  3261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.023s	sys 0.046s
I20260709 12:20:45.216581  3488 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:45.261507  3442 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:45.360070  3442 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.360591  3442 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:45.305542 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:45.305848 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:45.312008 28604 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:45.259766 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.368049 28601 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 27 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:20:45.175122  3524 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:45.401693 29325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.034s	sys 0.058s
W20260709 12:20:45.402206 29325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.034s	sys 0.058s
I20260709 12:20:45.314942 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:45.315521  3275 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:45.318301 28498 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 16 to 17, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:45.303421  3504 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.316041 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.303362 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:45.323493  3358 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:45.332721  3355 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 25.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:45.415041  3344 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:45.336251  3423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.021s	sys 0.060s
I20260709 12:20:45.415627  3423 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:45.416615  3423 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.312386 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:20:45.418557 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 106257us
I20260709 12:20:45.419220 28648 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:45.220738  3450 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:45.407878 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 91917us
I20260709 12:20:45.407662 28498 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 13 to 18, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:45.422171 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:45.408340 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 93516.3us
I20260709 12:20:45.336877  3552 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:45.354158  3261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.024s	sys 0.047s
I20260709 12:20:45.338734  3448 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 12:20:45.414584  3358 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:45.417300  3350 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:45.415619  3344 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:45.333779  3487 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:45.419641 28747 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:20:45.425849 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.428828  3552 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.346479  3492 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:45.427882 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.435663 28750 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 27.
I20260709 12:20:45.413265  3489 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.436187  3182 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:45.449944 28648 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:45.410794  3488 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.422729  3504 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.442476  3341 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:45.529084  3330 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.529958  3330 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:45.465602 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.022s
W20260709 12:20:45.539757 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.023s
W20260709 12:20:45.540541 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 622997us
W20260709 12:20:45.542723 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.016s	sys 0.015s
W20260709 12:20:45.543164 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.016s	sys 0.015s
I20260709 12:20:45.543992  3448 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:45.558988 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:45.560173  3573 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:45.490578 28603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.008s	sys 0.023s
I20260709 12:20:45.445561  3451 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:45.447714  3344 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:45.444512  3557 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:45.464389  3275 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:45.451505  3182 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:45.498600  3560 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:45.449404  3487 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:45.464649  3449 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:45.501574 29322 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.066s	sys 0.124s
I20260709 12:20:45.486915  3350 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:20:45.510043  3554 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:20:45.569092 28603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.008s	sys 0.023s
I20260709 12:20:45.530591  3330 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.572778  3110 raft_consensus.cc:993] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
W20260709 12:20:45.572932  3566 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:20:45.573444  3567 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:45.558187  3457 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:20:45.614271  3182 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:45.576503  3559 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:20:45.577593  3511 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.579636  3313 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:45.588302 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:45.655709 28675 raft_consensus.cc:2368] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23.
I20260709 12:20:45.634359  3350 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:45.597105 28600 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:45.599826 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:45.660351 28678 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:45.600895  3504 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.601303  3488 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:45.602700  3555 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:20:45.607623 28750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:45.661494 28750 raft_consensus.cc:606] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:45.661835 28750 raft_consensus.cc:614] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:20:45.612556 28722 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.015s	sys 0.060s
W20260709 12:20:45.662622 28722 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.015s	sys 0.061s
I20260709 12:20:45.659114  3372 raft_consensus.cc:1081] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:20:45.666033  3456 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:20:45.666461  3456 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:45.668284 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3288) took 1632 ms. Trace:
I20260709 12:20:45.668553  3350 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:45.669636  3460 consensus_meta.cc:287] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 12:20:45.668689 28748 rpcz_store.cc:276] 0709 12:20:44.035474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.039209 (+  3735us) service_pool.cc:224] Handling call
0709 12:20:44.067955 (+ 28746us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:44.084604 (+ 16649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.084649 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:44.100020 (+ 15371us) log.cc:844] Serialized 52 byte log entry
0709 12:20:45.140284 (+1040264us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:45.140342 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.140451 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.668045 (+527594us) raft_consensus.cc:1685] finished
0709 12:20:45.668068 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.668221 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":16431,"thread_start_us":1026505,"threads_started":1,"wal-append.queue_time_us":1329479}
I20260709 12:20:45.670081  3460 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.673954 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.674341  3330 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.675319  3563 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.676229 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:45.677062  3318 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:45.677508  3318 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:45.678051  3318 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:45.680291  3358 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.682286 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.682529  3358 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:45.628757 29322 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.068s	sys 0.124s
I20260709 12:20:45.604753  3557 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:45.574383  3344 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.616022  3275 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:45.657452 28720 leader_election.cc:400] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23.
I20260709 12:20:45.703414 28720 leader_election.cc:403] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:20:45.595333  3277 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:45.621377 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 79820.9us
I20260709 12:20:45.641929  3552 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:45.706132 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.692055 28678 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:45.706862 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2927) took 1605 ms. Trace:
I20260709 12:20:45.707348 28677 rpcz_store.cc:276] 0709 12:20:44.101606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.103408 (+  1802us) service_pool.cc:224] Handling call
0709 12:20:44.103715 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:44.104037 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:44.104061 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:44.114476 (+ 10415us) log.cc:844] Serialized 26 byte log entry
0709 12:20:44.857315 (+742839us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:44.857359 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:44.857425 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.706531 (+849106us) raft_consensus.cc:1685] finished
0709 12:20:45.706564 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.706782 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1366,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":707887,"threads_started":1,"wal-append.queue_time_us":1090083}
W20260709 12:20:45.708910 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51660.5us
I20260709 12:20:45.710697 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:45.715162 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.693277 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:20:45.693552 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:45.694918 28605 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.021s	sys 0.036s
I20260709 12:20:45.639950  3457 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:20:45.672215  3460 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:45.718050 28605 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.022s	sys 0.036s
I20260709 12:20:45.655318  3313 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:45.717773 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.720541 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:45.632577  3338 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.692588  3322 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:45.727716  3563 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:45.729727  3563 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:45.730634  3563 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.725857 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:45.735003  3450 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:45.735419  3376 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:45.735916  3376 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:45.732038  3562 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:20:45.736274  3376 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:45.736563  3562 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.737071  3562 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:45.739019 28598 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:45.740975 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.741603 28600 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:45.742461 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.744423  3376 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.748090  3491 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:45.749224  3491 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:45.749645  3491 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:45.749341  3456 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.750566  3491 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.751699  3491 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:45.754915 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.758363  3338 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:45.724577 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.708369  3553 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.718209  3261 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23.
W20260709 12:20:45.760217  3561 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:20:45.760856  3553 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:45.761826  3261 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:45.718642  3568 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:20:45.657416  3511 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.697679  3557 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:45.721768  3509 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:45.722410  3372 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:45.773272 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:45.722173  3572 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:45.774914 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:45.764565 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:45.765962  3164 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:45.788188 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.791433 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:45.767853  3553 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.794204 28675 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:45.687908  3350 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.793345  3457 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:45.802316  3456 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:45.785887  3322 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.793604  3509 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:45.812203  3509 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.816255  3322 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.818480  3322 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.810520  3292 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:45.805847  3511 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:45.775750  3372 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.778110  3106 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:20:45.820367  3372 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:45.808099 28722 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:45.778983  2962 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.001s
I20260709 12:20:45.800190  3110 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:45.805684  3164 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.800576  3491 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:45.836148  2962 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20.
I20260709 12:20:45.808553  3275 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.865338 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3292) took 2549 ms. Trace:
I20260709 12:20:45.836205  3457 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.838793  3320 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:45.841396  3562 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.844170 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:45.844142 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.845347 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:45.886049 28747 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:45.886250 28751 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:20:45.853279 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:45.776747  3182 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.860769 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:45.900985 28752 raft_consensus.cc:2410] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:20:45.863283 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:45.901754  3182 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.868472 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:45.865840 28605 rpcz_store.cc:276] 0709 12:20:43.306387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:43.437560 (+131173us) service_pool.cc:224] Handling call
0709 12:20:43.455335 (+ 17775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:43.456382 (+  1047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:43.456413 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:44.067503 (+611090us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b1800434e00. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a
0709 12:20:44.406459 (+338956us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b2c00058028. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:44.406964 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:20:45.103377 (+696413us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:45.719347 (+615970us) log.cc:844] Serialized 14 byte log entry
0709 12:20:45.765810 (+ 46463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.766110 (+   300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:45.853994 (+ 87884us) raft_consensus.cc:1685] finished
0709 12:20:45.854024 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:45.854196 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107508,"raft.queue_time_us":47221,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":27324,"spinlock_wait_cycles":72108544,"thread_start_us":1304683,"threads_started":2,"wal-append.queue_time_us":1039325}
I20260709 12:20:45.809733  3553 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.822691  3106 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:45.844713  3573 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:45.889365 28756 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:45.894614  3562 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.899839  3164 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:45.853327 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:45.919827 28749 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:45.905500 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 67334.8us
I20260709 12:20:45.800150  3313 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.870357  3491 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:45.925205 28748 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 26. Current term is 27. Ops: [21.15-26.17]
I20260709 12:20:45.921536 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.844918  3110 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:45.927759 29325 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:20:45.910748  3106 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:45.928184 29325 pending_rounds.cc:85] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 13
I20260709 12:20:45.928747 29325 pending_rounds.cc:107] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:20:45.929050 29325 raft_consensus.cc:2889] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:45.910506  3320 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:20:45.930608 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:45.867419  3318 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:45.933355 28571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.006s	sys 0.029s
W20260709 12:20:45.935465 28571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.006s	sys 0.029s
W20260709 12:20:45.935886 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 632556us
W20260709 12:20:45.933741 29290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.011s	sys 0.023s
W20260709 12:20:45.936925 29290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.011s	sys 0.023s
W20260709 12:20:45.937254 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 512282us
I20260709 12:20:45.933913 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:45.937350 29319 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 12:20:45.934078 28599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.011s	sys 0.027s
W20260709 12:20:45.941429 28599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.013s	sys 0.027s
I20260709 12:20:45.943310 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:45.904495  3457 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.957028 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:45.957777 28675 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:45.959362 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:45.960268 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:45.957418 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:45.963279 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.964218 28602 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:45.928323  3338 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:45.964547 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:45.978463 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:45.978787 28605 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:45.980588 29325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6828c27180d54395aa62e49037e09909"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:20:45.981300 29325 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:45.981739 29325 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:45.984899 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:45.985278 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:45.987686 29327 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:45.988816 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:45.976722 29289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.023s
W20260709 12:20:45.989601 29289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.011s	sys 0.023s
I20260709 12:20:45.989550 29326 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 27: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:45.990444 28682 raft_consensus.cc:1217] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Deduplicated request from leader. Original: 19.13->[20.14-26.17]   Dedup: 23.16->[26.17-26.17]
I20260709 12:20:45.990959 28682 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 26. Current term is 27. Ops: [20.14-26.17]
W20260709 12:20:45.976871 29292 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.017s	sys 0.017s
W20260709 12:20:45.991369 29292 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.017s	sys 0.017s
W20260709 12:20:45.991624 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 545804us
I20260709 12:20:45.992719 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:45.992324 28679 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
W20260709 12:20:45.995031 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:45.986133 29317 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:45.997767 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:45.998132 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:45.998737 29317 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:46.000306 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:45.992619 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:46.001475 29317 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:45.917989  3573 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.013129 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:45.976841  3492 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.524s	user 0.001s	sys 0.009s
I20260709 12:20:46.009960 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:46.013897 29326 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:45.935720  2962 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:46.075989 29318 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:46.008090 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.003144 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.078023 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:46.071154 28606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.020s	sys 0.015s
W20260709 12:20:46.078883 28606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.020s	sys 0.015s
W20260709 12:20:46.079689 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.010s	sys 0.003s
W20260709 12:20:46.080196 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.010s	sys 0.004s
I20260709 12:20:45.977948  3320 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:20:45.964607  3341 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:20:46.081271 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 616079us
I20260709 12:20:45.964534  3575 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:46.094179 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:46.103332 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:46.094179 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:46.112453 28647 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.735s (SENT) [suppressed 32 similar messages]
I20260709 12:20:46.110468 29318 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:46.078392  3451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.018s
I20260709 12:20:46.014498  3562 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:46.110008 29319 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:46.069196  3511 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:45.983477  3292 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260709 12:20:46.119429 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.072607  3488 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:46.098764 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:46.116572 28721 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:46.151842 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 363608us
I20260709 12:20:46.150758 29325 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:45.998718  3338 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.160121 29318 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:46.174098 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.107038  3430 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.104708  3337 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:46.176712 29326 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:46.191377 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.192047 29326 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.121651  3552 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:20:46.176162 29323 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:46.106824  3118 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:46.200275 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.184618 29325 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:46.148579  3451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.004s	sys 0.019s
I20260709 12:20:46.151630  3562 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.196556 29318 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:46.207681 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:46.201314 29327 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:46.177373 28601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.018s
W20260709 12:20:46.202087 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 198543us
I20260709 12:20:46.100096  2962 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.097932  3492 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:46.213003 28601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.004s	sys 0.018s
I20260709 12:20:46.217303 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:46.217923 29325 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:46.219592 29319 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:46.202262 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 1994) took 1662 ms. Trace:
W20260709 12:20:46.186451 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 69921.9us
I20260709 12:20:46.206496 29321 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:46.110430  3376 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.130584 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:46.224210 28754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
W20260709 12:20:46.224759 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 94257.8us
I20260709 12:20:46.188851  3355 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.100651  3491 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.201988  3341 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:46.201649  3350 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.211973  3562 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:46.254935 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1286) took 1145 ms. Trace:
I20260709 12:20:46.256042  3083 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.255376 28599 rpcz_store.cc:276] 0709 12:20:45.109343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.330800 (+221457us) service_pool.cc:224] Handling call
0709 12:20:45.331151 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.331546 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.331586 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:45.332110 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:20:45.941931 (+609821us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:45.941987 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:45.942080 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:46.254687 (+312607us) raft_consensus.cc:1685] finished
0709 12:20:46.254707 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.254861 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83677,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":609496,"threads_started":1,"wal-append.queue_time_us":920968}
I20260709 12:20:46.256712  3110 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:46.256623  3083 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.257144 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.259456  3083 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.111336  3182 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.099s
I20260709 12:20:46.236394 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:46.248214 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.210290  3118 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.249420  3341 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.250073  2962 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:46.203243  3320 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:20:46.175354  3488 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:46.260946  3582 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:20:46.241333  3591 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:46.169852  3511 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:46.265069  3579 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:20:46.198832  3509 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:46.244910 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:46.269413 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48455.6us
I20260709 12:20:46.335690 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:46.272259 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:46.245899  3318 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:46.274742 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 162321us
I20260709 12:20:46.200753  3430 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.203472  3337 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.311251 29318 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
W20260709 12:20:46.247128  3584 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:20:46.311553 28749 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:46.312669 29326 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:46.313550 28756 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
W20260709 12:20:46.261461  3450 consensus_meta.cc:287] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 12:20:46.252352  3589 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:46.274109  3442 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.913s	user 0.002s	sys 0.011s
I20260709 12:20:46.326992  3552 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:46.327244 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.271979  3350 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.252337  3573 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.378334 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1290) took 1264 ms. Trace:
I20260709 12:20:46.323395 28648 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:46.332788 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.333607 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:46.381114 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 57719.9us
I20260709 12:20:46.381788 28753 raft_consensus.cc:2393] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:46.332173 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.240389  3355 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.340348 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.240728  3451 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
W20260709 12:20:46.395020 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 59430.6us
W20260709 12:20:46.343353  3456 consensus_meta.cc:287] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.004s
I20260709 12:20:46.343729  3457 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.344725 28754 raft_consensus.cc:606] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:46.404564 28754 raft_consensus.cc:614] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:46.345362 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:46.405342 28678 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:46.345865  3118 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.246166  3526 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 12:20:46.346311 28674 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:46.346866 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1287) took 1237 ms. Trace:
I20260709 12:20:46.347219  3562 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.347712 28677 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:46.349367 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.275904  3607 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:46.350811  3313 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:46.351917  3372 consensus_meta.cc:287] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.002s
W20260709 12:20:46.352995  3593 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:20:46.353470  3492 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.464725 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 27.
W20260709 12:20:46.370155 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 125311us
I20260709 12:20:46.326653  3591 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.274251  3557 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.378785 28606 rpcz_store.cc:276] 0709 12:20:45.114350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.497476 (+383126us) service_pool.cc:224] Handling call
0709 12:20:45.497941 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.498379 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.498419 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:45.498968 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:20:46.079338 (+580370us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:46.376978 (+297640us) log.cc:844] Serialized 14 byte log entry
0709 12:20:46.377698 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.377822 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:46.377883 (+    61us) raft_consensus.cc:1685] finished
0709 12:20:46.377895 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.378273 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16189,"prepare.queue_time_us":176982,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":2370,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5175,"thread_start_us":847032,"threads_started":2,"wal-append.queue_time_us":766743}
I20260709 12:20:46.393826 29319 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:46.393846 28755 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:46.338856  3588 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:46.355173  3083 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.375058  3449 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:46.394570  3605 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:46.437479 28599 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:46.461189 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3067) took 1424 ms. Trace:
I20260709 12:20:46.388105  3450 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:46.462147 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.440953  3607 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.431963 28604 rpcz_store.cc:276] 0709 12:20:45.109613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.366332 (+256719us) service_pool.cc:224] Handling call
0709 12:20:45.366769 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:45.367203 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.367242 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:45.401187 (+ 33945us) log.cc:844] Serialized 52 byte log entry
0709 12:20:45.704267 (+303080us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:46.177229 (+472962us) log.cc:844] Serialized 14 byte log entry
0709 12:20:46.191477 (+ 14248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.191551 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:46.346636 (+155085us) raft_consensus.cc:1685] finished
0709 12:20:46.346656 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.346807 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80799,"prepare.queue_time_us":551678,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":63554,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":8023,"thread_start_us":671843,"threads_started":2,"wal-append.queue_time_us":611591}
I20260709 12:20:46.519706 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.408103  3564 raft_consensus.cc:2764] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:20:46.275430  3291 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.078s
I20260709 12:20:46.512765 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.395720  3350 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.514456 28751 raft_consensus.cc:2368] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18.
I20260709 12:20:46.387775  3442 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.533432 28604 raft_consensus.cc:2393] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:46.509917  3590 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:20:46.527169 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 59477.9us
I20260709 12:20:46.536353 28748 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:46.517194 28607 rpcz_store.cc:276] 0709 12:20:45.037050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.261093 (+224043us) service_pool.cc:224] Handling call
0709 12:20:45.261399 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.264518 (+  3119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.264564 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:45.265160 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 12:20:45.697704 (+432544us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:46.187430 (+489726us) log.cc:844] Serialized 14 byte log entry
0709 12:20:46.204322 (+ 16892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.204463 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:46.460973 (+256510us) raft_consensus.cc:1685] finished
0709 12:20:46.460994 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.461127 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17628,"prepare.queue_time_us":505623,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":33883,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":6975,"thread_start_us":886042,"threads_started":2,"wal-append.queue_time_us":806126}
I20260709 12:20:46.538684 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.539271 28607 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:46.539767  3598 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:20:46.541396 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3310) took 1626 ms. Trace:
I20260709 12:20:46.542616  3338 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.541728 28603 rpcz_store.cc:276] 0709 12:20:44.914877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.929615 (+ 14738us) service_pool.cc:224] Handling call
0709 12:20:44.929907 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.634498 (+704591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.634544 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:45.635491 (+   947us) log.cc:844] Serialized 26 byte log entry
0709 12:20:46.182620 (+547129us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:46.195499 (+ 12879us) log.cc:844] Serialized 14 byte log entry
0709 12:20:46.196063 (+   564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.196276 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:46.541175 (+344899us) raft_consensus.cc:1685] finished
0709 12:20:46.541195 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.541332 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73961,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":92175,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":18483,"thread_start_us":1162019,"threads_started":2,"wal-append.queue_time_us":665665}
I20260709 12:20:46.543581 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.544253 28603 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:46.546315 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:46.546978 29321 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:46.551249 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.553612  3355 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.438481  3318 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 12:20:46.555063  3291 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:46.555473  3291 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:46.556337  3291 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.557619  3291 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:46.514117 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 241948us
I20260709 12:20:46.376948  3589 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.535882 28681 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:46.464797  3615 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:46.523231 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.559939 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:46.510911  3591 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.512871  3164 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:46.564014 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.516886  3322 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:46.563877 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:46.558521  3337 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.573050  3511 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.573181  3322 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.532653  3552 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.574522  3562 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:46.575042 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.576346  3430 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:46.577397  3557 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.576395  3450 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:46.577950  3355 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:46.576275 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.578819 28606 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:46.579694 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.579766 28607 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:46.580727 28605 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:20:46.580534  3164 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.582620  3442 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:46.583444  3164 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.466957  3491 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 12:20:46.567198  3327 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:46.566517 28602 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:46.566325 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:46.569645  3589 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.562606  3615 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:46.585057  3562 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:20:46.562606 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 165511us
I20260709 12:20:46.589748 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:46.522754  3607 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:46.469036  3372 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.592027  3615 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:46.593510 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:46.592123  3164 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:46.592363  3562 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:46.605273 29323 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:46.605686 29323 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:46.521268  3588 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.597007  3488 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:46.577984  3450 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:46.599897 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.611752 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:46.612902 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.602947 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.603857 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:46.594964 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.520658  3083 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.614812 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.615000 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.615851 28753 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 25: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:46.589072  3327 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.606505 29323 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.634919 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:46.605638  3625 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:46.617383 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.599726  3571 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:46.618999 28605 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:20:46.619940 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.620090 28603 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:46.620760 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.621007 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.621268 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.621713 28749 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:46.650242 28747 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:46.622241 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.603451  3110 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:20:46.220569 29322 rpcz_store.cc:276] 0709 12:20:44.539939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:44.551230 (+ 11291us) service_pool.cc:224] Handling call
0709 12:20:44.551620 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:44.551886 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:45.692930 (+1141044us) log.cc:844] Serialized 14 byte log entry
0709 12:20:46.201564 (+508634us) log.cc:844] Serialized 14 byte log entry
0709 12:20:46.201774 (+   210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:46.201824 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:46.201871 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.202091 (+   220us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:46.202212 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":414144,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":4710,"raft.queue_time_us":226,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":22074,"spinlock_wait_cycles":15104,"thread_start_us":1629702,"threads_started":2}
I20260709 12:20:46.624090  3372 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.630568  3553 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.616374  3450 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.603788  3504 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:46.642331 29323 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:46.671888 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.672720 28598 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:46.647140 29320 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:46.640884 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.642697 28676 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
W20260709 12:20:46.613718 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 231286us
W20260709 12:20:46.635197  3106 consensus_meta.cc:287] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.000s
I20260709 12:20:46.665196 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.674378 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:46.677270 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:46.674723 29321 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:46.678577 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.680116 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.682534  3106 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.683859 28600 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 27: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:46.685599  3106 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.672871 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.687515 28755 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:46.689592 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.690346 28749 raft_consensus.cc:2368] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25.
I20260709 12:20:46.691660  3355 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:46.691319 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:46.693130 29323 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:20:46.691056 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.697039 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.697880 28598 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:46.695037  3553 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:20:46.702454  3553 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:46.702666  3327 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.698971  3552 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:46.704103  3552 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:46.703440  3553 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.701180 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.707551 28605 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:46.671829  3504 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:46.714156 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.690593  3442 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:46.712229  3504 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:46.718492  3442 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.652405  3625 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.694343  3275 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:46.721789 28606 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:46.722885  3625 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.725696  3588 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.726629 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.727721 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.728709  3275 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:46.729666  3275 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.730695  3350 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.728349 28753 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 27: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:46.731966 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.732398  3591 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.733569 28753 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:46.733704  3586 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:46.734078  3586 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:46.734488  3591 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.663483  3562 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.736070 29317 raft_consensus.cc:2410] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:20:46.736246  3562 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:46.736426  3083 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.739270 29317 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:46.735005  3586 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.741302 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:46.741643  3442 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:46.742551  3442 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:46.743110  3442 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:46.744755  3110 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:46.744990  3618 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:46.745647  3618 consensus_queue.cc:1243] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:20:46.746028 28606 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:46.746109  3618 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:46.746628  3618 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:46.713446  3552 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.734778 28753 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:20:46.754469 29320 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:20:46.739907  3607 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.759629 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:46.762887 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:46.744012  3442 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.755731 28721 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:46.778543  3291 raft_consensus.cc:2804] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:20:46.779240  3291 raft_consensus.cc:697] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:46.780334  3291 consensus_queue.cc:237] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:46.786525 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 442122us
I20260709 12:20:46.798110 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.799520 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.800295 28749 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:46.804258 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:46.801869 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:46.804829 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.805475 28678 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:46.805676 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:46.806409 28675 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 27: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:46.810990  3341 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:46.747720  3618 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.816686  3629 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:46.817433  3618 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.817492  3629 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:46.818939  3634 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 12:20:46.818823  3629 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.822746 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.824429 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:46.843056  3564 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:46.843734  3564 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:46.847987 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.848001 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:46.848862 28677 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:46.856120 28748 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:46.858716 29320 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:20:46.871229 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46888.4us
I20260709 12:20:46.871695 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:46.872557 28599 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.876250 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:46.876667 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 74872.7us
I20260709 12:20:46.877331 28678 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 27: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:46.877496 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:46.879455 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.883579 28674 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:20:46.796669  3588 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:46.891350 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:46.892493 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.897459 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.898291 28677 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:46.898300 28571 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:46.848305  3612 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:46.882684  3261 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:46.915349 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:46.915931 28678 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:20:46.898684  3557 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:46.909637 28677 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:20:46.896680  3438 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:46.871313  3571 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:46.909027  3305 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:20:46.937162 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.891758  3292 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:20:46.931586  3615 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.933895  3118 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:46.887697  3511 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:20:46.929754  3564 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:46.938220 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:46.975710 28677 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.906946 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:46.945786 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:46.946448 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.959007 28678 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:20:46.944988 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 344433us
I20260709 12:20:46.972843 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 3028) took 1126 ms. Trace:
I20260709 12:20:46.973009 28753 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:46.916236  3083 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:46.980711 28756 rpcz_store.cc:276] 0709 12:20:45.846055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.846185 (+   130us) service_pool.cc:224] Handling call
0709 12:20:46.972599 (+1126414us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b54003fff54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:46.972769 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5213056}
I20260709 12:20:46.981823 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:46.981601  3083 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:46.982406 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.896709  3491 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:20:46.984118 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.985421 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:46.984359  3083 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:46.986610 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.987344 28756 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:46.988456 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:46.975798 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.934979  3557 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:46.994588 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:47.000479 28756 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:46.991526 28599 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:47.004729 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:47.004899 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:47.005954 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:47.007059 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:47.008880 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:47.009608 29326 raft_consensus.cc:2376] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20. Re-sending same reply.
I20260709 12:20:47.010032  3448 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:47.010843  3448 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:20:47.010977 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.011245  3448 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:47.012115  3448 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.013324  3448 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:46.936146  3438 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.000828 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:46.937212  3305 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:47.002848 29292 leader_election.cc:400] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25.
I20260709 12:20:47.021426 29292 leader_election.cc:403] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:20:46.966069  3607 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:47.024772 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 117913us
I20260709 12:20:47.008116 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:47.025288 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 137471us
I20260709 12:20:47.025605 29322 raft_consensus.cc:2376] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16. Re-sending same reply.
I20260709 12:20:47.025961 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:47.017954 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.991756 28749 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 27: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:46.967134  3118 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:46.988271  3298 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.021572 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.035532 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.021021  3305 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:47.029182 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.027243 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:47.030305 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:46.991976  3492 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:47.001430  3557 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:47.001272  3560 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:47.033222 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.023904  3438 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:47.042685 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:47.050902 28605 raft_consensus.cc:3060] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:47.038276 28674 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:47.038475 28677 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:47.042900 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.047111 29320 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:20:47.052784 29320 pending_rounds.cc:85] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 12
I20260709 12:20:47.017000  3341 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:47.039904 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:47.030750  3489 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:47.005954 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:47.039876 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:47.053017 29320 pending_rounds.cc:107] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:20:47.061813 29320 raft_consensus.cc:2889] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:47.034514  3442 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:20:47.047850 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.066948 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:47.067807 28599 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:47.041603 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.049144 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:47.056399 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:47.040256 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.055603 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:47.031235  3275 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:47.063035 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:47.024945  3337 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25.
I20260709 12:20:47.069756 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:47.078883 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:47.080370 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.081568 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:47.089649 28605 raft_consensus.cc:2468] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
W20260709 12:20:47.093024 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 43987.2us
W20260709 12:20:47.095023 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62260.7us
I20260709 12:20:47.109381 29320 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 27: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:47.111806 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1529) took 1116 ms. Trace:
I20260709 12:20:47.114451 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1441) took 1270 ms. Trace:
I20260709 12:20:47.114964 28750 rpcz_store.cc:276] 0709 12:20:45.843718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.843860 (+   142us) service_pool.cc:224] Handling call
0709 12:20:47.102813 (+1258953us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400307354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:47.114378 (+ 11565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128982912}
I20260709 12:20:47.116529 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1841) took 1020 ms. Trace:
I20260709 12:20:47.117033 29319 rpcz_store.cc:276] 0709 12:20:46.096248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.227599 (+131351us) service_pool.cc:224] Handling call
0709 12:20:46.231682 (+  4083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:46.509859 (+278177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.107291 (+597432us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54006531d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:47.116473 (+  9182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372010368}
I20260709 12:20:47.028754  3313 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:20:47.033595  3450 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.051563  3628 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:47.046006  3565 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:47.122619 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:47.112349 29325 rpcz_store.cc:276] 0709 12:20:45.995542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.219394 (+223852us) service_pool.cc:224] Handling call
0709 12:20:46.235085 (+ 15691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:46.325624 (+ 90539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:46.325680 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:46.325749 (+    69us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:46.325796 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.103213 (+777417us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b54005861d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:47.111606 (+  8393us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.111739 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207579520}
I20260709 12:20:47.123942 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:47.131191  3641 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:20:47.133314  3261 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:47.061369  3489 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:47.149236 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.028496  3350 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 12:20:47.065719  3625 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:47.140137 29321 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:47.142602  3636 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:20:47.144635  3118 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.137786 29326 raft_consensus.cc:2393] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 25: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:47.082577  3275 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:47.092458  3553 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:47.078878  3491 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:47.039275  3602 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:20:47.159744  3612 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:47.120754  3583 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:47.050298  3492 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.054015  3504 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.121610  3277 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:47.184499  3277 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.186640  3277 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.126611  3372 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:47.035414  3571 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:47.188475  3640 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:20:47.043238  3298 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.191341  3298 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.133769  3261 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:47.176546  3583 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:47.192988  3583 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:47.152204  3489 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:47.109064  3563 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:20:47.120986  3327 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:47.163278  3586 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:47.177790  3630 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.488s	user 0.004s	sys 0.000s
I20260709 12:20:47.183553  3305 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.192409  3261 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:47.279444 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 184724us
I20260709 12:20:47.339046  3492 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.340015 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:47.341483  3573 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:20:47.346102  3341 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:47.353029 28599 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:47.362377  3504 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.372908  3552 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:47.281136 28598 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:47.373857  3450 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.285212 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 3079) took 1321 ms. Trace:
I20260709 12:20:47.203846  3372 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:47.286103 28606 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:47.374961 28600 rpcz_store.cc:276] 0709 12:20:45.963710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.980029 (+ 16319us) service_pool.cc:224] Handling call
0709 12:20:47.103689 (+1123660us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400217d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:47.284933 (+181244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1575998720}
I20260709 12:20:47.377070  3372 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.377913 28600 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:20:47.286264 28607 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:47.288069 28605 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:47.294835 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.381283 28675 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:47.382514 28605 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:20:47.290160 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 167552us
I20260709 12:20:47.375586 28599 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:47.384721 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.387516  3305 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.388242 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:47.388692  3305 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.389557  3305 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.390192 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:47.295831 28680 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:20:47.392393  3622 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:47.393384  3622 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.395944  3647 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:47.298442 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:47.172566  3118 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:47.169518  3275 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:47.161514  3313 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:47.198776  3327 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:47.174362  3565 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:47.373980 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 282051us
I20260709 12:20:47.282572 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1289) took 2172 ms. Trace:
I20260709 12:20:47.165745  3625 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.348001  3341 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.396356  3622 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.432865 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1295) took 1304 ms. Trace:
W20260709 12:20:47.329246 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 275198us
I20260709 12:20:47.434167 28604 rpcz_store.cc:276] 0709 12:20:46.128294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.519476 (+391182us) service_pool.cc:224] Handling call
0709 12:20:47.432242 (+912766us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54002c1354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:47.432599 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29942656}
I20260709 12:20:47.442032  3565 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.403872  3305 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.409260 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:47.445112 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:47.447418  3110 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:47.448858  3298 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:47.448545  3110 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.449468  3298 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.449949  3298 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:47.451205  3430 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:47.451700  3430 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:47.451738  3110 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:47.453222  3658 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:47.453727  3658 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:47.454128  3658 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:47.457860  3327 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.456696 28601 rpcz_store.cc:276] 0709 12:20:45.110167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:45.400883 (+290716us) service_pool.cc:224] Handling call
0709 12:20:45.401334 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:45.423092 (+ 21758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:45.423140 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:45.423759 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:20:45.629356 (+205597us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:46.216798 (+587442us) log.cc:844] Serialized 14 byte log entry
0709 12:20:46.222871 (+  6073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:46.438283 (+215412us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54003d2a54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:46.438330 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:47.190000 (+751670us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b24001723b8. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08189c4 00007f6fe0816acb 00007f6fe09d1dc9 00007f6fe09d1a55 00007f6fe09d0fb0 00007f6fe3647488 00007f6fe3647be8 00007f6fe361f398 00007f6fe361a76a 00007f6fe3619bb6
0709 12:20:47.281890 (+ 91890us) raft_consensus.cc:1685] finished
0709 12:20:47.281946 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.282327 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7439,"prepare.queue_time_us":527347,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":12786,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":18603,"spinlock_wait_cycles":65917184,"thread_start_us":791375,"threads_started":2,"wal-append.queue_time_us":576976}
I20260709 12:20:47.396577  3647 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:47.404803 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.461205  3647 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.456707  3313 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:47.397032  3182 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:20:47.463666  3313 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.406082  3552 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:47.464208  3322 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:47.466413  3313 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:47.466301  3552 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.450911  3305 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:47.400741  3450 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.469949  3625 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.472468 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:47.472790 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.459825  3615 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.492707  3450 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.495143  3450 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.498567  3622 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:47.499838 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.499555  3622 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.501143  3430 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.502449  3430 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:47.503659 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:47.506969 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.507999 28682 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:47.511775 28755 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:47.513285 28648 leader_election.cc:400] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18.
I20260709 12:20:47.517014 28648 leader_election.cc:403] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:20:47.542855  3448 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.006s
I20260709 12:20:47.515838  3622 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:47.549722 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.397889  3344 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:47.564551 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 177459us
W20260709 12:20:47.572911 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:47.573139  3438 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.003s
I20260709 12:20:47.573608  3438 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.579170  3344 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.580523  3622 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 17. Current term is 18.
I20260709 12:20:47.581764  3344 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.581895  3658 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.582973  3661 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:47.583678  3661 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:47.584843  3661 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.584271  3658 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:47.598538 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:47.601073 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:47.602387 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:47.604130 28756 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 12:20:47.605793 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 157780us
I20260709 12:20:47.592739 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.618216 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:47.600124 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:47.598644 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 87583.8us
I20260709 12:20:47.628680 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.632848  3488 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:20:47.636487 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:47.637192  3438 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.638080 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.640110  3602 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:47.640785  3602 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:47.640888  3322 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:47.636519 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:47.644647 29323 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:20:47.644533  3583 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.647107  3583 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.647611 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1532cf86464920afb02490b110f356"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:47.647895 28606 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:47.648216 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:47.648975 28749 raft_consensus.cc:606] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.653857  3583 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:47.654341 28749 raft_consensus.cc:614] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:47.651417  3291 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:47.654738  3583 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.655077  3291 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.656952  3583 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.657361  3291 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:47.659071  3671 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 12:20:47.659099 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.659617  3602 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.657379  3298 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.632220 29292 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:47.676623 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44596.1us
I20260709 12:20:47.676976  3350 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:47.677228 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:47.678061 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:47.679430  3668 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:20:47.679867 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:47.680866  3118 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:47.681536  3118 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.681936  3118 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:47.685497 28747 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:20:47.689949 28755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1453) took 1069 ms. Trace:
I20260709 12:20:47.690389 28755 rpcz_store.cc:276] 0709 12:20:46.620933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.688279 (+ 67346us) service_pool.cc:224] Handling call
0709 12:20:47.689721 (+1001442us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400338954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:47.689886 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430358400}
I20260709 12:20:47.692342 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:47.670099  3489 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:47.672860  3557 consensus_meta.cc:287] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.009s
I20260709 12:20:47.673750 29321 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:20:47.672855  3110 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:20:47.695039 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.701014 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:47.698339  3350 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:47.708556  3658 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:47.718297 28752 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:47.719340  3586 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.008s
I20260709 12:20:47.720588  3574 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.720891 28755 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:47.721276  3574 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.718080  3488 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:47.722859  3488 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:47.723733  3574 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.708788  3291 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:20:47.724066  3488 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.728822  3489 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.729164  3341 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:47.728852 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.738751 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:47.708230  3557 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.750239 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:47.751820 28674 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:47.744545 28681 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:47.759197 28679 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:20:47.763967 28752 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:47.768900 28571 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:47.757458 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:47.758003 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:47.731750  3341 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:47.783427 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46996us
I20260709 12:20:47.778718  3298 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:47.786703 28747 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:47.788149  3669 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:47.790323  3350 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:47.790907  3350 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.791469 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.792649  3658 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.792492  3275 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.793507  3350 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.793417  3658 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.794297  3350 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:47.795423  3275 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.795027  3350 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.796267 28675 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:47.796619  3586 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:47.770254  3110 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:47.797190 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51909us
I20260709 12:20:47.797693  3350 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:47.797819  3110 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:47.802639  3341 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.800154  3110 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:47.796366  3658 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:47.810652 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:47.811344 28753 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 27.
I20260709 12:20:47.812840 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:47.814195 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:47.815711 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:47.816392 28750 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:47.824092 29326 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:47.826562  3118 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.827543 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:47.816315 28674 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:47.825580 29323 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:20:47.832062 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:47.832288 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:47.834036  3658 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.834492 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3093) took 1007 ms. Trace:
I20260709 12:20:47.834534  3625 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:47.834942 28606 rpcz_store.cc:276] 0709 12:20:46.827223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.378157 (+550934us) service_pool.cc:224] Handling call
0709 12:20:47.378647 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:47.648424 (+269777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.834280 (+185856us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54003d3954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:47.834432 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618649856}
I20260709 12:20:47.839226  3608 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:47.839741  3608 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:47.840153  3608 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:47.835353  3625 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:47.786448 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:47.849843 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:47.853084 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 68833.7us
W20260709 12:20:47.862811 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 71464us
I20260709 12:20:47.874181  3330 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:20:47.874675  3652 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.703s	user 0.002s	sys 0.000s
I20260709 12:20:47.874981  3330 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 12:20:47.879236  3667 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.288s	user 0.003s	sys 0.000s
I20260709 12:20:47.879066  3625 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.880616  3562 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:47.883549  3622 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:47.884028  3666 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:20:47.884644  3110 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.885315  3110 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.887230 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.889163 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2017) took 1148 ms. Trace:
I20260709 12:20:47.889075  3511 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:20:47.889678 28673 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:47.890631  3511 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.891149  3511 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.891649  3118 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:47.896793 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.897071 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.899186  3261 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:47.904912 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:47.905634 29322 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:47.908247 28675 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:20:47.868677  3557 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:47.908224 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:47.914934  3666 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:47.915424  3666 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:47.915968  3562 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.834640  3658 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:47.921216 28750 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:20:47.923164 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.864583  3275 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:20:47.887543  3110 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:47.934659 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52491.1us
I20260709 12:20:47.934516  3563 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:20:47.935273  3330 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:47.922307 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:47.944089 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:47.889654 29317 rpcz_store.cc:276] 0709 12:20:46.740584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:46.741085 (+   501us) service_pool.cc:224] Handling call
0709 12:20:46.741365 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:46.932679 (+191314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:46.932716 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:46.933161 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:20:46.991073 (+ 57912us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:47.385598 (+394525us) log.cc:844] Serialized 14 byte log entry
0709 12:20:47.386145 (+   547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:47.386294 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:47.850784 (+464490us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:47.888682 (+ 37898us) raft_consensus.cc:1685] finished
0709 12:20:47.888793 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:47.888975 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":193745,"prepare.queue_time_us":247211,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":204577,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":10330,"spinlock_wait_cycles":4094336,"thread_start_us":393198,"threads_started":2,"wal-append.queue_time_us":191493}
I20260709 12:20:47.947232 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:47.921309  3622 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:20:47.954131 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 217275us
I20260709 12:20:47.951125  3450 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:20:47.978901 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:47.909282  3608 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:47.983278  3672 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:20:47.952205  3622 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:47.916325 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:48.003830 29326 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:47.962144  3430 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:48.009478 28750 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:20:48.013386 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 93846.6us
I20260709 12:20:48.012744 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:47.961700  3305 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:47.985167  3450 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.021315 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:47.949774  3562 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.001782  3322 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.027882 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.025203 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:48.028903 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.013926  3574 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:48.025619  3450 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:48.025343  3430 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:48.027568  3647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.018s
I20260709 12:20:48.085297 28752 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:20:48.086731 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.087667 29320 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
W20260709 12:20:48.094323 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 113155us
I20260709 12:20:48.098327 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:48.096735  3647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.018s
I20260709 12:20:48.067575  3511 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.103477 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:48.114890 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 85128.4us
I20260709 12:20:48.116027 29321 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.099737  3110 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.063418  3322 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.121718 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.137593 29326 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:48.135390 29325 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:48.146621 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:48.147300 29317 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:48.145668 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.146487 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:48.143005  3564 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:48.145138  3658 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:48.146998  3608 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:48.136067  3110 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:48.177963 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.118691  3622 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.178884 29326 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:48.097184  3430 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.192266 29322 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:20:48.172561  3565 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:48.201406 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:48.204855 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 71852.6us
I20260709 12:20:48.205500 29327 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:20:48.206174 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:48.204854 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.207831 29322 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
I20260709 12:20:48.206703 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:48.218146 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:48.222323 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 57987.1us
I20260709 12:20:48.184340  3602 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 12:20:48.267979 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:48.285624 29322 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:48.289049 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 310238us
I20260709 12:20:48.289474 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.260509  3563 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:48.290911 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:48.291441 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 359684us
I20260709 12:20:48.295226 29326 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:48.300098 29327 raft_consensus.cc:2410] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:20:48.229292  3661 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:48.286842  3622 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:48.298866 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:48.296649  3563 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.298362  3562 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.330936  3344 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.338621  3563 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.345638 29317 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:48.353998 29319 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 12:20:48.339260  3327 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:48.334239  3638 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:48.350286 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 157008us
I20260709 12:20:48.349175  3322 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:48.366976 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 160933us
I20260709 12:20:48.370819 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.374480  3666 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.381373 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:48.387496  3653 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 12:20:48.388818  3681 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:20:48.390918  3344 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:48.401829 28680 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:48.402311 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:48.362004  3327 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:48.380712  3674 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:20:48.416488  3327 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:48.425132  3322 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.426258  3322 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.429898 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.430639 28751 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:48.433096  3344 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:48.437723  3680 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:20:48.445305  3690 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:20:48.445657  3450 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:48.447782  3450 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:48.453146 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47758.5us
I20260709 12:20:48.456655  3488 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:48.457646  3565 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:48.458168  3565 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:48.459187  3565 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.460530  3565 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:48.457749  3638 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:48.490083  3638 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:48.400347  3110 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:48.496752 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:48.497550 28750 raft_consensus.cc:2368] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
W20260709 12:20:48.498147 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.500401 29321 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:48.498803 28747 pending_rounds.cc:85] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 14
I20260709 12:20:48.414840  3511 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.504060  3511 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.503298 28747 pending_rounds.cc:107] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:20:48.376642  3691 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.153s
I20260709 12:20:48.508749 28747 raft_consensus.cc:2889] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:48.511233  3562 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.525211 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:48.528577  3676 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
W20260709 12:20:48.529012  3693 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:20:48.533665  3625 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:48.544598  3511 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.541572  3703 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:48.542436  3608 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:48.546574  3327 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.549193 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:48.549998 28607 raft_consensus.cc:1275] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:20:48.550088  3344 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.551683 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.552687 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:48.552780 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:48.611126 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:48.549137 28606 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:20:48.686124 28599 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:48.686343  3322 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.554105 28603 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:20:48.553645 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:48.611414 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:48.562690  3675 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.459s	user 0.001s	sys 0.001s
W20260709 12:20:48.556222  3657 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.452s	user 0.003s	sys 0.000s
I20260709 12:20:48.694743 28605 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:48.692257 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:48.525230  3638 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.559880  3704 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.697857  3344 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.693369 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:48.670471  3646 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:48.701855 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.711683 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:48.703469 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.703704 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.703966 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:48.712654 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 201485us
I20260709 12:20:48.713192 29321 raft_consensus.cc:2410] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:20:48.703725 28599 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:48.611996  3277 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:48.565007  3372 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:48.699985 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:48.717717 29322 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:48.719374 28606 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:48.720345 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:48.722162 28600 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 27. Current term is 28. Ops: []
I20260709 12:20:48.723722 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:48.720312 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:48.722435 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:48.631194  3562 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.724226 28748 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:48.728338 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:48.715410  3372 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:48.727771 29320 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:48.726689 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:48.729544 28605 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.716646  3277 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:48.745841 28602 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:20:48.748900 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:48.749981  3666 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:48.750347 29323 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:48.750540 28748 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:48.753762 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:48.695065  3703 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.697539  3327 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.756560 29327 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:48.710109  3625 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.757663 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:48.760835  3305 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:48.760689  3615 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:48.761270  3305 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.761706  3305 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:48.764566  3612 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:48.765558 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:48.767467  3491 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.768078  3491 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.770318  3491 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.770567  3450 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:20:48.771328  3706 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:20:48.774649 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:48.760129  3261 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.860s	user 0.014s	sys 0.000s
I20260709 12:20:48.721899  3608 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.729108  3638 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.779925 28753 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:20:48.780378  3615 consensus_queue.cc:1243] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:48.780622  3646 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:48.783771  3322 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:48.785591 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 473097us
I20260709 12:20:48.808926 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:48.809201  3327 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.811075 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.798317 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:48.753475  3488 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.812333  3488 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.812877  3344 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.813023  3372 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.814337  3372 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:48.814714  3488 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:48.790182 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:48.721037  3704 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:48.800537 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:48.819480 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:48.824606 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 50034.5us
I20260709 12:20:48.826478 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:48.831974 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 66512us
I20260709 12:20:48.838095  3350 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:48.842701 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.817317  3615 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:48.851461  3562 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.827899  3628 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:20:48.882684 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.852715  3702 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:48.858925  3438 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:48.826082  3563 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.855433  3275 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:48.823784  3625 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.866701  3322 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.901201  3322 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.901716  3322 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.902163  3322 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.876828  3615 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:48.905259  3615 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.906756 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.853286  3703 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.866307  3638 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.816602  3646 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:48.817134  3330 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:48.868916  3608 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.851737 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:48.860067  3695 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 12:20:48.882860  3628 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:48.829396  3261 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:48.887830 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.893139 28571 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:48.904313  3322 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:48.899075  3572 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.852231  3612 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:48.910094 28752 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:48.912774 28753 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:48.913420 28754 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:20:48.914264 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:48.917271 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.919061 28748 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:20:48.932571 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 107127us
I20260709 12:20:48.884315 28605 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:48.934137 28647 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:48.895038 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:48.928027 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:48.935096 28756 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:48.922396  3646 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:48.926266  3628 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:48.925619  3261 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.935782 28571 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:48.933729  3638 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:48.934441  3608 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:48.930239  3612 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:48.968321 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:48.975190  3698 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:48.975560  3712 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:48.975970  3602 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:48.976934  3602 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:48.959959  3261 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:48.961794  3344 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:20:48.986716 29323 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:48.987509 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1869) took 1003 ms. Trace:
I20260709 12:20:48.987820 29323 rpcz_store.cc:276] 0709 12:20:47.983673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.749902 (+766229us) service_pool.cc:224] Handling call
0709 12:20:48.750234 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:48.987233 (+236999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:48.987460 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.969785  3565 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.950471  3275 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:48.977316  3602 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:48.931694  3647 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:20:48.934060  3330 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:48.949352  3572 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.029991 28682 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:49.030766  3305 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:49.033552 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 181934us
I20260709 12:20:49.035601  3305 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.035898  3713 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:49.038566  3330 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.039403  3275 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.039860  3565 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.040879  3572 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.042079  3565 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:49.030908  3488 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.043210  3488 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.045415  3488 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.048791  3320 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:49.049943  3563 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.052135  3602 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:49.053591  3602 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:49.056200 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:49.052163  3709 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:20:49.035686 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:49.058444 28572 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:48.961050  3661 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:20:49.059613  3661 consensus_queue.cc:1243] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:20:49.060765  3677 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.914s	user 0.000s	sys 0.003s
I20260709 12:20:49.060992 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:49.061836 29325 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:49.062186  3344 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:20:49.062129  3450 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:49.063086 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:49.063918 29327 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:49.065418 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:49.066733 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49839.6us
I20260709 12:20:49.073873  3720 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.074422  3720 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.009095 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.077584  3704 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.080732  3450 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:49.081200  3450 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:49.081573  3450 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:49.084584 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.093109 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.009531  3341 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:49.098508 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.083212  3720 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.106907 29319 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:20:49.108572 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.113559 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:49.112159 29290 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.114464 28678 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:49.115429  3722 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:49.115885  3722 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.116232  3722 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:49.116394 29327 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:49.118562 29320 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:49.092689  3330 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:49.092859  3489 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:49.131108 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 177752us
W20260709 12:20:49.136611 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 43584.6us
I20260709 12:20:49.105269  3702 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:49.143435 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:49.146220 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 89152.5us
I20260709 12:20:49.109694  3718 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.098393  3565 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:20:49.150650  3726 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:49.152841  3330 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.098702  3488 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:20:49.155637 28648 leader_election.cc:400] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
I20260709 12:20:49.163757 28648 leader_election.cc:403] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:20:49.113155  3563 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:49.161146 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.143813  3638 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:49.170277 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.171360 28682 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:49.108314  3341 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.176043 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:49.177318 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.179030  3277 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.181154  3666 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:49.131889  3661 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:20:49.159313  3602 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:49.199677 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 87732.5us
I20260709 12:20:49.134982  3646 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.201100 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.143162  3489 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.169587  3625 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:49.208783 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:49.212153 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51126.1us
I20260709 12:20:49.189252  3666 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:49.215211  3330 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.209834 29319 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:49.215790  3666 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.216886  3666 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:49.172601  3615 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:49.213048 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:49.230171  3716 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.255s	user 0.004s	sys 0.000s
I20260709 12:20:49.197082  3712 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:49.169860  3563 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:49.202345  3602 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.200394  3719 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
I20260709 12:20:49.223059  3327 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:49.238727 28680 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:20:49.240046  3489 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.233402  3450 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.246162  3646 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.247350  3730 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:49.257632  3322 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:49.258209  3322 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:49.260927  3322 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:49.249320 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.247959  3722 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.168006  3718 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.236814  3602 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:49.267984  3718 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.271111 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:49.272586 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:49.273182 29327 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:49.274415 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:49.275175  3719 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:49.275959  3719 consensus_queue.cc:1243] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:49.276974  3720 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:49.277335  3720 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.277657  3720 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:49.277778  3719 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.278369  3719 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:49.278903  3563 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:49.280380  3341 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.264714 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:49.280368  3719 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.223743  3647 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:20:49.273094 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:49.287971 29327 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:49.209537  3713 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:20:49.293644  3327 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:49.298194  3720 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.300510  3720 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.284740  3261 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.302820  3450 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.303083  3261 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.304966  3612 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:49.306077 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.306455  3612 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:49.298209  3722 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.308832 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.292799 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:49.325585 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.330193 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:49.331599  3730 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:49.332496  3730 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.333070 29327 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:49.335031  3730 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.323168  3713 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:49.336162  3713 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:49.337178  3713 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:49.337503 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 75913.3us
W20260709 12:20:49.341742 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 227132us
I20260709 12:20:49.340747 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.345443 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.347143  3450 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:49.347362 28749 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:49.347738  3450 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:49.348415 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.349242 28748 raft_consensus.cc:2410] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:20:49.348850  3450 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.348950 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.350520 28753 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:49.347621 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.284559  3615 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.380930  3615 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.384274 28754 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:20:49.296303  3628 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.387460  3628 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.389186 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:49.389962 28754 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:49.390758 28747 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 12:20:49.392180 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106440us
I20260709 12:20:49.392418  3712 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.392198 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.395058 28751 raft_consensus.cc:2410] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:20:49.394112 28601 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:49.396552 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:49.397388 28605 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:49.345117  3734 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:49.405470 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:49.394088 29327 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:49.401854 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:49.410386  3692 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:49.410811  3692 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.411142  3692 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:49.411607 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:49.412781  3291 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:49.413342  3291 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:49.414250  3291 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:49.417742  3715 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.443s	user 0.004s	sys 0.000s
I20260709 12:20:49.419663  3692 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.421269 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.421916  3692 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.409209 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:49.409636 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:49.427757 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 275836us
I20260709 12:20:49.429647 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:49.392184 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 161938us
I20260709 12:20:49.436533 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.399520  3734 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:49.438773 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:49.439965 28598 raft_consensus.cc:2410] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:20:49.440488 29317 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:49.438179 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:49.443912 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.445307 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.436117  3438 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:49.441920  3734 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:49.450996 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.452099  3691 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:49.452353  3320 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:49.459120 28754 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:49.459698 28753 pending_rounds.cc:85] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 11
I20260709 12:20:49.460144 28753 pending_rounds.cc:107] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:20:49.460475 28753 raft_consensus.cc:2889] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.478704 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.479974 28573 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:49.481549  3728 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.455567  3638 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.482616  3728 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.483038  3638 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.484468  3730 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:49.485080  3728 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.485008  3730 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.486006  3638 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.447953  3703 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:20:49.446762  3646 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:49.486714  3733 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:49.510926  3666 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:49.487246  3730 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:49.489500 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.512964  3724 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:49.513337  3724 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:49.490295 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.514468  3733 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:20:49.515049 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.515950  3647 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.515709  3733 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:49.518543  3719 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:49.519079  3719 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.491618 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:49.520051 28755 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:49.521198  3719 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.522953  3724 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.463824  3320 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:49.527321  3724 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:49.463559  3438 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:49.529531  3646 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.530236  3438 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.439656  3602 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.533983  3602 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.534720 28751 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:49.536473 29317 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:49.506147 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.509567 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:49.510324 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.539176 28752 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:49.510763 28678 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:49.540972 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.548545 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:49.564631 29320 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:20:49.565270 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:49.565768 28673 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:20:49.568933 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:49.569449 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:49.570307 29322 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:49.571712 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.573678  3612 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:20:49.566131 28673 pending_rounds.cc:85] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 13
I20260709 12:20:49.574906 28673 pending_rounds.cc:107] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:20:49.575155 28673 raft_consensus.cc:2889] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.576870 28755 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:49.544353  3646 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.580204 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:49.583396  3746 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:20:49.572692  3723 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:49.494951  3734 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:49.596899  3743 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:20:49.551251  3647 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.601372 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:49.612807  3734 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.616837 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 27.
I20260709 12:20:49.589777  3305 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:20:49.618677  3729 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:49.619081  3341 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:49.619406 29320 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:49.619802  3729 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:49.620204  3729 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:49.621094  3729 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:49.621755 29319 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:49.622406  3729 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:49.619700  3341 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.618724 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:49.624756 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:49.625106 29318 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:49.625473 29320 raft_consensus.cc:2368] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:49.625787  3341 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.629565 28604 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:49.632230 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:49.637974  3723 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:49.638350  3723 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:49.638685  3723 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:49.643105 29318 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:49.644096 29323 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:20:49.648054 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:49.648370 28606 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:49.650275 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.651083 28606 raft_consensus.cc:2410] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:20:49.652122 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.654443 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.645800  3602 consensus_queue.cc:1048] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.015s
I20260709 12:20:49.656721  3277 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:49.660779 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.661525 28604 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:49.661674 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:49.662441  3719 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:49.663357  3615 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:49.640894 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:49.674795 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:49.675428 29320 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:49.675566 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:20:49.691583 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 47145.2us
W20260709 12:20:49.682168 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.682658 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:49.694269 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.697520 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.697395 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.677014 28603 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:49.664837  3489 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.660169  3666 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:20:49.652498  3691 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:49.700273 28602 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:49.709574 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.710438 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:49.711969 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:49.723595 28751 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 15: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:49.712723  3741 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:20:49.713192 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.713742  3489 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:49.716569  3703 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:49.735437  3703 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:49.718191  3757 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.691460  3298 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:20:49.736774  3489 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.736740  3757 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.737757  3691 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:49.738135  3691 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:49.738973  3757 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.735447 28753 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:49.740666 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.741544  3320 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.726421 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:49.694279  3118 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:49.728590  3602 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:49.729844 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.691231  3291 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:20:49.700389  3305 consensus_queue.cc:1243] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:49.730273 28605 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:49.692363  3572 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:20:49.730466 28752 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 27.
I20260709 12:20:49.731658  3511 raft_consensus.cc:2764] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:20:49.732802 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.733903  3647 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.733997 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.734586 28750 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:20:49.734731 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.743049 28751 raft_consensus.cc:1217] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Deduplicated request from leader. Original: 18.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 12:20:49.767978 28751 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:20:49.746647 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.770159 28747 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:49.768970 28748 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:49.727564 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:49.752043 28606 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:20:49.673273  3622 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 12:20:49.772894 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.769806 28602 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:49.774086 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.774750 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.775148 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.775856 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.776916 28752 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:20:49.757200 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.778004 28750 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 18. (term mismatch)
I20260709 12:20:49.778357 28750 pending_rounds.cc:85] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 17
I20260709 12:20:49.778566 28750 pending_rounds.cc:107] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 12:20:49.778774 28750 raft_consensus.cc:2889] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:49.778940 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:49.757401 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.760329  3703 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:49.780026 28601 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:49.769820  3261 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:49.757612  3698 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.760313 28648 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:49.761986 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.738973  3691 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.776863  3291 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.756489 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.782989 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:49.788167 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.788880 28605 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:49.787245 28598 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 17.
I20260709 12:20:49.753823 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:49.774763 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.781687 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.778952 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:49.791258 28602 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:20:49.792721 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:49.793305 28601 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:49.793722 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.797379 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:49.800768 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.804684 28605 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:49.805356 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:49.807101 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:49.806980 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.807987 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.782655  3602 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:49.804996  3622 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 26.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:49.811596 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.812928 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.813604 28606 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:49.814563 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.795672  3291 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.820268  3698 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.821623 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:49.822906  3740 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:20:49.824694 28749 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 27.
I20260709 12:20:49.794555  3720 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:49.826953  3602 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.829648  3298 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:49.830206 28648 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:49.831634 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:49.806463 29319 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 27.
I20260709 12:20:49.807549 28598 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:49.837289 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:49.793010  3562 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:49.840198 28601 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:49.797211  3733 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:20:49.842212 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.842701  3733 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.843178  3733 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:49.843509  3646 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:49.844662  3612 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:49.845096  3612 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:49.846156  3612 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.847715  3612 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:49.842509  3764 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:49.818373  3291 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:49.842960 28601 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:49.848369 29320 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:49.890014 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.854241 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:49.850348 28674 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:49.894881 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.809556  3691 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:49.897651 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 43525.7us
I20260709 12:20:49.899878  3728 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:49.856299  3720 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:49.895694 28602 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:49.902911 28598 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 16: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:49.850258  3305 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:49.899926 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.809952  3625 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.095s
I20260709 12:20:49.852768  3666 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:49.884238  3562 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:49.852526  3277 consensus_queue.cc:1059] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:20:49.932605 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:49.935771 28602 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:20:49.929482 28606 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:49.908548 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:49.941584  3727 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 12:20:49.938319  3298 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:49.944139  3298 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:49.942910  3733 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:49.945629 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.951164 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.952245 28606 raft_consensus.cc:2410] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:20:49.937309  3565 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:49.948818  3305 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.960676 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.961880 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.962275 28598 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:49.963439  3305 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:49.962786 28606 raft_consensus.cc:2376] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22. Re-sending same reply.
I20260709 12:20:49.971304 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.972148 28606 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:49.973277 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:49.974257 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:49.961074 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 233567us
I20260709 12:20:49.961635  3118 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:49.981510 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:49.982730 29325 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:49.985706 29319 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:49.991283 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:49.958603  3298 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.011641  3298 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:49.974308  3723 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.014312  3723 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:50.000392  3118 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.007889 29319 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:50.016844  3769 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:50.017840  3769 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:50.023466 28606 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:20:50.029814 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.030895 28606 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:49.972424  3562 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.069916  3733 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.075285 28603 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:20:50.078207 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.078917 29319 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:50.080422  3724 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:20:50.080863  3724 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:50.081751  3724 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.082247  3666 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.082752  3724 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:50.082988  3666 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.088017  3666 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.088037  3277 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.089537  3713 raft_consensus.cc:3055] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:50.089417  3277 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.089910  3713 raft_consensus.cc:740] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:50.090366 28602 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:50.090754  3713 consensus_queue.cc:260] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.091766  3713 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:50.092787 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.093032  3698 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.093410 29320 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:50.088722 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.094552 29325 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:50.094664 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:50.091507  3277 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.095297 28673 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 27.
I20260709 12:20:50.093994  3562 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:50.097973 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:50.098773 28599 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:50.091496 28602 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:50.100970 28601 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:20:50.107720 28600 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:20:50.108824 28721 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:50.110102  3729 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:50.110615  3729 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:50.111547  3729 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:50.113780 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.118702 28682 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:20:50.119264 28682 pending_rounds.cc:85] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 15
I20260709 12:20:50.120273 28682 pending_rounds.cc:107] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:20:50.121410 28682 raft_consensus.cc:2889] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:50.054787 28606 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:50.123222 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:50.131084 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 132811us
I20260709 12:20:50.156510 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.157656 29320 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:50.160728 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.162024 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.162267 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.163404 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.164153 29326 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 27.
I20260709 12:20:50.165969 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.166640 29320 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:20:50.171490  3320 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.185865  3305 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.188143  3305 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:50.192268 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:50.206877 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.211374 28606 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:20:50.204897  3638 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:50.213483 28600 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:50.153869  3774 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:50.229689 29327 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:20:50.235258 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:50.235600  3730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.022s
W20260709 12:20:50.245208  3730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.014s	sys 0.022s
I20260709 12:20:50.222538  3638 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:50.205265  3740 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:20:50.252349 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:50.266700 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 120884us
I20260709 12:20:50.268232 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.269598 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:50.270546 28753 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:20:50.267496 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 137403us
I20260709 12:20:50.271605 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:50.269693 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.272320 29317 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:50.280396 29320 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:50.282353  3372 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:20:50.282976  3372 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.283411  3372 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:50.297490  3638 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.298581  3638 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:50.301384 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.301994 29326 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 27.
I20260709 12:20:50.305917 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:50.307548  3780 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:20:50.313318 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:50.315809 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:50.319772 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.321780 29327 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 15.
W20260709 12:20:50.316260 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.325232 28755 raft_consensus.cc:1240] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: [19.13-19.13]
W20260709 12:20:50.325492 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.320958 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:50.328269 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:50.328269 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.331954 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.332696 29322 raft_consensus.cc:2368] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 21. Current term is 22.
I20260709 12:20:50.333326 28749 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:50.333534 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:50.337181 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.338728 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.339639  3438 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:50.340010  3612 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:50.340601  3562 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:50.343945 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.345017  3727 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:50.350409 28755 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:50.361006 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:50.366525 29317 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:50.367197 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:50.371346 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:50.372246 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:50.333967  3277 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:50.378906  3647 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:50.379390  3647 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.379745  3647 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:50.382257 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:50.335093  3713 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:50.390134 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.398314 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:50.399325 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.397684 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:50.403404 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:50.369735  3730 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:50.373104  3572 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:50.386672  3277 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.356571  3720 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:20:50.385602  3712 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:50.424695 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.430461 29326 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:50.397697  3615 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:50.421423  3277 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:50.402208  3491 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:50.385399  3646 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:20:50.418864  3562 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:50.435729 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.385030  3330 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 12:20:50.419379  3730 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:50.421509  3787 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:50.432570  3712 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.431862  3615 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:50.409493  3728 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:20:50.435966  3491 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:50.453001 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49708.8us
I20260709 12:20:50.440757  3730 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:50.446413  3797 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:20:50.455984  3797 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.456327  3797 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:20:50.442945  3724 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:20:50.444648  3712 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:50.465732  3727 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:50.454263 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:50.468291  3698 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.468868  3698 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.467167  3491 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:50.471814 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.473493 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.474577 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:50.472312  3741 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:20:50.475721  3741 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:50.476114  3741 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:50.433799  3572 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.478509  3602 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:50.479466  3572 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.480077  3572 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:50.481549 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:50.483403  3261 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:50.483807  3261 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:50.484161  3261 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:50.484309 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.471733 28604 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:50.452545  3615 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:50.488215  3741 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.453081  3788 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:50.488929 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:50.489569 28607 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:20:50.489787  3798 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:50.491722 28722 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:50.492479  3798 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:50.492839  3798 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:50.493203  3798 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:50.495882  3612 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:50.501338  3798 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:50.450309 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47393.4us
I20260709 12:20:50.477037  3511 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:50.449601 29292 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:50.504297 29326 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 28.
I20260709 12:20:50.505209 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.507898 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:50.509594 28753 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
W20260709 12:20:50.521364 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 71898.1us
I20260709 12:20:50.521055  3798 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.526079  3741 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:50.527128 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 157066us
I20260709 12:20:50.528230 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:50.528573  3691 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:50.530019 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:50.530676  3430 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:50.531323 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:50.537420 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 139154us
I20260709 12:20:50.537896  3344 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:50.537709  3647 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.539230 28572 leader_election.cc:400] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:50.539427  3344 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.480402  3572 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:50.540637  3572 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:50.540309  3372 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.542179  3615 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.543063  3372 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.533166  3764 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:50.533841  3783 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:50.546504  3783 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:50.546871  3783 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:50.534518  3774 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:50.539968  3344 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.489321  3788 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:50.550581 28680 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:50.550827  3788 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:50.550963  3344 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:50.554050  3430 raft_consensus.cc:2764] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 12:20:50.555761 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50633.8us
I20260709 12:20:50.556882 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:50.537747 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.544260  3615 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:50.560149 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:50.560564 28607 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:50.561957 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:50.565568 28680 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:50.571853 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:50.572962 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:50.566751 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 126389us
I20260709 12:20:50.576025 28572 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:50.580535 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:50.582104 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:50.584820 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:50.608194 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:50.578955  3638 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:20:50.618521  3794 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:50.614924 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:50.575062  3774 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:50.598248 28680 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:20:50.627761 28680 pending_rounds.cc:85] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 12
I20260709 12:20:50.628216 28680 pending_rounds.cc:107] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:20:50.613142 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:50.625540 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:50.630954 28680 raft_consensus.cc:2889] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:50.569500  3291 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:50.635383 28678 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:20:50.635704 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.636282 29327 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:50.573602  3562 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:50.637293 28572 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:50.639910 28674 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:50.629649  3774 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:50.641263  3327 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:50.623838  3703 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:50.640416  3646 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.627414  3344 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:50.612536  3647 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.590596  3730 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.627640  3797 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.613580  3666 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:20:50.643424  3261 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.662285  3572 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.663940 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.664688 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.716553 29323 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:50.665045 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:50.666080 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:50.666683 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:50.669119  3602 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:50.718961 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:50.686239  3638 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:50.647753  3491 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.563956  3767 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:20:50.590286  3733 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:50.569312  3764 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 12:20:50.583135  3305 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:50.679279 28572 leader_election.cc:400] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 21. Current term is 22.
I20260709 12:20:50.732652 28572 leader_election.cc:403] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:20:50.683629 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:50.685917 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:50.575207  3769 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.097s
I20260709 12:20:50.634948  3625 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:50.709619 29326 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:50.579107  3691 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:50.735617 28681 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 28: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:50.736073 28748 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:50.717216 28677 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:50.678354  3774 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:50.724648 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 167708us
I20260709 12:20:50.738147 28749 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:50.732671 29327 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:50.684084  3703 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:50.737522 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60086.4us
I20260709 12:20:50.744884 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:50.745213 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:50.746219 28752 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:50.750484 28755 raft_consensus.cc:2368] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18.
I20260709 12:20:50.697907  3646 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.645474  3783 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.737712  3803 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.716849  3712 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.727073  3110 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:20:50.747100  3703 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:50.747494  3625 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:50.751452  3796 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:50.731832  3277 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.754482  3602 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:20:50.776276 28680 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:20:50.755769  3733 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 21. Current term is 22.
I20260709 12:20:50.784600  3722 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:50.785097  3722 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:50.785374  3277 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.786178  3722 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.787338  3722 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:50.789088  3110 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:50.789498  3110 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:50.790302  3110 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.791429  3110 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:50.793291 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 90680.8us
I20260709 12:20:50.776978  3305 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:50.798430 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57503.1us
I20260709 12:20:50.780879  3796 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:50.759110  3562 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.807152 28747 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 25. Current term is 26. Ops: []
W20260709 12:20:50.811359  3793 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.237s	user 0.004s	sys 0.000s
I20260709 12:20:50.814328  3647 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:50.783797  3788 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.818094 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 2996) took 1049 ms. Trace:
I20260709 12:20:50.818508 28675 rpcz_store.cc:276] 0709 12:20:49.765917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:49.766078 (+   161us) service_pool.cc:224] Handling call
0709 12:20:49.785368 (+ 19290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:49.795641 (+ 10273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:49.795675 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:49.800832 (+  5157us) log.cc:844] Serialized 26 byte log entry
0709 12:20:50.344219 (+543387us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b18004824a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:20:50.555283 (+211064us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:50.555327 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.555496 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:50.810778 (+255282us) spinlock_profiling.cc:243] Waited 915 us on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:50.815176 (+  4398us) raft_consensus.cc:1685] finished
0709 12:20:50.815197 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:50.815330 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9554,"raft.queue_time_us":11681,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9253,"spinlock_wait_cycles":56972928,"thread_start_us":210688,"threads_started":1,"wal-append.queue_time_us":762836}
I20260709 12:20:50.809913  3646 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.829814 29327 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:50.833177 28753 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:50.836772 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 91994.8us
I20260709 12:20:50.837399  3797 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 28 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.837677  3788 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:50.838527 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:50.838703  3491 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.839304 28599 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:50.771497  3803 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:50.839936 28598 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:20:50.841091 28603 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:20:50.841714  3803 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.840247 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:50.842540 28604 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 17: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:50.843258  3712 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.844368 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.844779 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:50.824982  3572 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:50.845515 28747 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 28: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:50.853288 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:50.820015  3625 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:50.855417  3796 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:50.868429  3809 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:20:50.870858  3691 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:50.852710 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:50.858198 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:50.877362 29319 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:50.905061 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:50.907655 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 193439us
I20260709 12:20:50.905627 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:50.908574 28604 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:50.909821 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:50.910908 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:50.914258 28603 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:50.872610  3723 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:20:50.902994  3712 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.856586  3261 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:50.934499 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.854941  3703 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:50.943071 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:50.945056 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:50.945740 28599 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:50.959847 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:50.960597 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:50.960661 28603 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:50.966305 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55219.7us
I20260709 12:20:50.917481  3691 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:20:50.998759 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:50.950280  3712 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:51.006251 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 47873.1us
I20260709 12:20:51.009112  3305 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.009642  3305 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:51.011668  3305 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:50.986343  3698 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:51.013732 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.015053 28599 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:20:51.017062 28599 pending_rounds.cc:85] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 13
I20260709 12:20:51.017604 28599 pending_rounds.cc:107] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:20:51.000334  3691 consensus_queue.cc:1243] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:20:51.021101 28599 raft_consensus.cc:2889] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:51.018360  3815 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:51.006554  3805 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:20:51.035926 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.036798 28606 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:51.041183 28604 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:50.985867  3625 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:20:51.046625 29319 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:51.051981  3703 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:51.051981  3769 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:51.052810  3769 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:51.060088 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.060971 28604 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:51.057446  3812 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:20:51.070858 28604 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:51.074743  3298 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:51.075240  3298 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:51.076649 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.078684  3712 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:51.079697  3774 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.080746 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:51.083233 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:51.086251 28677 raft_consensus.cc:2368] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:51.091657 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.092815 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.093346 28598 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:51.093832 29320 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:51.095140 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.095162 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:51.097203 28607 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:51.097229 29319 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:51.103998 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.105125  3565 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:51.108502  3565 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:51.110131 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:51.110275 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:51.110842 29321 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:51.111176 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:51.110864 29327 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:51.099925  3372 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:51.090548  3794 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.114656  3794 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:51.117146  3822 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:20:51.120831 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:51.122047 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:51.122983 29327 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:51.123368 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:51.112632 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:51.126052 29318 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:51.128899 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:51.129649 29326 raft_consensus.cc:2368] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:51.125365 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:51.131168 29322 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:51.134392 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:51.143832 28647 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:51.136626  3823 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:20:51.145603 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:51.071164  3769 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.142674  3330 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:51.131479  3320 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:51.153748  3320 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.154027  3572 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:51.154642  3572 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:51.154814  3625 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:51.155069  3572 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:51.155324  3625 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:51.147962 29318 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:51.129372  3565 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:51.136987  3277 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:51.159644  3277 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.160005  3277 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.160720 28605 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:20:51.076339  3298 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.154139  3320 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:51.163028  3298 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:51.158921  3565 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.164475 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:51.157804  3625 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:51.167250  3565 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:51.167312 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:51.167528  3804 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:20:51.167981 28607 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:51.132320  3698 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:51.086792 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:51.124724  3797 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
W20260709 12:20:51.169327 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 69412.7us
I20260709 12:20:51.176782 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.178637 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.178928 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:51.180143 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.180855 28607 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:51.180951 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:51.183403 28571 leader_election.cc:400] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:51.183954 28571 leader_election.cc:403] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:20:51.183365 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:51.187836  3344 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.188320  3344 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:51.189329  3733 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:51.190078  3774 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:51.190587  3344 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:51.184263  3769 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.192484 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:51.193305 28676 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 29 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 12:20:51.201237 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.201964 28599 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:51.205521 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:51.208096 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:51.214740 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.215359 28601 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:51.206073 28599 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
W20260709 12:20:51.221551 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71070.1us
I20260709 12:20:51.233597 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.234140 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.235170 28603 raft_consensus.cc:2468] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:20:51.231576 28571 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:51.236236 28602 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: [19.13-20.14]
I20260709 12:20:51.241369  3767 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.241961  3767 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.244328  3767 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:51.258118 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:51.259160 28599 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:20:51.258992 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46189.6us
I20260709 12:20:51.260774 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.261340 28603 raft_consensus.cc:2376] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19. Re-sending same reply.
I20260709 12:20:51.261320 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.262277 28753 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:51.262749 28599 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: [18.12-20.13]
W20260709 12:20:51.265765 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53725.5us
I20260709 12:20:51.271754  3703 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.206319  3330 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:51.272786 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:51.282172 28601 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:51.282239 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.275981 28607 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:51.265015  3698 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:20:51.276285 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:20:51.289919  3722 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
W20260709 12:20:51.272284  3822 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:20:51.296175 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.260552  3291 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:20:51.277252  3372 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:20:51.295579  3797 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:51.279558  3703 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.285971  3829 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:51.272368  3713 consensus_queue.cc:1059] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:20:51.283289  3802 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:20:51.333705  3430 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 12:20:51.337280  3430 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:51.337607  3430 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:51.340090 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:51.299890  3330 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.291254  3562 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:51.302490 28598 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:51.272281  3830 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:20:51.322672 29292 leader_election.cc:400] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18.
I20260709 12:20:51.266695  3719 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:20:51.340978 28602 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:51.363404  3277 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.343856 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:51.347604 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:51.292356  3602 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:20:51.353037 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.353613 29292 leader_election.cc:403] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:20:51.371477 28572 leader_election.cc:400] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:20:51.374347 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:51.374673 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 63436.8us
I20260709 12:20:51.376116 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:51.357455  3837 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:20:51.379726 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:51.380496 28751 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:20:51.380874 28753 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:20:51.384294 28601 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:51.405894 28750 raft_consensus.cc:1240] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:51.402122 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:51.413929 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.384886  3350 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 17. Current term is 18.
I20260709 12:20:51.381846  3562 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:51.432271 28722 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:51.433490 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:51.408653  3647 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.421422  3767 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:51.421182  3774 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:51.338492  3430 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.478307 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:51.403237  3723 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:20:51.438057 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:51.430996  3638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.009s	sys 0.017s
I20260709 12:20:51.479523 28751 raft_consensus.cc:2410] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 29 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 12:20:51.437224  3801 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:51.498390 28748 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:20:51.442648  3647 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.437093  3798 raft_consensus.cc:2804] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:51.511660 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:51.498746  3638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.010s	sys 0.018s
I20260709 12:20:51.440488  3767 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.477638  3666 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:20:51.508522  3430 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:51.550477 28750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:51.551383 28750 raft_consensus.cc:606] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:51.437299  3491 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 12:20:51.511958  3774 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:51.522414  3767 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:51.437427  3572 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.518194  3638 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:51.522535  3798 raft_consensus.cc:697] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:51.502936  3713 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 12:20:51.534686  3666 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:51.560261  3831 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:51.515916  3372 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
W20260709 12:20:51.605281  3810 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:20:51.509699  3838 consensus_queue.cc:1175] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" responder_term: 19 status { last_received { term: 19 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 19 index: 15 } }
I20260709 12:20:51.618862  3794 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:51.582399  3698 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.618569  3572 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:51.588218  3797 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:51.580446  3774 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.570878  3800 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 12:20:51.627566 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:51.628247 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:51.652489 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 108562us
I20260709 12:20:51.556406  3562 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.607879  3847 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.666378 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 324132us
I20260709 12:20:51.625030  3703 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:51.632453 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.656250 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:51.658842 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 147245us
I20260709 12:20:51.646193  3801 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:51.671517 28677 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:51.653414  3277 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:51.677009 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 168292us
I20260709 12:20:51.674904 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:51.679171 29318 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:51.680339 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.678496 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.682247 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.646821  3666 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:51.688941  3851 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:51.689260  3666 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:51.669471  3847 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.690428 28674 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:51.691540  3847 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:51.668596  3769 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:20:51.692536  3797 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.695894  3801 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.680559  3798 consensus_queue.cc:237] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.677455  3638 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:51.700152  3320 consensus_meta.cc:287] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.002s
W20260709 12:20:51.675639  3844 log.cc:927] Time spent T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:20:51.649507  3698 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:51.735157  3698 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:51.714654  3320 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:51.736544 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51574.3us
I20260709 12:20:51.726297  3774 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:51.727761  3647 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:51.737605  3845 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:20:51.732749 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:51.738320 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.738631 29319 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.704708  3803 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:51.741357  3803 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:20:51.736763  3840 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:20:51.732199  3298 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.000s
I20260709 12:20:51.743935 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:51.753182 28677 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:20:51.777658 28748 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:51.766037 28755 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:20:51.778818 28605 raft_consensus.cc:2410] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:20:51.779415  3110 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:51.706171  3291 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:20:51.789512 29290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:51.790366 29319 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:51.790951 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:51.791834 29320 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:51.795236 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:51.796070 29319 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:20:51.786466  3110 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:51.798373  3320 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:51.798858  3110 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:51.679755  3855 consensus_queue.cc:1059] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 12:20:51.787041  3804 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 12:20:51.807868  3819 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.813s	user 0.003s	sys 0.000s
I20260709 12:20:51.788539  3807 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:51.810962  3807 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:51.811805  3807 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:51.815896 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.776476  3767 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.820132  3807 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:51.823002 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1905) took 1224 ms. Trace:
I20260709 12:20:51.823407 29317 rpcz_store.cc:276] 0709 12:20:50.598340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.598533 (+   193us) service_pool.cc:224] Handling call
0709 12:20:50.619213 (+ 20680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:50.619602 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.619634 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:50.620100 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:20:50.908456 (+288356us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:50.908499 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:50.908579 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.807550 (+898971us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b24002edd08. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08189c4 00007f6fe0816acb 00007f6fe09d1dc9 00007f6fe09d1a55 00007f6fe09d109d 00007f6fe360310e 00007f6fe361a88c 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221
0709 12:20:51.822755 (+ 15205us) raft_consensus.cc:1685] finished
0709 12:20:51.822777 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.822951 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1053,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6485,"spinlock_wait_cycles":9702272,"thread_start_us":287591,"threads_started":1,"wal-append.queue_time_us":314928}
I20260709 12:20:51.823707  3767 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:51.829092  3724 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:51.829524  3724 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:51.830370  3724 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.831414  3724 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:51.835119  3430 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:51.841409 29319 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 16. Current term is 17. Ops: []
W20260709 12:20:51.856774 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 66914.8us
W20260709 12:20:51.871217  3843 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260709 12:20:51.873512  3826 log.cc:927] Time spent T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.863s	user 0.003s	sys 0.000s
I20260709 12:20:51.874850 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3126) took 1035 ms. Trace:
I20260709 12:20:51.884419 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:51.894600 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:51.875310 28600 rpcz_store.cc:276] 0709 12:20:50.839879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:50.879675 (+ 39796us) service_pool.cc:224] Handling call
0709 12:20:50.911420 (+ 31745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:50.933210 (+ 21790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:50.933242 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:50.933702 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:20:51.093180 (+159478us) spinlock_profiling.cc:243] Waited 905 us on lock 0x7b18001ef7c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1
0709 12:20:51.093314 (+   134us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:20:51.259516 (+166202us) log.cc:844] Serialized 14 byte log entry
0709 12:20:51.268723 (+  9207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:51.268787 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:51.872848 (+604061us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:51.874559 (+  1711us) raft_consensus.cc:1685] finished
0709 12:20:51.874594 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:51.874774 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31594,"prepare.queue_time_us":63160,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":49557,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":10503,"spinlock_wait_cycles":10438144,"thread_start_us":138012,"threads_started":2,"wal-append.queue_time_us":59052}
I20260709 12:20:51.895340 28680 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:51.899473  3724 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.899776  3730 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:51.900017  3724 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:51.901644 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:51.902089  3724 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:51.902226 28682 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:51.903426 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:51.905890  3807 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:20:51.906284  3807 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.906634  3807 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:51.913664  3783 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:51.914907  3807 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.900279  3350 raft_consensus.cc:3055] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:51.916221  3350 raft_consensus.cc:740] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:51.917205  3350 consensus_queue.cc:260] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.917768  3807 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:51.924690  3350 raft_consensus.cc:3060] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.926287 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:51.928781 28674 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 28.
I20260709 12:20:51.941440  3320 raft_consensus.cc:993] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:20:51.942075  3320 raft_consensus.cc:1081] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
W20260709 12:20:51.949496 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 279387us
W20260709 12:20:51.950089 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 275302us
I20260709 12:20:51.950507 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:51.953672  3298 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:51.954196  3298 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:51.959556 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:51.960196 29323 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:51.961083 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:51.961705 29318 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:51.968185 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:51.968464 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:51.970281 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:51.976783  3344 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:20:51.978665  3344 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:51.980141 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:51.981827  3625 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:51.985888 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:51.988726  3814 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:51.989202  3814 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:51.989562 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45786.5us
I20260709 12:20:51.986553  3862 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:51.989622  3814 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:51.995536 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:51.995600 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:51.997069 28720 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:52.000087 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:52.001124 29318 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:20:51.998553 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:52.042281 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.023442 28682 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
W20260709 12:20:52.055845 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58868.5us
I20260709 12:20:52.055157 28607 raft_consensus.cc:1275] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:52.104131 28599 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:52.061244 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:52.012526 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:52.105057 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.083479 29322 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:20:52.123245 28750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
W20260709 12:20:52.105373 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 98066us
I20260709 12:20:52.123829 28750 raft_consensus.cc:606] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:52.125026 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:52.125871 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:52.126466 28600 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:52.126365 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:52.127015 28755 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:20:52.111879 29318 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:20:52.104646 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.011109 28677 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:52.130985 29327 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:52.054029 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:52.131831 28601 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:52.137183 28606 raft_consensus.cc:2393] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:51.956305  3298 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:52.101123  3110 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:20:52.151522 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 153051us
I20260709 12:20:52.032248  3730 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.148334 28605 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:52.158380 28755 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:20:52.011955  3838 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.160219 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:52.165962 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:52.032382  3798 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:52.153751 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:52.034317  3800 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:52.131783  3851 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:52.185462 28601 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:52.141304  3874 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:52.208355 28753 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:52.159703  3110 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:52.232551 28755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:52.233233 28755 raft_consensus.cc:606] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:52.233630 28755 raft_consensus.cc:614] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:52.195957  3712 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:52.195250  3330 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:20:52.232611  3110 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:20:52.246506 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 92859.6us
I20260709 12:20:52.247354 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.248107 28601 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 28.
I20260709 12:20:52.162535  3730 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.199314  3838 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.159999  3713 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:20:52.267580 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 100502us
I20260709 12:20:52.209976  3851 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:52.255856  3803 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:52.243897  3798 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.256747  3330 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:52.314843 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 50729.3us
I20260709 12:20:52.222793  3874 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.336207  3330 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.344084  3638 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:52.344695  3638 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.346660  3638 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:52.251420  3712 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.322774  3864 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:20:52.323803  3868 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 12:20:52.324893  3880 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:20:52.326078  3838 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:52.312394  3803 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:52.390415 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 70909.6us
I20260709 12:20:52.392844 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:52.331986  3851 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:52.361385 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.372428 28600 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:52.402933 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:52.382829  3698 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.385984  3712 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:52.386893  3730 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:20:52.380302  3628 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:20:52.396173 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:52.316386  3798 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:52.316009  3713 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:52.443957 29317 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:20:52.397514  3803 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:52.413002  3838 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:52.461270 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.462493 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.442714  3638 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.384069  3864 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.430917  3565 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:52.469863  3883 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:52.474167  3883 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:52.461125 28682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:20:52.477205 28682 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.477679 28682 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:52.465665 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:52.432651  3698 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:52.485227 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:52.494136 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:52.477131  3565 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.489470  3881 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:52.500525 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:52.505435 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.484256  3794 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:52.492347 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:52.499657  3350 consensus_meta.cc:287] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.002s
I20260709 12:20:52.473640  3638 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.507421 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.501235 29327 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:52.510880 28601 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:52.516177 28600 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:52.509570  3881 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.494848  3646 consensus_queue.cc:1048] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:20:52.510519  3730 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:52.520335 28605 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:20:52.488528  3883 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.487179  3713 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.501693 28682 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.529490 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:52.532166 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:52.533625 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:52.534322 28755 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:52.537586 28751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:52.538311 28751 raft_consensus.cc:606] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:52.517668  3350 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:52.524008  3646 consensus_queue.cc:1243] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:20:52.512095  3794 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:52.563056 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 293099us
W20260709 12:20:52.564462 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58145.8us
W20260709 12:20:52.565065 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 55023.8us
I20260709 12:20:52.522845  3881 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:52.566829 28682 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:52.553117  3562 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.556525  3320 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:52.556253  3277 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:20:52.590212 28755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:52.585229 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:52.590840 28755 raft_consensus.cc:606] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:52.591001 28749 raft_consensus.cc:3055] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:52.592872 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:52.591355 28749 raft_consensus.cc:740] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:52.596647 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:52.597474 28752 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:52.573464  3883 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:52.594832 28749 consensus_queue.cc:260] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.601038 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:52.527952  3730 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.602409 28749 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:52.603609 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 150525us
I20260709 12:20:52.582971  3892 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:52.612828 29323 raft_consensus.cc:1275] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:20:52.589931  3277 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.604341  3320 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:52.624701  3698 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:52.624624  3647 consensus_queue.cc:1059] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:52.625589  3794 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:52.625834  3905 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:52.626523  3638 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:52.625599 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:52.592198  3562 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.627777 29325 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:52.631546 28749 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
W20260709 12:20:52.655663 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 52566.8us
I20260709 12:20:52.637431  3277 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:52.682251  3562 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:52.682173 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:52.641214  3900 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:52.674827 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 88091.3us
I20260709 12:20:52.580291  3801 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:20:52.642930  3838 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:52.628532  3864 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:52.678786 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.728626 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:52.729430 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47429.7us
I20260709 12:20:52.730080 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:52.730837 28749 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:20:52.731473 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:52.725603 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:52.734354 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:52.735826 29325 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:52.784577 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:52.785233 28753 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 15.
W20260709 12:20:52.732720  3885 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 12:20:52.680354  3628 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.647334  3110 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:52.726858  3801 consensus_queue.cc:1243] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:20:52.893934 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 142890us
I20260709 12:20:52.739108  3565 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:52.921317 28748 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 28.
I20260709 12:20:52.680042  3905 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.923401 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:52.931186  3914 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.931738  3914 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.933878  3914 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:52.942013  3110 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:52.911996  3291 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:52.920953  3912 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:52.908638  3899 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 12:20:52.905457  3628 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:52.975179  3887 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:52.998598  3887 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.998822  3730 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:52.999025  3887 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:52.884775  3320 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.000003  3628 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:53.004165  3803 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.002s
W20260709 12:20:52.975523  3907 log.cc:927] Time spent T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 12:20:52.976522  3890 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:53.004732  3803 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:52.977483  3898 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:20:53.007237  3803 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.010790  3277 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.011281  3887 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.011713  3874 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.013551  3887 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:53.015185  3877 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.850s	user 0.000s	sys 0.002s
I20260709 12:20:52.987748  3912 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:53.057865  3912 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:52.997905  3814 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.006s	user 0.012s	sys 0.000s
I20260709 12:20:53.016624  3628 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:53.024981  3277 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 29 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.027073  3901 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:53.027506 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 418569us
W20260709 12:20:53.028307 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 302778us
I20260709 12:20:53.029145  3350 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.029194  3903 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:53.100297 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:53.100728 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:53.101375 29323 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:53.101482 29326 raft_consensus.cc:2410] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:20:53.030037  3565 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.034667  3913 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:52.961288  3838 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:52.961071  3873 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
W20260709 12:20:53.043651  3878 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.877s	user 0.000s	sys 0.005s
W20260709 12:20:52.986783  3893 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 12:20:53.080240  3905 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.102802 29327 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:53.127031 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:52.969708  3291 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.156399  3912 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.157208  3291 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.159365  3912 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:53.159845  3881 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.001s
I20260709 12:20:53.167179 28750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47636 (request call id 1498) took 1003 ms. Trace:
I20260709 12:20:53.106578  3901 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.167721 28750 rpcz_store.cc:276] 0709 12:20:52.163626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.163732 (+   106us) service_pool.cc:224] Handling call
0709 12:20:52.164008 (+   276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:52.169077 (+  5069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.169107 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:52.200582 (+ 31475us) log.cc:844] Serialized 52 byte log entry
0709 12:20:52.455202 (+254620us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:52.455242 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:52.455305 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:53.166877 (+711572us) raft_consensus.cc:1685] finished
0709 12:20:53.166910 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.167105 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4679,"raft.queue_time_us":5206,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6715,"thread_start_us":215665,"threads_started":1,"wal-append.queue_time_us":914626}
I20260709 12:20:53.173575  3874 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:53.174224  3874 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:53.135020  3798 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.004s
I20260709 12:20:53.177017  3798 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.179265  3798 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.131188 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.132998 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:52.942660  3110 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
W20260709 12:20:53.136612  3896 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:20:53.144408  3638 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.134001  3829 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.147215 29323 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:53.124452  3913 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:53.199128 28570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.030s	sys 0.058s
W20260709 12:20:53.203254 28570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.030s	sys 0.058s
I20260709 12:20:53.092255  3814 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.096236  3628 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.115072  3350 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:53.215391 28645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.003s	sys 0.003s
W20260709 12:20:53.215790 28645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.003s	sys 0.004s
W20260709 12:20:53.207896  3330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.010s	sys 0.039s
I20260709 12:20:53.188455  3902 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.195971  3903 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:53.132320  3565 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.192529  3874 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:53.217509 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.006s
W20260709 12:20:53.192844 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 59950.8us
I20260709 12:20:53.208233  3912 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.236786 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:53.237612 29327 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
W20260709 12:20:53.212553 28648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.045s
I20260709 12:20:53.207976  3862 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.227241 28598 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:53.160300  3881 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.240561 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:53.221166 28647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.006s
W20260709 12:20:53.232105 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.000s	sys 0.006s
I20260709 12:20:53.235149 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:53.197947  3638 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.248421 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.235746 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:53.238394 28648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.000s	sys 0.045s
W20260709 12:20:53.249439 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 621151us
I20260709 12:20:53.241246 29323 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:53.212867  3344 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.227013  3903 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.227777  3291 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:53.245054 28647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.000s	sys 0.007s
I20260709 12:20:53.252750 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:53.258464 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 620623us
I20260709 12:20:53.258790 28750 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:53.254973 28605 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:20:53.252192 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.259776 28748 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:53.255262 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:53.255743 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.257229 28752 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
W20260709 12:20:53.250288 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 326931us
W20260709 12:20:53.245244 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 636332us
I20260709 12:20:53.262676 28602 raft_consensus.cc:2368] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20.
I20260709 12:20:53.230505  3602 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:53.230281  3905 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:53.251881 28674 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:53.255527 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:53.205521  3829 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.266294 28600 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:53.249951  3911 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.270013 28647 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:53.257529  3831 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:53.282685 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:53.285324 29323 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:53.272198 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:53.274132  3814 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.257360  3903 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:53.274770  3851 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:53.245059  3912 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.276899  3802 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.268797  3602 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.278431 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2103) took 1199 ms. Trace:
I20260709 12:20:53.287073 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:53.303560 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:53.304107 29321 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:53.287276 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:53.287490 28600 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 29.
I20260709 12:20:53.253134  3804 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:53.289520 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.308327 28604 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:53.301784 29319 rpcz_store.cc:276] 0709 12:20:52.078863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.078993 (+   130us) service_pool.cc:224] Handling call
0709 12:20:52.130311 (+ 51318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.340428 (+210117us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:20:52.353702 (+ 13274us) log.cc:844] Serialized 14 byte log entry
0709 12:20:52.603766 (+250064us) log.cc:844] Serialized 14 byte log entry
0709 12:20:53.026640 (+422874us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b18002ec7e0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a89716 00007f6fe3a9a287 00007f6fe3a9a208
0709 12:20:53.026812 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:53.026863 (+    51us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:53.026917 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.278177 (+251260us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54004b9454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:53.278232 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.278372 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390130,"prepare.queue_time_us":529612,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":83,"raft.queue_time_us":505834,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":21227,"spinlock_wait_cycles":482472576,"thread_start_us":239084,"threads_started":2,"wal-append.queue_time_us":696368}
I20260709 12:20:53.291762 28750 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 29.
I20260709 12:20:53.294041 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:53.295297  3829 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.295234  3647 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:53.288547  3703 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.230752  3902 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.298445  3920 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.331970  3920 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:53.332978  3883 consensus_meta.cc:287] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.727s	user 0.011s	sys 0.000s
I20260709 12:20:53.299079  3638 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.299904  3881 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.269073  3905 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.309942 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:53.314141 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.338078 28674 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:53.288853  3719 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:53.315613 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:53.341291 28682 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 28. Current term is 29.
I20260709 12:20:53.263583  3344 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.314904  3804 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:53.352294  3879 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 1.024s	user 0.024s	sys 0.000s
I20260709 12:20:53.265903  3291 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.320156  3565 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.314038  3803 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.265101  3794 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:20:53.326701  3901 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.288308  3831 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.326583  3628 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.248015  3913 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.327335 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.329305  3912 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.280743  3911 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.312875  3625 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.334936 29321 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:53.326269 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.342721 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:53.348625  3923 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:53.335426  3647 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.337404  3703 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.353314  3804 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.349581 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.350193  3918 consensus_queue.cc:1048] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:53.340596  3874 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.351307  3602 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.354489 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.357648 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:53.493894 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 120058us
I20260709 12:20:53.494263 28681 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:53.494364 28604 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:53.363477 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:53.493934 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 151294us
I20260709 12:20:53.495038 28677 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:53.384697 28676 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:53.307875  3802 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.494719 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:53.366704 29325 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:53.348822  3902 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.247761  3862 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.372953  3565 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:53.529117  3646 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.529389  3565 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.529893  3646 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.528715  3344 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.529872  3565 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:53.367681 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.532859 28678 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:53.368130  3719 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:53.534701  3719 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.370864 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:53.368605 28680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3517) took 1104 ms. Trace:
I20260709 12:20:53.537431 28680 rpcz_store.cc:276] 0709 12:20:52.264601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.264800 (+   199us) service_pool.cc:224] Handling call
0709 12:20:52.269040 (+  4240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:52.353037 (+ 83997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:52.353081 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:52.353133 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:52.353188 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:53.368334 (+1015146us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54001be754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:53.368380 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:53.368533 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192632704}
W20260709 12:20:53.441754 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 79344.5us
I20260709 12:20:53.541544  3862 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.337841  3713 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:53.377455 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:53.546003 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51365.5us
W20260709 12:20:53.546110 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 168779us
I20260709 12:20:53.552203 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:53.553289 29322 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:53.556062 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:53.556994 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:53.348685  3873 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.138s
I20260709 12:20:53.573362 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:53.574131 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.574752 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.574877 28600 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:20:53.574923 28604 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:53.576333 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:53.576650 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:53.577107 29319 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:53.577335 28600 raft_consensus.cc:2368] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 28. Current term is 29.
I20260709 12:20:53.578133 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:53.578812 28603 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:53.578907 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:53.579877 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.577498 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.581081 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.550169 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:53.597030 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.376050  3831 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:53.575378 28599 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:53.605746 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.483677  3901 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.610019 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.610890 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:53.611128 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:53.622391 28607 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:53.498900  3858 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.534233  3922 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.180s
I20260709 12:20:53.631455 28722 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 28. Current term is 29.
I20260709 12:20:53.637133 28722 leader_election.cc:403] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
W20260709 12:20:53.483373  3796 consensus_queue.cc:1175] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5b3b2f4041a24b05983f30878f16db9d" responder_term: 21 status { last_received { term: 21 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 21 index: 13 } }
I20260709 12:20:53.547885  3851 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:20:53.572312  3305 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:53.629623 28677 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:20:53.582130  3918 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:53.606405  3712 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.605643  3794 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.644345  3918 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.656641  3851 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 29 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:53.657747  3918 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.657716  3851 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.658664  3905 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.659266  3305 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:53.659870  3698 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 28. Current term is 29.
I20260709 12:20:53.660167  3703 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:53.660802 28498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 234) took 15504 ms (client timeout 15000 ms). Trace:
I20260709 12:20:53.660923  3703 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.546703  3920 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.572278  3917 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:53.661437  3703 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.662050  3917 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:53.662454  3917 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:53.663626  3703 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.611786  3733 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.378070  3803 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.665131  3802 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.604277  3862 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.656243 28496 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 6 to 21, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 21 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.665717  3931 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.666111  3803 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.665853  3862 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.660272  3305 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.666291  3931 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.666780 28496 catalog_manager.cc:5697] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:53.668597  3291 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.634862  3372 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:53.636843  3901 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.545609  3565 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.670285  3911 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.674950 28496 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 13 to 23. New cstate: current_term: 23 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.677786  3911 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:53.678167  3911 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.678555  3911 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:53.678754 28496 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:53.487951  3625 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.680573 28496 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 11 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 17 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:53.681813  3350 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.664753  3733 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.672233  3712 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.682320 28496 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 13 to 18, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 18 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:53.683365  3647 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.684000  3733 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.656924 28602 pending_rounds.cc:85] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 14
I20260709 12:20:53.684777 28602 pending_rounds.cc:107] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:20:53.685117 28602 raft_consensus.cc:2889] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:53.644965  3713 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:53.631999  3646 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.546204  3874 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.630126  3888 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:20:53.672247  3794 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.635888 28603 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
W20260709 12:20:53.690791 28598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3390) took 1636 ms (client timeout 2076 ms). Trace:
W20260709 12:20:53.691605 28598 rpcz_store.cc:269] 0709 12:20:52.053928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.054050 (+   122us) service_pool.cc:224] Handling call
0709 12:20:53.690601 (+1636551us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000a6c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:53.690735 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538494336}
I20260709 12:20:53.682062  3625 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.694566 28496 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.698694 28496 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 11 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.682122  3931 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.642974  3858 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:53.703083  3933 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.703642  3933 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.706080  3933 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.708920  3874 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.710142 28496 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 12 to 17, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 17 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:53.711841 28496 catalog_manager.cc:5697] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:53.714041  3862 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.714658  3911 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.725234  3911 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:53.682371  3350 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.674021  3372 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.743763 28604 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:20:53.731230  3712 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.732291  3931 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:53.759981 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 209861us
I20260709 12:20:53.775369 29317 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: []
W20260709 12:20:53.661286 28498 rpcz_store.cc:269] 0709 12:20:38.135188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:38.135400 (+   212us) service_pool.cc:224] Handling call
0709 12:20:53.632808 (+15497408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:46.248205 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:46.461326 (+213121us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:46.465072 (+  3746us) write_op.cc:435] Acquired schema lock
0709 12:20:46.466705 (+  1633us) tablet.cc:662] Decoding operations
0709 12:20:46.556160 (+ 89455us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:46.556219 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:46.556246 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:20:46.557412 (+  1166us) tablet.cc:701] Row locks acquired
0709 12:20:46.557431 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:20:46.557578 (+   147us) write_op.cc:270] Start()
0709 12:20:46.557699 (+   121us) write_op.cc:276] Timestamp: P: 1783599646557531 usec, L: 0
0709 12:20:46.557722 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:20:46.558394 (+   672us) log.cc:844] Serialized 6586 byte log entry
0709 12:20:47.016714 (+458320us) op_driver.cc:464] REPLICATION: finished
0709 12:20:47.199328 (+182614us) write_op.cc:301] APPLY: starting
0709 12:20:47.199424 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:47.244192 (+ 44768us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:47.244304 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:47.361369 (+117065us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:47.361874 (+   505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:20:47.361967 (+    93us) write_op.cc:312] APPLY: finished
0709 12:20:47.362621 (+   654us) log.cc:844] Serialized 148 byte log entry
0709 12:20:47.385312 (+ 22691us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.385858 (+   546us) write_op.cc:454] Released schema lock
0709 12:20:47.385974 (+   116us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:47.386824 (+   850us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:47.386861 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":127075,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":179376,"apply.run_cpu_time_us":29244,"apply.run_wall_time_us":187293,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70847,"num_ops":16,"prepare.queue_time_us":695244,"prepare.run_cpu_time_us":11147,"prepare.run_wall_time_us":390300,"raft.queue_time_us":308947,"raft.run_cpu_time_us":11364,"raft.run_wall_time_us":168215,"replication_time_us":438163,"thread_start_us":785025,"threads_started":4,"wal-append.queue_time_us":94860,"wal-append.run_cpu_time_us":65103,"wal-append.run_wall_time_us":1703261}]]}
I20260709 12:20:53.770783  3703 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.748122  3350 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.780915  3838 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:53.781498  3838 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.782496  3350 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.791915 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:53.778810 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.783809 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:53.784298 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:53.784533 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.801039 28677 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:53.780956  3703 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.747206  3372 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:53.790164  3565 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:53.796722 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 223417us
I20260709 12:20:53.793113 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:53.806272 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:53.812177 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.812999 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:53.813390 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.814456 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.820037 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.821235 29319 pending_rounds.cc:85] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 12
I20260709 12:20:53.821597 29319 pending_rounds.cc:107] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:20:53.821868 29319 raft_consensus.cc:2889] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:53.823447 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.824301 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.824426 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.827167 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.827260 28750 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:53.828768 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.831357 28749 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:53.831604 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.840420 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:53.809080  3888 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:53.880942  3320 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:53.819005  3350 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:53.889344  3901 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.812018  3917 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.833314  3918 consensus_queue.cc:1059] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 12:20:53.889381  3794 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:53.894888 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:53.896947 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:53.898340 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.899104 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.748073 28496 catalog_manager.cc:5697] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 10 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.906366 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.908798 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.909652 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.791793  3931 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:53.950766 28753 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:53.914119  3838 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:53.917372 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.918222 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.919569 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:53.920223  3916 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.922994 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:54.009224 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 193887us
I20260709 12:20:53.925627  3344 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:53.926366  3820 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:53.927848  3703 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:53.881860  3277 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:53.947840 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:53.950377 28754 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:53.946800 28751 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:53.938030  3330 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:20:53.965981 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 332874us
W20260709 12:20:53.977631 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.003669 28676 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:54.006855  3372 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:53.944746 28648 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 2.076s (SENT) [suppressed 11 similar messages]
W20260709 12:20:53.999506 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 54137.5us
I20260709 12:20:53.925364  3831 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.029464 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.029978 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.030823 29323 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:53.941910  3888 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:54.012513 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 89610us
I20260709 12:20:54.036675 29327 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:20:54.038070 28755 raft_consensus.cc:2368] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:53.951043  3712 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.011602  3291 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:54.031772 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.045425 29323 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:54.046173 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.033535 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.040514 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:54.012197 28748 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 26: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:54.034821 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.019208 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.013206  3565 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:53.943357  3320 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.016222  3305 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:54.043903 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.031051  3330 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.060127  3330 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:54.037941 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.015607  3916 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.051923 29327 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:20:54.031436  3918 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.053594 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:54.052762  3939 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:54.059161 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.034184 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:54.050063  3800 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:54.045035  3291 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:54.021602  3820 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.055307  3949 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:54.069687 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:54.092478 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:54.081319 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62222.9us
I20260709 12:20:54.044708  3712 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.090180 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.073038 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.067426  3937 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:54.068317  3936 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:54.128410 28748 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:54.122584 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.072654  3881 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:20:54.134907 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 190169us
I20260709 12:20:54.067832  3939 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.145483 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.149921 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.075022  3940 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:54.136165  3936 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:54.152503  3936 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:54.090272  3800 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.153287  3372 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:54.153554  3917 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.152778 28680 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:54.154750  3372 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.092082  3924 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:54.158843 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 89203.9us
I20260709 12:20:54.135655  3703 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.122645  3602 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:54.135565  3895 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:54.072206  3918 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.166802 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:54.210409 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 43678us
I20260709 12:20:54.211370 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.145056  3939 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:54.172999 28496 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 9 to 20, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 20 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.145270  3901 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:54.183355 28676 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:54.186769  3602 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.185860  3895 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.188526  3820 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:54.189807  3903 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.888s	user 0.011s	sys 0.000s
I20260709 12:20:54.230062 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.232326 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:54.190505  3944 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:20:54.191411  3931 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.139608  3881 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:54.192754 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.193034  3888 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.196856  3848 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.197005 28722 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:54.197513  3948 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:20:54.184957  3924 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.184801  3291 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.198734  3703 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.199309  3936 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.258692  3277 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.202066 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.260113 29322 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:54.202900 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.203531 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.203617 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.204461 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:54.204912  3934 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:20:54.206456  3712 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.155395  3372 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.164186  3831 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.207821  3320 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:54.263257  3846 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:54.256071  3261 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:54.272066  3261 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:54.273085  3261 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.212997 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.214990 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.215605 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.232465  3933 consensus_queue.cc:1059] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:20:54.220646 28748 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:20:54.222926 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.223948 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.280768 28605 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:54.234869  3903 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.285653 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.287102 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:54.248535  3919 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 12:20:54.129911  3949 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.236032 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.237008 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.292136 28600 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:54.239319 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.216234  3901 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.216836  3562 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.240789 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.242683 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:54.238027 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.221318  3961 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:54.244359 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.219350  3940 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:54.247543 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50608.4us
I20260709 12:20:54.253756 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.256657 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.256948 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.258250  3921 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.305781  3921 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.307518  3903 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.307924  3921 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:54.261389 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57047us
I20260709 12:20:54.261960 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.308727 28750 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:54.308822 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.309643  3862 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:54.310048 28571 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.310303  3858 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:54.310792  3862 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:54.311208 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.228811  3909 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:54.312717  3909 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.314694  3909 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.301868  3901 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:54.245332  3881 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:54.267223 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.266270 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:54.247586  3931 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.319298 29325 raft_consensus.cc:2368] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20.
I20260709 12:20:54.319286  3931 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.248224  3794 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:54.321547 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.321846  3794 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:54.322682 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.322726  3794 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.323851 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.219975 28648 leader_election.cc:400] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20.
W20260709 12:20:54.325030 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 105205us
I20260709 12:20:54.325547 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.326264 28598 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:54.275856 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.327071 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:54.327401 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:54.327575 28598 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:54.327936 28682 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:54.329304 29326 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:54.330194 29317 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:54.331712 29317 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:54.331887 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.333086 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:54.276989 29318 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:54.333909  3949 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:54.334022 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.334648 28606 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:20:54.334724  3562 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.336587 29327 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:54.274580 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:54.282482  3938 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 12:20:54.278642 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.347486 28680 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:54.348390 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.348981 28680 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:54.349687  3924 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:54.349856 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.278892 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.288841 28748 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:54.351521 28673 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:20:54.263646  3918 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.290977 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.368629 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:54.373253 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70145.1us
I20260709 12:20:54.375720 28682 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
W20260709 12:20:54.296660  3942 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:20:54.259220  3277 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.298319 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:54.300928 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 58318.3us
I20260709 12:20:54.284986  3291 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:54.256219  3848 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.302380  3344 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:54.305119 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.408723  3344 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:54.409140  3344 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:54.289343 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.409814 28607 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:20:54.355538 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.321547  3931 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.357584 28606 raft_consensus.cc:1240] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:54.376741 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.377897 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.379202 29322 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:54.383069 28747 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 26.
I20260709 12:20:54.383618 28572 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:54.415316 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:54.225445 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.391031 28598 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:20:54.396080 28571 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.401373  3277 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:54.402067  3953 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:20:54.401974 28677 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
W20260709 12:20:54.402316 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 97656.4us
I20260709 12:20:54.418803 28647 leader_election.cc:400] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20.
I20260709 12:20:54.419770 28647 leader_election.cc:403] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:20:54.403774  3888 raft_consensus.cc:993] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:20:54.417197  3912 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:54.362604  3305 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:54.417656 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.403074  3936 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:54.424003  3277 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20.
W20260709 12:20:54.424718 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 50589us
I20260709 12:20:54.422161 28720 leader_election.cc:400] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 28. Current term is 29.
I20260709 12:20:54.433873 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.433970  3954 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:54.413045  3916 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.434724  3962 raft_consensus.cc:3055] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:54.427284 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.417903  3298 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:54.435029  3698 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:54.430554 28680 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:20:54.435117  3962 raft_consensus.cc:740] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:54.436194  3962 consensus_queue.cc:260] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.437443  3962 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:54.435029 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.442040 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.480197 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.460729 28606 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:20:54.639528 28598 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:20:54.606148 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.431957  3966 raft_consensus.cc:1081] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Signalling peer a8342e3fcab94ce89482df67988159ea to start an election
I20260709 12:20:54.485791 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.659466  3912 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:54.429759  3909 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.231s
I20260709 12:20:54.539882  3881 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.663407  3846 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.663968  3846 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.654353  3733 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.665055  3733 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.667232  3733 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.667495  3846 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.576033  3562 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.446427 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.434134  3895 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.590493 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:54.598757 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:54.573783 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.484694 28607 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: [18.12-21.14]
W20260709 12:20:54.675021 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 300803us
W20260709 12:20:54.675740 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.300493 28496 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 7 to 17, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.525527  3862 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:54.483809  3602 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:54.422283  3805 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:54.453122  3888 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:54.484212 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:54.707298 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 223168us
I20260709 12:20:54.665619  3372 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.672307  3730 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:54.682986 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:54.521860  3964 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 12:20:54.685571 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 199877us
I20260709 12:20:54.538448  3939 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:54.581317  3955 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.297s	user 0.003s	sys 0.000s
I20260709 12:20:54.696974 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.697522 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:54.687635 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.514442  3848 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.686617 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:54.702930 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.734977 29321 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
W20260709 12:20:54.677599 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 231270us
I20260709 12:20:54.679349 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:54.709414 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:54.715325 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:54.717278 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3164) took 1141 ms. Trace:
I20260709 12:20:54.736945 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.737149 28604 rpcz_store.cc:276] 0709 12:20:53.575926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.609732 (+ 33806us) service_pool.cc:224] Handling call
0709 12:20:53.610020 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:53.744316 (+134296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.717058 (+972742us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400216e54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:54.717221 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287370112}
I20260709 12:20:54.532264  3800 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:54.738623  3970 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:20:54.739838 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.740516 29325 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 28.
I20260709 12:20:54.472302  3831 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.225s
I20260709 12:20:54.536628  3703 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.742430  3703 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:54.742790  3703 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:54.684911  3905 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:20:54.703390  3874 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:54.743528  3703 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.744117  3874 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.744779  3703 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:54.746824  3874 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.721789 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.713522  3847 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:54.684010  3796 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:20:54.723110 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.670173 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:54.760921 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 90825.7us
I20260709 12:20:54.762195 28573 leader_election.cc:400] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:54.762640 28573 leader_election.cc:403] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:54.725009 28602 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:20:54.540807  3565 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:54.683925  3881 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:54.766337 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 79780.3us
I20260709 12:20:54.706923  3888 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:54.731913 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 314325us
I20260709 12:20:54.778903 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:54.759704 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50397.6us
W20260709 12:20:54.779352 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57649.9us
I20260709 12:20:54.780130 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.781556 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:54.710762  3971 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:54.783082 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:54.783310 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.730011 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.784580 28673 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:54.555121  3330 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.679054  3901 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.726473 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:54.769989 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.795207 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.795622  3913 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:54.795907 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.763263 28605 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:20:54.803239  3874 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:54.805250 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.807708 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:54.808646 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:54.810405 29319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2122) took 1020 ms. Trace:
I20260709 12:20:54.810755 29319 rpcz_store.cc:276] 0709 12:20:53.790316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.793629 (+  3313us) service_pool.cc:224] Handling call
0709 12:20:53.820985 (+ 27356us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:20:53.886028 (+ 65043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:53.886059 (+    31us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:20:53.939544 (+ 53485us) log.cc:844] Serialized 104 byte log entry
0709 12:20:54.093782 (+154238us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:54.151554 (+ 57772us) log.cc:844] Serialized 14 byte log entry
0709 12:20:54.158327 (+  6773us) log.cc:844] Serialized 14 byte log entry
0709 12:20:54.158512 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:54.158577 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:54.571893 (+413316us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:54.810192 (+238299us) raft_consensus.cc:1685] finished
0709 12:20:54.810214 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:54.810353 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64751,"prepare.queue_time_us":63527,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":135139,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":291,"spinlock_wait_cycles":3620224,"thread_start_us":147869,"threads_started":1,"wal-append.queue_time_us":298170}
I20260709 12:20:54.813695  3971 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:54.814105  3971 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.814218  3924 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:54.814492  3971 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:54.816602 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:54.816983  3969 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:20:54.817693  3939 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:54.818266  3939 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.803318  3895 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:54.818756  3939 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.820036 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.781611  3931 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:54.821378  3733 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:54.822938  3719 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:54.823470  3719 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:54.764827  3565 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:54.825534  3719 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.826191  3881 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:20:54.828048  3901 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.781759  3730 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:54.828336 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:54.828728  3917 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:20:54.828882  3730 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.829190  3917 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.829393  3730 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:54.829650  3917 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:54.830186 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.831038 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.832751 28496 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:54.747601  3847 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.829202 28751 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 23: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:54.835279 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63516.5us
W20260709 12:20:54.836277  3964 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:54.777801  3602 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:54.795070  3703 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:54.839272 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.788362  3888 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:54.781203  3899 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:54.842491 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.843729 29321 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:54.845242 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.770632  3820 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:54.836463 28496 catalog_manager.cc:5697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 10 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 17 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:54.732571  3562 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.106s
I20260709 12:20:54.778731  3862 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:20:54.850229 28749 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
I20260709 12:20:54.837947 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:54.850910 28681 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:54.847247 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49984.1us
I20260709 12:20:54.849954  3703 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:54.844560  3847 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:54.907400 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:54.850732  3940 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:54.859788 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.915198 28679 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 28.
I20260709 12:20:54.860522 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:54.864917 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:54.867475 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:54.890828 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:54.894199 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:54.897701 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 59829.2us
I20260709 12:20:54.903244 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.918325 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.919739 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.921540 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:54.916616 29320 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
W20260709 12:20:54.915220 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 43545.9us
I20260709 12:20:54.917503 28749 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
W20260709 12:20:54.932953 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 206566us
I20260709 12:20:54.933938 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.940444 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:54.868489  3899 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.958484 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.959524 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:54.959684 28752 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 28.
I20260709 12:20:54.905995  3703 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:54.878825  3915 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:54.971917 28603 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:54.929883  3298 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:54.940683  3937 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:54.939167  3874 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:54.968940  3939 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:54.953989  3372 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:54.929929  3900 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:54.938879  3961 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:20:55.000308 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:55.003178 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:54.954434  3901 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:54.958456  3962 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:20:54.954747  3936 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:54.968845  3899 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:54.958098  3851 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:55.019289 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:55.000898  3794 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.062s	sys 0.084s
I20260709 12:20:55.022298 28753 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:55.023488 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:55.012326  3953 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:20:55.031461  3967 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:20:55.030905 28496 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 9 to 16, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 16 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.026227  3372 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:55.026648  3344 consensus_meta.cc:287] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.004s
I20260709 12:20:55.037954  3730 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.044266 28756 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:55.071437 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 71490.2us
I20260709 12:20:55.011770  3937 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:55.161536 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 400511us
W20260709 12:20:55.173820 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 233161us
I20260709 12:20:55.174104 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:55.117230  3794 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.062s	sys 0.085s
I20260709 12:20:55.018577  3915 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:55.117111  3846 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.158289  3962 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:55.155869  3874 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:55.041329  3900 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.278544  3900 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:55.070338  3320 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.099s
I20260709 12:20:55.279716  3320 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:55.280117  3320 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:55.280943  3320 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.282429  3320 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:55.197445  3730 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:55.324257 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:55.325273 28600 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:55.327145 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:55.190433  3912 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:55.179168 28720 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:55.173612  3625 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:55.193037  3733 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:55.195156  3330 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:55.173317  3344 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.170861  3372 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:55.153894  3851 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.196007  3565 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.196059  3846 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:55.196141  3691 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:55.196688  3962 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.197851  3915 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:55.344646  3913 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:55.231089  3796 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:55.175562  3937 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:55.234071  3902 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.234799 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:55.235615  3847 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:55.237923 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:55.427181 29325 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:55.428040 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:55.241787 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:55.260304 28607 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:20:55.434124 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:55.263594  3917 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:55.267349  3820 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:55.268193 28675 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:55.207911  3562 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:55.400795 28605 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
W20260709 12:20:55.348670 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 169586us
I20260709 12:20:55.450311 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:55.387471  3858 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:55.293635  3974 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:55.388101  3900 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.423681 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:55.349503  3350 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:20:55.438372 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 263668us
W20260709 12:20:55.438542 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 203876us
W20260709 12:20:55.473165 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:55.474359 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:55.475754 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:55.476282 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:55.428056 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:55.477941 28747 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:20:55.477852 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:55.445639 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:55.447136 28599 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:20:55.447985 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:55.385958  3912 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:55.479836 28598 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:55.462272 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:55.464769 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:55.466080 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:55.419099  3796 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:55.438668 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 350448us
I20260709 12:20:55.390388  3733 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.505079 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:55.505657 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:55.510476 28603 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:55.510066 28607 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:55.285331 28496 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 11 to 18, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 18 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.331226  3874 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.517386 28673 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:55.521835 28607 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: [21.16-21.16]
W20260709 12:20:55.474191 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 450755us
I20260709 12:20:55.523298 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:55.542773 28573 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:55.543918 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:55.545723 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:55.523595 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:55.419040  3691 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.463367  3860 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.399744  3625 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.524128 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:55.427436  3913 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.504133  3915 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:55.644160 28598 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 18.
I20260709 12:20:55.464789  3261 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:55.446772  3800 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:20:55.523741  3330 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.187s
I20260709 12:20:55.471293  3730 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:55.445915  3902 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.525159  3719 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.548228  3848 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:55.514149  3912 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:20:55.773620  3984 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
W20260709 12:20:55.774509  3981 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 12:20:55.774571  3691 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:55.775580  3565 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:20:55.775941  3344 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:55.777189  3905 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:55.779107  3915 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.481551  3703 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:55.645447  3919 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:55.483124  3900 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:55.524724  3562 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.292s
I20260709 12:20:55.473942  3974 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:55.938865 28604 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.020s	sys 0.027s
W20260709 12:20:55.998100 28604 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.020s	sys 0.027s
W20260709 12:20:55.977615 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 549575us
I20260709 12:20:56.000506  3900 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:55.870602  3971 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.056s	user 0.004s	sys 0.014s
W20260709 12:20:55.980100 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 436210us
I20260709 12:20:55.870445  3924 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:20:55.986449 28572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.040s
W20260709 12:20:56.006268 28572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.000s	sys 0.041s
I20260709 12:20:55.869356  3949 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:55.994055 29321 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:55.786911  3873 consensus_queue.cc:1059] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.197s
I20260709 12:20:55.995048 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60198 (request call id 1581) took 1955 ms. Trace:
I20260709 12:20:55.979027  3261 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.018930 28681 rpcz_store.cc:276] 0709 12:20:54.034112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.149599 (+115487us) service_pool.cc:224] Handling call
0709 12:20:55.989743 (+1840144us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54000c8354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:55.989904 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610090240}
I20260709 12:20:55.660235  3860 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:55.982956  3831 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:20:55.984423  3820 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:55.985090  3691 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.008882  3851 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.008498  3971 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:56.010748  3888 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.116s	user 0.016s	sys 0.008s
I20260709 12:20:56.013144  3961 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:55.980396  3719 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.016935 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.019414 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:55.992466  3565 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.034780 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:55.781443  3796 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.018723  3924 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.035969 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:20:56.045758 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.011s	sys 0.009s
W20260709 12:20:56.046120 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.011s	sys 0.009s
I20260709 12:20:56.046460 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:56.024098  3831 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:56.046355 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 527995us
W20260709 12:20:56.030766  3858 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.015s	sys 0.030s
I20260709 12:20:56.076670 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:56.035683  3978 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.591s	user 0.000s	sys 0.001s
I20260709 12:20:56.025699  3949 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.033589  3911 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.045398  3847 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:56.087954  3858 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.017s	sys 0.043s
I20260709 12:20:56.030450  3691 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.029214  3261 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.112684 28751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 3150) took 1237 ms. Trace:
I20260709 12:20:56.034384  3888 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.078754  3796 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:56.080950  3831 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:56.042409  3992 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:56.076602  3917 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.126173 28751 rpcz_store.cc:276] 0709 12:20:54.864680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.864795 (+   115us) service_pool.cc:224] Handling call
0709 12:20:54.865127 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:54.865482 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.865518 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:54.866134 (+   616us) log.cc:844] Serialized 52 byte log entry
0709 12:20:55.072342 (+206208us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:55.072583 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.072654 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:56.102181 (+1029527us) raft_consensus.cc:1685] finished
0709 12:20:56.102215 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.102418 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1206,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":205739,"threads_started":1,"wal-append.queue_time_us":523847}
I20260709 12:20:56.049201  3924 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:56.130872 28749 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:56.102409  4002 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:56.112998  3562 raft_consensus.cc:3055] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:56.036332  3961 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.136646  4012 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:56.141980 28675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 3543) took 1856 ms (client timeout 1726 ms). Trace:
I20260709 12:20:56.144263  4008 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.147432  3902 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.116406  3858 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:56.152606 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 3162) took 1217 ms. Trace:
I20260709 12:20:56.048208  3565 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:56.132706  3320 consensus_meta.cc:287] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.850s	user 0.014s	sys 0.000s
I20260709 12:20:56.133025  3913 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:56.135238  3994 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:20:56.152467  3562 raft_consensus.cc:740] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:56.131639  3909 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:56.267908 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 617251us
W20260709 12:20:56.269656 28675 rpcz_store.cc:269] 0709 12:20:54.285301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.312220 (+ 26919us) service_pool.cc:224] Handling call
0709 12:20:56.141803 (+1829583us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540019f354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:56.141911 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971800320}
I20260709 12:20:56.277107 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3430) took 1028 ms. Trace:
I20260709 12:20:56.280704 28749 rpcz_store.cc:276] 0709 12:20:54.935411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.935571 (+   160us) service_pool.cc:224] Handling call
0709 12:20:54.936218 (+   647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.138208 (+1201990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.140324 (+  2116us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400034dd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:56.152552 (+ 12228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2746894592}
I20260709 12:20:56.335836 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:56.292208 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 245809us
I20260709 12:20:56.293859  3874 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.275439  3730 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 23 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:20:56.294920  3814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.774s	user 0.031s	sys 0.048s
W20260709 12:20:56.293011 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 216430us
I20260709 12:20:56.305680 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:56.311064 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:56.336658 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.294461  3261 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.245220  3846 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.280334  4002 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:56.337121 28604 rpcz_store.cc:276] 0709 12:20:55.248815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.249722 (+   907us) service_pool.cc:224] Handling call
0709 12:20:55.250092 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:55.250357 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:20:55.998532 (+748175us) log.cc:844] Serialized 14 byte log entry
0709 12:20:56.275937 (+277405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:56.276192 (+   255us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:20:56.276523 (+   331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.276796 (+   273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.277036 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1931,"prepare.queue_time_us":768047,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"thread_start_us":911982,"threads_started":2}
I20260709 12:20:56.341471 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:56.353281 28749 raft_consensus.cc:2410] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:20:56.288453  3902 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:56.362520 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51549.7us
I20260709 12:20:56.355283 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:56.042637 28496 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 12 to 13, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 13 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:56.280733  3998 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:56.298714  4001 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.135473  3992 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.371243 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:56.349269  3814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.828s	user 0.032s	sys 0.048s
W20260709 12:20:56.371634 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 106508us
I20260709 12:20:56.339639  3903 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.279676  3911 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.351078  3917 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:56.351231  3703 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.381435 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:56.382807 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:56.395720 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:56.288211  4008 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:56.399348 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 84872.7us
I20260709 12:20:56.372014  3847 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:20:56.369781  3874 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.400141 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:56.281347  4012 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.403122  3848 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:56.407552  3874 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.408023  3798 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:56.378481  3921 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:56.373350  4009 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:56.378281  4002 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:56.373653  3915 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.380169  3719 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.385887  4010 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:56.376336  3905 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
I20260709 12:20:56.416100  3913 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:56.374643  3902 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.421017  3897 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:56.421546  3848 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:56.422086  3919 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.418785  3971 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.429122  3974 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:56.470839  4004 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:20:56.459877 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.377939  3903 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.386876  4001 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.455735  3949 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:56.440874  3320 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:56.393139  3562 consensus_queue.cc:260] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.386384  3858 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.465325  3848 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:56.505265  3320 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:56.514880  4014 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:20:56.517428  4015 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:20:56.518278  3949 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:56.518851  3949 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.496241  4020 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:56.474772  3881 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.524691  3881 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:56.525900  4002 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.529971 28496 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.531241  3110 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:56.446841  4009 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.532191  3110 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.459941  3917 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:20:56.535228  3917 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 26.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:56.535904  3110 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:56.466038 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 129125us
W20260709 12:20:56.504318 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 152522us
I20260709 12:20:56.445649  3798 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:56.479064  3991 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
W20260709 12:20:56.499766  3899 consensus_meta.cc:287] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 1.345s	user 0.004s	sys 0.022s
I20260709 12:20:56.427060  3730 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:56.501643  3862 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 1.593s	user 0.018s	sys 0.006s
I20260709 12:20:56.453936  3691 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:56.531174  3372 consensus_meta.cc:287] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.112s	user 0.011s	sys 0.010s
I20260709 12:20:56.551776 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:56.475368  4019 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:56.530131  3949 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.457995  4010 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.560544  3862 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:56.557216  3899 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.577662  3899 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:56.578931  3912 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.010s
I20260709 12:20:56.569523  3372 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.594017 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:56.594483 28754 raft_consensus.cc:2368] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:56.581450 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.595186 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.595352 29321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39262 (request call id 1608) took 1122 ms. Trace:
I20260709 12:20:56.595597 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:56.595760 29321 rpcz_store.cc:276] 0709 12:20:55.472736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.474108 (+  1372us) service_pool.cc:224] Handling call
0709 12:20:56.595158 (+1121050us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400628254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:56.595274 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193128704}
I20260709 12:20:56.595373 28748 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:20:56.596729 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:56.597323 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.597806 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.598380 28598 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:56.598434 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.599347 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:56.599673 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.600975  3912 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.602548 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 3188) took 1172 ms. Trace:
I20260709 12:20:56.603229 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.603979 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1604) took 1883 ms. Trace:
I20260709 12:20:56.604496 29325 rpcz_store.cc:276] 0709 12:20:54.720756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.741153 (+ 20397us) service_pool.cc:224] Handling call
0709 12:20:54.741447 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:55.439155 (+697708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.603687 (+1164532us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b5400660154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:56.603905 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576583424}
I20260709 12:20:56.606537 29322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39262 (request call id 1610) took 1133 ms. Trace:
I20260709 12:20:56.606994 29322 rpcz_store.cc:276] 0709 12:20:55.473380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.475560 (+  2180us) service_pool.cc:224] Handling call
0709 12:20:55.475811 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:55.772277 (+296466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:55.772307 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:55.772347 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:55.772376 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.606260 (+833884us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54005861d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:56.606329 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.606472 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681356160}
I20260709 12:20:56.608376 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3436) took 1194 ms. Trace:
I20260709 12:20:56.608584  3912 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.607164 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.610432 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.611367  3350 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.611847  3350 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:56.603029 28603 rpcz_store.cc:276] 0709 12:20:55.430037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.464463 (+ 34426us) service_pool.cc:224] Handling call
0709 12:20:56.602343 (+1137880us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b54000be354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:56.602479 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67641216}
I20260709 12:20:56.581382  3992 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.582790 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.472879  3919 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.624403 28748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:56.625087 28748 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:56.584957  3911 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:56.626786 28748 raft_consensus.cc:614] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:56.627148  3919 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.627640  4001 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:56.584653 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:56.579046  4023 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.571290  4019 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.590516 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.600211  4026 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:56.591645  3902 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.635887  3992 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.592243 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:56.591969  3831 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.636385  3992 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:56.637053 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44906.9us
I20260709 12:20:56.639348  3831 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.596200 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:56.619194 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.640928 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:56.608894 28606 rpcz_store.cc:276] 0709 12:20:55.413713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.413979 (+   266us) service_pool.cc:224] Handling call
0709 12:20:55.414291 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.024520 (+610229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.024554 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:56.024609 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:56.024674 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:56.608132 (+583458us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54001234d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:56.608167 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:56.608311 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402827008}
I20260709 12:20:56.641469 28598 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:56.641767  4020 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:56.641984 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.642649  4020 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:56.622453 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:56.643227  3973 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 1.637s	user 0.021s	sys 0.007s
I20260709 12:20:56.623829 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:56.644070 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.646179 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.643272 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.647701 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.648206 28606 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:56.649097 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.649842 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:56.641239 29327 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:56.626258 28601 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:56.589236 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.618162 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:56.630638 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 43874.8us
I20260709 12:20:56.630612 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.588145  3298 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.590483  3881 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:56.633585 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:56.569815  3330 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:56.652599 28605 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:56.652793 28598 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
W20260709 12:20:56.653208 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 104750us
I20260709 12:20:56.657752 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.691674 28681 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:56.660409 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:56.661266 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:56.672902 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:56.660336  3298 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:56.678284  3992 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.645747  4009 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:56.572305  4016 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 12:20:56.677044  3985 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:56.673643  4028 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:20:56.703091 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.656311  3913 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:56.573060  3949 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.692796 28750 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:56.694281 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:56.697494 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 79438.2us
I20260709 12:20:56.699918 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.700167 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.711515 28682 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 27: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:56.700811 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.701676 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.715206 28605 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 29.
I20260709 12:20:56.702605 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.705050 28607 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:20:56.709205 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.726675 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:56.728085 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.728524 28681 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:56.691059  3899 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.734118 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.741523 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:56.742022 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.738432 28681 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:20:56.739784 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.689186  3796 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:56.747685 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.748363 28674 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:56.749017 29326 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:56.750087 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.628989  4023 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.764128 28676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:20:56.708451  3719 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:56.751827 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:56.784407 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:56.725562  3261 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:20:56.787147 28750 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 29.
I20260709 12:20:56.735569  3913 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.768702 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:56.788630 28679 raft_consensus.cc:2368] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:56.735224  3915 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:56.789817  3915 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.751024 29326 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:56.752219 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:56.776180 28676 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:56.795136 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.795928 28676 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:56.797969 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.727497  4009 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:56.803632 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51919.7us
I20260709 12:20:56.802917 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.804731 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.733532  3851 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:56.742594  3330 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:20:56.819648 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 92289.5us
I20260709 12:20:56.820027 28679 raft_consensus.cc:2410] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 12:20:56.798992  3962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.023s	sys 0.046s
I20260709 12:20:56.806455 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.827325 29327 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:56.803675 29326 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 16.
I20260709 12:20:56.828116 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.804380 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:56.820197 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.826447 28603 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:56.826138 28607 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 27.
I20260709 12:20:56.656507  4026 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.829895 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:56.831429 29320 raft_consensus.cc:2410] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:20:56.832163 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:56.832407 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.833184 28681 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:20:56.833621 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:56.833926 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.747565  3895 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 12:20:56.799791  3719 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:56.837728 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.740634  3949 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.767514  3899 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:56.838915 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.841003 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:56.857932 29326 raft_consensus.cc:2410] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:20:56.783399  3814 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:56.727099  3985 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.844344  3724 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:56.845153 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:56.846304  4031 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:20:56.851238  3921 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:20:56.852720  4033 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:20:56.852839  3961 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:56.853713  4011 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.237s	user 0.000s	sys 0.003s
I20260709 12:20:56.854238  3261 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:56.776885  3796 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.857897 28680 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
W20260709 12:20:56.838519  3962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.026s	sys 0.057s
I20260709 12:20:56.843488 28676 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:56.841861  3924 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.706s	user 0.007s	sys 0.003s
I20260709 12:20:56.864738 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:56.866170 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:56.781888  4002 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:20:56.948333 29320 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:56.840591  3698 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:20:56.950803 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 224185us
I20260709 12:20:57.003278 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:56.843428  3719 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:57.006371 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:57.007257 28674 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:20:56.855739  4023 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:56.958864  4029 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:20:56.960937  3899 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:56.982542 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 184256us
I20260709 12:20:56.948173  3814 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.825484  3851 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:56.994845 29326 raft_consensus.cc:2410] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:20:56.947973  3724 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.947721  4028 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:56.947544  3998 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:57.005301 28676 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:56.864233  4012 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:57.008885 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 175314us
I20260709 12:20:56.967952  3895 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:57.014108 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:57.016034 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:56.826674  4009 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.020678 29320 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 29.
I20260709 12:20:56.987771  3961 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:57.017354 29290 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:56.991012  3921 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:57.006485  3698 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.010334  3798 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.003496  3924 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.041160 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.043936  4012 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:57.045288  3851 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.056600  4005 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:57.057948  4036 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 12:20:57.059254 29325 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:57.060715  4009 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.063169  3985 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:20:57.091956 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77921.1us
I20260709 12:20:57.067394 28605 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:57.066983 28600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3190) took 1636 ms. Trace:
I20260709 12:20:57.093549 28600 rpcz_store.cc:276] 0709 12:20:55.430529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.503562 (+ 73033us) service_pool.cc:224] Handling call
0709 12:20:55.503879 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:55.771480 (+267601us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:20:56.042430 (+270950us) log.cc:844] Serialized 14 byte log entry
0709 12:20:56.303956 (+261526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:56.304024 (+    68us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:56.304081 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.066738 (+762657us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002c1354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:57.066784 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.066925 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":307634,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":67983,"spinlock_wait_cycles":529017472,"thread_start_us":531519,"threads_started":2,"wal-append.queue_time_us":350464}
I20260709 12:20:57.094800 28674 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 29.
I20260709 12:20:57.095510 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.069072 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3181) took 1655 ms. Trace:
I20260709 12:20:57.039911 28676 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:20:57.071251 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.021726  4023 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:57.021289  3962 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:57.030243  3724 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:57.037425  3937 consensus_meta.cc:287] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 1.589s	user 0.013s	sys 0.017s
W20260709 12:20:57.070210  3848 consensus_meta.cc:287] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.004s
I20260709 12:20:56.996424  3330 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.032692  3915 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.069072  3698 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:57.040957  3881 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.065529  4002 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:57.096197 28599 rpcz_store.cc:276] 0709 12:20:55.414005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.422627 (+  8622us) service_pool.cc:224] Handling call
0709 12:20:55.422917 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:55.479386 (+ 56469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.068821 (+1589435us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b54000bde54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:57.069013 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12328320}
I20260709 12:20:57.129293 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.097452 28753 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 27: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:57.101275 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:57.108996 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 81407.9us
I20260709 12:20:57.131703 28720 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.035954  4028 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.130374 28604 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:57.192890 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.193778 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.089934  4020 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:57.120146 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 290316us
I20260709 12:20:57.065857  3961 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.224349 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.195286 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:57.225795 28676 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:57.226619 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.037710  3998 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.235463 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:57.238025 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 382403us
I20260709 12:20:57.236315 28604 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:20:57.248072 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.252170 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.254506 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.251281 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:57.258157 28600 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:57.259553 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.264315 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.269217 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:57.103614  4023 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.263347 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:57.270275 28676 raft_consensus.cc:2368] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 26. Current term is 27.
I20260709 12:20:57.278627  3851 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:57.279243  4037 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.280076  4037 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:57.283387  4039 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:20:57.285244  4026 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.286386 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:57.287199  4046 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:57.287607  4046 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:57.287967  4046 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:57.289258  3961 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.249689  4012 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:57.290539  4012 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:57.293164  4051 log.cc:927] Time spent T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:57.088763 28496 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 12 to 19, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 19 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.255988  3902 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:57.114816  3962 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.294868 28647 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.128556  3937 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.128752  3848 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:57.261108  3298 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 12:20:57.279188  3851 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.308112 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.310817 29321 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:57.309877  4047 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:20:57.229276  4002 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:57.297111  3350 consensus_meta.cc:287] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.004s
I20260709 12:20:57.318557 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.323338 28674 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:57.319906 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.325201 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.326488 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.273265  3949 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.295478  3730 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:20:57.308840  4040 log.cc:927] Time spent T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:20:57.340737 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:20:57.332929 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 213632us
I20260709 12:20:57.344805 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.225864  3921 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.294446  4012 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.337889 28675 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:57.299045  4037 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.349046 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.305096  4005 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:57.299747  3902 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:57.316186  3796 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.347496 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.369331 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.370959 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.348105 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.372284 28674 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:57.349851 29320 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:57.351045 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.374787  3814 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.380827 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.381729 29320 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:57.382929 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.339617  3730 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:57.379627 29290 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.385835 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.386575 28674 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:57.314670  3298 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.377624  3961 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:57.390712 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:57.391479 29320 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:57.377071  3902 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:57.387207 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 136034us
I20260709 12:20:57.335433  3350 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.385284  3730 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:57.397696  4037 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:57.404906 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:57.399484 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:57.391577  3924 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.397132  3961 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.416625 28571 leader_election.cc:400] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:57.417037 28571 leader_election.cc:403] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:20:57.427774 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.415194  3881 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:57.428903 29320 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:57.412497  4041 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:57.419767  4028 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.416522  3961 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:57.434166  3962 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.441627  3724 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.443463  3724 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.444685  4023 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.445046  3848 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.445792  4002 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.446671  3298 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.447132  4019 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.430054  3881 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.447995  3881 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:57.450578 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 3172) took 1090 ms. Trace:
I20260709 12:20:57.450946 28754 rpcz_store.cc:276] 0709 12:20:56.359714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.370424 (+ 10710us) service_pool.cc:224] Handling call
0709 12:20:57.450336 (+1079912us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540004a6d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:57.450471 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476438272}
I20260709 12:20:57.458201  4024 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:57.458667  4024 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:57.459534  4024 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.461146  3874 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.462296  3998 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.463639  3602 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:57.464079  3602 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:57.466300  3602 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.467721  3602 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:57.469767  3992 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:57.470223  3992 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:57.471133  3992 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.476981 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.478173  3730 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.484457  3730 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.486526  3903 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.490183  4032 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:20:57.490656  4032 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.491215  4032 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:20:57.490770  3881 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.490497  3719 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.493258  3719 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.494365 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.496109 29319 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 25. Current term is 26. Ops: []
I20260709 12:20:57.472415  3992 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:57.493258  3881 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.473702  4046 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:57.521293  3990 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 1.746s	user 0.001s	sys 0.002s
I20260709 12:20:57.527016  4010 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.528370  4008 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.530582  4032 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.532045  4046 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.532850  4032 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 30 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.532796  4024 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:57.571122 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 156444us
I20260709 12:20:57.573200 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:57.573601 28571 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:57.579866 28681 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:57.589619 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:57.591367 28756 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:57.593541 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:57.594851 28754 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:57.596150 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:57.599592 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.602301 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.604843 28605 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:57.605947 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.606333 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.606840 28605 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:20:57.607582 28600 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:57.608208 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.571532 28496 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 10 to 16, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 16 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:20:57.610857 28605 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:20:57.611142 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.614706 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.610240 28496 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 14 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 17 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:57.618996 29317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2151) took 1142 ms. Trace:
W20260709 12:20:57.584070 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 452314us
I20260709 12:20:57.621466 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3440) took 1025 ms. Trace:
I20260709 12:20:57.645474 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.647055 29322 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:57.648741 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:57.648978 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:57.650645 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:57.649724 28496 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 9 to 15, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 15 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.648375 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:57.657804 29322 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:57.663028 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:57.666046 29319 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:57.668329 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:57.668768  4026 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:20:57.670071 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.671620  3881 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:57.672478 28678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3558) took 2149 ms. Trace:
I20260709 12:20:57.672947 28678 rpcz_store.cc:276] 0709 12:20:55.522647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.522859 (+   212us) service_pool.cc:224] Handling call
0709 12:20:55.523157 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.004853 (+481696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.004905 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:56.004971 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:56.005023 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.671939 (+1666916us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54001be754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:57.672024 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.672259 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107105152}
W20260709 12:20:57.675979 28753 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60480 (request call id 3427) took 1263 ms (client timeout 1537 ms). Trace:
W20260709 12:20:57.676542 28753 rpcz_store.cc:269] 0709 12:20:56.412048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.560151 (+148103us) service_pool.cc:224] Handling call
0709 12:20:57.675461 (+1115310us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b5400337554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:57.675759 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145268480}
I20260709 12:20:57.678334 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:57.683413  3999 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:57.683615 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 110527us
I20260709 12:20:57.685145  4032 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:57.686259  4032 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.688352 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.691632  3110 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:57.693994  3110 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.695231  4053 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:57.696835  4016 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:57.699697  3995 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:57.700232  3995 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.700639  3995 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:57.702112  3372 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.680312 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:57.702358 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.708906  3565 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.712322  3625 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.714672  3733 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.684309  3999 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.719580  4032 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.720743  3918 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:57.721722  3924 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:57.722491  3924 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:57.726974 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46543.6us
I20260709 12:20:57.637895 28607 rpcz_store.cc:276] 0709 12:20:56.595769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.596000 (+   231us) service_pool.cc:224] Handling call
0709 12:20:57.621095 (+1025095us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b540022f954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:57.621276 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149316992}
I20260709 12:20:57.722854  3851 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.730952 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:57.732648 28603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3443) took 1136 ms. Trace:
I20260709 12:20:57.501163  3902 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.735895  3913 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.736969  3999 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.715623  4043 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:20:57.748279  3698 consensus_meta.cc:287] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.004s
I20260709 12:20:57.748126 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:57.749171 28607 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:57.748929  3698 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.750605 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:57.751226 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:57.751588 28756 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:20:57.752979 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:57.753772 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:57.754383 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:57.755374 28754 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:57.759332  3902 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.685039  4037 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:57.763883  4037 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.764326  4037 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:57.702891  3110 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.766415 28752 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:57.768651  3110 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.743465 28603 rpcz_store.cc:276] 0709 12:20:56.596574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.643838 (+ 47264us) service_pool.cc:224] Handling call
0709 12:20:57.664294 (+1020456us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54000a6c54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:57.732465 (+ 68171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418015616}
W20260709 12:20:57.771567 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:57.771960 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:20:57.755098 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 64229us
I20260709 12:20:57.622498 29317 rpcz_store.cc:276] 0709 12:20:56.474274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.474452 (+   178us) service_pool.cc:224] Handling call
0709 12:20:56.505284 (+ 30832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:56.689441 (+184157us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:20:56.989564 (+300123us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.366363 (+376799us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.366585 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:57.366664 (+    79us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:57.366742 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.516532 (+149790us) spinlock_profiling.cc:243] Waited 8.82 ms on lock 0x7b180047e840. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:20:57.615849 (+ 99317us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400610dd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:57.615947 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.616304 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13808,"prepare.queue_time_us":148605,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":2069,"raft.queue_time_us":15833,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":5459,"spinlock_wait_cycles":414990464,"thread_start_us":662047,"threads_started":2,"wal-append.queue_time_us":426250}
I20260709 12:20:57.762070 28600 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 27: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:57.762791 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:57.780581  3565 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:57.781081  3565 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:57.781558  3565 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:57.746470  3987 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 1.751s	user 0.004s	sys 0.001s
I20260709 12:20:57.727713  3860 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.789021 28603 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:57.784722 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.792306 28607 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:20:57.793511 28751 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:20:57.795476 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60480 (request call id 3424) took 1384 ms. Trace:
I20260709 12:20:57.798210 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 1969) took 3026 ms. Trace:
I20260709 12:20:57.798578 29323 rpcz_store.cc:276] 0709 12:20:54.771471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.773243 (+  1772us) service_pool.cc:224] Handling call
0709 12:20:54.773645 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:54.798238 (+ 24593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:54.798285 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:54.835053 (+ 36768us) log.cc:844] Serialized 26 byte log entry
0709 12:20:55.290100 (+455047us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:55.290164 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:55.290281 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.520032 (+2229751us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:20:57.797677 (+277645us) raft_consensus.cc:1685] finished
0709 12:20:57.797715 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.798009 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49752,"raft.queue_time_us":24183,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":23774,"spinlock_wait_cycles":51815296,"thread_start_us":421656,"threads_started":1,"wal-append.queue_time_us":860636}
I20260709 12:20:57.804565 28598 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:57.806303  3888 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.795873 28748 rpcz_store.cc:276] 0709 12:20:56.411114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.628993 (+217879us) service_pool.cc:224] Handling call
0709 12:20:56.629482 (+   489us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:56.629918 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:56.629944 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:56.659114 (+ 29170us) log.cc:844] Serialized 52 byte log entry
0709 12:20:56.995474 (+336360us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:20:57.013227 (+ 17753us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.025114 (+ 11887us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.489804 (+464690us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b18004e4ba0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe795358f 00007f6fe0992571 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd
0709 12:20:57.528958 (+ 39154us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b18004e4ba0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:20:57.794584 (+265626us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b18004e4ba0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a89716 00007f6fe3a9a287
0709 12:20:57.794888 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.795006 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.795067 (+    61us) raft_consensus.cc:1685] finished
0709 12:20:57.795082 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.795296 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":401821,"prepare.queue_time_us":520186,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":151838,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":42187,"spinlock_wait_cycles":22359424,"thread_start_us":347301,"threads_started":2,"wal-append.queue_time_us":336552}
I20260709 12:20:57.778731 28496 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 11 to 21. New cstate: current_term: 21 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.809679  3937 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:57.809880  3975 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 2.129s	user 0.004s	sys 0.001s
I20260709 12:20:57.811781 28607 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: []
W20260709 12:20:57.814775 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 84009.4us
I20260709 12:20:57.789944  4032 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:20:57.811666 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:57.817107  3888 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:57.819110  3888 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:57.822378 28604 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:57.817344  3937 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:57.824348  3888 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.825959  3888 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:57.830479 28599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3444) took 1233 ms. Trace:
I20260709 12:20:57.831542  3565 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.830859 28599 rpcz_store.cc:276] 0709 12:20:56.596852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:57.271685 (+674833us) service_pool.cc:224] Handling call
0709 12:20:57.272006 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:57.355550 (+ 83544us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:57.579665 (+224115us) log.cc:844] Serialized 14 byte log entry
0709 12:20:57.669028 (+ 89363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:57.669144 (+   116us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:57.669216 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.830082 (+160866us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54003db3d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:57.830122 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.830309 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17800,"prepare.queue_time_us":151092,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":18622,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":253,"spinlock_wait_cycles":205982848,"thread_start_us":282596,"threads_started":2,"wal-append.queue_time_us":80293}
W20260709 12:20:57.833145  4075 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:20:57.835151  3320 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.844724  3565 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.823293  3913 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:57.845758  3913 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:57.847177  3913 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.858583  3971 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:57.861007  3971 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.863893 29323 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:57.858932  3974 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:57.864897  3974 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:57.865557 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:57.866080  3974 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.866714 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:57.818389  3924 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.878716 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:57.879992  3920 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:57.852138  3350 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.866076 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:57.885205 28607 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:20:57.854725 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:57.864270  3971 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.898731  3798 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:57.899658  3798 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:57.902688  3798 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:57.892132  3703 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:57.907260  3703 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:57.907945  3703 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:57.909082  4043 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:57.909771  4043 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:20:57.914016  4074 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:20:57.918007 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 134525us
I20260709 12:20:57.923437 29319 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
I20260709 12:20:57.932590 29326 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:57.939882  3350 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:57.940665  3350 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.941810 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:57.942894  3350 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:57.943925 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:57.945194 29321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 1977) took 1306 ms (client timeout 1702 ms). Trace:
I20260709 12:20:57.945943  3565 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:57.946003  3724 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:57.929983  3971 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:57.951337  3937 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:57.943948 28601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 3183) took 2522 ms (client timeout 2236 ms). Trace:
I20260709 12:20:57.951372 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:57.945640 29321 rpcz_store.cc:269] 0709 12:20:56.638791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:56.660966 (+ 22175us) service_pool.cc:224] Handling call
0709 12:20:57.944720 (+1283754us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b540047b8d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:57.944984 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420427136}
I20260709 12:20:57.932636  4041 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
W20260709 12:20:57.960789 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 169448us
W20260709 12:20:57.961210 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 273737us
W20260709 12:20:57.953204 28601 rpcz_store.cc:269] 0709 12:20:55.420969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.445400 (+ 24431us) service_pool.cc:224] Handling call
0709 12:20:57.937728 (+2492328us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002c0454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:20:57.943709 (+  5981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533847296}
I20260709 12:20:57.966701 29327 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:57.962541  3937 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:57.959479  3698 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:57.968632  4041 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:20:57.960963  3913 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:57.978726 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:57.960189  3995 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:57.985247 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 43554.7us
I20260709 12:20:57.984145 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:57.977396  3565 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:57.980533  4041 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:57.991596 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:57.992215  3344 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:20:57.991266  3937 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:58.000082  3344 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:58.010360 28573 leader_election.cc:400] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20.
I20260709 12:20:58.012542 29326 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:58.006172  4016 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:58.008097  3920 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:57.997568  3913 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:58.024600 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.020877 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.019243 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.021903 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.020275 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3428) took 2740 ms. Trace:
I20260709 12:20:58.006330  3565 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.022189 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:20:58.026080 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48818.6us
I20260709 12:20:58.025172 28756 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:20:58.023386 28647 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:58.024356 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.023775 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:58.007130  3344 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.018296  3920 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:58.025751 28602 rpcz_store.cc:276] 0709 12:20:55.243125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:55.245341 (+  2216us) service_pool.cc:224] Handling call
0709 12:20:55.245728 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:55.772595 (+526867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:55.772624 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:57.420311 (+1647687us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b2c00058028. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:20:57.581387 (+161076us) log.cc:844] Serialized 26 byte log entry
0709 12:20:57.663454 (+ 82067us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:20:57.665903 (+  2449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:57.973323 (+307420us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54003d3454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:20:57.973385 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:57.973430 (+    45us) raft_consensus.cc:1685] finished
0709 12:20:57.973445 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:57.983436 (+  9991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225148160,"thread_start_us":77021,"threads_started":1,"wal-append.queue_time_us":160874}
I20260709 12:20:58.033211 29319 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:58.036036 28752 raft_consensus.cc:2368] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 26. Current term is 27.
I20260709 12:20:58.036952 28748 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:58.040736  3724 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:58.041392  3724 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:58.039309  3562 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:58.038197  3920 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:58.046958 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 66005.9us
I20260709 12:20:58.059966 28751 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:58.061605 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 67659.1us
I20260709 12:20:58.052426  3995 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.045413  4037 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:58.080602 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.085683 29321 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:58.085830 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:58.086778  4077 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:20:58.085702 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:58.088016 29326 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:58.096555 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:58.097126 29323 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: []
I20260709 12:20:58.097308 29327 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:58.101123 29321 raft_consensus.cc:1240] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:58.100296  3905 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:58.103585  3905 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:58.059825  4041 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.119597 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:58.120601 29321 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:58.121814 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:58.124758  4026 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:20:58.125626  4000 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:58.130138 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:58.053318  3724 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.131114 29319 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
W20260709 12:20:58.133739 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 70734.4us
W20260709 12:20:58.134356  3961 consensus_meta.cc:287] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.012s
I20260709 12:20:58.135016 28573 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:58.135418 28648 leader_election.cc:336] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Timed out: RequestConsensusVote RPC to 127.26.205.131:44843 timed out after 1.619s (SENT)
I20260709 12:20:58.135929 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:58.136410  4026 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:58.136881  4026 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:58.137287  4026 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:58.139562 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.141104  3565 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:58.141767 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 99157.8us
I20260709 12:20:58.142853  4016 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:58.134965  3961 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.144366 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:58.146396  3913 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:58.146543  3961 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:58.147680 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:20:58.148639  3995 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:58.152838  3995 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.153373  3995 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:58.154624  4041 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:58.157723  3820 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:58.158360  3820 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.158803  3820 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.149940 28571 leader_election.cc:400] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 26. Current term is 27.
W20260709 12:20:58.150264 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 171206us
I20260709 12:20:58.163288 28571 leader_election.cc:403] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:20:58.163834 28573 leader_election.cc:400] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 26. Current term is 27.
I20260709 12:20:58.170377  3995 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.173285  3905 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:58.152872  4037 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:20:58.184968 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.185601 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.186309 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.176630  3565 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:58.190032  4000 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:58.193572 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.194592 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:58.195591  3698 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:58.183873  3820 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.182530  3913 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:58.178953  3974 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 26. Current term is 27.
I20260709 12:20:58.202219 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.207214  4000 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:58.211400 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.211705  4000 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:58.213299 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 77929.1us
I20260709 12:20:58.189657  3703 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.214473 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:58.215981  3913 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:58.216396  3913 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.216789  3913 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:58.217623  3919 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:20:58.218606  3919 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:20:58.219602  3851 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:58.219980  3851 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:58.220822  3900 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:58.221230  3900 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:58.222184  3900 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.223290  3900 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:58.228375 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.228868 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.229280 28680 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:58.230141 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.231510 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.232822  3698 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:58.232694  4001 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:58.233286  3698 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:58.233928  4001 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:20:58.234349  4001 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:58.235195 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.235343  4001 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:58.220862  3851 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.244633  3565 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:58.250008 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.252732 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.235419  3995 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.259696  3851 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:58.261489 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:58.266556 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.268234 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.268771  4001 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:58.269322 28678 raft_consensus.cc:2393] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:58.271656  3703 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.272715  3800 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:20:58.272842  3565 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:20:58.274363 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 80012.6us
W20260709 12:20:58.264737 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 84692.9us
I20260709 12:20:58.278417 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.278702 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:58.279359 28679 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:58.279464 29321 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:58.234354  3698 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.283841  3698 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:58.286856  3800 consensus_queue.cc:1059] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:20:58.292469 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.295101 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:58.297541  3920 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.299577  4043 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.301158  4026 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:58.301378 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.303258 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:58.310159 28678 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:58.288123 28679 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:58.325527 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.326321 28674 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:58.304829  3913 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.305912  4037 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:58.339608 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.332736  3918 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:58.340651 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.343722 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.344863 29326 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:58.342375 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:58.327144  3860 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:20:58.350299 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:58.345549 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 50533.6us
I20260709 12:20:58.328039  3703 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:58.352631 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.354573 28675 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:58.355304 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:58.343636  3918 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.355301 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:58.364705 28676 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:20:58.368114 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.369701 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.375718 28602 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:58.377938 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.378041 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.380143 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.360451  3918 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:58.383966 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:20:58.386955 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 125593us
I20260709 12:20:58.387281  3989 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:20:58.390544 28607 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:58.391839 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.392668 28603 raft_consensus.cc:2368] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
I20260709 12:20:58.393309 28752 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:20:58.382951 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.371807  3350 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:58.403889 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.404140 28756 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:58.405287 28680 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 27: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:58.376585  3820 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:58.406927 28674 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:58.344198  3320 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:20:58.403703  3565 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:20:58.414351 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 67429.9us
I20260709 12:20:58.415400 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:58.419247 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.420042 28675 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:20:58.420994 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.421836 28603 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:58.424721 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.425942 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.426111 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.426474 28607 raft_consensus.cc:2376] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20. Re-sending same reply.
I20260709 12:20:58.427340 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.427423 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.428200 28607 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:58.428561 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.429646 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.430173 28606 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:20:58.432492  3873 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:58.432991  3873 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:58.433676  3110 raft_consensus.cc:3055] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:58.433903 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.434166  3110 raft_consensus.cc:740] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:58.434594 28754 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:58.435350 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.414093 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.435279  3110 consensus_queue.cc:260] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.436718 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.438162 28673 raft_consensus.cc:1240] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:20:58.438761 28599 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:20:58.439307 28673 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:58.439857 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.440514 28604 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:58.443040  3320 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:58.443150 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.443483  3320 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:58.443838 28752 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:20:58.444552  3860 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:58.444749 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.444407  3320 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.445363 28751 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:20:58.445180  3860 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.445777  3320 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:58.432579 28679 raft_consensus.cc:1240] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: []
I20260709 12:20:58.433003 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.447571  3860 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.449285  3858 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.449681  3350 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:58.450176  3350 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:58.450579  3350 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:58.449136 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:20:58.453469  4037 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:58.453857  4037 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:58.454239  4037 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:58.454756 28601 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:58.433929  3873 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.456971  3873 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:58.449774  3858 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:58.461249  3888 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.003s
I20260709 12:20:58.461875 28755 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:58.464254 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.464910 28675 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:58.467429 28756 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:20:58.467512 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.468163 28603 raft_consensus.cc:2376] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 27. Re-sending same reply.
I20260709 12:20:58.472968 28605 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:58.473162  4026 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:20:58.474546 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 119300us
I20260709 12:20:58.476526 28571 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:58.477005 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.478782  3831 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:20:58.477773 28605 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:58.481036 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.481458  4043 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.481863 28603 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:58.482791  3858 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.482950  3913 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.365360  3995 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:20:58.489789 28677 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:20:58.457532 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:58.414417  3565 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:20:58.484236 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 59660.8us
I20260709 12:20:58.435494 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:58.492444 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.489115 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:58.492869 28606 raft_consensus.cc:2468] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 30.
I20260709 12:20:58.493289 29323 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
W20260709 12:20:58.494908 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 81613.8us
I20260709 12:20:58.495357 28754 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:58.495278 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.496368 28678 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:58.498493 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.499490 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:58.410233  3988 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:58.499963 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:58.502974 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 182782us
I20260709 12:20:58.504673 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.506247 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:58.507510  4083 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:20:58.507802 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.508404 28752 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:20:58.509716 28752 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 29. Current term is 30. Ops: [29.19-29.19]
I20260709 12:20:58.513245  3915 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:58.513900  3915 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.514904  3920 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.516731 28600 raft_consensus.cc:1217] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Deduplicated request from leader. Original: 19.13->[20.14-29.19]   Dedup: 23.16->[25.17-29.19]
I20260709 12:20:58.517310 28600 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 29. Current term is 30. Ops: [20.14-29.19]
I20260709 12:20:58.494571  3565 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:58.517876 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.518821 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.507529 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.523708 28602 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:20:58.498370  3937 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:20:58.528357 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.516139  3915 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.528879 28682 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:20:58.501152  3625 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:58.526594 28721 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:58.535198 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.531895 28598 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:20:58.533444 28755 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:58.539990 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.536099 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.541917 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.529795  3110 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:58.547076 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.545292 28571 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:58.549750 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 49846.7us
I20260709 12:20:58.550709 28573 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:20:58.554607 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 97211.5us
I20260709 12:20:58.554906 28601 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:58.540597  3344 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:58.527801  3988 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.536360  3625 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:58.560802 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.566087 28598 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:58.542882  3937 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.568914 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.542253  4000 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:20:58.567363 28603 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:58.558349  3995 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:58.556758  3974 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:58.588961 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:58.560899  3344 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:58.544662  3905 consensus_queue.cc:1059] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:20:58.573387  4000 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.624576 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.561517  3919 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:20:58.627879 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.628502 28605 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:58.623483 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:58.609947  3344 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:58.609572  3995 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:58.641247 29321 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:58.618643  4000 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:58.577914  3937 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:58.648716  4085 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:20:58.653610 28747 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:20:58.654047 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:58.639217  3961 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:58.661749 29326 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:58.612309  3974 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:58.677079  3565 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:58.681232  3987 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:20:58.654299  3860 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:20:58.686283  3860 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:58.686789  3860 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:58.687299 28598 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:58.669638 28648 leader_election.cc:400] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
I20260709 12:20:58.693176 28648 leader_election.cc:403] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:20:58.708796 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:20:58.713388 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.713630 28755 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:58.717748 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:58.720692 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.721145 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.706830  3851 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
W20260709 12:20:58.725265 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.726354 28748 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 19: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:20:58.727152 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60278.5us
I20260709 12:20:58.727844 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:58.734998 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:58.738433 28675 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:58.739605 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:58.739605 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:58.740953 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:58.741285 29326 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:58.741587 28754 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:20:58.660619  3625 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.740516 28605 raft_consensus.cc:2468] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:58.687856  3860 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:58.746208 28751 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 27: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:20:58.748780 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:58.749734 28598 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:58.750057 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:58.751461 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:58.752254  3905 raft_consensus.cc:2764] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:20:58.752512  3625 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:58.752903  3905 raft_consensus.cc:2764] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:20:58.754019  3905 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:20:58.755264  3915 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:20:58.755986  3915 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:58.756930  3860 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:58.760610  3913 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:58.710654  3858 consensus_queue.cc:1059] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:20:58.773204 28755 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:20:58.738103 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:58.692348  4037 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:58.778174 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 199885us
I20260709 12:20:58.774026  3851 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:58.786392 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48359.1us
I20260709 12:20:58.788064 28722 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:58.778810  3724 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:58.791963 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:58.737223  3995 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.779848  3988 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:58.792649  3989 raft_consensus.cc:2804] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:20:58.789104  3888 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:20:58.792412  4024 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.769438  3974 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.789572  3851 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.827343 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:58.849560 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 98180.1us
I20260709 12:20:58.851275  4093 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:20:58.823446  3320 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:58.825637  3888 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:58.859347  3320 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:58.848935  3703 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.864179  3320 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:58.868599  4092 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:20:58.869148  4092 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:58.870018  4092 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:58.873351  4086 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:20:58.855599  3989 raft_consensus.cc:697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:58.885812  4037 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:58.886991 28673 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:20:58.864485  3915 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:58.863658  3888 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:58.863015  3900 raft_consensus.cc:3055] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:58.863250  3565 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:58.825243  3724 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:58.898308  3698 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.004s
I20260709 12:20:58.861263  4041 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:20:58.893661  3900 raft_consensus.cc:740] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:58.890621  3703 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.854029  4024 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:58.893821  4043 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:58.911281 28603 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:58.898797  3320 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.878479  3798 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:20:58.913471 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 178577us
W20260709 12:20:58.944263 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 88249.6us
I20260709 12:20:58.947588 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:58.917236 28750 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
W20260709 12:20:58.902835 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 203835us
I20260709 12:20:58.954845 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.956017 28681 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:20:58.957011 29321 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:20:58.959542 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:58.960292 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.957477 28647 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:58.964705  4096 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:20:58.965866 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:58.964895 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.909933  4041 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 26.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:58.968804 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:58.969017 29323 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:58.969667 28675 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 26: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:58.915050  4093 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:58.972632  3350 consensus_meta.cc:287] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.522s	user 0.016s	sys 0.004s
I20260709 12:20:58.975704 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:58.981882 28756 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 17.
W20260709 12:20:58.984722 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.903138  3918 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.986905 28722 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:58.990906 29327 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: []
I20260709 12:20:58.991828 28678 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:20:58.992636  3110 raft_consensus.cc:2804] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:58.993436  3110 raft_consensus.cc:697] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:58.995882 28603 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:58.980603  4041 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:59.000196 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.975871  4096 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:20:59.001685 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:58.999316 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:58.980772  4093 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:20:59.003562 28753 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21. Ops: []
W20260709 12:20:59.003522 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 176259us
I20260709 12:20:59.012125 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:59.011505  3110 consensus_queue.cc:237] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:58.991334  4043 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:59.020517  4095 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.006s
I20260709 12:20:59.023208  4095 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:59.023574  4095 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:58.984781  3350 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.030519 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.002274  3565 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:20:58.985803  3989 consensus_queue.cc:237] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:59.039129  3703 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.024669  3937 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.039186  4100 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:59.044955 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:58.991981  3900 consensus_queue.cc:260] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:59.074792 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 108992us
I20260709 12:20:59.026042  4043 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:59.030083  3798 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:20:59.076326 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 114708us
I20260709 12:20:59.077900 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.096722 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:20:59.097962 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 100430us
I20260709 12:20:59.099475 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:20:59.070784  3961 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:20:59.024511  3917 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.114s
W20260709 12:20:59.160604 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 61229.4us
I20260709 12:20:59.138067  3900 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:20:59.173398 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 95625us
I20260709 12:20:59.069054  3820 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:20:59.178979 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 90377.1us
I20260709 12:20:59.180900 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.178619 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:20:59.181723 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 85121us
I20260709 12:20:59.090090  3798 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:59.189476 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:59.077216  4024 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.173370  4098 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:20:59.229943 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:59.096323  3703 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:59.235023 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:59.236402 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:59.258659 28604 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:20:59.236915 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:20:59.174371  3995 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:20:59.024391  4095 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.254822 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:59.235666 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:20:59.159056  3913 consensus_queue.cc:1059] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.071s
I20260709 12:20:59.264619 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:59.268292 28674 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:59.232122  3798 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:59.229890  3320 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.236104  3971 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:59.278116 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 88737.9us
W20260709 12:20:59.263274  4102 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:20:59.293990 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:59.280027 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 105616us
I20260709 12:20:59.280212  4107 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:59.281390 29323 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:20:59.282687 28676 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
W20260709 12:20:59.278796  3344 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.004s
I20260709 12:20:59.252159  4026 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:20:59.265925  4094 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:59.285183  4095 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:59.286885  3350 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.288291  3961 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.293715 28751 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:59.402873 29321 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:59.403120 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:59.295142 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.234669  3820 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:59.390136 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.384238 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:59.401804 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:59.417846  4106 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:20:59.382469  3971 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:59.381635  3344 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:59.298391  4107 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:59.277519  4092 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.405047  4043 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:20:59.436214 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 141168us
I20260709 12:20:59.439049 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.439800  3320 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:59.440164  3320 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:59.440577  3320 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:59.441075 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.298549  3995 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:20:59.442332  3995 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.382246  4094 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:20:59.444633  4094 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:59.448333  3320 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.449949  4098 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:20:59.451342  3320 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.452670  4098 consensus_queue.cc:1059] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:59.453378 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.453493  4098 raft_consensus.cc:3055] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:59.454000  4098 raft_consensus.cc:740] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:59.454841  4098 consensus_queue.cc:260] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:59.455158 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.456305  3110 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:20:59.457156  3110 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:20:59.457924  4098 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:59.405895  3800 raft_consensus.cc:3055] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:20:59.472364 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:59.475304 29317 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:59.480268 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:20:59.428998  3698 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:59.488422  4111 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:20:59.490715  4113 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:20:59.472262  4092 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.436939  3917 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:59.437820  4107 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:59.438038  4099 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:59.523875 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 141213us
I20260709 12:20:59.532186 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:59.530048 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 503400us
W20260709 12:20:59.513090  4103 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 12:20:59.474335  3800 raft_consensus.cc:740] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:59.539642 29323 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:20:59.539992 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.540877 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.468219  4094 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.522581  3917 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:20:59.551875 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:20:59.549463 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 94369.9us
I20260709 12:20:59.621366 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 30 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:59.582351  3110 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:20:59.518982  3698 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.633061 28678 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 29.
I20260709 12:20:59.491765  4024 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 7 to 12, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:20:59.635392 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:59.637264 28676 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:20:59.638892 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:59.639485 29325 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:59.638700 28675 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:59.538964  4016 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.094s
I20260709 12:20:59.556195  3917 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:59.643747 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:59.644340 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:59.640197 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:20:59.554906 28750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:59.682286 28750 raft_consensus.cc:606] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:59.682667 28750 raft_consensus.cc:614] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:59.638669  3905 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:59.706099 28756 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:20:59.724697 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:20:59.723062 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:59.705785  4093 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.000s
I20260709 12:20:59.733054  3820 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.740548 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:20:59.741328 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 189527us
I20260709 12:20:59.741670  3698 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.625861  3971 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:20:59.747740  3888 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.845s	user 0.011s	sys 0.000s
I20260709 12:20:59.748189  3344 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.684386  4092 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.705672  3905 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:20:59.645895  3798 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.778133 29320 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 16: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:20:59.782371 29322 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:20:59.727941  4118 raft_consensus.cc:3055] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:20:59.788403 28756 raft_consensus.cc:1240] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:59.789112 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:59.782116 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:59.784178 28755 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:20:59.781505 28721 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:20:59.785526 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:59.790897 28749 raft_consensus.cc:606] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:20:59.788679 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:59.791553 28749 raft_consensus.cc:614] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:59.795696 28752 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:20:59.781404  4000 consensus_meta.cc:287] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 1.122s	user 0.012s	sys 0.000s
I20260709 12:20:59.779080  3820 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.786978  3905 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:59.799817 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.788309  4094 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.772887  4093 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.796505  3344 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.788651  4118 raft_consensus.cc:740] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:20:59.783051  3888 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.826438  3989 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:20:59.835443 28751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:59.836048 28751 raft_consensus.cc:606] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.836390 28751 raft_consensus.cc:614] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:59.815719  3820 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.838449  3820 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.838694 28747 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:20:59.824424  4092 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:59.841022  3918 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.843572  4104 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:20:59.843993  4104 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:20:59.804934  4000 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.844995  4104 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.846424  4104 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:20:59.846815  4000 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.850093  3724 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.854882  3800 consensus_queue.cc:260] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:59.866652  4092 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:20:59.833447 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45708us
I20260709 12:20:59.829656  3344 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:20:59.816841  4125 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:59.880051 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:59.880757 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.880959 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:59.881860 29327 raft_consensus.cc:2410] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
W20260709 12:20:59.883747 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.888154 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:59.892136 28681 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:59.900550 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:59.901080 28754 raft_consensus.cc:2368] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23.
I20260709 12:20:59.901172 28675 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:20:59.901906 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:59.903664 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:59.902024 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:20:59.904395 28756 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:20:59.909332  3798 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.913074 28748 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:20:59.914379 28755 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:20:59.920707 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:20:59.925635  3900 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.001s
I20260709 12:20:59.927570  3888 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:20:59.936187 29317 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
W20260709 12:20:59.934957 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46842.4us
I20260709 12:20:59.942653 28675 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:20:59.943900 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:20:59.934521 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:20:59.945269 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:59.948140 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:59.949297 28678 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:20:59.949913 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:20:59.861462  4094 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:20:59.933609  4100 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.002s
I20260709 12:20:59.953428  3344 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.951288 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:20:59.886018  3703 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:59.955916 28571 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:20:59.979099 28752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:20:59.961884  4100 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:59.989228 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 157971us
I20260709 12:20:59.960911  4110 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:59.980858 28752 raft_consensus.cc:606] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:20:59.948634  3974 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:20:59.976263  4092 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:59.995467 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:20:59.997327 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 111722us
I20260709 12:20:59.999323  4093 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:20:59.999706  4107 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:00.000329  4098 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.004s
I20260709 12:20:59.982561  3971 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:20:59.974198  3703 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:20:59.982324  3820 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:59.960618  4094 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.014385 29323 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:59.968201  3995 consensus_queue.cc:1059] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:20:59.994828  3988 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.015303 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:20:59.933315  4125 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.042083 28681 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:21:00.043157  4125 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.044651 29325 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:00.033094  3989 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:00.029387  3851 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.014230  4100 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:00.049048  4100 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.050081  4107 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.019371  3820 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.050947  3820 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:00.051349  4100 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:00.052778 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:00.036453 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.053565 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:00.055701  4137 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:00.056003  3919 raft_consensus.cc:3055] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:21:00.035982  4094 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.056452  4137 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:00.056607  3919 raft_consensus.cc:740] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 29 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:00.057016  4137 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.059757  4137 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.005728  4092 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:00.060724  4092 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:00.036810  4041 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:00.036937  3724 consensus_queue.cc:1059] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:21:00.062387  4041 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:00.015431  4115 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:21:00.062978  4041 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:00.055073 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:00.069653  3851 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:00.070075  3851 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:00.070472  3851 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:00.037680  3971 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.076053  3971 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.076845 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:00.077445 28677 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:00.039399  3988 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.041287  3703 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.044206  3905 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.039220 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.055739 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:00.086115 28747 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
W20260709 12:21:00.080015 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 84622.6us
I20260709 12:21:00.038527  3917 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:00.078974 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 115201us
I20260709 12:21:00.088609 28682 raft_consensus.cc:1240] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:00.089371  3988 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:00.089968 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 74990.4us
I20260709 12:21:00.091531 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.092610  4037 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:00.093034  4037 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:00.093410  4037 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:00.094015 28721 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:00.096061 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.097532 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.100455  3831 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:00.100991 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:00.101068  3831 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:00.102236  3831 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.103513  3831 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:00.105567 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:00.110275 28676 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:00.119122 28677 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:00.122938 28720 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.122994 28753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 3194) took 1760 ms. Trace:
I20260709 12:21:00.122255 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:00.108165 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:00.123658 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.126377 28680 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:00.123921 28753 rpcz_store.cc:276] 0709 12:20:58.363066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.370101 (+  7035us) service_pool.cc:224] Handling call
0709 12:20:58.370409 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:59.013078 (+642669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.122777 (+1109699us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003fff54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:00.122940 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453827328}
W20260709 12:21:00.125053 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 70093.9us
I20260709 12:21:00.132025 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:00.134407  4109 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:00.134992 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.136253 28720 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:00.136513 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.136650  4096 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:00.137272  4096 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:00.137578 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:00.129660  4043 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:21:00.138167  4096 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.139254  3820 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.130103  4093 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.011s
I20260709 12:21:00.140607  4094 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:00.123871  4107 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.142336  4094 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:00.142632 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.143301 29321 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:00.144467 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.123391  4138 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:00.131145  3961 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:21:00.147349  4043 raft_consensus.cc:2804] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:00.147954  4043 raft_consensus.cc:697] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:00.138401  3971 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:00.149197  3971 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:00.148916  4043 consensus_queue.cc:237] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.149606  3971 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:00.150007  3971 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:00.125013  4000 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:00.152539  4000 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:00.153430  4000 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.155352  3920 raft_consensus.cc:3055] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:00.155723  3920 raft_consensus.cc:740] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:00.156237 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.156858 29323 raft_consensus.cc:3060] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:21:00.156560 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:00.158242  4110 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:00.159327 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:00.160696 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.160943  4110 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:00.161357  4110 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:21:00.161689 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 52807.5us
W20260709 12:21:00.161975 28572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.132:46291 timed out after 1.670s (SENT) [suppressed 11 similar messages]
I20260709 12:21:00.162881 28679 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:00.156591 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.142109  4107 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.127432 29326 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:00.164742 29318 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:00.174536 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.181118 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.089419  3905 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.184018 29326 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:00.180739 28647 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:00.161711  4110 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:00.191022  4137 raft_consensus.cc:2764] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:21:00.197858 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.202821 29317 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:00.173899  3565 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:00.198506 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.200913  3917 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:00.206532 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 76160.4us
I20260709 12:21:00.219787 29326 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:00.203155 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:00.186956  4093 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:00.220705 29318 raft_consensus.cc:3055] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:00.221305 28721 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.223376 29323 raft_consensus.cc:2468] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:00.204396  4095 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:21:00.235611  3995 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:00.236199  3995 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.237805  4094 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.156544  3920 consensus_queue.cc:260] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.238358  3995 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.238274  4094 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.223905  4037 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.241091  3820 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.202126  3900 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:21:00.240428  4094 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.237581  3831 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:00.243963  3320 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:00.230947 29318 raft_consensus.cc:740] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:21:00.254133 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51067.3us
I20260709 12:21:00.251905 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:00.203292  4024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59654 (request call id 0) took 5338 ms. Trace:
I20260709 12:21:00.262293 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.259382  3320 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:00.263190  3320 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.258497 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:00.263662  3320 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:00.264235  3110 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:00.267638  3110 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.268586  3110 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:00.201628  4129 raft_consensus.cc:476] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Not starting pre-election -- already a leader
W20260709 12:21:00.289340 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:00.290408 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 128447us
I20260709 12:21:00.250883  3565 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:00.291630 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.292881 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.262197  3917 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:21:00.294384 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 128603us
W20260709 12:21:00.310217 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:00.327292 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 83090.6us
I20260709 12:21:00.340690 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.336100  3320 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.294611  3995 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:00.294179  3961 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:00.296337  4140 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:00.340137  3846 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.364032  3846 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.324941  4138 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:00.329879  4090 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:00.370428 28603 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:21:00.370347  3110 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.332643  3917 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:00.365487  4138 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.373306 29325 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:21:00.329520  3974 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:00.375051 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:00.375207 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:00.377254  4137 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.377086  4118 consensus_queue.cc:260] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.378131  4148 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:00.375121  4146 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.379338  3846 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.381212 28673 raft_consensus.cc:1240] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
I20260709 12:21:00.336920  4136 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.372558  3565 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:00.390743 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50149.6us
I20260709 12:21:00.368359  4140 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:00.373220  3350 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:00.400797 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:00.411358  3110 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.386919  3917 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:00.420221 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.400714  4146 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.413753 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 3090) took 1459 ms. Trace:
I20260709 12:21:00.412758 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:00.416632  3350 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 23 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:00.420154 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.421350 28598 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:00.417256 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:00.420933 29325 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:00.371531  3995 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.424144 28601 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 16.
I20260709 12:21:00.452596 29317 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:00.428210 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:00.420975 28673 rpcz_store.cc:276] 0709 12:20:58.954085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:58.954296 (+   211us) service_pool.cc:224] Handling call
0709 12:20:58.973727 (+ 19431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.381039 (+1407312us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540041cba0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f6dc0 00007f6fe3a811c0 00007f6fe3a82231 00007f6fe3a7ed8f 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c
0709 12:21:00.404799 (+ 23760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.413671 (+  8872us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461785472}
I20260709 12:21:00.456265 28680 raft_consensus.cc:2393] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 18: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:00.401588  3820 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:00.465932  3820 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.389443  4001 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 12:21:00.471122 28676 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:21:00.424080  4148 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.473104  3350 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.474946  4092 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:00.476138  4142 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:21:00.465282 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:00.483769 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.485385  3344 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:00.418983  4095 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.487208 29325 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:00.479851  4001 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.452761  4094 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:21:00.518453  4148 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.392066  3974 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.543555 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:00.519033 29317 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:00.519909 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:00.455317  3905 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:00.522241  4097 log.cc:927] Time spent T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 1.557s	user 0.008s	sys 0.026s
I20260709 12:21:00.262661  4024 rpcz_store.cc:276] 0709 12:20:54.857021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:54.868604 (+ 11583us) service_pool.cc:224] Handling call
0709 12:20:55.027780 (+159176us) log.cc:844] Serialized 508 byte log entry
0709 12:20:56.678754 (+1650974us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b54003b59a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39f8142 00007f6fe39d8eaa 00007f6fe39dfd53 00007f6fe39dfcd9 00007f6fe39dfc69 00007f6fe39dfc31 00007f6fe39dedfd 0000000000388634 0000000000388479 00007f6fe0992475
0709 12:20:57.477169 (+798415us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b18004da9a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39ffb26 00007f6fe39f949a 00007f6fe39f8714
0709 12:20:57.733018 (+255849us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b54003b59a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe39ffb26 00007f6fe39f949a 00007f6fe39f8714 00007f6fe39d8eaa 00007f6fe39dfd53 00007f6fe39dfcd9 00007f6fe39dfc69 00007f6fe39dfc31 00007f6fe39dedfd 0000000000388634
0709 12:21:00.176467 (+2443449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21696,"raft.queue_time_us":14257,"raft.run_cpu_time_us":16453,"raft.run_wall_time_us":3666885,"spinlock_wait_cycles":82478080,"thread_start_us":258395,"threads_started":1,"wal-append.queue_time_us":940988,"wal-append.run_cpu_time_us":9389,"wal-append.run_wall_time_us":1623785}
I20260709 12:21:00.522135 29318 consensus_queue.cc:260] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:00.522506 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44705.7us
I20260709 12:21:00.523517  3851 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.524108  4092 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.525002  3961 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:21:00.525861  4146 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:00.497339 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.530836 29319 raft_consensus.cc:1240] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:00.555932  3344 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.406306  4136 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:00.473141  4143 log.cc:927] Time spent T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:21:00.544891 28605 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:00.545578  4155 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:00.384951  4090 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.570644 29318 raft_consensus.cc:3060] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:00.570680 28682 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:21:00.542590 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:00.406333  4137 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.545831  4094 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:00.552932 28601 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:00.478227  4107 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:21:00.546202  4001 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.559793 28598 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:21:00.559846  3995 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.554793  3905 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.530458  3820 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.541909  4043 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:00.574858 28681 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:00.574981 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:00.577075  3110 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:00.585889  3110 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:00.578320 28678 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:21:00.530324  3917 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.603086 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:00.579164  4094 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:00.549655  4095 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.605474  4094 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.605922 29292 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.607191 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.586529  3344 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.585836 28600 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:00.587338  4124 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.587939 28675 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:21:00.589005  4130 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:00.589375  4041 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:21:00.591270  4090 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.593068  3110 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.593684  4136 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.594182  4043 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.596159  3851 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.596947 28605 raft_consensus.cc:1240] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:00.598615  4001 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:00.599156  3971 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:00.650199 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.650465  4043 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:00.579553  4155 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.651649  3971 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.615470 29318 raft_consensus.cc:1275] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:21:00.616007  4107 raft_consensus.cc:2764] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 12:21:00.632305 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.653008  4155 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.638096 28600 raft_consensus.cc:1240] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:21:00.638602  3989 raft_consensus.cc:993] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:00.654304  3989 raft_consensus.cc:1081] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:00.654742  3974 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.630676  4041 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.656685  4041 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.644769  3860 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.657473  3860 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.657716  3919 consensus_queue.cc:260] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:00.659117  3919 raft_consensus.cc:3060] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:21:00.659674  3860 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.660607  4107 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:00.648337  4156 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:00.680603 28601 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:00.683710 28601 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:21:00.622757  3961 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:00.557821  4140 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.608666  4092 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 12:21:00.682602  4107 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.687529 29292 leader_election.cc:400] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23.
I20260709 12:21:00.695770 29292 leader_election.cc:403] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:00.698915 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.706470 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:00.707136 28600 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:00.709022 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:00.710784 28601 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:00.630352  4124 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.635730  4130 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.696990  4137 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:00.721882 28605 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:21:00.743113 28601 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
W20260709 12:21:00.746445 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 203911us
W20260709 12:21:00.747045 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48248.3us
I20260709 12:21:00.747876 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.751619 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:00.753794 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:00.754442 28598 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:00.714287  4093 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:00.755703 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.719153  3565 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:00.757292 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.722601  3961 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23.
I20260709 12:21:00.834671 28753 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 23. Current term is 24. Ops: [23.16-23.16]
W20260709 12:21:00.762954 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 56017.6us
I20260709 12:21:00.783010 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.785516 28722 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:00.700663  4107 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.760329  4137 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.795449 29318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:21:00.798044  4130 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.801941 29319 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:00.803128 28600 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:00.803299  4124 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.804563 28679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1625) took 1261 ms. Trace:
I20260709 12:21:00.805147  4140 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:00.806435  3565 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:00.948179 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:00.945151 28679 rpcz_store.cc:276] 0709 12:20:59.542710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.543063 (+   353us) service_pool.cc:224] Handling call
0709 12:20:59.549581 (+  6518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.163403 (+613822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.804281 (+640878us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54003e21d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:00.804496 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410034048}
W20260709 12:21:00.948673 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 165753us
I20260709 12:21:00.811731  3905 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:00.813076 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.803292  3800 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:00.813851  4164 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:00.814342  3917 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.814982  4037 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:00.784829  4162 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:21:00.817360  3320 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:00.833024 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:00.838238 29325 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:00.962270 28747 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:00.852777 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.840426 29318 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:00.901069 28753 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:00.901216 28572 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.932998 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 30 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:00.940562 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:00.945071 28750 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:21:00.964177 29318 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:00.945691 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:21:00.946796 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 161330us
I20260709 12:21:00.942099 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:00.949065 28571 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.965664 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:00.816401  4000 consensus_queue.cc:1059] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 12:21:00.955752 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.957091 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:00.972013 28749 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 29.
I20260709 12:21:00.933684  3798 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:00.932286  4092 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:00.978443  4092 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.958726 29317 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:21:00.984088 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.984923 29317 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:00.958881 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:00.933642  4110 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.033s
W20260709 12:21:00.954825 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 122167us
I20260709 12:21:00.971324  3320 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:21:00.967733 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 66611.1us
I20260709 12:21:00.985883  3320 consensus_queue.cc:1243] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:21:00.967928 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:00.986742 28572 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:00.955471 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.843726  4146 consensus_queue.cc:1059] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 12:21:00.955891  4130 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:21:00.973299 29326 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:00.902637  4165 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.134s
I20260709 12:21:00.975183 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.973436 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.960070  4164 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.014962 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.977793  4136 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:01.005442 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.988463 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:00.953878  4166 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:00.983573 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:00.993145 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:00.994591 28747 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:21:00.932200  4137 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.992420  3798 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:00.996084  3974 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:00.995921  4163 consensus_queue.cc:1059] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:21:00.948760  4043 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:21:00.948948  3698 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:21:00.983139  3917 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.001039 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:01.002710 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.047226 29318 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.003011 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:01.025935 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60362.5us
I20260709 12:21:01.048532 29325 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:01.003502 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.046135  4164 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:01.050065 29326 raft_consensus.cc:2393] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:01.022926 29327 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:01.021135  3920 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:00.977353  4107 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:01.034396  3860 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:01.036718 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:01.036989  4165 raft_consensus.cc:3055] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:01.054021  4098 consensus_queue.cc:1048] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:21:01.058013  4165 raft_consensus.cc:740] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:01.037484  4170 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:01.059053  4170 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:01.060034  4170 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.064779  4043 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.065307  4043 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.067416  4043 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.068131  4130 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:01.069134  4130 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.071298  4146 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:01.039294 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.073624 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:01.075667  3988 consensus_queue.cc:1059] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:01.076599  3971 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:01.077118  3971 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:01.077939  3971 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.080600  4000 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:01.081254  4137 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:01.081452 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:01.002625  4160 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:21:01.038049  3320 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:01.082435  4092 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:01.083760  4157 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.440s	user 0.004s	sys 0.000s
I20260709 12:21:01.085605 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3608) took 1198 ms. Trace:
I20260709 12:21:01.081499  3988 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:21:01.085932 28674 rpcz_store.cc:276] 0709 12:20:59.887042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:59.887379 (+   337us) service_pool.cc:224] Handling call
0709 12:20:59.899985 (+ 12606us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:59.962368 (+ 62383us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:21:00.243650 (+281282us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b180036ece0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe74773c7 00007f6fe3a899a7 00007f6fe3a990bf 00007f6fe3a99038
0709 12:21:00.386784 (+143134us) log.cc:844] Serialized 14 byte log entry
0709 12:21:00.572177 (+185393us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:00.576635 (+  4458us) log.cc:844] Serialized 52 byte log entry
0709 12:21:00.576798 (+   163us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:21:00.576829 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:00.576876 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:01.056608 (+479732us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:21:01.085392 (+ 28784us) raft_consensus.cc:1685] finished
0709 12:21:01.085415 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:01.085547 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55219,"prepare.queue_time_us":33741,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":82179,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":12203,"spinlock_wait_cycles":74279040,"thread_start_us":292476,"threads_started":2,"wal-append.queue_time_us":243524}
I20260709 12:21:01.087808  4118 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:01.088367  3860 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:01.088792  3860 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:01.089646  3860 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.090495  4095 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.048014 29321 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:00.982818  3989 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:00.996347  4110 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.091825  3989 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:01.070035 29318 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:01.092728  3989 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.093291  4110 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.095836 28677 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:01.052960  3917 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.098409  3917 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.038165  4168 consensus_queue.cc:1059] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:01.100770 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:01.101385 28752 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:21:01.052419 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68923.7us
I20260709 12:21:01.014041  3703 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:01.011940  4094 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:01.055620 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62544.1us
I20260709 12:21:01.102685  3900 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:01.103298  3900 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.104346 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:01.049655 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.104758  4167 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:21:01.105176  3820 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:01.106747  4167 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:01.107251  3905 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:01.107657  3905 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.108018  3905 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:01.069586  3815 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:01.108646  3815 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.109057  3815 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:01.109665  4165 consensus_queue.cc:260] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.110949  4165 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:01.051244  4162 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:01.080842  3831 raft_consensus.cc:3055] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:01.041045  3798 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.112532  3831 raft_consensus.cc:740] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:01.112460  4162 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.113497  3831 consensus_queue.cc:260] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.106606  3820 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:01.112864  4138 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.115665  3320 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:01.115752  4138 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.116472 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1628) took 1041 ms. Trace:
I20260709 12:21:01.090893  3860 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:01.116881 28681 rpcz_store.cc:276] 0709 12:21:00.074593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.075681 (+  1088us) service_pool.cc:224] Handling call
0709 12:21:00.075982 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:00.601729 (+525747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:01.116203 (+514474us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b5400299354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:01.116399 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146771840}
I20260709 12:21:01.038205 28675 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:21:01.118108  4138 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.125532  4162 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:01.126896  3900 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:01.105365 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 55788.3us
I20260709 12:21:01.134685 28681 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:01.067925  4043 raft_consensus.cc:3055] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:01.138207  4043 raft_consensus.cc:740] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:01.138676 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.139400 28675 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:01.139279  4043 consensus_queue.cc:260] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.143395  4043 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:01.145957  4115 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:01.148098 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:01.149269  3820 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:01.153055 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:01.154302  4115 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:01.154680  4115 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:01.155062  4115 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:01.157456 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:01.158648 28598 raft_consensus.cc:1240] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: [18.12-22.14]
I20260709 12:21:01.158877 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:01.157665 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 30 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.159969  3820 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:01.159746  3815 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.157959 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:01.157312  4171 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 12:21:01.161258 28603 raft_consensus.cc:2368] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23.
I20260709 12:21:01.163574  3815 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.164299  4118 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.133329 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.173436 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.174132 28605 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 16.
I20260709 12:21:01.174531 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.174788  3974 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:01.176258 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:01.176683 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.177279 29321 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:01.178272 28605 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:21:01.178418 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:01.164803 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 59810.9us
I20260709 12:21:01.166714  3831 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:01.179018 29321 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:01.179299 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:01.180418 28603 raft_consensus.cc:1240] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:01.164140  3905 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.178638 28605 pending_rounds.cc:85] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 14
I20260709 12:21:01.181490 28605 pending_rounds.cc:107] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:21:01.181813 28605 raft_consensus.cc:2889] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:01.182055 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.182590  3905 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.183296  3815 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:01.183534 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.183279  4118 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.185093 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.185689 28675 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:21:01.186455 28605 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 23. Current term is 24. Ops: [21.15-23.16]
I20260709 12:21:01.186735  4118 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.187124 28604 raft_consensus.cc:2410] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:21:01.170334 28601 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:01.188068  3815 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.184139  4165 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:01.189642 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.190579 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 12:21:01.195643  4165 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.196229  4165 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:01.192109 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.197688  3815 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:01.193806 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.206380  4115 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.209005 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.209977 28605 raft_consensus.cc:2393] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:01.211877 28752 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:01.212673 28605 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:01.213917 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.248905 28675 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:01.215128 28681 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:01.195116 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:01.136128 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.219905 28677 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260709 12:21:01.252104 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 116064us
I20260709 12:21:01.256083 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.198907 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:01.234406 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:01.222757  4162 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:21:01.195681  4092 consensus_queue.cc:1059] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 12:21:01.237846 28600 raft_consensus.cc:1217] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Deduplicated request from leader. Original: 19.13->[20.14-29.19]   Dedup: 23.16->[25.17-29.19]
W20260709 12:21:01.239363 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 253514us
I20260709 12:21:01.271027 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:01.272890 28600 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 29. Current term is 30. Ops: [20.14-29.19]
I20260709 12:21:01.280755 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.279778 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:01.283994 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:01.284471 29321 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:01.261471 28601 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:01.264530 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.269327 28682 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 24: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:01.273710 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.300962  3110 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:01.301766  3110 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.303789 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:01.304535 28747 raft_consensus.cc:2368] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
I20260709 12:21:01.292629 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.305962 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:01.305020 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.308943 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.309535 28749 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:21:01.306715 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.313131 28753 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:01.268725  4140 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.268278  4043 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.319435 28755 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:21:01.313999 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:01.321362 28571 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:01.317499 28603 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:01.314244 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.322520 28748 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:01.313990 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:01.323788 28756 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:01.316922 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:01.324347 28752 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:01.325582  3110 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:01.326148 28600 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:21:01.328097 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.309805  4026 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:01.274407  4129 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:01.334700 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.335381 28747 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:01.336848 28676 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:01.337085 28682 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 30 index: 19. (term mismatch)
I20260709 12:21:01.337420 28682 pending_rounds.cc:85] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 18
I20260709 12:21:01.337641 28682 pending_rounds.cc:107] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 29.19
I20260709 12:21:01.337890 28682 raft_consensus.cc:2889] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:01.335278 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:01.305020  3820 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:01.339115 28648 leader_election.cc:400] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
I20260709 12:21:01.346578 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:01.339397 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.340790  3110 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.347761 28749 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:01.346370 28648 leader_election.cc:403] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:21:01.348111 28601 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:01.348037  3110 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.349620 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.314004  4137 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:01.349768 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.345844 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.363492 28600 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:01.344282 29321 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:21:01.365152 28756 raft_consensus.cc:1240] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 29. Current term is 30. Ops: [29.19-29.19]
I20260709 12:21:01.366256 28747 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:21:01.316355  4094 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:01.352427 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.351070 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.276013  4107 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 12:21:01.336727  3917 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.319479  4136 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:21:01.401407 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 50413us
I20260709 12:21:01.417047  3110 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.361699 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.402427 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.403191 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.419549 28749 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:01.339862  4155 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:01.371543  3320 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.425088  3320 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.362334  4137 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.404838  3900 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
I20260709 12:21:01.411861  4095 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:01.334487  4140 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.339512  4043 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.424382 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:01.367581  4115 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.446400 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:01.447741  3320 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:01.447921  4127 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:01.449519  4127 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:01.447773  3913 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:01.350960  3703 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.087s
I20260709 12:21:01.461278 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.411537  4136 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.399159  3988 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:21:01.436514 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 461893us
I20260709 12:21:01.476871 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.477834 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.351883  4098 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:01.434248 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.442834  4096 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:01.459205 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:21:01.465971 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.421651  4094 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:01.469553 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:01.438210  4166 raft_consensus.cc:3055] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:01.438748  4137 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:01.493300 28602 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:21:01.468799 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.497088 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:01.500360 28606 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:01.423432  4155 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:01.508847 29319 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:21:01.509047 28601 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 24: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:01.457652 28677 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:01.373090  4026 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 12:21:01.495653 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.439949  4095 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:01.420423  3917 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.508302  4170 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:01.518407 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.524139  3110 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.067s
W20260709 12:21:01.596745 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 99689.5us
I20260709 12:21:01.524013  3320 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 12:21:01.516578 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.508585  4109 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.092s
I20260709 12:21:01.564337  4115 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:01.517827  4092 consensus_queue.cc:1059] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.083s
I20260709 12:21:01.600917  4115 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:01.602077 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.601930  4115 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.603034  4115 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:01.603413 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.604061 28756 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:21:01.517679 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:01.563829 29292 leader_election.cc:400] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23.
I20260709 12:21:01.569633 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:01.607553 29292 leader_election.cc:403] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:21:01.567494 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.611526 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.613502 28599 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 24: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:21:01.565734  4147 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:21:01.619988 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.560184  4094 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:01.593333 28605 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:01.493891  4136 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:01.583638 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:01.564582 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 50223.6us
I20260709 12:21:01.568109  4096 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:01.562103  4037 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:21:01.632543 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:01.617350 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 99699us
I20260709 12:21:01.617838  3320 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:01.617834 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.560842  4166 raft_consensus.cc:740] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:01.637786  4166 consensus_queue.cc:260] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.639183  4166 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:01.639570 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.568290  4043 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.622818 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:01.640782 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.641150 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.641348 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.641921 28604 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:01.642500 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:01.642971 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.643668 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.615919 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:01.519174  3988 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.646641  3988 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:01.595870  4095 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:01.518499  4156 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.116s
I20260709 12:21:01.673681  4156 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23.
I20260709 12:21:01.600165  4000 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:01.674639  4000 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.675105  4000 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:01.681142  4165 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.682595 29320 raft_consensus.cc:2368] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22.
I20260709 12:21:01.683591  4165 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:01.515944  4098 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.596072  4155 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:21:01.636601 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.651554 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 3236) took 1251 ms. Trace:
I20260709 12:21:01.630645 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.710726 29320 pending_rounds.cc:85] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 13
I20260709 12:21:01.710903 28756 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:21:01.711109 29320 pending_rounds.cc:107] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 12:21:01.649078 28601 raft_consensus.cc:1275] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:21:01.656118  4107 raft_consensus.cc:3055] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:01.658468  3815 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.633059  4037 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.662726  4167 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:01.621933  4138 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.636191 28720 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.707559 28676 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:21:01.711668 29320 raft_consensus.cc:2889] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:01.710569 28606 rpcz_store.cc:276] 0709 12:21:00.400335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:00.400505 (+   170us) service_pool.cc:224] Handling call
0709 12:21:01.651401 (+1250896us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540004bd54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:01.651503 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373855616}
I20260709 12:21:01.716327 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:21:01.730165 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 94030.5us
I20260709 12:21:01.717362 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.720373 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.735744 29321 raft_consensus.cc:2410] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:21:01.651090  3724 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.724505 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.740058 28755 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:01.651937 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.513090 28752 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:21:01.750226 28747 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:01.754405 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.755154 28681 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:01.755898 28601 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:21:01.756385 28601 pending_rounds.cc:85] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 14
I20260709 12:21:01.757323 28601 pending_rounds.cc:107] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:21:01.757625 28601 raft_consensus.cc:2889] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:01.712510  3913 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:01.644332 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.768517 28604 raft_consensus.cc:2410] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:21:01.769613 29317 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:01.793115 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.793669 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:01.723043  4037 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:21:01.806746 28675 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:21:01.716482  4107 raft_consensus.cc:740] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:01.803730 29318 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:01.804009 28607 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:01.723162  4167 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:01.822312 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.823097 28605 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
W20260709 12:21:01.807621 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 361265us
I20260709 12:21:01.807853 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:01.808539 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc886982591478e97f84ddb724a679a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.811450 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:01.765632  3971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.002s	sys 0.005s
I20260709 12:21:01.761161  4163 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:01.831148 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.795603  4146 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.844779  3703 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.852089 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.844677  4163 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:01.783365  3798 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:21:01.866271 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.849766 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.868825 28755 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:21:01.793020  3905 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:01.852753 28752 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 27.
I20260709 12:21:01.854102 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:01.854780 28603 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:01.865974 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:21:01.835105  3971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.002s	sys 0.005s
I20260709 12:21:01.874505 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.784554  3724 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.881700 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:01.835551  4129 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:01.784349  4138 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.885259  3320 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:01.865269  4162 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:01.899565  3320 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.899807 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:01.903198  3320 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:01.903501 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 243093us
I20260709 12:21:01.905402 28606 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:01.879377  4127 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:21:01.910619 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:01.910548 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.883949  4043 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:01.912856 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:21:01.927248 28750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.019s	sys 0.012s
I20260709 12:21:01.924808 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:01.927682 28750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.019s	sys 0.013s
I20260709 12:21:01.898307  4129 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:01.887188  4110 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:01.877559  4026 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:21:01.873772  3703 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.940717  4184 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:01.941180  4184 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.941497  4184 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:01.944768  3320 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:01.948254 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 340576us
I20260709 12:21:01.950997  4192 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:01.951628  4192 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.953751  4192 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:01.865499  4146 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.912284  3900 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.909283  4127 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:01.932367 28603 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:21:02.000211  4127 raft_consensus.cc:3060] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:01.968410  4037 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 30 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.936228 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:01.810423  4096 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.902485  4162 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:02.002605  4162 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.003916  4162 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:01.908484  3913 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:02.004626  3913 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.004873  3724 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.005041  3913 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:02.007032 28681 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:01.929571  3919 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:01.963045  3917 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.973676  4138 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:01.979764  4000 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:02.014494  4140 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.934651  4001 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:01.963938  4178 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:21:01.930764  4167 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.926133  4043 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:01.879462  3798 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.889007  3905 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:01.926314  4107 consensus_queue.cc:260] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.987804 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:02.053438 28755 raft_consensus.cc:2410] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:21:01.988641 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.054477 28750 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:02.054879 28750 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:01.988497 28751 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:21:02.035147 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.999235 28756 raft_consensus.cc:2410] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:21:02.019201 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:01.988778 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:02.045336 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 173564us
I20260709 12:21:02.057308 28747 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:02.018615  3900 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:01.981958  3703 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.059677 28752 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:02.060159 28753 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:02.018432  3815 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.017823  4098 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:01.989537  4094 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.062129  3900 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.063299  4094 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.063460 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:02.065167  3905 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.065829 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:02.068069  3798 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.072418 28676 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:02.014793  4000 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:02.082657 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 31 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:02.083180 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:02.049993  4043 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:02.058969 28750 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:02.088620 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.012146  4137 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.093477 28750 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:01.930661 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 430267us
I20260709 12:21:01.932619 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.104691 28750 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:02.098498 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:02.109261 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:02.119683 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.123261 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.124568 29319 raft_consensus.cc:2410] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 23 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:21:02.125594 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:02.126134 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.126446 29321 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
W20260709 12:21:02.129455 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.130533 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:02.133311  3320 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.015588  4001 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.117024 28679 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:21:02.140552 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:02.136135  3110 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:21:02.137887 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 205322us
I20260709 12:21:02.139101 28647 leader_election.cc:400] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22.
I20260709 12:21:02.159803 28679 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:02.161666 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.079675  4146 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.163017 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:02.163594 29322 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:02.163715 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:21:02.164664 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.162256 28647 leader_election.cc:403] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:21:02.162058 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.162753 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.168116 29318 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
W20260709 12:21:02.169381 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.166211 28673 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:21:02.174222 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.176338 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:02.177876 28678 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:01.995642  4163 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.177551 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:02.186599  4109 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:02.195585 28747 raft_consensus.cc:1240] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:02.098188  4167 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:02.139199  4107 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:02.134667  4138 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.159538  4137 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:02.185439  4136 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
I20260709 12:21:02.142271  3350 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:21:02.189201 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:02.210668 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:02.211205 29321 raft_consensus.cc:2376] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21. Re-sending same reply.
I20260709 12:21:02.211730 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.213169 29326 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:02.202690 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:02.162747  4193 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:21:02.218354 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 56423.6us
I20260709 12:21:02.207950 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:02.099311  4140 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.096s
I20260709 12:21:02.217197  3110 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:02.222641 29325 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 30 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 29. Current term is 30. Ops: [25.18-29.19]
I20260709 12:21:02.222841  3110 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:02.223313  3110 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:02.215765 28679 raft_consensus.cc:1240] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:02.182789  4092 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:02.225255 28676 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:02.230329 28678 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:02.231207 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:02.232324 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.232928 29325 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:02.207372  4165 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:02.226964  4115 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
I20260709 12:21:02.242524 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:02.237847 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.179591  4093 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 12:21:02.224794  3900 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:21:02.227221 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 294217us
W20260709 12:21:02.244923 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.227851  3798 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:02.241787 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:02.250941 28599 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 12:21:02.231442  3350 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.253537  3350 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:02.256707  3920 consensus_queue.cc:1059] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:21:02.257670  3920 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:21:02.258013  3920 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:02.258877  3920 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.216426  4127 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:02.260875 28572 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:02.247359  3800 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:02.263736  3920 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:21:02.264084 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 30 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:02.264784 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:02.265537 28606 raft_consensus.cc:2393] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:02.265730  4127 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.268103  4206 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:02.231563  3905 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22.
I20260709 12:21:02.268275  4203 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:02.268554 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:02.249480 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:02.274583 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 30 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:02.275487 29322 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:02.276230 29326 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:02.276466 28721 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:02.278628 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.279732  4127 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:02.280194  4127 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.280581  4127 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:02.280997  3971 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:02.281738  3971 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:02.282495  4203 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:02.283167  3913 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:02.284410  4177 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.433s	user 0.005s	sys 0.000s
I20260709 12:21:02.289084 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:02.289597  4001 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.291250  4129 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.292490 28674 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:02.279126  3110 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:02.314754 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 72295.2us
I20260709 12:21:02.243628  4192 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:02.239260  4092 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:02.222163  4136 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:02.318547 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:02.217602  4138 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.325686 28678 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
W20260709 12:21:02.325938 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.319902 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:02.227186  4098 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:21:02.325954  4193 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:02.329250  4193 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.331964  4193 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.316020  3831 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:02.332849  3831 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.333235  3831 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:02.321609 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 102119us
I20260709 12:21:02.334559 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.322149  3320 consensus_queue.cc:1048] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:02.335050 28673 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:21:02.335294  3320 consensus_queue.cc:1243] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 26.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:21:02.321620  3110 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.252079  3900 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.324960 28598 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:02.338702  4092 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.339308  4136 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.340037 28601 raft_consensus.cc:1240] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:21:02.340706  3900 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:02.338739 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:21:02.337752 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 60042.6us
I20260709 12:21:02.347317 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:02.347921 28606 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:02.315944  4203 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:02.326149  3798 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:21:02.357918 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 106529us
I20260709 12:21:02.363458 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:02.366458 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:02.366896 28603 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:02.367501 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.368270  3320 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:02.369048 28572 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:02.369777 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:02.370182 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:02.336822  4192 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:21:02.359525  4155 consensus_meta.cc:287] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.005s
I20260709 12:21:02.377209 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:02.379606 28603 raft_consensus.cc:2393] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:02.345084  4118 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:21:02.382608 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 43978.1us
I20260709 12:21:02.383997 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:02.384745 28607 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:02.385077 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:02.386175 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:02.386938 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.387192 28750 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:21:02.384413 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:02.386139 28756 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:02.389875 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:02.390287  4203 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:02.371888  4136 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:21:02.398712  3913 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.399369  4173 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:02.387948  3798 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:02.401571 28602 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 30 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:21:02.397382  3350 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.395958  3800 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:02.381908  4093 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.376246  4146 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:02.373376  4184 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:02.375012  3971 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:02.409057 28756 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:21:02.385046 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.434669 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:02.439982 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.427603  4210 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 12:21:02.464131 28607 raft_consensus.cc:1217] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Deduplicated request from leader. Original: 19.13->[20.14-30.19]   Dedup: 23.16->[25.17-30.19]
I20260709 12:21:02.465137  3320 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.465642  3320 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.385183  4155 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.470196 28648 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:02.470559 28750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:02.471401 28750 raft_consensus.cc:606] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:02.453908  4095 consensus_meta.cc:287] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.732s	user 0.003s	sys 0.008s
I20260709 12:21:02.477187 28681 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:02.450626  3800 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.464805 28607 pending_rounds.cc:85] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 16
I20260709 12:21:02.424522  4213 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.429145  3350 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:21:02.429342  3920 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.417493  4118 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:21:02.450405  4146 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.480701 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:02.488597 28607 pending_rounds.cc:107] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 26.17
W20260709 12:21:02.492614 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 216264us
I20260709 12:21:02.489643 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:02.462127  4094 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:21:02.492311  3320 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.492759 28600 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:02.450845  3971 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.430686  3913 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:21:02.487092  3905 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:02.593616  3905 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:02.594110  3905 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:02.487226  4095 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:02.423554  3860 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 12:21:02.499203 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 123795us
I20260709 12:21:02.425635  4192 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.426815  4127 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.500746 28598 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:02.500701 28607 raft_consensus.cc:2889] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:02.433465  3900 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.606376  3900 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:02.543473 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.503695 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.607600 28753 raft_consensus.cc:2468] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:02.608353  3320 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:02.486622  4214 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.115s
I20260709 12:21:02.486884  4210 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.491142  3800 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:02.589206 28648 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:02.477268  4115 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 12:21:02.430565  3798 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.503314  4146 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:02.590539 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:02.450984  4110 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 12:21:02.598521 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:02.474073  4093 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:02.607741 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 104124us
I20260709 12:21:02.457139  4173 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:21:02.501004 28605 raft_consensus.cc:2376] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20. Re-sending same reply.
I20260709 12:21:02.589351  3350 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:02.613708 29318 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:21:02.753684 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 385272us
I20260709 12:21:02.620756 28677 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:02.621778 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:02.595589  3971 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:02.626287  4115 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:02.491896  4213 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.626899 28679 raft_consensus.cc:2368] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25.
I20260709 12:21:02.607641  4165 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:02.618283  4129 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:02.755020 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 133314us
I20260709 12:21:02.501120  3920 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.758589 28598 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:02.759618 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.760538 29326 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:02.623651  3917 raft_consensus.cc:2764] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 12:21:02.767637 29322 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:21:02.773063 29320 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:02.768788  4184 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.761857  4163 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 12:21:02.772324 29317 raft_consensus.cc:1275] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:02.805202 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.805915 28753 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:02.810669 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.812014 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:02.812718 28755 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:21:02.813462 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.765992  4137 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:02.818962 29320 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 24: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:02.818872 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 31 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:02.766381  4140 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.763562  4115 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:02.824986 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:02.820062 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:02.831540 28605 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:02.832621 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:02.622625  4210 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.832629 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.828688 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.831552 29322 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:02.830116 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:02.833731 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.836972 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.843377 29317 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:02.763687  3350 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.842121 28756 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:02.823937 28753 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:02.826895  4137 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:02.849471 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:02.849761 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:02.852519 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:02.865015 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:02.865648 29320 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:02.851145  4223 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.867365 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.867451 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.898008 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.898686 28751 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:02.869268 28678 raft_consensus.cc:1240] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:21:02.849570  4211 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.870736 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:02.866441  4115 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:02.874542  4219 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260709 12:21:02.875226  4220 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:21:02.868768  4155 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:02.881006  4224 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:21:02.882581  4037 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 30 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.887106  3920 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.854647  4137 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:02.889978 28721 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:21:02.937723 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47827.4us
W20260709 12:21:02.850497  4217 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:21:02.889988 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:21:02.890938 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 134181us
I20260709 12:21:02.836937  4140 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.912756 29323 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:02.923241 28756 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:02.916548  4094 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:02.877722  3350 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.930393 28754 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:02.888593  4218 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:21:02.891563  3820 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:02.924132 29325 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:02.890575  4223 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.957250 29323 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:02.954945 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:02.942879 29320 raft_consensus.cc:2393] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 24: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:02.943392 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:02.950155  3831 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.000s
I20260709 12:21:02.941721  4115 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:02.908802  4001 consensus_queue.cc:1048] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 12:21:02.962301 28647 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:02.965385 29317 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
W20260709 12:21:02.961623  4107 consensus_meta.cc:287] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.001s
I20260709 12:21:03.009469 29319 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:21:02.929890  4184 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 12:21:03.025345 29326 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
W20260709 12:21:02.977535 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:02.965914 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 308367us
W20260709 12:21:03.027429 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.028268 28647 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:02.981591  4203 raft_consensus.cc:2804] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:02.963459  3820 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.956116  4095 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.952003  4127 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.988421  4223 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.989087  4210 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:02.949141  4118 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:21:02.991034  4202 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.730s	user 0.002s	sys 0.001s
W20260709 12:21:02.979995  4227 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 12:21:02.994415 29327 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:02.942404  4228 consensus_queue.cc:1059] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.056s
I20260709 12:21:02.916600  4211 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.945322  4140 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:02.996801  4093 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:03.037137  4213 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:03.056903  4211 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:03.059459 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3259) took 1439 ms. Trace:
I20260709 12:21:03.059894 28601 rpcz_store.cc:276] 0709 12:21:01.619666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.817406 (+197740us) service_pool.cc:224] Handling call
0709 12:21:01.817747 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:02.340425 (+522678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.059173 (+718748us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54002c0954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:03.059368 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200583936}
I20260709 12:21:03.061391 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.062114 28676 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:21:03.064410 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:02.998075 28751 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:21:02.998433 29317 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 16. Current term is 17. Ops: []
W20260709 12:21:02.999490  4167 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.794s	user 0.009s	sys 0.001s
I20260709 12:21:03.000672 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.072989 28673 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:03.000721 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.073340  4240 consensus_queue.cc:1059] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:03.001395  4138 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:03.005403  4204 log.cc:927] Time spent T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.725s	user 0.001s	sys 0.002s
I20260709 12:21:03.074206  4240 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:21:03.074582  4240 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:03.075392  4240 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.007403 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:03.077404 29323 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:03.012121 29320 pending_rounds.cc:85] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 15
I20260709 12:21:02.964583  3905 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.015942  4146 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:02.958128  4094 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:03.029014 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.032449 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:03.030673  3988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.002s	sys 0.008s
W20260709 12:21:03.041745 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77320.9us
I20260709 12:21:03.032284  4162 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.092741 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:03.043604 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.033711  4229 raft_consensus.cc:2804] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:03.037817  4203 raft_consensus.cc:697] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:02.976476  3831 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.042425  4118 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:03.107383  4118 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:03.108985  4229 raft_consensus.cc:697] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:03.109994  4229 consensus_queue.cc:237] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.112598 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.062311  4127 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:21:03.112636 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:03.116139 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3645) took 1252 ms. Trace:
I20260709 12:21:03.116565 28677 rpcz_store.cc:276] 0709 12:21:01.863483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.866379 (+  2896us) service_pool.cc:224] Handling call
0709 12:21:01.866674 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.754306 (+887632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.115903 (+361597us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b5400299d54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:03.116079 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729631104}
I20260709 12:21:03.086283  4096 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:03.118175  4096 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.070139  4137 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.120591 28681 raft_consensus.cc:2393] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:03.101320  4162 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.122589  4162 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:03.120150  4096 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:03.005457  4043 consensus_meta.cc:287] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.871s	user 0.010s	sys 0.000s
I20260709 12:21:03.127754  3800 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.136986  4043 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.138772  3800 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.139652  4043 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:03.078483 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.078857 29320 pending_rounds.cc:107] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:21:03.140635 29320 raft_consensus.cc:2889] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:03.075412 28675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 3119) took 1341 ms. Trace:
W20260709 12:21:03.061964  4166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.009s	sys 0.003s
I20260709 12:21:03.092132 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3651) took 1009 ms. Trace:
I20260709 12:21:03.094900 28676 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:21:03.089426 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:03.147368 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:03.141973 28675 rpcz_store.cc:276] 0709 12:21:01.733526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.807507 (+ 73981us) service_pool.cc:224] Handling call
0709 12:21:01.827072 (+ 19565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.877919 (+ 50847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.877953 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.878523 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:21:02.222281 (+343758us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:21:02.222322 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.222384 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.004743 (+782359us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:21:03.075134 (+ 70391us) raft_consensus.cc:1685] finished
0709 12:21:03.075156 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.075355 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23302,"raft.queue_time_us":32948,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":14370,"spinlock_wait_cycles":79559552,"thread_start_us":293782,"threads_started":1,"wal-append.queue_time_us":375201}
I20260709 12:21:03.147569 28674 rpcz_store.cc:276] 0709 12:21:02.082600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:02.082737 (+   137us) service_pool.cc:224] Handling call
0709 12:21:02.113937 (+ 31200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:02.292844 (+178907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.091812 (+798968us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54000c7454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:03.092052 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410139904}
I20260709 12:21:03.098407 29323 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
W20260709 12:21:03.147410 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58103.8us
I20260709 12:21:03.099956 28682 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:03.101163 28680 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:03.081418  4231 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:21:03.086162  3988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.003s	sys 0.009s
I20260709 12:21:03.103859  3905 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.104244  4092 raft_consensus.cc:3055] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:03.105435  4146 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.106180  4094 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:03.145437  4166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.010s	sys 0.004s
I20260709 12:21:03.071841  3820 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.126137 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 30 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:03.174695 28748 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:21:03.126806 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:03.128511 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:03.129381  4118 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:03.130628  4207 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.845s	user 0.000s	sys 0.003s
I20260709 12:21:03.133606  3919 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:03.134505  3831 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:03.135020 28722 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.135468  4203 consensus_queue.cc:237] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.167315  4162 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.146286 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:03.127664  4211 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:03.149863  4248 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:03.176684  4026 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:03.149914 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:03.199606  3110 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:03.150723 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:03.200697 28749 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:03.184334  3820 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.203585  3110 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:03.158509 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:03.160085 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:03.205549 28754 raft_consensus.cc:2410] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 12:21:03.161481 28647 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:03.161676 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:21:03.123745 28600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3497) took 1633 ms (client timeout 1610 ms). Trace:
W20260709 12:21:03.170624 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.173422 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:03.173859 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 144950us
I20260709 12:21:03.177843 28720 leader_election.cc:400] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25.
I20260709 12:21:03.182385 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.207325 28720 leader_election.cc:403] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
W20260709 12:21:03.196750  4109 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.006s	sys 0.010s
I20260709 12:21:03.208070 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.166801  4231 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.098860  3971 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.179625 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3258) took 1560 ms. Trace:
I20260709 12:21:03.083773  4240 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:03.168198  4092 raft_consensus.cc:740] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:03.184157  4115 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:03.192178 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 57247.5us
I20260709 12:21:03.219944  3831 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:03.233036  3831 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:03.232834  4115 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.233469  3831 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:03.233605 28722 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:03.152575 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:03.192224  4162 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.235190  4115 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.235493  4173 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:03.236045  4173 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.236415  4162 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:03.237617 29317 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:21:03.238195  4173 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:03.240593  4218 consensus_queue.cc:1059] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:03.241467  4163 raft_consensus.cc:3055] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:03.241811  4163 raft_consensus.cc:740] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:03.242281  3971 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.243058 28753 raft_consensus.cc:2368] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22.
I20260709 12:21:03.242620  4163 consensus_queue.cc:260] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.178355  4137 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.179734  3919 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:03.243582  4092 consensus_queue.cc:260] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.244419  3919 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.245222  4092 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:03.245841  3919 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:03.206231 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44842.6us
W20260709 12:21:03.206164 28600 rpcz_store.cc:269] 0709 12:21:01.489976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.595643 (+105667us) service_pool.cc:224] Handling call
0709 12:21:03.123566 (+1527923us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400233554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:03.123665 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971888000}
I20260709 12:21:03.210814 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.249049 28607 raft_consensus.cc:2410] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:21:03.249172 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.204538  3110 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.216974  3820 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.249969 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.250980 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.251341  3820 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:03.252014 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.254547 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:03.250245 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.255218 28607 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:03.255308 29318 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:03.255417 28600 raft_consensus.cc:2468] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:03.226256 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.226377  4155 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:03.226944 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.228982  3703 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:03.252285 28573 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:03.229312  4146 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:21:03.199517  4248 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.220533  4231 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:03.208930  4043 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25.
I20260709 12:21:03.219962 28604 rpcz_store.cc:276] 0709 12:21:01.619396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.816174 (+196778us) service_pool.cc:224] Handling call
0709 12:21:01.816553 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:01.828277 (+ 11724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:01.828324 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:01.853487 (+ 25163us) log.cc:844] Serialized 26 byte log entry
0709 12:21:01.932350 (+ 78863us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800389740. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b 00007f6fe361ed23 00007f6fe361f0d1 00007f6fe3a3aa0f
0709 12:21:02.105059 (+172709us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:02.105117 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:02.105210 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:03.130059 (+1024849us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:21:03.179401 (+ 49342us) raft_consensus.cc:1685] finished
0709 12:21:03.179438 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:03.179567 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11281,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":37329,"spinlock_wait_cycles":76988160,"thread_start_us":172479,"threads_started":1,"wal-append.queue_time_us":356150}
I20260709 12:21:03.212905 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.252192 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.275151 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.275594 28606 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:03.275772 28676 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
W20260709 12:21:03.214296  4109 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.007s	sys 0.010s
W20260709 12:21:03.278151 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43706.5us
W20260709 12:21:03.280234 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:03.281239 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.256513 28601 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:03.222975 28598 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:21:03.264503 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.264575 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.265836 28748 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 30 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:21:03.217344  3724 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:03.288477 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.270988 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.264423  4173 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:03.289256 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.260968  3703 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:03.266887  3820 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:03.287364 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:03.266813  4248 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:03.297703 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:03.301383 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.302991 29318 raft_consensus.cc:2410] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 23 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:21:03.296747  3724 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:03.291523  4173 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:03.319710 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.307530 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.296633  4203 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:03.300163  3815 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:03.300637  3905 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:21:03.321676  4173 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:03.331848 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.332464 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:03.336403 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:03.340318 28607 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:03.337649 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.340934 28678 raft_consensus.cc:2393] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:21:03.333022  4246 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:21:03.333720  4250 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:21:03.336072 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:03.346918 28677 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:03.303859  4155 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:03.341310 28682 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:03.351500 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.341643 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:03.341934 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.309679  4140 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.344139 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:03.352628 28675 raft_consensus.cc:3060] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:03.366067 28674 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:03.371052 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:03.375613 28675 raft_consensus.cc:2468] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:03.377439 28648 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.377625 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:03.378585 28675 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:03.383386 28753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:03.342806  4146 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:03.383876 28601 raft_consensus.cc:2468] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:03.383994 28753 raft_consensus.cc:606] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.393703 28753 raft_consensus.cc:614] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:03.387645 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.395496 28720 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:03.396584  4000 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:03.354805  4096 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.397547  4096 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.399693  4096 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.376736  4140 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.401471 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.402144 28601 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:03.402490  4140 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.404778 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:03.405099  4254 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:03.405406 28600 raft_consensus.cc:3060] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:03.405588 28677 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
W20260709 12:21:03.406904  4255 log.cc:927] Time spent T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:21:03.408736  3988 raft_consensus.cc:2804] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:03.410058 28602 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:03.384425  4094 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:03.389343  4232 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:21:03.385142  4095 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:21:03.413026  4225 log.cc:927] Time spent T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.576s	user 0.000s	sys 0.003s
I20260709 12:21:03.389597 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.402516  4118 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.414058  4184 raft_consensus.cc:2804] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:03.414863 28720 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:03.415458 28752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
W20260709 12:21:03.490970 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76188.2us
I20260709 12:21:03.491169 28752 raft_consensus.cc:606] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:03.426647 28600 raft_consensus.cc:2468] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
W20260709 12:21:03.475966  4246 log.cc:927] Time spent T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:21:03.392280  3724 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:03.436628 28599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3493) took 1947 ms (client timeout 1992 ms). Trace:
I20260709 12:21:03.443976 28675 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
W20260709 12:21:03.490018 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 100507us
I20260709 12:21:03.428378 28607 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
W20260709 12:21:03.496809 28599 rpcz_store.cc:269] 0709 12:21:01.488895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:01.621494 (+132599us) service_pool.cc:224] Handling call
0709 12:21:03.430842 (+1809348us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b5400092754. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:03.436547 (+  5705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413101952}
I20260709 12:21:03.497964 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.492079  3110 raft_consensus.cc:2804] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:03.499392  3110 raft_consensus.cc:697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:03.478911  4138 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:21:03.501515 28722 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:03.505329  3320 raft_consensus.cc:2804] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:03.505808  3320 raft_consensus.cc:697] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:03.507843 28601 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:21:03.506543  3320 consensus_queue.cc:237] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.478395  4094 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:21:03.511373 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.481046  4095 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:03.505405  3110 consensus_queue.cc:237] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.488533  3988 raft_consensus.cc:697] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:21:03.515568 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.495486  4110 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:03.527735 28599 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 12:21:03.633577 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 325997us
I20260709 12:21:03.507395  4184 raft_consensus.cc:697] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:03.514909  4094 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:03.636631 28602 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:03.660743 28573 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:03.643014 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 135009us
I20260709 12:21:03.665478 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.527623  3905 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:03.699669 28755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:03.530483  3831 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.703797 28755 raft_consensus.cc:606] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:03.704209 28755 raft_consensus.cc:614] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:03.676810  4140 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:21:03.738479 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.738886 28604 raft_consensus.cc:3060] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:21:03.746779 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 71910.7us
I20260709 12:21:03.747691 28573 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.751088 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.754864 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:03.738929  4110 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:03.760185  4110 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:03.763309 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 97914.4us
I20260709 12:21:03.765293 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:03.690761  4095 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.744696  4096 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:03.763649  3920 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:03.791965 28601 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 12:21:03.783811  4258 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 12:21:03.793830 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.794468 28599 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
W20260709 12:21:03.787160  3919 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260709 12:21:03.753499  4146 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:21:03.805528  4264 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:03.806337  4231 consensus_meta.cc:287] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.002s
W20260709 12:21:03.807369  4261 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 12:21:03.808203  4240 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.019s
W20260709 12:21:03.809580  4262 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:21:03.809646 28751 raft_consensus.cc:2410] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:21:03.806881  4231 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:03.813474 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45988.3us
I20260709 12:21:03.815469 28601 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 12:21:03.819301 28601 pending_rounds.cc:85] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 16
I20260709 12:21:03.819684 28601 pending_rounds.cc:107] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 12:21:03.820034 28601 raft_consensus.cc:2889] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:03.817472 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 73750.2us
I20260709 12:21:03.746066  3988 consensus_queue.cc:237] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.825572 28755 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:21:03.834416 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "a8342e3fcab94ce89482df67988159ea"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:03.835120 28749 raft_consensus.cc:606] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Received request to transfer leadership to TS a8342e3fcab94ce89482df67988159ea
I20260709 12:21:03.835552 28749 raft_consensus.cc:614] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:03.826326  3905 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:03.812104  3919 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:03.851843  3919 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.821584  4000 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.840322  3831 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:03.840929  4270 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:21:03.870883  4231 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:03.871378  4271 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:03.872308  4273 log.cc:927] Time spent T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:21:03.876579  4263 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:21:03.834846  4001 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
W20260709 12:21:03.879216 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:03.916145 28604 raft_consensus.cc:2468] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:21:03.751948  4184 consensus_queue.cc:237] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.915328  3110 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:03.917886  3110 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:03.897987  4170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.009s	sys 0.019s
W20260709 12:21:03.929940 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 133195us
I20260709 12:21:03.931231 28648 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:03.928853  4170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.642s	user 0.009s	sys 0.019s
I20260709 12:21:03.935175  3110 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:03.884248  4000 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:03.942863 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:03.944882  4283 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.942624  3905 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:03.947814  4272 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.947053  4279 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:03.945025  4285 raft_consensus.cc:2804] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:21:03.970793  4248 consensus_meta.cc:287] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
I20260709 12:21:03.981289  3831 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:03.985494  4094 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:03.986586  4173 consensus_meta.cc:287] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.004s
I20260709 12:21:03.989099  4136 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:03.990077 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:04.188398 28600 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 19.
I20260709 12:21:03.991004  4000 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:03.991677  4218 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.198488  4218 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.200726  4218 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:03.998384 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43758.1us
W20260709 12:21:03.999349  4274 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:21:04.012295 28676 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:21:04.011978  4284 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:04.016065  4138 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:04.034694 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.035392 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:21:04.038419  4269 log.cc:927] Time spent T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 12:21:04.042070  4268 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:04.043701  4259 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.599s	user 0.001s	sys 0.000s
I20260709 12:21:04.045981 28598 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:21:04.051086  4095 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:03.956974  4283 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.221634  4284 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.227571  4284 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.228626  4268 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:04.230540  4277 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.232s	user 0.003s	sys 0.000s
I20260709 12:21:04.063071 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.231966  4118 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.232656  4118 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.235270  4118 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.063469 28605 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:04.065855  3798 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:03.996914  4278 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:21:03.958492  4272 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.076784 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.238986 28751 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:21:04.004045  3919 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.077896  3971 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:21:04.094303  4282 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:21:04.105350  4163 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:04.122783 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 940396us
I20260709 12:21:04.122262  4001 raft_consensus.cc:993] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:21:04.128038 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.250412 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:04.129053 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.251361 28677 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:04.123008 29327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2235) took 1109 ms. Trace:
I20260709 12:21:04.144475 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:04.147300 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 893054us
I20260709 12:21:04.147519  3703 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.148519  4214 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:04.152798 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:04.144979  4211 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:04.254011 28674 raft_consensus.cc:2368] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19.
W20260709 12:21:04.159941  4289 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.220s	user 0.000s	sys 0.003s
I20260709 12:21:04.162143 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:04.228338  4283 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.173020 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.176076 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:21:04.165731  4229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.008s	sys 0.000s
I20260709 12:21:04.184571 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.185179 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:21:04.186774 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.261015 28753 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:04.266381 28755 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:04.267953 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:04.268550 29326 raft_consensus.cc:3060] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:21:04.192766  4136 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.194968  4094 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.191920  4173 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.187444  4166 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.196715  3988 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.187669  4248 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:04.265856  4229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.008s	sys 0.000s
I20260709 12:21:04.184247  4231 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:04.190310  3831 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.286818 29326 raft_consensus.cc:2468] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:04.287108 29318 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:04.209136 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:04.211570 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:04.260133  4109 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:04.244135  3798 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.190105  4285 raft_consensus.cc:697] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:04.247515 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1413) took 1019 ms. Trace:
I20260709 12:21:04.217481  4138 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:04.254998 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:04.172111 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:04.256181 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.296805 28752 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:04.257491 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:21:04.297608 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 88546.4us
I20260709 12:21:04.293272 28598 rpcz_store.cc:276] 0709 12:21:03.227842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.477557 (+249715us) service_pool.cc:224] Handling call
0709 12:21:04.045641 (+568084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.222157 (+176516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.247270 (+ 25113us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540004b350. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:04.247444 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305580288}
I20260709 12:21:04.185115  4279 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.189637 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:04.269052 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:04.303469 29320 raft_consensus.cc:2368] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24.
I20260709 12:21:04.272847 28607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3277) took 1042 ms. Trace:
I20260709 12:21:04.304303 28607 rpcz_store.cc:276] 0709 12:21:03.229998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.497688 (+267690us) service_pool.cc:224] Handling call
0709 12:21:03.498045 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:03.498485 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.498514 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:03.508984 (+ 10470us) log.cc:844] Serialized 52 byte log entry
0709 12:21:03.665561 (+156577us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:21:03.665645 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:03.665814 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.272556 (+606742us) raft_consensus.cc:1685] finished
0709 12:21:04.272584 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.272781 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":177,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":4926,"thread_start_us":27976,"threads_started":1,"wal-append.queue_time_us":133617}
I20260709 12:21:04.277673 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:04.280956 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 118917us
I20260709 12:21:04.281244 29322 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:04.255541  4242 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:04.252068 29327 rpcz_store.cc:276] 0709 12:21:03.013833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.070863 (+ 57030us) service_pool.cc:224] Handling call
0709 12:21:03.071200 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:03.071572 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:03.071602 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:03.072059 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:21:03.167684 (+ 95625us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:21:03.177958 (+ 10274us) log.cc:844] Serialized 14 byte log entry
0709 12:21:04.114804 (+936846us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b18004933c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe090cc0a 00007f6fea04c219 00007f6fe0994a40 00007f6fe098f4e4 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a89716 00007f6fe3a9a287 00007f6fe3a9a208
0709 12:21:04.115020 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.115127 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.115187 (+    60us) raft_consensus.cc:1685] finished
0709 12:21:04.122784 (+  7597us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:04.122943 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62836,"prepare.queue_time_us":11974,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":943337,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5151,"spinlock_wait_cycles":9778560,"thread_start_us":95253,"threads_started":1,"wal-append.queue_time_us":153297}
I20260709 12:21:04.251528  4165 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:21:04.265978  4162 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.260064  4256 raft_consensus.cc:1081] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:21:04.260073  4206 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:04.284070  4268 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.250474  4118 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260709 12:21:04.291824 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.250701  3971 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.297690 28677 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:04.298918 28648 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:04.300916 29319 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:21:04.301445 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46513.7us
I20260709 12:21:04.296329 29290 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:04.334882 29292 leader_election.cc:400] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22.
W20260709 12:21:04.310892 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 121326us
I20260709 12:21:04.335170 29292 leader_election.cc:403] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:04.325699 28752 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:04.274767  3703 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:04.240221 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:04.336736 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71464.4us
I20260709 12:21:04.309638  4284 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:04.348533 28677 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:04.323021  4092 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:21:04.289857  4231 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.342052 28571 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:04.352285  4206 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:04.283778  4166 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.289016 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:04.286165  3988 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.301059  4109 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.353318 28571 leader_election.cc:400] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19.
I20260709 12:21:04.332156  4043 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:04.348984  4214 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:21:04.381528 28573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:04.338796 28755 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:21:04.316521  4127 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:21:04.367264 28571 leader_election.cc:403] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 12:21:04.369419  4295 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:21:04.371008  4231 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:04.342362 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 43556.2us
I20260709 12:21:04.375972  4272 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.376410  4136 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.377664  3798 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.378557  4279 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.379031  4256 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:04.379390  4173 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.329348  4140 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:21:04.328948  4146 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.029s
I20260709 12:21:04.371742  4043 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.328939  4162 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.348225  4284 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:04.346064  4211 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22.
I20260709 12:21:04.392199 29323 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:04.357314  3724 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:04.394491 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.439930 28680 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 29.
I20260709 12:21:04.349313  4242 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:21:04.372792  4281 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:21:04.381017  4214 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:04.430516 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 87060.9us
I20260709 12:21:04.425443  4231 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.398403  4167 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 18. Current term is 19.
I20260709 12:21:04.425789  4043 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:04.475097 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 234926us
I20260709 12:21:04.439234  4284 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:04.464255  4214 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:04.453190  4279 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:04.452899  4173 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:04.493209 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 150720us
I20260709 12:21:04.426517  4240 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 12:21:04.467168  3724 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:04.482908  4096 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.468116  4242 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:21:04.513612 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 168054us
W20260709 12:21:04.515141 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 177277us
I20260709 12:21:04.464869  4278 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:21:04.517686  3971 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:04.523573  4214 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.508929  3988 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:04.524605  4248 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.525298  3831 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.525485  4162 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.526655  4166 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:04.529304  4096 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.484695  4231 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.510108  4279 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.533211  4109 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.541666 28680 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:04.407953  4285 consensus_queue.cc:237] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.505092  4206 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:04.513828  4242 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:04.554323 28681 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:21:04.559643 28721 leader_election.cc:400] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24.
I20260709 12:21:04.558360 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.560010 28721 leader_election.cc:403] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:21:04.568574  4231 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.569109  4279 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:04.569691  4296 log.cc:927] Time spent T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:04.570983  4096 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.550405  4303 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:04.574271  4303 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.575914 28680 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 29.
I20260709 12:21:04.510756  4173 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.579631 28678 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:21:04.580147 28678 pending_rounds.cc:85] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 12
I20260709 12:21:04.580394 28678 pending_rounds.cc:107] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:21:04.580646 28678 raft_consensus.cc:2889] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:04.580664 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.586658 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:04.586889 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.587525 28755 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:04.588418 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.590569 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:04.593627 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.593106 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:04.597996 28755 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:04.600119 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:04.601184 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.602038 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:04.603499 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.581751  4303 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.604359 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:04.610065 28648 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:04.610307  4162 raft_consensus.cc:2764] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:21:04.605043 28755 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 30.
I20260709 12:21:04.605803 28753 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:21:04.611855  4248 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:04.599213  4301 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:04.612392 28751 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:04.612156  4096 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:04.613090  4096 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:04.612905  4278 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:04.609373 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:04.614007 28681 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:04.613526  4096 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:04.604003 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46635.4us
I20260709 12:21:04.617111 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.601527  4309 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.639333  4309 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.633738 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:04.634230  4206 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.635092 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:04.606175  4109 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:04.642695  4109 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:04.643030  4173 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.643127  4109 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:04.643409  4309 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.644416  4214 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.636029  4110 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:04.601337  4231 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:21:04.648401 28675 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:21:04.594110  3724 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.617408 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.642167 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.609397  4166 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:04.655237 29319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41580 (request call id 2236) took 1509 ms (client timeout 1856 ms). Trace:
I20260709 12:21:04.646884 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:04.658368 29321 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:04.692449 29327 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:21:04.710426 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.605818  3800 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.642711  4283 raft_consensus.cc:993] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
W20260709 12:21:04.655767 29319 rpcz_store.cc:269] 0709 12:21:03.145855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.146026 (+   171us) service_pool.cc:224] Handling call
0709 12:21:04.655015 (+1508989us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540007ab54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:04.655171 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2550977408}
I20260709 12:21:04.617743  4098 raft_consensus.cc:3060] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:04.724488 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:04.724385 28681 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:04.731256 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.733292 29321 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:04.731529 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.643157  4303 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:04.651757  4095 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:04.725571  3900 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.744912  3900 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.747149  3900 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.748574  4095 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:04.749532  4095 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.729180  3800 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.754014  3800 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:04.754134  4109 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.758442  4214 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:04.759676  4214 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.761766  4214 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:04.762970 29322 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:04.766202  4109 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.616720  4242 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.776311 29327 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:04.778077 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.799746 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:04.789948  4314 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:21:04.812124  4284 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.816267  4096 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.738270  4303 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.800890  4242 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:04.821996 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.828989  4284 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.832141  3831 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.832731  3831 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.834923  3831 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.844202 29326 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:04.846797 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.802769  4043 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.859051 28681 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:21:04.868606 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.869437 28681 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:04.873852  4096 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.878334 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.879117 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 30.
I20260709 12:21:04.879582 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.880287 29323 raft_consensus.cc:2393] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 17: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:04.881145 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.881379 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:04.881880 29318 raft_consensus.cc:2410] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 25 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 12:21:04.883783  4140 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.884562  3703 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:04.884356  4140 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:04.886472  4140 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:04.890105 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:04.891100  4307 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:04.892167 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:04.892832  4163 consensus_meta.cc:287] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.000s
W20260709 12:21:04.876677  4138 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
I20260709 12:21:04.920814  4001 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.918618  4138 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:04.921555  4001 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:04.925112 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 234877us
I20260709 12:21:04.925694  4138 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.928939  4306 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:04.946780 28749 raft_consensus.cc:2410] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:21:04.948143 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.950048 28681 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:04.951563 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.952303 28677 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:04.893294 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:04.893761  4307 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:04.894275  3900 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:04.959017 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:04.959645 29327 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:21:04.887795  4303 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:04.903522  4136 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:04.914633  4268 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:21:04.916226  4310 log.cc:927] Time spent T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.399s	user 0.003s	sys 0.012s
W20260709 12:21:04.917481  4298 log.cc:927] Time spent T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.396s	user 0.000s	sys 0.009s
I20260709 12:21:04.974762  4218 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 12:21:04.917764  4283 raft_consensus.cc:1081] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:04.924311  4001 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:04.954993 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 61770.1us
I20260709 12:21:04.896766 29290 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:04.974876 29325 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:04.975997 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:04.976413 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.976828 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:04.977272 29327 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:04.978034 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:04.977967 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:04.974226  4170 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:21:04.984728 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:04.984915 29320 raft_consensus.cc:2410] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:21:04.985399 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:04.991353 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:04.956058  4167 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:04.956218  4000 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.055171 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.056165 29327 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:04.974911  4146 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:05.058023 29327 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 12:21:05.058228  4146 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:05.059342 28754 raft_consensus.cc:2368] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21.
I20260709 12:21:05.062625 28752 raft_consensus.cc:2368] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20.
W20260709 12:21:05.065050 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 168375us
I20260709 12:21:05.077649 28675 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:05.063868 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:04.975493  4136 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:05.098275 29292 leader_election.cc:400] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21.
I20260709 12:21:05.096427 28572 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:04.974617  3800 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 12:21:05.098800 29292 leader_election.cc:403] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:05.165413 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:05.175354 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.001240  4098 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24.
I20260709 12:21:05.130849 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3291) took 1178 ms. Trace:
I20260709 12:21:05.126619 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.107761 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:05.112957 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:05.202850 29318 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 30.
I20260709 12:21:05.201890 28601 rpcz_store.cc:276] 0709 12:21:03.952654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:03.952835 (+   181us) service_pool.cc:224] Handling call
0709 12:21:03.958379 (+  5544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:04.180839 (+222460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:04.180867 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:04.190587 (+  9720us) log.cc:844] Serialized 26 byte log entry
0709 12:21:04.400181 (+209594us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:21:04.400239 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:04.400339 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:04.916712 (+516373us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:21:05.130597 (+213885us) raft_consensus.cc:1685] finished
0709 12:21:05.130620 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:05.130795 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2789,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":708,"spinlock_wait_cycles":34714880,"thread_start_us":158641,"threads_started":1,"wal-append.queue_time_us":280535}
W20260709 12:21:05.179364 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 81222.9us
I20260709 12:21:05.200083 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.204607 29327 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 30: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:05.204721 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:05.081801 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 81299.5us
I20260709 12:21:05.108166 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:05.166925 28721 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:05.107290 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:05.131304 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.208626 28754 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 17.
I20260709 12:21:05.123633 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.209393 29319 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:21:04.979405  4268 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:21:05.086362 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 108503us
I20260709 12:21:05.129415 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:05.229209 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.230361 29327 raft_consensus.cc:2410] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 25 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
W20260709 12:21:05.233011 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 66183.4us
I20260709 12:21:05.233390 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.249164 28721 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.250929 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.210803 29322 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:05.203752 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:05.126765 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:05.253005 28678 raft_consensus.cc:2393] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:04.979331  4140 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:05.097774  4138 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:05.096310  4242 raft_consensus.cc:2804] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:05.276351 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.099323  4206 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:05.280645  3110 consensus_queue.cc:1059] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:21:05.283025 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.200567  4043 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:05.283684 28752 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 30.
I20260709 12:21:05.272409 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:05.274132 29320 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:21:05.099970  4307 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:05.180270  4109 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 20. Current term is 21.
I20260709 12:21:05.185400  4096 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.278147 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.292726 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:05.165829  4165 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:05.077222  4000 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.293140 28754 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:05.099576  4308 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:05.281358  3320 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:05.290854 28749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 3245) took 1214 ms. Trace:
I20260709 12:21:05.290174 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:05.285641 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.287971 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.296952 29326 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:05.122773  4211 consensus_queue.cc:1059] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.158s
I20260709 12:21:05.286607 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.274360  4304 raft_consensus.cc:2804] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:05.302011  4304 raft_consensus.cc:697] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:05.302450  3831 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:05.302919  3831 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.303330  3831 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:05.303045  4304 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.271222  4283 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:21:05.274722  4163 raft_consensus.cc:3060] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:05.297959  3320 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:21:05.298229 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.164197  3724 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.125s
I20260709 12:21:05.298919 28721 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:05.289244  4281 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:21:05.216655  4146 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.297166  4096 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.082270  4167 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.274818  4138 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:05.296133 28749 rpcz_store.cc:276] 0709 12:21:04.171271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:04.171405 (+   134us) service_pool.cc:224] Handling call
0709 12:21:05.288627 (+1117222us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400034dd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:05.290796 (+  2169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541963008}
I20260709 12:21:05.275941  4140 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.310870  4303 raft_consensus.cc:3055] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:05.311506  4268 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.291136  4242 raft_consensus.cc:697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:05.190629  4136 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.331559 29323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:21:05.513409 29323 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:05.513815 29323 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:05.333240 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:05.325767 29292 leader_election.cc:400] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20.
I20260709 12:21:05.339260 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:21:05.516995 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 191387us
I20260709 12:21:05.352257 29322 raft_consensus.cc:1275] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 12:21:05.518029 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 156459us
I20260709 12:21:05.519852 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:05.363003 29317 raft_consensus.cc:1275] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:05.368063 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:21:05.422717 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 218988us
I20260709 12:21:05.342976  4096 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:05.321997  3798 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:05.308346  4165 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.337679  4170 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:05.423185  3320 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.535328  3320 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:21:05.383033 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.536614 28753 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:21:05.376068  4138 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:05.353700  4308 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:05.459128 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 349341us
I20260709 12:21:05.579151 28572 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:05.377573 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.521458 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:05.526997 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:05.580569 28753 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:05.580688 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.528143 28755 raft_consensus.cc:2468] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:05.524931  4109 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.546376  4165 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:05.546842 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.528596 29323 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.527655  3798 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.548493  4279 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:05.548626 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:05.592757 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44203.6us
I20260709 12:21:05.593122 29323 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:05.549554  4283 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:05.499617  4303 raft_consensus.cc:740] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:05.596918  4303 consensus_queue.cc:260] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.597918  4303 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:05.552564 28751 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:21:05.600522  4173 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:05.553889  4242 consensus_queue.cc:237] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.603508  3724 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:05.528369  3703 consensus_queue.cc:1175] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5b3b2f4041a24b05983f30878f16db9d" responder_term: 21 status { last_received { term: 21 index: 18 } last_committed_idx: 18 last_received_current_leader { term: 21 index: 18 } }
I20260709 12:21:05.603993  3724 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.605980  3703 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:21:05.606134  3724 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:05.606456  3703 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.606889  3703 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:21:05.532058  4268 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:05.596017  4279 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.610225  4167 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:05.610777  4279 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:05.612061  4308 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:05.531559  4136 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:05.612634  4307 consensus_queue.cc:1175] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a8342e3fcab94ce89482df67988159ea" responder_term: 22 status { last_received { term: 21 index: 18 } last_committed_idx: 17 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:21:05.591928  3798 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:05.561381  4140 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:05.561703  4096 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:05.563746  3971 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:05.565750  4333 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:05.567031 28750 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:05.567754  4000 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:05.576260 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.619892  3320 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:05.633361 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57172.3us
I20260709 12:21:05.634501 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.583475 29319 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 12:21:05.636651 29319 pending_rounds.cc:85] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 14
I20260709 12:21:05.637004 29319 pending_rounds.cc:107] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:21:05.637302 29319 raft_consensus.cc:2889] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:05.584893 28572 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:21:05.585810 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 64423.9us
W20260709 12:21:05.587208 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51466.1us
I20260709 12:21:05.588974 28754 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:05.596024  4283 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.643469  3320 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 31 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:05.643720  4283 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:21:05.581508  4332 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.302s	user 0.007s	sys 0.002s
I20260709 12:21:05.644744  4001 consensus_queue.cc:1048] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:05.645620  4118 raft_consensus.cc:3055] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:05.646018  4118 raft_consensus.cc:740] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:05.646839  4118 consensus_queue.cc:260] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.647818  4118 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:05.615181 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.648737 28756 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:05.615839 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:05.649737 28751 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:05.650950  4303 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:05.651232  4173 consensus_queue.cc:1048] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:05.652043 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.653076  3919 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:05.653535 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:05.653785  4214 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.654357  4313 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:05.654449  4214 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.655129  4313 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:05.655529  4313 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.655838  4313 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:05.618558  4096 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.659924 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:05.660871 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:05.661019  4096 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:05.661454 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.661777  4096 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:05.662175  3919 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:05.662221  4096 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.662783  3919 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:05.662916  4096 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:05.663233  3919 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:05.641312 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:05.643162  4211 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:05.665575 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.668897 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:05.665715 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 80916.1us
I20260709 12:21:05.670807 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.671236 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.673478 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:05.579286  4170 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.679199 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.680032 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:05.682577 29320 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 24. Ops: []
I20260709 12:21:05.683145 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:05.689437 29319 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:21:05.686941 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.690892 28605 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:05.694695 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.698082 28601 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:21:05.591185  4109 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.610818  4167 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:05.703055  3988 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:05.704003 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.704136  4173 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:05.712486  4173 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.714650  4173 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:05.714805  4136 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:05.715370  4136 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.704342  4165 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:21:05.716114 28607 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:05.716398  4165 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:05.716866  4165 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:05.717713  4165 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.718937  4165 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:05.618711  3971 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:05.709864 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:05.680112  4146 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:05.707937 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:05.725461 28675 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:05.725625 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.726286 28601 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 18.
I20260709 12:21:05.695151  4303 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:05.695551  4140 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:05.730947 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:05.619207  4095 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 12:21:05.735406  3320 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:05.739429  3320 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.721834  4167 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:05.742656 29319 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 31.
I20260709 12:21:05.745313 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.741060 29325 raft_consensus.cc:1240] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 12:21:05.743887 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:05.744239 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.746327 28598 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:05.746949 28601 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:05.705396  3831 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.753597  4214 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:05.755551  3971 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.756866  3971 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:05.757109  4184 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.757596  4184 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.730821  4206 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:05.760691 28601 raft_consensus.cc:3060] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:05.687379  4333 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.765431  3320 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:05.745042  4167 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:05.745533  4339 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:05.782238 28598 raft_consensus.cc:1275] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:05.764847  4163 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:05.829285 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:05.813158 28606 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:05.767289  4140 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:05.833967 28599 raft_consensus.cc:2393] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:05.834937 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.780634  4214 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:05.838491 28598 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 27. Current term is 28. Ops: []
I20260709 12:21:05.838276  4214 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:05.839170  4345 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:21:05.832799  4284 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:05.844636 28573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.019s	sys 0.011s
W20260709 12:21:05.845016 28573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.019s	sys 0.011s
W20260709 12:21:05.845271 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 583983us
I20260709 12:21:05.849844 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:05.851271 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:05.811004  4340 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:05.867028 28601 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 12:21:05.854421  4214 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:05.900704 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.845079  4140 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:05.835172  3703 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.847559  4284 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.881956  4170 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:05.919711 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.881712  4338 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:21:05.929733 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 288483us
I20260709 12:21:05.930940 28606 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:05.933009 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:05.951283 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:05.952845 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 258578us
W20260709 12:21:05.954470 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:05.870839  4340 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:05.963848 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:05.959345 28598 raft_consensus.cc:2368] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 30. Current term is 31.
I20260709 12:21:05.959460 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.967417 28603 raft_consensus.cc:1275] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:21:05.971410 28606 raft_consensus.cc:1275] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:21:05.977255 28606 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:05.977169  4110 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:21:05.978322 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.978868 28606 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:05.979836 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.980829 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:05.981307 28606 raft_consensus.cc:3060] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:05.986446  4184 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:05.994736  3798 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:05.999583 28496 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 342) took 35167 ms (client timeout 15000 ms). Trace:
I20260709 12:21:05.962097  4346 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:05.952277  4109 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.000900 28498 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 21 to 22, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 22 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:05.931478  4338 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:06.008524 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.024174 28599 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 31: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:05.961905  4095 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:05.969455  4268 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:05.909368  4206 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.025663 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:05.967358  4136 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.029639 28598 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:06.013880 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:06.028367 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:06.028851 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 166298us
I20260709 12:21:06.036998 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:06.042457 28607 raft_consensus.cc:1813] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Handling vote request from an unknown peer a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:06.045444 28607 raft_consensus.cc:2393] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:06.041119 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.046401 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.047235 28599 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:06.047919 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.041925 28747 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:21:06.049687 28606 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:06.050460 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.053495 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.040308 28498 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:06.024639  4346 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.027654  4338 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:21:06.048957 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:06.068354 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.059069 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:06.088135 28607 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:06.088680 28606 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 31: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:06.089728 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.074328 28498 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 17 to 18, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 18 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:06.090935 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:06.077764  3798 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.026371  4095 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.086998 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.097038 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.091490 29320 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:06.068044 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.099260 28599 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:06.093788 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.094344 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:06.102944 28606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:21:06.103690 28606 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:06.104420 28606 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:06.103741 28756 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:21:06.105082 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.105450 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:06.094292 28498 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 12 to 23, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 23 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
W20260709 12:21:06.106825 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.109407 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:06.110282 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.053160  4285 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:06.058890  3831 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.113312 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:06.106246  3988 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:06.120746  3798 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:06.126530  3988 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:06.126569 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet a5dc72678108404787b2aa034d4a7243 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:54532
I20260709 12:21:06.127283  3988 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:06.119333 28498 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:06.040109  4268 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.132354 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.124979 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.124859 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.088053  4346 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:21:06.122032 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 161830us
I20260709 12:21:06.129719 28498 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:06.112246  4330 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:21:06.138351 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.123374 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:06.098486  4095 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:06.133404 28677 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:21:06.098238  4307 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:21:06.118784  4328 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:21:06.135951 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:06.140129 28498 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:06.118340  4342 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:06.120402 28607 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:06.143371 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.139037 28606 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.138726  4358 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.138967  4170 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:06.153720 29318 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:21:06.137912  4109 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:21:06.012657 28496 rpcz_store.cc:269] 0709 12:20:30.831885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:30.860880 (+ 28995us) service_pool.cc:224] Handling call
0709 12:20:31.386882 (+526002us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b540002c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e9090 00007f6fe3a87f3a 00007f6fe983de9c 00007f6fe993c04e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc 00007f6fe7dfc392 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:05.999490 (+34612608us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:58.794177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:58.794953 (+   776us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:58.795003 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:20:58.795035 (+    32us) tablet.cc:662] Decoding operations
0709 12:20:58.887908 (+ 92873us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:58.887996 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:58.888023 (+    27us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:20:58.890149 (+  2126us) tablet.cc:701] Row locks acquired
0709 12:20:58.890199 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:20:58.890377 (+   178us) write_op.cc:270] Start()
0709 12:20:58.910217 (+ 19840us) write_op.cc:276] Timestamp: P: 1783599658890314 usec, L: 0
0709 12:20:58.945476 (+ 35259us) op_driver.cc:348] REPLICATION: starting
0709 12:20:59.032841 (+ 87365us) log.cc:844] Serialized 9494 byte log entry
0709 12:20:59.739524 (+706683us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b180024ce20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0974e07 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe39fc190 00007f6fe39f5ae7 00007f6fe39f4dd9 00007f6fe39ff930
0709 12:20:59.810656 (+ 71132us) op_driver.cc:464] REPLICATION: finished
0709 12:21:00.091260 (+280604us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b180024ce20. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992557 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:21:00.240516 (+149256us) write_op.cc:301] APPLY: starting
0709 12:21:00.240651 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:01.074877 (+834226us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:01.074920 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:02.277388 (+1202468us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:02.332870 (+ 55482us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:21:02.332946 (+    76us) write_op.cc:312] APPLY: finished
0709 12:21:02.333504 (+   558us) log.cc:844] Serialized 212 byte log entry
0709 12:21:02.469101 (+135597us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:02.489859 (+ 20758us) write_op.cc:454] Released schema lock
0709 12:21:02.586408 (+ 96549us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:02.717095 (+130687us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:02.719915 (+  2820us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":574474,"reported_tablets":47,"spinlock_wait_cycles":77551488,"child_traces":[["op",{"apply.queue_time_us":393469,"apply.run_cpu_time_us":78463,"apply.run_wall_time_us":2394063,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104207,"num_ops":24,"prepare.queue_time_us":353259,"prepare.run_cpu_time_us":98341,"prepare.run_wall_time_us":479702,"raft.queue_time_us":527763,"raft.run_cpu_time_us":10790,"raft.run_wall_time_us":272604,"replication_time_us":864919,"spinlock_wait_cycles":33546880,"thread_start_us":943335,"threads_started":5,"wal-append.queue_time_us":384498,"wal-append.run_cpu_time_us":67674,"wal-append.run_wall_time_us":2989817}]]}
I20260709 12:21:06.175822 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:06.153640 28498 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:06.147039  4092 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:06.129721  4285 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.207938 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:06.208732 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:06.129532  3919 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.210201 28606 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.132000  4313 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.151911  4279 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:21:06.215678  4348 log.cc:927] Time spent T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:21:06.226223 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.144534  4353 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:06.228068 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.231284  3320 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:06.221649 28498 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 14 to 20, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 20 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:06.138268  4283 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.207623  4109 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:06.236312 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 141996us
I20260709 12:21:06.237586 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.283453 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.216328  4242 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:06.220376  4146 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:06.287659 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.207782  4352 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:06.232182  4334 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.283484  4138 consensus_meta.cc:287] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.000s
I20260709 12:21:06.220278  4333 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.261926 28498 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 17 to 19, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 19 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:06.294471 28606 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:06.322968 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.323578 28606 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:06.218358  4092 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:06.231030  4279 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.214399  4358 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.231137  4284 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.235502  4303 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:06.321317 28571 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.285588  4109 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:06.215610  4218 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 12:21:06.326094 28606 raft_consensus.cc:1275] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:21:06.247628  4140 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.293165  4355 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:06.297219  4340 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.154331  4342 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.292083  4353 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:06.362612  4353 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:06.363131  4353 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:06.342434  4303 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:06.363775  4303 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:06.364670  4313 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.289340  4242 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:06.366618 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 185987us
I20260709 12:21:06.342097 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.358210 28498 catalog_manager.cc:5697] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 17 to 18, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 18 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
W20260709 12:21:06.357965  4118 consensus_meta.cc:287] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.004s
W20260709 12:21:06.360365  4356 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:21:06.360231 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.361065 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:06.374027 28677 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Advancing to term 31
I20260709 12:21:06.374140 28607 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:21:06.374738 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.361732  4342 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.332242  4138 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.374974 28498 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:06.375401 28607 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:06.291674  4361 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 12:21:06.376406 28680 raft_consensus.cc:2410] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:21:06.320886  4334 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.343968  3703 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 31 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.366300  4333 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:06.373245  4242 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:21:06.341231  4096 consensus_meta.cc:287] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.003s
I20260709 12:21:06.334846  4279 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:21:06.378257 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 185990us
I20260709 12:21:06.334679  4092 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:06.379784 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:06.388526 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:21:06.395287 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 167306us
I20260709 12:21:06.395982 28573 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.420706 29318 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:06.402681 28498 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 20 to 21, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:06.425743 29320 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:21:06.427850 28498 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:06.429221 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49521.8us
I20260709 12:21:06.429840 28498 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 20 to 23, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 23 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:06.430625 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:06.431890 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.435668 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.435513 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.436605 29320 raft_consensus.cc:2393] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:21:06.404083 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 268216us
I20260709 12:21:06.404527 28604 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
W20260709 12:21:06.438218 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 156143us
I20260709 12:21:06.438797 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:06.439513 29325 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:06.440179 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.422199  3724 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.443826 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.444741 29326 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 18.
I20260709 12:21:06.423414  3703 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:21:06.452724 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.447624 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:06.453867 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.454850 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:06.426342  4268 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:06.460922 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.461064 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:06.407626  4096 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.474836 29325 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:06.464852 28607 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:21:06.442726 28498 catalog_manager.cc:5697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 17 to 20, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 20 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:06.450601  4362 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.432543  4378 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:06.473318 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.443202  4001 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:06.489403 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.490272 28680 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:06.495155 28498 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:06.512825 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:06.520532 28681 raft_consensus.cc:1240] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:06.525415 28498 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:06.491060 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.511762 28677 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 31.
I20260709 12:21:06.473124  4285 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.460013  4374 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:06.528851 28682 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 26.
I20260709 12:21:06.491057  4268 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:06.530591 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.483249  4001 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:06.457480  3724 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.549860 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.472610  4355 consensus_queue.cc:1048] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:21:06.506598  4184 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:06.549990 29317 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:06.550742 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.550904 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.534858 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.489861  4362 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.524406  4378 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:06.565709 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.561982 28720 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.566444 28498 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 13 to 16, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 16 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:06.472787  4365 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
W20260709 12:21:06.541597  4366 log.cc:927] Time spent T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:21:06.568768 28677 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:06.544303  4001 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:06.532208  4358 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:06.567560 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.531749  3900 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:21:06.568075  4379 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:21:06.582554  4365 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:21:06.584718  3971 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.001s
I20260709 12:21:06.556854  4333 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.589540 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 79917.8us
I20260709 12:21:06.616686 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.590806 28674 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:21:06.592207 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:21:06.596037 28722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.621s (SENT) [suppressed 11 similar messages]
I20260709 12:21:06.603965 28498 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:06.618979 28498 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 19 to 20, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 20 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:06.574528  4380 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:06.622972 28754 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:06.608704  4304 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:21:06.624336  4218 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:21:06.628036  4380 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:06.629572  4393 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.649021 28498 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 15 to 16, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 16 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:06.634960  4373 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
I20260709 12:21:06.614728  4346 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.661255  4096 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.632066  4342 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:06.648655  4375 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 12:21:06.645995  3988 consensus_meta.cc:287] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.006s
I20260709 12:21:06.607728  4303 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.647619  4218 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:06.669797 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.681648 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:06.682420 28606 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:06.622253  4333 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:06.677860  4165 consensus_meta.cc:287] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.958s	user 0.013s	sys 0.002s
I20260709 12:21:06.659132  4380 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:21:06.658277  4370 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:21:06.679198 28603 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:06.668098 28498 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 14 to 19, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 19 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:06.693267  4303 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:06.681078  4383 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:21:06.693969  4374 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:06.722048  4374 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:06.722455  4374 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:06.728734  4333 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.730013  3919 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.697295  4353 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.645272  4378 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.732479  4353 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:06.690024 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:06.733724 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 43785.1us
I20260709 12:21:06.735121  4268 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:06.735579  4268 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:06.736816 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:06.737980  3703 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.738451  3703 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.738777  4374 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:06.672794 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 76783us
I20260709 12:21:06.743569  4334 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.746436  4374 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:06.747957  4338 consensus_meta.cc:287] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.006s
I20260709 12:21:06.854485 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.679908  3988 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.761708  4346 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.681838  4218 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:21:06.701704  4095 consensus_meta.cc:287] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.010s
I20260709 12:21:06.855657 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:06.667538  4393 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.852815 29319 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:21:06.789695  4303 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:06.845613  4173 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:21:06.752625  3724 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.845468  4381 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:21:06.684067  4096 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 LEADER]: Stepping down as leader of term 27
W20260709 12:21:06.753147 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:06.676056  4342 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.799707  4362 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.810053 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.813476 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.810472 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.802547  4138 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.887864  4338 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.808506 29320 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25. Ops: []
I20260709 12:21:06.751166  4272 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:21:06.792075  4364 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 12:21:06.785974 28498 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:06.717196  4401 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:06.784927 28604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1424) took 1096 ms. Trace:
I20260709 12:21:06.736384  4268 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.837327 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:06.790074 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34892 (request call id 3684) took 1088 ms. Trace:
I20260709 12:21:06.763425  4283 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:06.770231  4376 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 12:21:06.845396  3320 consensus_queue.cc:1048] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:21:06.754667  4368 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.411s	user 0.001s	sys 0.002s
I20260709 12:21:06.834998  3703 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.802878  4279 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.796708 28600 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:06.849603  4118 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:21:06.779613  4167 consensus_meta.cc:287] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.956s	user 0.012s	sys 0.003s
I20260709 12:21:06.813059  4384 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.770720  4353 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:06.889595  4001 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.892620 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:06.894876 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.749017 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet a5dc72678108404787b2aa034d4a7243 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:21:06.903797 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:06.905561 28756 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:21:06.906558 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:06.907953  4242 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:06.909087  4109 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:21:06.909683  4092 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:06.911841 28754 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:06.739710  4110 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Committing config change with OpId 19.12: config changed from index 7 to 12, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:06.920321  4214 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.924738 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:06.925751 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:06.927107 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:06.927409 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:06.929585 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:06.934950 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:06.998484 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 105944us
I20260709 12:21:06.939541 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:07.000828 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:06.949270  3988 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:06.951789  4095 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.052863 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:07.053673 29327 raft_consensus.cc:2368] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:21:07.054621  4095 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.952046 29317 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 31: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:06.953568  4393 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.954211  4173 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:07.055861  4173 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:07.056978  4173 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.058472  4173 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:06.959713  4342 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:06.960942 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:06.961695 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:07.061543 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 126683us
I20260709 12:21:07.061811 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.061920 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:07.062264 28721 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.062990 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.063521 28675 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:07.064496 28682 raft_consensus.cc:1240] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:21:06.958742 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:06.969024 28598 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:21:07.065299 28607 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:07.065918 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 3313) took 1036 ms. Trace:
I20260709 12:21:07.066318 28598 rpcz_store.cc:276] 0709 12:21:06.029708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.041611 (+ 11903us) service_pool.cc:224] Handling call
0709 12:21:07.065761 (+1024150us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400002154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:07.065864 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025649408}
I20260709 12:21:06.966470  4218 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.072511 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.972251 28498 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 16 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 17 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:06.973711 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:06.980031 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.987121 28602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3534) took 1105 ms. Trace:
I20260709 12:21:07.047242  4404 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:06.991485 28680 raft_consensus.cc:2368] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
I20260709 12:21:07.048067 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:06.993769 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:06.992728  4279 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:06.938591 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:07.094436 28599 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:21:07.095733 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:07.056003 28677 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:07.060570 28606 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:07.097180 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:07.002118 28751 raft_consensus.cc:2393] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:06.961269 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.003803 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:07.099319 28747 raft_consensus.cc:2368] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:21:07.099503 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:07.100291 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:07.101045 28751 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:21:07.004504 29326 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 24. Current term is 25. Ops: []
W20260709 12:21:07.006471 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.009867 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:07.010462 28752 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 31: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:06.996927  4167 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.105523  3988 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:07.106232  4167 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.091907  3798 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.107561  3798 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:06.972216  4338 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.011452 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:07.081924  4378 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:07.109706  3798 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.109987  4378 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.110877 28601 raft_consensus.cc:2393] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 25: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
W20260709 12:21:07.021010 28754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47636 (request call id 1598) took 1341 ms (client timeout 1783 ms). Trace:
W20260709 12:21:07.111405 28754 rpcz_store.cc:269] 0709 12:21:05.679609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.679801 (+   192us) service_pool.cc:224] Handling call
0709 12:21:07.020851 (+1341050us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54001c4154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:07.020959 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166894464}
I20260709 12:21:07.111829 28601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 3536) took 1194 ms. Trace:
W20260709 12:21:07.028932 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 412278us
I20260709 12:21:07.008167  4092 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.112191 28601 rpcz_store.cc:276] 0709 12:21:05.917400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.917541 (+   141us) service_pool.cc:224] Handling call
0709 12:21:07.111662 (+1194121us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003dbdd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:07.111780 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664838400}
I20260709 12:21:06.997252  4384 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.114141  4406 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:07.030107 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:07.026412 28600 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:06.997514  4353 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.115962  3900 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:21:07.117257 28600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39434 (request call id 1430) took 1373 ms (client timeout 1783 ms). Trace:
W20260709 12:21:07.117640 28600 rpcz_store.cc:269] 0709 12:21:05.743529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.743651 (+   122us) service_pool.cc:224] Handling call
0709 12:21:07.117093 (+1373442us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400233f54. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:07.117198 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414914432}
I20260709 12:21:06.971271 29323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2277) took 1289 ms. Trace:
I20260709 12:21:07.118517 29323 rpcz_store.cc:276] 0709 12:21:05.681497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.681655 (+   158us) service_pool.cc:224] Handling call
0709 12:21:05.682030 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:05.892085 (+210055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:05.892128 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:05.916200 (+ 24072us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.099592 (+183392us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:21:06.099637 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.099704 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.791350 (+691646us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:21:06.971014 (+179664us) raft_consensus.cc:1685] finished
0709 12:21:06.971034 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.971216 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14221,"raft.queue_time_us":32866,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":10096512,"thread_start_us":320687,"threads_started":2,"wal-append.queue_time_us":428161}
I20260709 12:21:06.971855 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.985033 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.121440 28678 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:07.002959 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:07.001883 28490 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 253016us
I20260709 12:21:06.972832 28604 rpcz_store.cc:276] 0709 12:21:05.688589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.688714 (+   125us) service_pool.cc:224] Handling call
0709 12:21:06.784751 (+1096037us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54000a8554. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:06.784859 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630953856}
I20260709 12:21:07.075824 28572 leader_election.cc:400] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:21:07.122745 28572 leader_election.cc:403] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:21:07.075664 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:06.985484 28681 rpcz_store.cc:276] 0709 12:21:05.701322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.701516 (+   194us) service_pool.cc:224] Handling call
0709 12:21:05.701865 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:06.526248 (+824383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.789720 (+263472us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54003755d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:06.789994 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857872640}
I20260709 12:21:07.076310 28498 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 17 to 19, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 19 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:07.123689 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48115.2us
W20260709 12:21:07.082613 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 109017us
I20260709 12:21:07.083640 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:06.986836 29321 raft_consensus.cc:2955] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 7 to 12, VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:07.076763 28602 rpcz_store.cc:276] 0709 12:21:05.881907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:05.882045 (+   138us) service_pool.cc:224] Handling call
0709 12:21:05.911963 (+ 29918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:06.135105 (+223142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:06.135134 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:06.135528 (+   394us) log.cc:844] Serialized 26 byte log entry
0709 12:21:06.313314 (+177786us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:21:06.432909 (+119595us) log.cc:844] Serialized 14 byte log entry
0709 12:21:06.443015 (+ 10106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:06.443088 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:06.691658 (+248570us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b18000a57c0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:21:06.769874 (+ 78216us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b2400172328. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08189c4 00007f6fe0816acb 00007f6fe09d1dc9 00007f6fe09d1a55 00007f6fe09d109d 00007f6fe360310e 00007f6fe361a88c 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221
0709 12:21:06.986855 (+216981us) raft_consensus.cc:1685] finished
0709 12:21:06.986898 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:06.987051 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2753,"prepare.queue_time_us":243660,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":92645,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":12536,"spinlock_wait_cycles":36816384,"thread_start_us":497122,"threads_started":3,"wal-append.queue_time_us":227054}
I20260709 12:21:07.089747 28607 raft_consensus.cc:2468] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
W20260709 12:21:07.091135 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 57859.6us
I20260709 12:21:07.090816 29322 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:07.127403 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:21:07.127864 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56025.5us
I20260709 12:21:07.118086  4353 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:06.959985  4163 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.115800 28648 leader_election.cc:400] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 30 pre-election: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 30. Current term is 31.
I20260709 12:21:07.143575 28648 leader_election.cc:403] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 30 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:07.141032 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:07.116266 28676 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:07.033584 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:07.138813 29317 raft_consensus.cc:2368] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:21:07.139832 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:06.970242  4272 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:07.140034 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:07.141009 28572 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:07.115929  4406 consensus_queue.cc:1048] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:21:06.955700  4096 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:06.998688  4165 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:07.146224 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:07.133492 28722 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:07.166934 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:07.001281  4001 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.006305  4242 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.135690  4138 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:07.141569 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60252.4us
I20260709 12:21:07.151202 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:07.151520 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:07.176915 28607 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:07.151208 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:07.082147  4283 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:07.148974 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:07.178785 28676 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:07.157094 29322 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:07.141705 28750 raft_consensus.cc:1240] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 26. Current term is 27. Ops: []
I20260709 12:21:07.119570  4095 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:07.159904 28498 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 13 to 18, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 18 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:07.115792  4384 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:07.123358  4170 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:07.160319 28647 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:07.093505  4342 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.073s
I20260709 12:21:07.146938 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.157073  4353 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:06.953862  4303 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.174399 28572 leader_election.cc:400] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:21:07.204898 28603 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:07.220333 28572 leader_election.cc:403] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:21:07.206838 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:06.937768  4380 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.006596  4109 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.046064  4401 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.113s
I20260709 12:21:07.009119  4214 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.181629  4333 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:21:07.150801  4279 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader pre-election lost for term 30. Reason: Vote denied by peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) with higher term. Message: Invalid argument: T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 30. Current term is 31.
I20260709 12:21:07.147557  4378 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.152302  3971 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.257417  3971 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.259608  3971 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.149426  3320 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:07.198184  4389 raft_consensus.cc:2804] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:07.260788  4389 raft_consensus.cc:697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:07.261787  4389 consensus_queue.cc:237] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.199994  4136 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:07.264727  4136 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.267102  4136 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.200671 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:07.200848  4371 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:07.200671 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.268456  4371 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.268922  4371 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:21:07.269284 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68702.8us
I20260709 12:21:07.202292 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:07.273798  4384 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:07.274847  4384 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:21:07.275863  4384 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:21:07.202802 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 55944.5us
I20260709 12:21:07.203294 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.203361  4339 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:21:07.204138  4424 log.cc:927] Time spent T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:21:07.115808  4355 consensus_queue.cc:1048] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:21:07.222406 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:07.157850  4146 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:07.191994 28498 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:07.223873 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.219376  4283 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:07.123557  4404 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:07.235013 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 60823.4us
I20260709 12:21:07.146867  4362 consensus_queue.cc:1059] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:21:07.143229  4338 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:07.185781  4092 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:07.158453  3703 consensus_queue.cc:1059] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.066s
I20260709 12:21:07.157155  4163 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.168352  4165 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.282676 28753 raft_consensus.cc:2393] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:07.288678 28680 raft_consensus.cc:2368] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
I20260709 12:21:07.288378 28681 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:07.280948 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.317639 28677 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:07.271960 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:07.289932 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:07.276664 29318 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:07.299089 28498 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 21 to 23, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 23 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.319140 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:07.300381 29317 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:21:07.320061 29320 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:21:07.248144  4167 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:07.182368  3724 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.079s
I20260709 12:21:07.276284  4384 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:07.239774  4353 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:07.309681 29322 raft_consensus.cc:2410] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 25 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 12:21:07.320029 28498 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:07.323192 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 51351.8us
I20260709 12:21:07.363227 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.278087  4303 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.276348  4109 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.326479 28675 raft_consensus.cc:1275] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:21:07.302770  4333 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.246541  4272 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.372694  4333 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.373183  4272 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:07.375005  4333 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.252070  4096 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.369825  4404 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.371968  4380 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.378448 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.384593 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.324043  4165 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:07.386854 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 97014.6us
I20260709 12:21:07.351548  4242 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:07.400534 29290 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.375995  4146 raft_consensus.cc:3055] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:07.403967 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.407403 29290 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.377624  4214 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.378443  4136 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:07.421728  4425 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:21:07.426875 28676 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
I20260709 12:21:07.397326  4096 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:07.433360  4163 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.397037  4404 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:07.436851  4404 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:07.437322  4404 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:21:07.439764 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.440583 28571 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:07.409157  4146 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:07.412976  4406 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:21:07.441779  4146 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.442981  4146 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:07.443179  3703 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:07.443717  3703 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:07.444559  3703 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:07.446403  4415 log.cc:927] Time spent T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:21:07.418191  4279 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:21:07.447849  4279 consensus_queue.cc:1243] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:21:07.448311  4279 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:07.400950  4283 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.448665  4279 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:07.449510  4279 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.450629  4279 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:07.398947  4109 raft_consensus.cc:2764] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
W20260709 12:21:07.453492 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 46173.3us
I20260709 12:21:07.458473  4342 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.407754  4218 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.445186  4401 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:07.405934  4353 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.474156  4371 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.495533  4371 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.458688  4214 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:21:07.455866  4242 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:21:07.474053  4342 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:07.515137 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 381735us
I20260709 12:21:07.517174 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:07.520857 29318 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:21:07.522054 28722 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:07.525928 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.531616 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:07.544705 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 368408us
I20260709 12:21:07.454628  4136 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:07.555881 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 412690us
I20260709 12:21:07.560631 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:07.557571 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 178884us
W20260709 12:21:07.582619 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.488047  4109 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.071s
I20260709 12:21:07.600535 29318 raft_consensus.cc:2468] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:07.522652  4218 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.605937 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:07.542246  4163 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.609157 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:07.558328  4428 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:07.455677  4384 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.568980  4242 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.625268 28647 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:07.629702 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:07.605471  4303 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:07.672679 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:07.676805  4110 raft_consensus.cc:2804] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:07.679344 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:07.680634  4118 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.681120 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.681453  3971 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.681910  4428 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:07.682878 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.686416  4001 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:07.687639 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:07.688366 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:07.692878  3703 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:07.625312  4163 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.701601  4338 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:21:07.630643  3724 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.072s
I20260709 12:21:07.708324  4136 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:07.712219 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.577612  3988 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.098s
W20260709 12:21:07.713328 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:07.784972 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:07.721581  4167 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 17. Current term is 18.
I20260709 12:21:07.721302 28677 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
W20260709 12:21:07.714003 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 153441us
I20260709 12:21:07.676017  4242 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.598907  4092 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:21:07.726378 28747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.012s
W20260709 12:21:07.822108 28747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.007s	sys 0.013s
I20260709 12:21:07.620978  4218 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:07.766022  4173 consensus_meta.cc:287] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.001s
I20260709 12:21:07.768229  4404 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.715637 29318 raft_consensus.cc:1240] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:07.787891 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:07.790078 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:07.736901  4384 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:07.855082 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 54534.8us
I20260709 12:21:07.731825  4110 raft_consensus.cc:697] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:07.792778 29320 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
W20260709 12:21:07.798045  4426 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:21:07.728052  3971 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.798789 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:07.799449  4436 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:21:07.799556  4165 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.805096  4428 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.805943  4342 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:07.761270  4138 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:07.722070  4118 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.718405  4437 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:07.810789 28673 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 28.
I20260709 12:21:07.881845 28748 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:07.812960  4163 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.760519  4001 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:07.814958  4435 consensus_queue.cc:1048] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.020s
W20260709 12:21:07.846848 29321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.020s	sys 0.024s
W20260709 12:21:07.899926 29321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.021s	sys 0.024s
I20260709 12:21:07.849489 29318 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:21:07.900923 29318 pending_rounds.cc:85] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 14
I20260709 12:21:07.901234 29318 pending_rounds.cc:107] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:21:07.901536 29318 raft_consensus.cc:2889] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:07.816623  4242 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:07.794325  4405 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:21:07.867707 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 270186us
I20260709 12:21:07.871908 29326 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:07.850335  4427 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:21:07.905731 29322 raft_consensus.cc:1240] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:21:07.908557 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.912153 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.914742 29292 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:07.890067  4437 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:07.907979  4405 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:07.914322  4427 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:07.916767  4214 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:07.921296  4353 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:21:07.924873  4437 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:07.931423  4446 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:07.925701  4242 consensus_queue.cc:1059] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.016s
I20260709 12:21:08.047703  4339 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:21:08.048338  4339 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:07.998597 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:08.052022 28602 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:07.852368 28603 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:21:07.999001 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 369205us
I20260709 12:21:08.060820  3798 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.925662  4092 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.061709  3798 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.064049  4118 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.000650 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:08.065799 28600 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:08.067014  4001 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:07.871531 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:07.847411 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:08.079883 28604 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:21:08.080058 28605 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:08.081314 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:08.082190 28604 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:08.083065 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:08.002409 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:07.946745  4427 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:07.849205 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:08.003213 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.086932 28607 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:07.829310 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:08.016614 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 184891us
I20260709 12:21:08.090963 28720 leader_election.cc:400] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
W20260709 12:21:08.091171 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:08.017586 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 147038us
I20260709 12:21:08.092204  4447 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:21:08.019920 28747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 3280) took 1090 ms. Trace:
W20260709 12:21:08.035015 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 308734us
I20260709 12:21:08.096627 28747 rpcz_store.cc:276] 0709 12:21:06.929104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:07.101412 (+172308us) service_pool.cc:224] Handling call
0709 12:21:07.101744 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.122143 (+ 20399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.122175 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.146646 (+ 24471us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.822612 (+675966us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:21:07.822671 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.822780 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.019278 (+196498us) raft_consensus.cc:1685] finished
0709 12:21:08.019329 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.019642 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20356,"raft.queue_time_us":24351,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5786,"thread_start_us":629749,"threads_started":1,"wal-append.queue_time_us":708898}
I20260709 12:21:07.927547  4110 consensus_queue.cc:237] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.100170 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.102483 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:08.103776  4439 log.cc:927] Time spent T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:21:08.037310 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2296) took 1230 ms. Trace:
I20260709 12:21:08.037487  4096 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.104683 29325 rpcz_store.cc:276] 0709 12:21:06.806395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.816959 (+ 10564us) service_pool.cc:224] Handling call
0709 12:21:06.828411 (+ 11452us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095aa22 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:21:06.832326 (+  3915us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b58001c4798. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ae9c 00007f6fe095aa5b 00007f6fe98738d9 00007f6fe89cdee0 00007f6fe8a970ab 00007f6fe8a97131 00007f6fe8a58fc0 00007f6fe8a43929 00007f6fe8a433d2 00007f6fe1fbabd4
0709 12:21:06.832535 (+   209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:07.116812 (+284277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:07.116845 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:07.117411 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:21:07.253632 (+136221us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:07.253675 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:07.356913 (+103238us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54005861d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:07.356978 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:08.036694 (+679716us) raft_consensus.cc:1685] finished
0709 12:21:08.036739 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:08.037061 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1958,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":15127,"spinlock_wait_cycles":667728256,"thread_start_us":135852,"threads_started":1,"wal-append.queue_time_us":459210}
I20260709 12:21:08.038620  4165 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.107736 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.040561 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.109779 29317 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 19: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:08.110050 28601 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:21:08.042410 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.110140  4242 raft_consensus.cc:3055] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:21:08.110685  4242 raft_consensus.cc:740] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:08.113713 28677 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:21:08.114509 28748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 3272) took 1188 ms. Trace:
I20260709 12:21:08.115015 28748 rpcz_store.cc:276] 0709 12:21:06.925426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.925543 (+   117us) service_pool.cc:224] Handling call
0709 12:21:08.113954 (+1188411us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54001b3fd4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:08.114222 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932028160}
I20260709 12:21:08.116266  4434 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:21:08.042735  3971 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.084230 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:07.948799  4404 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:07.946506  4405 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.058660  4218 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.059342 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:08.062263 28573 leader_election.cc:400] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:21:08.000337 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:08.050485  4339 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.077162  4268 raft_consensus.cc:3055] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:08.001971 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:08.085729 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:08.106107  4096 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.038480  4279 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.043372  4355 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.119103 28605 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:08.120378 28604 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:08.123131 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.117614  3798 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.123041  4437 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.123739 28602 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:08.141270 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.133389  4268 raft_consensus.cc:740] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:08.150007 28601 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:21:08.151726 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.153611  4406 consensus_queue.cc:1059] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:21:08.154862 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 73334us
I20260709 12:21:08.150432 28720 leader_election.cc:400] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21.
W20260709 12:21:08.155112 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 93213.9us
I20260709 12:21:08.161666 28599 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: [20.12-21.13]
I20260709 12:21:08.112138  4242 consensus_queue.cc:260] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.167418 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:08.168018  4242 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:08.174309 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:08.175153 28748 raft_consensus.cc:2376] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24. Re-sending same reply.
I20260709 12:21:08.175422 29290 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:08.176818 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.178041 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:08.178412  4268 consensus_queue.cc:260] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.180011 29327 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 24. Current term is 25. Ops: []
I20260709 12:21:08.181735  3798 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:08.182317 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.183145 28603 raft_consensus.cc:2410] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:21:08.183822 28606 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 27. Current term is 28. Ops: []
I20260709 12:21:08.181759  4339 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:08.183413  4437 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.193660 28603 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:08.186132  4096 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:08.201102 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 108655us
I20260709 12:21:08.214171 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:08.201917  4448 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:08.156339  4355 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.212117  4268 raft_consensus.cc:3060] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:08.156724  4279 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.221161 28600 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:08.220083 28573 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.249071 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.250531 29327 raft_consensus.cc:2393] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:08.218161  4448 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:08.263891 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:08.261093 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 83250.3us
I20260709 12:21:08.265872  4218 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:08.266341  4218 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.266676  4218 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:08.269004 28673 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:08.263136 28604 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:08.283123  4447 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:08.264598  4448 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:08.280373  4434 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:08.288941  3798 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:21:08.289420  3798 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:08.289786  3798 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:08.288941  4434 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:08.290973  4434 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:08.303992 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 86067.2us
I20260709 12:21:08.305063 28573 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.307619  4338 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:08.307812 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 125721us
I20260709 12:21:08.309085 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.308914  4146 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:08.310305  4355 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.310986  4146 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:08.317863 28675 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 12:21:08.323967  3724 raft_consensus.cc:3055] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:08.324384  3724 raft_consensus.cc:740] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
W20260709 12:21:08.325906  4457 log.cc:927] Time spent T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:21:08.325865  3724 consensus_queue.cc:260] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.329167  4384 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.332530  4384 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.335031  4279 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.341594  4092 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.342372  4092 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.327934  3724 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:08.340421  4384 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.368789 28573 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:08.374007 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.389678  4381 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:08.390558  4381 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.395252  4109 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.395900  4109 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.398133  4092 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.398386  4109 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.399341  4303 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.400141  4303 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.402783  4303 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.406618 28572 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.360266  3798 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:08.418097 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.424844  4167 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:21:08.425441  4304 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:08.426175  4304 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.430122  4405 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:08.433661 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.437750  3798 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.441169 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.443351 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.444694  4447 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:08.444821  4333 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:08.445401  4447 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:08.445607 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.447285 28747 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 27. Current term is 28. Ops: []
I20260709 12:21:08.448086  4453 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.453161  4453 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.454487 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.455842  4453 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.448479 28748 raft_consensus.cc:1240] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:08.448618  4118 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:08.449306 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.447271  4170 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:08.455974 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:08.458277 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:08.459177  4451 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:21:08.465286 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46891.6us
I20260709 12:21:08.475591 28753 raft_consensus.cc:2393] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 27: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:08.465983  4304 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:08.480289 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 141085us
I20260709 12:21:08.492712 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:08.492784 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.475708  4170 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:08.482398 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 50090.4us
I20260709 12:21:08.495888  4242 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:08.475734 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.484615  4118 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.485754  4451 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.488013 28752 raft_consensus.cc:2368] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
I20260709 12:21:08.496014  4170 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.502784 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.504365 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.504807 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.505290  4451 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.484252  4272 consensus_queue.cc:1059] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:21:08.506556  4272 raft_consensus.cc:3055] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:08.506964  4272 raft_consensus.cc:740] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:08.508119 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.508973  4242 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.511644  4242 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.515656  4092 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:08.517792  4092 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:08.518133  4092 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:08.518934  4118 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.512033  4381 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:08.521111 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.527302 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.462523  4218 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.520733 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.530402 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:08.537106 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.519469  4092 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.537470  4167 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:08.551321 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:08.552697 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.552845 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:21:08.553921  4459 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.003s
I20260709 12:21:08.554095 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.555442 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:08.556052  4268 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.556242 28749 raft_consensus.cc:606] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:08.556684 28749 raft_consensus.cc:614] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:08.556782 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.557708 29322 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:08.558770  4401 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.559350 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:08.559544  4401 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.560609  4406 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:08.556824  4268 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.563408  4268 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.508142  4272 consensus_queue.cc:260] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.569384 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.570262 28676 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:08.571127 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:08.571920 28681 raft_consensus.cc:3060] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:08.572125  4272 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:08.573064  4427 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:21:08.573746 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 81191.6us
I20260709 12:21:08.574666 28573 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.576634 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.577427 28752 raft_consensus.cc:2368] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
I20260709 12:21:08.578424 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.580775 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.581310 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.582659 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.581482 28673 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:08.581362 28674 raft_consensus.cc:1240] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:08.586476 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.570192  4333 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:08.595973 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:08.600410 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.588769  4218 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.603152 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:08.604521 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.602473 28678 raft_consensus.cc:3055] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:08.607407 28678 raft_consensus.cc:740] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:08.609524 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.596880  4338 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:08.613262 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:08.619793 28721 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:08.626132 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.610306  4279 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:08.630295 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 55792.9us
I20260709 12:21:08.638408  4401 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.640050 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.640952 28674 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:08.641860 28674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:21:08.642963 28674 raft_consensus.cc:606] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:08.643361 28674 raft_consensus.cc:614] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:21:08.630898 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 186706us
I20260709 12:21:08.619443  4303 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.646404  4303 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.649145  4279 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.652032  4279 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.627964  4451 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:08.656710  4451 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:08.657136  4451 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:08.658004 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.659202 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:08.659723 28679 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 23
W20260709 12:21:08.662858 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.623761  4339 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.667809 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.669545 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:08.670492 29317 raft_consensus.cc:3060] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:21:08.672724  4469 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.137s	user 0.003s	sys 0.000s
I20260709 12:21:08.678015 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.670492 29323 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:08.679530 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.624075  4434 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.686553  4218 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:08.690465  4333 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:08.712831 28751 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:21:08.716658 28681 raft_consensus.cc:2468] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:08.718196 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.679917  4448 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.712417  4001 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:08.716300  4118 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:08.740142  4472 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:21:08.758675  4451 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.729184 29322 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:21:08.717118  4339 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.761901  4389 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:08.762710  4339 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.719552  4303 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.732372 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.769912  4434 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.770885 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.772085 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.733923 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:08.713842 28678 consensus_queue.cc:260] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.762758  4389 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.773855 28678 raft_consensus.cc:3060] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:08.775691  4389 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:08.737287 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57828.2us
I20260709 12:21:08.776245 28674 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:08.777092 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.777302 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:08.778333  4001 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:21:08.779018 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:08.780350  4001 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:08.739019 28675 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:08.782637 28677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:21:08.782878  4092 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:08.783221 28677 raft_consensus.cc:606] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:08.718173  4218 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.784725  4448 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.786065  4218 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.786664  3320 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:21:08.788604 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.789672 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:08.791056  4279 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:08.791467  4279 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:08.791810  4279 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:08.793969 29290 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:08.740530 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53713.9us
I20260709 12:21:08.744249 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.794967 28682 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:21:08.795209 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.724153  4384 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:08.739893  4118 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.796348  4384 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.797785  4118 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.798287 29327 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:08.799203  4242 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:08.799938  4242 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:08.799167  4384 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.801975  4384 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:08.802619  4384 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.805065  4384 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.805960 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:08.807144 28679 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:08.772207 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:08.813591 28675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:21:08.814510 28674 raft_consensus.cc:2393] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 20: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:08.814347 29317 raft_consensus.cc:2468] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:08.814204 28675 raft_consensus.cc:606] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:08.817903 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 32 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.825387 28721 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:08.830405  4451 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.832039  4110 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.832649  4110 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.823707  4339 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.011s
I20260709 12:21:08.837118 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.840349 28680 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 28.
I20260709 12:21:08.841645 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.842470  4170 consensus_queue.cc:1059] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:08.843360  4170 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:08.843550  4427 raft_consensus.cc:3055] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:08.844039  4427 raft_consensus.cc:740] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:08.845021  4427 consensus_queue.cc:260] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.846295  4427 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:08.851181 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.853745  4453 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:08.855583  4453 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:08.855966  4453 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:08.857892  4381 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:21:08.834878  4110 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.842895 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:08.870321 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.870672 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:08.872131 28678 raft_consensus.cc:1275] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:21:08.877476 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.879339 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:08.856344  4453 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:08.880681 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 32 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:08.870404  4118 raft_consensus.cc:2804] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:08.860592  4272 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:08.886439 28682 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 32 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:21:08.881659 28751 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
W20260709 12:21:08.888489 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.889514 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:08.892509 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49679.3us
I20260709 12:21:08.893458 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.890311 28747 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:08.901286 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.881229  4381 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:08.831378  4450 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 12:21:08.907106 28756 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 32 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
W20260709 12:21:08.907528 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 135456us
I20260709 12:21:08.914778  4167 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:08.915416  4167 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.917651  4167 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.919247  4272 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:08.919971 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:08.927485 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:08.930151 28753 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:21:08.905572  4451 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:08.942543  4381 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:08.910285  4170 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:21:08.944168 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:08.955993 29326 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:08.944659 28722 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:08.906090  4118 raft_consensus.cc:697] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:08.960073 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:21:08.944080  4480 log.cc:927] Time spent T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.108s	user 0.001s	sys 0.003s
I20260709 12:21:08.972568  4381 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:08.995733  4381 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:08.996727  4381 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.997910  4381 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:08.997987  4279 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.974540  4173 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.001056  4173 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.003957  4173 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:08.975086  4389 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:09.004721  4389 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:09.005126  4389 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:09.007581  4279 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:08.977072  4475 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 12:21:08.978291  4118 consensus_queue.cc:237] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:08.979539 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:08.979697 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:09.009987 28678 raft_consensus.cc:2368] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23.
I20260709 12:21:08.963712  4434 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.010771  4434 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:08.983464  3798 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:21:09.013893  4434 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:08.984021 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:21:09.016464 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 123376us
I20260709 12:21:09.018352 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:08.984865 28648 leader_election.cc:400] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
I20260709 12:21:09.019381 28648 leader_election.cc:403] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.020118  4279 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21.
I20260709 12:21:08.986618  4304 consensus_queue.cc:1048] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:08.987859  4380 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:09.020982  4380 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.023159  4380 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:08.990017 28753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:09.023942 28753 raft_consensus.cc:606] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:09.024367 28753 raft_consensus.cc:614] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:08.948305  4452 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:09.026422  4452 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:09.026964  4452 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:09.028050  4279 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:08.984790 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:09.020043 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 87799.5us
I20260709 12:21:09.030772 28648 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:09.032112 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:09.032397 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:09.033593 28648 leader_election.cc:400] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
I20260709 12:21:09.035003 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:09.035203  4339 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:09.035785 28756 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
I20260709 12:21:09.035154 28648 leader_election.cc:403] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.036274 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:09.035063  4406 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:09.037299 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:09.037463  4406 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23.
I20260709 12:21:09.041121 28753 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:09.041381 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.042315 28602 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:21:09.035755  4279 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.045485  4450 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:09.046079  4450 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:09.046583  4450 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:09.048713  4384 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:09.049063 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:09.049515  4384 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:09.051023  4384 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.051962 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:21:09.054980 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:09.055409 28648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.048940  3798 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:09.057507  3798 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.057149  4279 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:09.067147 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 48932.3us
W20260709 12:21:09.069051 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 159520us
I20260709 12:21:09.069540 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.070513 29325 raft_consensus.cc:1217] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Deduplicated request from leader. Original: 21.16->[22.17-22.17]   Dedup: 22.17->[]
I20260709 12:21:09.075765 29325 raft_consensus.cc:1240] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 12:21:09.071079  4304 raft_consensus.cc:2804] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:09.071251 29317 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:21:09.111141 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 76072.8us
I20260709 12:21:09.120734 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:09.121657 29326 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:21:09.123024 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.126962 28598 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:09.137681 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.137316 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:09.139384 28753 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:09.141448 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:09.137262 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:09.145066 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:09.152746 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.153800 28607 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:21:09.159623 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.156194 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:09.161469 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:09.131892 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.164687 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:09.164882 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:09.165369 28748 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:09.166391 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:09.167083 28677 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 28.
I20260709 12:21:09.167863 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:09.109627  4272 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.166054 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:09.124294  4406 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:09.183923 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46952.1us
I20260709 12:21:09.187770  3320 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.186743 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:09.190912  4448 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.191602  4448 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.192354 28599 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:09.194978  4448 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:09.190181 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:09.138702  4304 raft_consensus.cc:697] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:09.203142 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:09.206598 29326 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:09.215787 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:09.216964 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:09.213502  3320 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.185874  4110 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:21:09.219363 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 32 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.221390 28605 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:21:09.223438 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.231482  4167 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.232134  4167 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.234529  4167 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:09.255077 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 185609us
I20260709 12:21:09.254935 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.259711 28602 raft_consensus.cc:2410] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for term 32 because replica has last-logged OpId of term: 29 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:21:09.215893  4434 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:09.200786  4092 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:09.219327  4303 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:21:09.268729 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:09.269502 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:09.270076 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:09.274017  4362 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.100s
I20260709 12:21:09.274716 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.276494 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.287971 28600 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:09.217880  4453 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.280885  4304 consensus_queue.cc:237] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.265108 28673 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:09.286101 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.288977 28647 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:09.289186 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.268754 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:09.297336 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.298210 28602 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:09.205695  4389 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.303098 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.303895 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.306543 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.285763  4092 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.202467  4272 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.314975 28755 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:09.310029  3320 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:09.316335 28604 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 25: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:09.290583  4434 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:09.319828 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:09.319490 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.321187 28607 raft_consensus.cc:1275] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:21:09.322048 28605 raft_consensus.cc:2468] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:09.322283 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.329313 28602 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:09.303659  3724 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:21:09.331045 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 200028us
I20260709 12:21:09.334118 28720 leader_election.cc:400] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23.
I20260709 12:21:09.334543 28720 leader_election.cc:403] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.335023 28648 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:09.345091 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 203745us
I20260709 12:21:09.345614 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.347035 28606 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:21:09.352825  3798 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.353703  3798 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.356839 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.315042  4092 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:09.356899 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.330544  4434 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:21:09.362278 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 47149.5us
I20260709 12:21:09.363386 28604 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:09.368646  3724 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:09.371198  3724 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.373078 28601 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:09.375535  4272 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:09.376540 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.377220 28602 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:09.378636 28748 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:09.385535  4453 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:09.358263  4401 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:09.385939 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:09.388536 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 31.
I20260709 12:21:09.389434  4429 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23.
I20260709 12:21:09.319993  4452 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:09.385593  4427 consensus_meta.cc:287] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 12:21:09.392290 28752 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:09.393435  4452 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:09.364257 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 134154us
I20260709 12:21:09.401772 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:09.402711 29317 raft_consensus.cc:2368] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
W20260709 12:21:09.412925 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:09.413594 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.413681 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:09.422519 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:09.423199 28673 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 31.
I20260709 12:21:09.423892 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:21:09.425273  4489 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:21:09.428732 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:09.432801 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:09.434149 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:09.435878 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.446574  4092 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.399300  4242 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:21:09.456012 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 46651.8us
I20260709 12:21:09.470463 28602 raft_consensus.cc:1275] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:21:09.472913 28602 pending_rounds.cc:85] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 16
I20260709 12:21:09.474896 28678 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:09.478180 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:09.487520 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51723.1us
I20260709 12:21:09.488633 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.473213 28602 pending_rounds.cc:107] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 22.17
W20260709 12:21:09.494105 28572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.495663 28572 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:09.492936 28602 raft_consensus.cc:2889] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:09.468561  4401 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.497571  4496 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:21:09.500622  4362 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:09.500900  4401 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.501354  4496 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:09.501756  4496 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:09.502568 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:09.503029  4401 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:09.503643  4499 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:21:09.504055  4499 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.504372  4499 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:21:09.506922 28572 leader_election.cc:400] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:21:09.507225 28572 leader_election.cc:403] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:21:09.508606 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.502591  4496 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.514777 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.515259  4427 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:09.516239  4362 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:09.517374  4405 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:09.522994 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:09.519259  4487 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
I20260709 12:21:09.519857 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:09.507978 28682 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:21:09.529138  4501 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:09.521555 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.530002 28607 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:09.526715 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:09.530409  4362 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.530025  4405 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.533216 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.533389  4405 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:09.531069 28603 raft_consensus.cc:2393] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 25: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:09.535422  4110 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:09.527287  4268 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 20. Current term is 21.
I20260709 12:21:09.535712  4272 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:09.497756  4448 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:21:09.536835 28722 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.537513  4448 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:09.538033 28722 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:09.536984  4279 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:09.492475  4303 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:09.547132  4303 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:09.547672  4303 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:09.496097  4384 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:09.539439 28722 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.549388 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:09.550120 28605 raft_consensus.cc:2393] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:09.550201 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.545394  4427 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:09.545729  4501 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:09.520979  3798 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:09.542508  4279 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:09.544457 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:09.551847 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 62727.5us
I20260709 12:21:09.555027 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:09.560390 28604 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 31.
I20260709 12:21:09.557739 28722 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.564491 28722 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.552098  4427 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:09.567365  4450 consensus_meta.cc:287] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.003s
I20260709 12:21:09.567512  4501 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:09.567620  4427 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:09.567845  4450 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.556399  4381 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:09.569000 29326 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:09.554762 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:09.572741  3798 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:09.568287  4499 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.573521  4405 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:09.575261 28721 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:09.553997  4406 raft_consensus.cc:993] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
W20260709 12:21:09.590951 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.581497  4405 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:09.595547 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:09.596295  3320 consensus_queue.cc:1048] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:09.583495  3798 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:09.586169  4496 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:09.586236  4381 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:09.606700 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52035.9us
I20260709 12:21:09.583227  4268 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:09.553421  4434 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.595302  3724 raft_consensus.cc:1081] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:21:09.609655 28722 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:09.608177  3798 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:21:09.611690  4491 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 12:21:09.597945 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 109372us
I20260709 12:21:09.620095 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:09.621309  4338 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:09.624287 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:09.627525 28682 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:21:09.625005 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.677887 28678 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:21:09.753990 28682 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 29.
I20260709 12:21:09.658237 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:21:09.657305 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:09.677732 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:09.698395 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:09.766381 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 141489us
I20260709 12:21:09.766357 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:09.767669 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:09.771311 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:09.772668 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 74391.6us
I20260709 12:21:09.772759 28606 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 28. Current term is 29. Ops: []
I20260709 12:21:09.773872 28720 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:09.776713 29326 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:21:09.626973  3798 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:09.626322  4333 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:09.778496  3320 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:21:09.781863  3320 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.782263  3320 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:21:09.780792 29292 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:09.658167  4507 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.677042  4499 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 29 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:09.641825  4381 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:09.692340  4434 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:09.652218  4450 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:09.787097 29327 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:09.778764 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.644297  4242 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:09.689693  4389 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:09.677155  4092 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:09.678391  4362 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:09.791584 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.661623  4427 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.675921  4272 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.111s
I20260709 12:21:09.784230  4384 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:09.638665  4338 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.781991  4437 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:09.782094  3724 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:21:09.800666 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 142513us
I20260709 12:21:09.782734  3798 raft_consensus.cc:3060] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:09.632515  4268 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.672236  4303 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.666986  4279 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.786821  4381 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:09.795985  4242 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:09.676762  4405 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.801980  4362 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:21:09.823778 28682 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 28. Current term is 29. Ops: []
I20260709 12:21:09.798153  4499 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:09.827991 28751 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:21:09.797137  4304 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:09.794584  4333 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.819859  4450 raft_consensus.cc:2804] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:09.800242  4173 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:09.803078  4384 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:09.788121  4507 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.821312  4496 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.855654 28673 raft_consensus.cc:1275] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:21:09.858533 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:09.861485 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:09.826088  4381 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:09.802595  4001 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:21:09.873826  4001 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:21:09.874234  4001 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:09.875142  4001 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.876328  4001 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:21:09.883963 29322 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:09.886893  4279 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:09.887467  4511 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:09.887805  4118 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:21:09.819213  4513 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.083s
I20260709 12:21:09.849539  4167 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:09.869356 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:09.864562  4384 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:09.915158 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.874322  4173 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:09.900249  4517 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:09.895907 28756 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
I20260709 12:21:09.910742  4427 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:09.862743  4304 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:09.897102 29320 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 31.
I20260709 12:21:09.871292  4448 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.872836  4450 raft_consensus.cc:697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:21:09.955709 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 174997us
I20260709 12:21:09.956868 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:09.867019  4499 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:09.916242  4434 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:09.922195  4511 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:09.976629 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:09.954707 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:09.971441 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:09.892285  4496 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:09.973107 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 47786.4us
I20260709 12:21:09.975353 29320 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 12:21:09.982467 29320 pending_rounds.cc:85] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 17
I20260709 12:21:09.982769 29320 pending_rounds.cc:107] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 12:21:09.983117 29320 raft_consensus.cc:2889] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:09.984539 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:09.986966 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 104446us
I20260709 12:21:09.990272 29318 raft_consensus.cc:1240] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 12:21:09.990631 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:09.977456  4096 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:21:09.994176 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:09.926203  4517 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.002528 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:09.975855  4453 consensus_queue.cc:1048] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.018s
I20260709 12:21:10.013461 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:21:10.015460 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 249158us
I20260709 12:21:09.978161  4434 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.021369 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.022087 28600 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:10.023020 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.024241 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:09.978693  4448 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:09.973667  4173 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.007684  4513 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:21:10.035302 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49642.5us
I20260709 12:21:10.041769  4517 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.043213  4517 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:10.043808  4517 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.046133 29322 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 25: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:21:10.046197  4516 log.cc:927] Time spent T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:21:10.012800  4406 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:10.048588  4338 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.048511  4381 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.051469  4272 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.013048  4096 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:10.051826 28648 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:10.052536  4401 consensus_queue.cc:1048] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:21:10.123584 28600 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:10.054402  4434 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:09.979462  4511 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.057436  4496 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.059700  4110 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:10.060041  4499 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.037168  4303 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.060523  4304 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.061275  4522 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.064464  4450 consensus_queue.cc:237] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.067562  4529 consensus_queue.cc:1059] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:10.071307  4384 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:10.159106 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.077683  4333 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:10.078611 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 225195us
I20260709 12:21:10.094790  4339 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 12:21:10.064232  4279 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.095675  3320 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.053006  4507 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:10.123929 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 72214.6us
I20260709 12:21:10.130968  4110 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:10.117046  4096 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.075620  3798 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.081377  4362 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:10.160712 28573 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:10.162082 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 160377us
W20260709 12:21:10.162773 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 104124us
I20260709 12:21:10.158877  4513 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.178709  4496 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:10.178710 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:10.175316 29327 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:10.181684 28572 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:10.172561  3320 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 32 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.092479  4406 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.123471  4272 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.165112  3724 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:10.191144  4525 consensus_queue.cc:1059] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:10.192056  4525 raft_consensus.cc:3055] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:21:10.192378  4525 raft_consensus.cc:740] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:10.192494  4496 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:10.193215  4525 consensus_queue.cc:260] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.194485  4525 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:10.195009  4384 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.192379  3798 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:10.200510  4499 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:10.201071  4499 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:10.201278  4333 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.201795  4333 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.202036  4499 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.203819  4333 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.204609 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.205982  4272 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.206564  4272 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:10.210768 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.211470 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.212785 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.213888 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:10.215806 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.175570  4096 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:10.158116  4242 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.211546 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.251897 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.233332 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.254532 28598 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:10.255044 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.255900 28599 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:10.256597 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.261322 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:10.261432 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 175530us
I20260709 12:21:10.262471 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.263005 28600 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:21:10.262768 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.263403 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.263561 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.264196 29326 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
W20260709 12:21:10.264882 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51078.9us
I20260709 12:21:10.265337 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.266314  3320 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.266776  3320 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.261935 28602 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:10.185294  4406 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:10.269730 29322 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:10.233349  4333 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:10.300760 28602 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:10.168541  4279 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:10.270053 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 102710us
I20260709 12:21:10.207782  4535 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:10.295194 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:10.270936  4384 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:10.343633  4381 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.346443  4268 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.347761 28607 raft_consensus.cc:2468] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:10.332139 28600 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 32.
W20260709 12:21:10.360684  4531 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:21:10.362041  4362 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.362421  4096 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.367636 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:10.368245 29317 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:21:10.303229 28599 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:21:10.301760 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.370407 28604 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 32: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:10.300776 28606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42098
I20260709 12:21:10.370978 28606 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:10.371413 28606 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:10.163467  4522 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.311969  4279 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.313902  4339 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:10.184382  4513 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.316722 28678 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:10.317023 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.386210 28602 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:21:10.320916  4448 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.375264  4096 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.324589  4110 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.396199 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.327929  4272 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:10.335106  4406 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.402637  4406 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.403348  4279 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:10.403780  4279 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:10.377650  4384 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:10.404765  4279 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.405211  4384 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.407254  4513 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:10.407456 29317 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 32.
I20260709 12:21:10.337605  4511 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:10.301956  4527 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.340392  3320 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:10.410859 28605 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:10.411731 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:10.374575 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:10.389024 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.310109 28648 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:21:10.391631 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 123272us
I20260709 12:21:10.396986 28600 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:10.412932 28607 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:10.417156 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.417537 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf685c3207841c286a253af2d105972" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.400804  4110 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:10.418077 28748 raft_consensus.cc:2410] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:21:10.412343 29317 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:10.416930 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:10.421777 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.391544  4001 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.430708 28722 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:10.306932  4333 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.419564 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.435657 28604 raft_consensus.cc:3060] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:10.437631 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:10.445464  4549 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:10.445966  4549 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:10.446362  4549 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:10.446803  4542 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:10.447233  4542 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.447576  4542 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:10.451035 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:10.451478  3971 raft_consensus.cc:2804] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:10.452127  3971 raft_consensus.cc:697] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:10.453293  3971 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.418124  4527 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.460718  4499 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:10.461421  4499 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.462661 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.463532 28749 raft_consensus.cc:2393] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:10.468375 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.442190 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.469805 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.470798 28678 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 24: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:10.451145  4517 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.471987 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.472991 29322 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 25: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:21:10.479739 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 49134.5us
W20260709 12:21:10.480243 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 170153us
I20260709 12:21:10.483275 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:10.481950 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.485280 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.483618 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:10.486722 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 73178us
I20260709 12:21:10.488047 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.487355 29322 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:10.376405  3724 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.421675  4511 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:21:10.488679 28599 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 19.
I20260709 12:21:10.499646 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.499976 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.500250 28605 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
W20260709 12:21:10.500562 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.500780 28599 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:10.492806 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:10.487475 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:10.493678 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:10.494220 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.496687 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.503269 28607 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:10.496629 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.505968 28679 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:10.496986 29317 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:10.498481 28753 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:10.512889 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.513718 28756 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
I20260709 12:21:10.409924  4272 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.495349  4513 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:10.502032 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:10.523744 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.498718 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:10.491092  4406 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:10.549379 28607 raft_consensus.cc:2468] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 26.
I20260709 12:21:10.551965 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:10.554701 28678 raft_consensus.cc:2393] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:10.553123 28682 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:10.522712 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:10.555040 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.555714 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.496565  4339 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:10.551800 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.442128  4001 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:10.549809 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51177.1us
I20260709 12:21:10.564245 28754 raft_consensus.cc:2393] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 32: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:10.565409 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:10.565990 28681 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:21:10.491475  4092 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 12:21:10.570794 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.526782  4513 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.526324  4096 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.577527 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.559754  4381 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:21:10.582269 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.506785  4528 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.062s
I20260709 12:21:10.583648  4497 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:10.583568  4096 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.580646 28751 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:10.585532  4173 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:10.589443 28721 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:10.590415 28601 raft_consensus.cc:1275] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:10.591046 28606 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.562878  4450 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:10.559924  4339 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.558537  4406 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:10.581597  4513 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:10.612597 28605 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:10.608922 28604 raft_consensus.cc:2468] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:10.613940 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.607921  4497 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.624603 28606 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.623162 28721 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:10.630059 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.618934  4339 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:10.636373  3798 raft_consensus.cc:2804] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:10.646260  3798 raft_consensus.cc:697] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:10.638731 28573 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:10.641361 29320 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:10.642930 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:10.648948 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:10.611464  4242 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.619881  4406 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:10.652942 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:10.653889 28681 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 32.
I20260709 12:21:10.614871  4450 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:10.659607 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 99650.1us
I20260709 12:21:10.631604  4452 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:21:10.619310  4527 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.641728  4497 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:10.662923  3798 consensus_queue.cc:237] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.620316  4522 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.666396 28573 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:10.671766 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.672855 28681 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 27.
I20260709 12:21:10.674304 29290 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:10.675541 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:10.657157  4529 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:10.661211  4450 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:10.656945  4528 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:10.859207  4304 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:10.874568  4524 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:10.651211  4389 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:21:10.838817 28573 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:10.889869 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 51132.4us
I20260709 12:21:10.744951 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:10.725028 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 49579.3us
I20260709 12:21:10.755584 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:10.716181  4511 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:10.893999  4511 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.894522  4511 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:10.894774 28598 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:21:10.758370 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.899137 28752 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 27.
I20260709 12:21:10.681671  4527 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:10.745738 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:10.744359  4381 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:10.705986  4522 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:21:10.758438 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:10.775552  4303 raft_consensus.cc:3055] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:21:10.757593 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:10.906944 28753 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:10.739013  4499 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:10.711566  4452 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:10.774889  4517 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:10.780901  4427 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:21:10.875319  4557 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:10.875684  4218 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:10.765651 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:10.806893 28645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:10.920619 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.789883  4333 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.723799 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.734862 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.859061  4279 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:10.926548 29318 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:10.832333 28599 raft_consensus.cc:2468] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:21:10.780668 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:10.781417 28571 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:10.698530  4096 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.670166  4242 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:10.909917  4522 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:10.776721 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 56319.4us
I20260709 12:21:10.718658  4272 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:10.724519  4551 log.cc:927] Time spent T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:21:10.904018 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 381355us
I20260709 12:21:10.907140 28752 raft_consensus.cc:1240] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:21:10.907469 29322 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:10.905915  4380 consensus_queue.cc:1048] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:21:10.916154 28751 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 16. (term mismatch)
I20260709 12:21:10.910022  4381 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:10.953541 28682 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:21:10.928769 28680 raft_consensus.cc:3055] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:10.928759 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:10.900630  4535 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:10.922627 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.963312 28599 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 12:21:10.934333 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 153006us
I20260709 12:21:10.905215  4524 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.911595  4304 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.906386  4303 raft_consensus.cc:740] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:10.913223  4517 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:10.974794  4533 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:10.975271  4533 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:10.975644  4533 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:10.900653  4339 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.979734  4339 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.957466 28680 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:10.982411 28680 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.983500 28680 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:10.961009 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.984901 28676 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 26: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:10.988782  4001 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:10.990141  4304 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:10.989859  4303 consensus_queue.cc:260] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.991179  4303 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:10.992947 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:10.950667 28751 pending_rounds.cc:85] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 15
I20260709 12:21:10.995882 28751 pending_rounds.cc:107] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 28.16
I20260709 12:21:10.996202 28751 raft_consensus.cc:2889] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:10.997885 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:11.000353 28680 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:11.000912 28682 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 25. Current term is 26. Ops: []
W20260709 12:21:10.988145  4549 consensus_meta.cc:287] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 12:21:10.939778  4522 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:10.938547 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:10.967787 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:10.960945 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:11.011379 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 50517.1us
I20260709 12:21:10.974422  4517 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.984822 28600 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:10.937211  4527 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:10.934563  4218 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:10.939589  4448 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:21:11.005106 28602 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:11.006655  4450 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:10.961596  4535 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:10.703153  4545 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:10.965741 28571 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:11.020345 28676 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:21:11.032372 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 93900.3us
I20260709 12:21:11.039009  4562 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:11.038872  4452 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.19, Last appended by leader: 19, Current term: 32, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.039575  4562 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.040640  4499 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:11.041713  4562 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:11.044540 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 78875.9us
I20260709 12:21:11.045713  4524 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.046296 28571 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:11.047749  4538 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:11.047883 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:11.027894  4547 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:11.047443 28571 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:11.009547  4381 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.035840  4529 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:11.054879 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:11.057577 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:11.059345 28607 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:21:11.050014 28747 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:10.927835  4557 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.060035 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:11.048178  4538 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:11.063176  4517 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:11.078227 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:11.078985 29323 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:11.081142 28673 raft_consensus.cc:3060] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:11.082362  4557 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.083962  4529 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:11.074919 28676 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:11.034935 28648 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:11.087977 28599 raft_consensus.cc:1240] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 25. Current term is 26. Ops: []
I20260709 12:21:11.046689  4513 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.088737 29317 raft_consensus.cc:2393] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 24: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:11.087553 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:21:11.050918  4542 consensus_meta.cc:287] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
I20260709 12:21:11.091244 28673 raft_consensus.cc:1275] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:21:11.091614 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 56768.2us
I20260709 12:21:11.068532 28602 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:11.090525 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:11.052513  4528 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:11.053378 28571 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:11.103339 28747 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:11.048751  4535 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:11.049875  4218 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:11.117111 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 63806.6us
I20260709 12:21:11.053565  4381 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:11.085702  4538 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:11.036690  4333 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.072s
I20260709 12:21:11.089717  4380 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.119710 29320 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 26: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:11.063022  4451 consensus_queue.cc:1059] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:21:11.140667  4451 consensus_queue.cc:1243] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:21:11.141109  4218 raft_consensus.cc:3055] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:11.141460  4218 raft_consensus.cc:740] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:11.142223  4218 consensus_queue.cc:260] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.143425  4218 raft_consensus.cc:3060] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:11.118257  4501 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.144868  4501 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.147065  4501 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:11.120267  4118 consensus_queue.cc:1059] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:21:11.148227  4118 raft_consensus.cc:3055] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:21:11.148607  4118 raft_consensus.cc:740] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:11.149577  4118 consensus_queue.cc:260] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.151127  4118 raft_consensus.cc:3060] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:11.118619  4499 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:11.108155  4557 raft_consensus.cc:2804] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:21:11.129606 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.030818  4549 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.049691  4547 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.075215  4406 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.135216 28600 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:11.119877 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:11.091902  4092 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:21:11.036504  4497 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.139613  4380 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.137077 28648 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:11.118139  4362 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:11.117579  4529 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:21:11.166245  4437 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:11.184695  4529 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:11.164515  4547 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:11.172762  4380 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:11.185173  4529 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:11.184845  4437 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.110473  4542 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.187503  4437 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.188815 29325 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:11.193975  4406 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:11.169582  4557 raft_consensus.cc:697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 26 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:11.174028  4511 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.175720  4556 raft_consensus.cc:2804] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:11.176111 28648 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:11.176205  4339 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:21:11.178849  4549 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.179526 28674 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:11.173529  4497 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:11.203015 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:21:11.251940 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 75801.6us
W20260709 12:21:11.268540 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 146047us
I20260709 12:21:11.277622 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:11.282467 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:11.291585 29318 raft_consensus.cc:2393] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 25: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:11.254412  4501 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.255934  4406 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:11.291575 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:11.185186  4522 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.325855 28571 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:11.264796  4556 raft_consensus.cc:697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:11.290385  4542 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:11.342715 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:11.324409  4499 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:11.341825 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:11.346112 28680 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:11.348651 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:11.349994 28675 raft_consensus.cc:2393] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:11.350278 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:11.343020  4569 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.302s	user 0.000s	sys 0.004s
W20260709 12:21:11.464828 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 109199us
I20260709 12:21:11.473016 28751 raft_consensus.cc:1240] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:11.344053  4501 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:11.465729  4279 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:21:11.514572  4583 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:11.346769  4405 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.143s
I20260709 12:21:11.522531  4556 consensus_queue.cc:237] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:11.525681  4573 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:21:11.526139  4542 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:11.526717  4542 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.529119  4542 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:11.533625 28677 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
W20260709 12:21:11.537086 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.550743 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:11.551460 28679 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:11.561131 28573 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:11.563450 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 237672us
I20260709 12:21:11.564298 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39252 (request call id 2186) took 1047 ms. Trace:
I20260709 12:21:11.564918 29326 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: []
W20260709 12:21:11.524914  4533 consensus_meta.cc:287] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 12:21:11.564692 29325 rpcz_store.cc:276] 0709 12:21:10.493876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.494006 (+   130us) service_pool.cc:224] Handling call
0709 12:21:11.540876 (+1046870us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b540047b8d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:11.541014 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1577504512}
W20260709 12:21:11.558089  4560 log.cc:927] Time spent T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:21:11.596055  4576 log.cc:927] Time spent T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:21:11.359650  4557 consensus_queue.cc:237] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.571807  4583 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:21:11.597286  4517 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
W20260709 12:21:11.712016 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 234557us
I20260709 12:21:11.712877 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:21:11.713300  4535 consensus_meta.cc:287] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 12:21:11.717900  4535 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.721709 28722 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:11.598488 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:21:11.618501  4577 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:21:11.711897  4333 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 12:21:11.737754 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.738618 28600 raft_consensus.cc:3060] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:11.739019 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.740904 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.741676 28601 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:11.747802 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:11.754769 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.642575  4362 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:11.658480  4511 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:11.659053 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:11.759754 28676 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 29.
I20260709 12:21:11.659659  4522 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:11.673547  4303 consensus_meta.cc:287] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.682s	user 0.004s	sys 0.007s
I20260709 12:21:11.689378  4501 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.582791  4533 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.695027  4583 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
W20260709 12:21:11.728595 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.715804  4304 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:11.727311  4427 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:11.758510 28603 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:11.760918 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:11.783751 28676 raft_consensus.cc:1240] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
W20260709 12:21:11.789095 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.790848 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:11.791376 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:11.791961 28747 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:11.798127 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:11.798804 28754 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:21:11.785351  4381 consensus_meta.cc:287] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.630s	user 0.006s	sys 0.005s
I20260709 12:21:11.802624 28747 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:21:11.780992  4448 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:11.780547  4304 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.804816 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:11.806985 28599 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:11.786129  4589 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:11.799069  4538 consensus_meta.cc:287] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.002s
I20260709 12:21:11.808619 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.818086  4538 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.818545 28599 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:11.811108 28753 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26. Ops: []
W20260709 12:21:11.812703  4118 consensus_meta.cc:287] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.001s
I20260709 12:21:11.808408  4304 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:11.814677  4535 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:11.809968  4448 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.802016  4452 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:11.808920  4529 consensus_meta.cc:287] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
I20260709 12:21:11.820402  4538 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:11.803764  4218 consensus_meta.cc:287] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:21:11.817523  4533 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.808642 28721 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:11.835282 28599 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:11.836655 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:11.815857 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:11.836213 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:11.845814 29325 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26. Ops: []
I20260709 12:21:11.849658  4588 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:21:11.821897  4589 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.850209  4588 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:11.851258  4588 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.851974  4589 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.820678  4583 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.858959 28601 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
W20260709 12:21:11.826400  4547 consensus_meta.cc:287] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 12:21:11.860292  4588 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:11.860270  4547 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.826709  4452 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.827088  4529 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.831589  4450 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:11.864425  4452 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:11.866541  4529 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:11.866585  4538 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.877892  4538 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.870914 28607 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
W20260709 12:21:11.882961 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46824.8us
I20260709 12:21:11.883337  4504 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:11.883808  4504 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.884011  4381 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:11.884196  4504 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:11.888588  4538 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:11.872732  4589 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:11.884470 29326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39252 (request call id 2195) took 1012 ms. Trace:
I20260709 12:21:11.874500 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.891006 29326 rpcz_store.cc:276] 0709 12:21:10.871630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.871917 (+   287us) service_pool.cc:224] Handling call
0709 12:21:11.555925 (+684008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.565351 (+  9426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.884269 (+318918us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540042a9d0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7e8ad 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:11.884398 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572256128}
I20260709 12:21:11.891855 28604 raft_consensus.cc:2393] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 19: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:11.874734 28754 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 28.
I20260709 12:21:11.883373 28674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1706) took 1023 ms. Trace:
I20260709 12:21:11.893776 28674 rpcz_store.cc:276] 0709 12:21:10.860039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.860141 (+   102us) service_pool.cc:224] Handling call
0709 12:21:10.860403 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.257774 (+397371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.883168 (+625394us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b5400251054. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:11.883320 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733319424}
I20260709 12:21:11.873162  4448 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:11.888625 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 80064us
I20260709 12:21:11.872529 29292 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:11.893400  4547 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.872368  4304 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.897722 28677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34892 (request call id 3754) took 1152 ms. Trace:
I20260709 12:21:11.898118 28677 rpcz_store.cc:276] 0709 12:21:10.745354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.745488 (+   134us) service_pool.cc:224] Handling call
0709 12:21:11.897539 (+1152051us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b5400272254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:11.897638 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454706560}
I20260709 12:21:11.899642  4448 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:11.899799 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:11.900302  4448 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:11.900668 29326 raft_consensus.cc:2393] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
W20260709 12:21:11.901364  4572 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.427s	user 0.002s	sys 0.000s
I20260709 12:21:11.877359 28599 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:21:11.902817 28605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1467) took 1010 ms. Trace:
I20260709 12:21:11.903056 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:11.903687 29326 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
I20260709 12:21:11.907649 29319 raft_consensus.cc:1275] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:21:11.910187  4504 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.912205  4504 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:11.899438  4304 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:11.912794  4524 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:21:11.903201 28605 rpcz_store.cc:276] 0709 12:21:10.892351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.892540 (+   189us) service_pool.cc:224] Handling call
0709 12:21:10.912627 (+ 20087us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:10.925207 (+ 12580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:10.925237 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:10.925926 (+   689us) log.cc:844] Serialized 52 byte log entry
0709 12:21:11.212640 (+286714us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:21:11.212690 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.212761 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:11.900823 (+688062us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:21:11.902557 (+  1734us) raft_consensus.cc:1685] finished
0709 12:21:11.902578 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:11.902766 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2898,"raft.queue_time_us":20909,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13064,"spinlock_wait_cycles":11777920,"thread_start_us":250044,"threads_started":1,"wal-append.queue_time_us":374290}
I20260709 12:21:11.913915 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:11.914641 28678 raft_consensus.cc:2368] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23.
I20260709 12:21:11.914991  4339 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:11.915555 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:11.916714 28676 raft_consensus.cc:2393] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 24: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:21:11.916957 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 566701us
I20260709 12:21:11.918018  4538 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:21:11.918433  4538 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:11.919610  4538 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.920933 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:11.922415  4499 consensus_meta.cc:287] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.005s
I20260709 12:21:11.922855  4499 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:11.923688 28602 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:11.924489  4538 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:11.925432 28673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1705) took 1065 ms. Trace:
I20260709 12:21:11.925828 28673 rpcz_store.cc:276] 0709 12:21:10.859687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.859830 (+   143us) service_pool.cc:224] Handling call
0709 12:21:10.871381 (+ 11551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:11.105480 (+234099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:11.925168 (+819688us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540016d354. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:11.925349 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482013568}
W20260709 12:21:11.903340  4594 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:21:11.926062 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:11.934139  4524 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:11.932752 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:11.935619 28571 leader_election.cc:400] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23.
I20260709 12:21:11.935700 28722 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:11.915549  4339 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.936805  4502 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:11.935920 28571 leader_election.cc:403] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:21:11.937552  4502 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:11.938352  4535 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:11.938660  4502 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:11.940740  4173 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:11.941391  4173 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.945482  4524 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:11.945967  4524 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:11.946666  4339 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:11.871948 28606 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:11.936866  4578 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:11.948240  4578 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:11.948788  4578 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:11.901320  4448 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:11.959686 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:11.961669 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.962915  4522 consensus_queue.cc:1059] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:11.963739  4522 raft_consensus.cc:3055] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:11.955006 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.956048 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:11.957477 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:11.965093 29317 raft_consensus.cc:3060] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:11.965530 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:11.904563  4593 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 12:21:11.958305 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:11.974272 29320 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 20. Current term is 21. Ops: []
I20260709 12:21:11.974692 29325 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:11.950815  4523 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:21:11.975983 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:11.976217 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:11.983222 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:11.984459 28599 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: [23.19-23.19]
I20260709 12:21:11.969077 29326 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 32 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:21:11.943638  4173 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:11.991174 28604 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:11.964098  4522 raft_consensus.cc:740] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:11.999814 28602 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:21:11.991488 28600 raft_consensus.cc:2468] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:21:12.007025 29317 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:12.008858 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:12.020418 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.021744 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:12.023201 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.028553 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.024268 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.029793 28673 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 20: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:12.030444 28754 raft_consensus.cc:2368] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
I20260709 12:21:12.040280 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:12.041285 29317 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:12.033196 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:12.045091 28606 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:12.045552 28682 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 26: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:12.025110 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.046387 28676 raft_consensus.cc:3060] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:12.022575 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.048099 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.050546 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.050869 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.051997 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:12.052543 28604 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:12.061295 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.061916 28753 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:12.062300 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:12.063026 28599 raft_consensus.cc:2393] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:12.062719 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:12.065600  4564 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:12.066615 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:12.067965  4570 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.983s	user 0.000s	sys 0.003s
I20260709 12:21:12.070644  4339 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:12.071183  4339 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:12.072254  3798 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:12.072135  4339 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.072815  3798 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.074872  3798 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.076084  4545 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.076673  4545 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.082209  4545 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.018368  4511 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:12.083482  4511 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.084709 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.085410 28606 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:12.085541  4511 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.095124 28604 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:12.018473  4542 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:12.100661 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:12.110222 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.038306  4362 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:12.133126 28678 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
W20260709 12:21:12.136574 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 140070us
W20260709 12:21:12.143834 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 65507.4us
I20260709 12:21:12.144770 28647 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.142802 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.058107  4556 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:11.996359  4304 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.113s
I20260709 12:21:12.149226  4511 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:12.150781  4511 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:12.152180  4511 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.140503 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:12.171854 28573 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:12.175578 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:12.175786 28573 leader_election.cc:400] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
I20260709 12:21:12.178500 28573 leader_election.cc:403] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:21:12.115109  4523 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.176527 29292 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:12.180792 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.096798  4406 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.072s
I20260709 12:21:12.185230 29292 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:12.138008  4110 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.161511  4218 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:12.116839  4588 consensus_queue.cc:1048] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
W20260709 12:21:12.189110 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44378.8us
I20260709 12:21:12.182422  4524 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.184798  4584 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:12.134160  4362 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.187199  4535 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23.
I20260709 12:21:12.187089  4556 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:12.189694  4096 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:12.225270 28647 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.211822  4542 raft_consensus.cc:2804] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:12.212080  4218 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:12.267230 28600 raft_consensus.cc:2468] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:12.189097  4450 raft_consensus.cc:2804] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:21:12.236615 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 48714.7us
I20260709 12:21:12.172278  4437 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.062s
I20260709 12:21:12.191735  4538 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:12.219638  4381 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:21:12.268400 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 88256us
I20260709 12:21:12.224062  4501 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.257658  4504 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:21:12.249639  4448 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:12.269335  4218 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:12.219383  4110 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:12.276362 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 51217.1us
I20260709 12:21:12.283303 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.270546  4406 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:12.188474  4523 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.288359 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.278347  4096 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:21:12.282152  4504 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:12.298060  4504 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:21:12.290520  4564 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.010s
I20260709 12:21:12.301162  4564 consensus_queue.cc:1243] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer 5b3b2f4041a24b05983f30878f16db9d log is divergent from this leader: its last log entry 22.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 12:21:12.282121  4381 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:12.302491  4381 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.293402 28647 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:12.314541  4608 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:12.315222  4608 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:12.316299  4608 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.317953  4608 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:12.286849  4501 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.287081  4448 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.321631  4501 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.322335  4448 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.322774  4533 raft_consensus.cc:2804] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:12.322333  4578 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.323438  4533 raft_consensus.cc:697] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:12.325399  4578 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.273658  4556 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.325990 28605 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:12.330220 28676 raft_consensus.cc:2468] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 28.
I20260709 12:21:12.331768 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:12.361769 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:12.362783 28753 raft_consensus.cc:2393] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:12.363627 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.331468 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.340487 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.387162 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.296078  4406 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.391148 28676 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:21:12.399282 28682 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:21:12.400009  4598 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:21:12.401439  4513 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:12.401593  4611 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:21:12.407040  4279 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:12.407548  4279 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:12.398430 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:12.412122 28752 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:21:12.117745 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:12.413921 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.416066 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.422348 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.393718  4529 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:12.422436 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 241694us
I20260709 12:21:12.423064  4529 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.424223 28682 raft_consensus.cc:1240] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:12.425231  4529 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.408401  4279 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.427186 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.427572  4279 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:12.427845 28753 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
I20260709 12:21:12.436877  4524 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.324393  4533 consensus_queue.cc:237] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.441778  4522 consensus_queue.cc:260] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.442972  4522 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:12.444186  4406 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.445880  4556 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.456980  4511 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.457583  4511 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.459694  4621 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:12.460228  4621 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:12.470373 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 53103.7us
I20260709 12:21:12.472358 28753 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:12.474481 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:12.484267 29317 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:12.475251 28722 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:12.477109 28648 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.492695 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.493312 28599 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:21:12.494263 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.494328 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.479770 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e3c15999a1401a85e85110ac625d58" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:12.497673 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.498338 28676 raft_consensus.cc:3060] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:12.499550 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.408069  4504 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.532953 28682 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
W20260709 12:21:12.498406 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 72753.7us
I20260709 12:21:12.538600 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.539736 28676 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:21:12.460381  4511 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.461369  4362 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.539399  4542 raft_consensus.cc:697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:21:12.573555 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 96510us
I20260709 12:21:12.573521  4608 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:12.592707  4542 consensus_queue.cc:237] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:12.566154 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 91004.8us
I20260709 12:21:12.576424 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:12.596468 28722 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.205.129:36607 timed out after 1.595s (SENT) [suppressed 1 similar messages]
I20260709 12:21:12.541333  4405 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.597404  4405 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.600142  4405 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.575990 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.500952 29317 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:21:12.604271 28606 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:21:12.610057 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45056us
I20260709 12:21:12.611541 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:12.605329 28674 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:12.614050 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:12.565327 28753 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:21:12.490335  4589 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.469151  4538 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 24. Current term is 25.
I20260709 12:21:12.567523  3971 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.462361  4621 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.567054  4564 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.608983  4110 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.600404  4523 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.470546  4513 consensus_queue.cc:1048] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.150s
I20260709 12:21:12.619891  4524 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:12.541538  4583 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:12.636382 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.627462  4437 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:12.628693  4511 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.663738 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:12.666034 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.633627  4450 raft_consensus.cc:697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 28 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:12.701447 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.702003 28572 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:12.624527  4589 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:12.707768 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44121.7us
I20260709 12:21:12.710048 28720 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.702792 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:12.703851  4448 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:12.713492  4448 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.715788  4448 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.717170 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:12.718191  4437 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:12.657989  4524 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:12.719568  4524 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.704387  4624 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.056s
I20260709 12:21:12.725677 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.729756 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:12.724058  4218 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.733480 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:12.710292  4110 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:21:12.735065 28754 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:12.735387  4110 consensus_queue.cc:1243] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:21:12.642441  3971 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.736698 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb599a2fb1704106b47a69be90b821d0" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.737859 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.738237 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.738523 28755 raft_consensus.cc:1275] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 13. (term mismatch)
I20260709 12:21:12.738925 28755 pending_rounds.cc:85] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 12
I20260709 12:21:12.736791 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.739130 28755 pending_rounds.cc:107] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 25.13
I20260709 12:21:12.739202 28748 raft_consensus.cc:1275] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 12:21:12.741614  4502 raft_consensus.cc:2804] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:12.742218  4502 raft_consensus.cc:697] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:12.743129  4502 consensus_queue.cc:237] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.705387  4303 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
W20260709 12:21:12.745033  4625 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:21:12.747418 28748 pending_rounds.cc:85] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 12
I20260709 12:21:12.747896 28748 pending_rounds.cc:107] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:21:12.748317 28748 raft_consensus.cc:2889] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:12.739481 28755 raft_consensus.cc:2889] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:12.748842 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 46934.4us
I20260709 12:21:12.749689 28572 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:12.769565 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:12.771643 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46050.1us
W20260709 12:21:12.773691 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.701243  4621 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.779191 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.780077 28599 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 17. (term mismatch)
I20260709 12:21:12.785267 28599 pending_rounds.cc:85] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 16
I20260709 12:21:12.785537 28599 pending_rounds.cc:107] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 25.17
I20260709 12:21:12.785787 28599 raft_consensus.cc:2889] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:12.785934  4527 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:12.786423  4527 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:12.781652  4585 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:12.788642 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:12.793064 28647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.782248  4529 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:12.658865  4583 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.744187  4303 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.806576 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.806874 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:12.814990 28753 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:12.807426 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:12.804180 28648 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.811012  4626 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:12.811576 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.808238  4585 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:12.738266  3971 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:12.767248  4362 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:12.704722  4523 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 12:21:12.660189  4564 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.705005  4511 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.779366  4607 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:12.846283  4607 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:12.847441  4511 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.847221  4607 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.820047 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.849408 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.850541 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.851941  4603 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:12.852684  4603 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:12.853583  4603 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:12.670892  4497 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 12:21:12.808271  4504 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 30 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:12.858482  4564 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:12.841655  4623 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:21:12.860495  4279 consensus_queue.cc:1048] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:12.860930 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.840583  4218 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.845264  4523 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:12.862250  4523 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.844936 28604 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:12.863870  4110 consensus_queue.cc:1048] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:12.864307  4523 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.864759  4536 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:12.867026 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.868501  4589 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:12.870716 28603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42096 (request call id 3410) took 1925 ms (client timeout 1595 ms). Trace:
W20260709 12:21:12.871129 28603 rpcz_store.cc:269] 0709 12:21:10.908290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:10.908517 (+   227us) service_pool.cc:224] Handling call
0709 12:21:12.833915 (+1925398us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b5400092254. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:12.834071 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925134208}
I20260709 12:21:12.825316  4450 consensus_queue.cc:237] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.859063 28679 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:21:12.876991 28606 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:12.878129  4583 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:12.879680 29317 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:12.880110  4303 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.813230  4586 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 12:21:12.889582  4585 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.797518  4621 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.894323  4621 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:12.826478  4626 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:12.896895  4626 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:12.897998 28605 pending_rounds.cc:85] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 11
I20260709 12:21:12.898315 28605 pending_rounds.cc:107] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:21:12.898558 28605 raft_consensus.cc:2889] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:12.852632 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:12.900621 29320 raft_consensus.cc:2393] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:12.908533 28752 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:21:12.910706 28600 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:21:12.919516 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 323132us
I20260709 12:21:12.910877  4389 raft_consensus.cc:2764] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:21:12.923617 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.924183 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:12.926394 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:12.910881  4628 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:21:12.927408 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:12.928010 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 213152us
W20260709 12:21:12.930857 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:12.931037 28600 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:21:12.949993 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.960731 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.960786 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.968798 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.971123 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.955667  4542 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:12.923599  4608 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 12:21:12.922228  4564 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:21:12.965603 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.977385 28601 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:12.986923 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:12.988034  4564 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:12.972488  4567 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:12.987957 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.988166 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:12.995085 28756 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 29. Current term is 30. Ops: []
I20260709 12:21:12.996652 28753 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:12.998162 28749 raft_consensus.cc:2393] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 25: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:12.986037 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:12.997722  4303 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:13.001163  4621 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:13.006337 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:13.008067 28720 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:13.013376  4637 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:13.004783  4529 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.009s
I20260709 12:21:13.012889 29292 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:12.988586  4564 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:13.020763 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:13.039909 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:12.999773  4533 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:21:13.045799  4511 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:21:13.038005  4624 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:13.052340 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:13.053514 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:13.053731 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:13.055162  4437 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:13.057462 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:13.011809  4303 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:13.058262 28749 raft_consensus.cc:606] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:13.015581  4626 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:13.015658  4637 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.063409 29320 raft_consensus.cc:1275] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:13.064265 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:13.064659 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:13.061600 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:13.065433 28601 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:13.065840 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:13.067839 28604 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:21:13.069526 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:13.038213  4529 consensus_queue.cc:1243] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 23.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:21:13.038197  4632 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.077885 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:13.069798 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:13.058930  4448 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:13.065101  4533 consensus_queue.cc:1243] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 24.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:21:13.062186  4362 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:13.065941  4437 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.085248 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:13.063832  4626 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:13.092941  3798 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:13.093549  3798 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:13.071056  4637 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:13.070626  4527 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:13.082122  4502 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:13.109746  3798 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.160251  4303 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:13.163434  4639 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:21:13.083235  4522 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.082s
I20260709 12:21:13.091764  4437 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:21:13.173565  4631 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:21:13.182487 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:13.184255 28673 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:21:13.184032 28648 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:13.148794  4635 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:21:13.084563  4624 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:21:13.186527 28752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:13.187108 28752 raft_consensus.cc:606] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:13.094197  4362 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.084141  4636 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:13.096637  4626 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:13.080358  4578 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 29.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.065s
W20260709 12:21:13.195137 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 155725us
I20260709 12:21:13.201221  4523 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:13.082587  4632 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.192646  4586 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.192854  4362 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:13.091708  4612 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.106s
I20260709 12:21:13.196215  4636 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.198345  4557 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:13.231138 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 191554us
I20260709 12:21:13.234014 29317 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:13.196574  4618 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:21:13.216777  4567 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.276000 28748 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:21:13.277473 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.221645  4636 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:13.264994  4633 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:13.284579 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.289139 28679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7f9c29f436b4c6bbfb909b71ca1d309"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:21:13.293484 28679 raft_consensus.cc:606] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:13.293941 28679 raft_consensus.cc:614] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:13.295459 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.236455  4607 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.303560 28573 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:13.273175  4590 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.306221 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:13.219674  4586 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.282545  4448 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:13.296837  4635 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:21:13.314184 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.322007  4451 raft_consensus.cc:993] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:13.322487  4451 raft_consensus.cc:1081] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:13.309856  4616 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:13.331212 28753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:13.333901 28753 raft_consensus.cc:606] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:13.319319  4513 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:13.283167  4567 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:13.341243 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 110537us
I20260709 12:21:13.346372 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:13.312215  4450 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 12:21:13.310511  4607 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.417425  4567 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:13.418383 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 73071.3us
I20260709 12:21:13.324200  4448 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.313525  4590 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.326352  4437 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:13.437462 28647 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:13.449246 28752 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:13.436519  4557 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:21:13.458107  4643 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:21:13.453641  4640 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:21:13.441007  4648 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:13.450651  4533 consensus_queue.cc:1048] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:21:13.454931  4557 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.475535  4437 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:13.482646  4339 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.483179  4339 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.484208  4564 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:13.485304  4339 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:13.485347  4564 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:13.488953  4632 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:13.494095  4586 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:13.495730  4590 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:13.497265  4607 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:13.466219  4651 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 12:21:13.476272  4641 log.cc:927] Time spent T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:21:13.504665  4557 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:13.527403  4362 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.530426  4448 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:13.534559  4524 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.545094  4524 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.548557  4524 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:13.557479  4603 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:13.558058  4603 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.559666  4362 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:13.591405 28756 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:21:13.593044  4603 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:13.593981 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.593724  4626 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.598644 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.599272 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.620194 28747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:13.620808 28747 raft_consensus.cc:606] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:13.621173 28747 raft_consensus.cc:614] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:13.625316 28747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:13.625882 28747 raft_consensus.cc:606] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:13.627194 28756 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 29. Current term is 30. Ops: []
I20260709 12:21:13.628554 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:13.636021 28753 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:21:13.640558  4636 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.642840  4636 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:13.643545 28753 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:13.645052  4637 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.647317  4637 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:13.647337 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:13.648164 29319 raft_consensus.cc:2368] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26.
I20260709 12:21:13.652806 28747 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:21:13.655134 28756 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:13.655737  4626 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:13.657305 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.657214 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.658017 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.658639 28756 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:13.660182  4362 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 29.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:21:13.661078  4557 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.660279 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:13.662137 28756 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:13.661477 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:13.663367  4557 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:13.664157  4362 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:13.667994 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:13.681609 28756 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:21:13.690892 28678 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:21:13.694113 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:13.695013 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:13.695678  4362 raft_consensus.cc:493] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.696213  4362 raft_consensus.cc:515] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:13.695685 28679 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 19.
I20260709 12:21:13.703239  4567 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.701539 28679 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:21:13.703801  4567 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.717087 28682 raft_consensus.cc:1240] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:13.706519 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:13.718621  4538 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:21:13.709442 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:21:13.711946  4644 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.438s	user 0.000s	sys 0.001s
I20260709 12:21:13.713004 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:13.714855 28681 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:21:13.707926  4584 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:13.720230 28677 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:13.726667 28679 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 12:21:13.727563 28679 pending_rounds.cc:85] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 13
I20260709 12:21:13.727910 28679 pending_rounds.cc:107] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 12:21:13.728315 28679 raft_consensus.cc:2889] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:13.748734 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:13.719851  4538 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:13.727133  4517 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:13.764173 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:13.766176 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:13.766964 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:13.768471 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:13.769251 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:13.773625 28573 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:13.774565 28573 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:13.777997 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:13.778241 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:13.778632 28604 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:13.778889 28600 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:21:13.784009 28674 raft_consensus.cc:1275] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:21:13.786929 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:13.761655  4517 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:13.754482  4586 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.798218 28674 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:21:13.799849 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:13.800742 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:13.803597 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:13.804200 28603 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:13.804643 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:13.805497 29327 raft_consensus.cc:2393] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:13.828665 29326 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:21:13.834638 28606 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:21:13.808123 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:13.835858 28600 raft_consensus.cc:3060] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:21:13.826620 29317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:21:13.837664 29317 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:13.838124 29317 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:13.827999 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:13.808949  4517 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:13.806830  4511 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.041s
I20260709 12:21:13.848582 29320 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:13.848560 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:13.852481 29292 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:13.855243 28674 raft_consensus.cc:1275] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:21:13.859287 29325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2408) took 1130 ms. Trace:
I20260709 12:21:13.866719 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:13.879961 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:13.880831 28674 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:21:13.803612  4362 leader_election.cc:290] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:13.859822 29325 rpcz_store.cc:276] 0709 12:21:12.729281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.729420 (+   139us) service_pool.cc:224] Handling call
0709 12:21:12.729809 (+   389us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:21:13.493741 (+763932us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b18004b8140. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe36274bc 00007f6fe097548b 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe098f455 00007f6fe3a77060 00007f6fe3a77bfb 00007f6fe3a8264b
0709 12:21:13.493862 (+   121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.493888 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:21:13.678906 (+185018us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b2c000eb598. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:21:13.679649 (+   743us) log.cc:844] Serialized 78 byte log entry
0709 12:21:13.849752 (+170103us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:21:13.849793 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.849865 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.849910 (+    45us) raft_consensus.cc:1685] finished
0709 12:21:13.849920 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.859190 (+  9270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14634,"raft.queue_time_us":38701,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":10009,"spinlock_wait_cycles":47739520,"thread_start_us":229245,"threads_started":2,"wal-append.queue_time_us":108465}
I20260709 12:21:13.898818 28600 raft_consensus.cc:2468] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:21:13.806311  4333 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:13.785857  4583 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 12:21:13.853178  4524 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.853327  4584 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:13.899121  4644 log.cc:927] Time spent T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:21:13.852542  4542 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 32 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.917795 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.907951 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:13.899526 29317 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.918795 28607 raft_consensus.cc:2468] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:21:13.879151  4533 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.879086  4303 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:21:13.926993 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 152491us
W20260709 12:21:13.895259  4639 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:21:13.893591  4621 raft_consensus.cc:2804] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:13.929154 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01095df8e33a4e11bc9089bc7a5cdd37" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:13.834741  4586 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.896682  4513 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:13.942651 29317 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:13.848886  4538 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:13.948724 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 171349us
I20260709 12:21:13.948992 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3623) took 1044 ms. Trace:
I20260709 12:21:13.952481 28571 leader_election.cc:304] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:13.957046 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:13.930516  4333 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:13.961503 28674 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:21:13.950167 28598 rpcz_store.cc:276] 0709 12:21:12.904130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.904254 (+   124us) service_pool.cc:224] Handling call
0709 12:21:12.904598 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:12.919496 (+ 14898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:12.919526 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:12.935537 (+ 16011us) log.cc:844] Serialized 52 byte log entry
0709 12:21:13.082170 (+146633us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:13.103478 (+ 21308us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.111238 (+  7760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.111340 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:13.696766 (+585426us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b18003792a0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:21:13.711235 (+ 14469us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:21:13.948770 (+237535us) raft_consensus.cc:1685] finished
0709 12:21:13.948792 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:13.948923 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18612,"prepare.queue_time_us":25879,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":16857,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":10827,"spinlock_wait_cycles":79907328,"thread_start_us":103461,"threads_started":1,"wal-append.queue_time_us":238455}
I20260709 12:21:13.971503 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:13.974931  4333 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:13.943332  4513 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:13.985167  4663 log.cc:927] Time spent T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:21:13.987074  4513 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:13.989144 28598 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:21:13.993610 28677 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:14.001199 28603 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:14.003809 28679 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:21:13.916512  4524 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.007421 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:14.009784 28598 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 22: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:13.940847  4621 raft_consensus.cc:697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:13.934692  4533 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.015736 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:14.016669  4649 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:13.972671  4673 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:13.972316  4584 raft_consensus.cc:2749] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:14.013501  4585 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:14.011482  4567 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.074883 28605 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 12:21:13.935923  4542 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.028023  4538 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:21:14.085348 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:14.064178  4339 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.093104 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:14.095638 29325 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:21:14.101531 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:14.102670 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:14.103241 28674 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:14.109067 28601 raft_consensus.cc:1275] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:21:14.109673 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.116981 29290 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:14.102048  4339 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.102442  4405 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:14.127542  4533 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.102226  4513 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:14.130784 28677 raft_consensus.cc:1217] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Deduplicated request from leader. Original: 19.17->[21.18-24.20]   Dedup: 21.18->[22.19-24.20]
I20260709 12:21:14.131278 28677 pending_rounds.cc:85] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 18
I20260709 12:21:14.131512 28677 pending_rounds.cc:107] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 23.19
I20260709 12:21:14.131819 28677 raft_consensus.cc:2889] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:14.118731  4626 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.006s
I20260709 12:21:14.131420 28674 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:14.078751  4674 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:14.159235  4636 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:14.071048  4649 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:14.166240 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45964.3us
I20260709 12:21:14.170885 28750 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260709 12:21:14.179905  4669 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:21:14.181051  4339 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:14.181449  4667 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:21:14.183259  4303 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.183735  4303 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:14.188066  4618 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:14.188659  4618 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:14.211194 28600 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:21:14.202389  4303 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.188334  4362 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:21:14.218787 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 51726.3us
I20260709 12:21:14.119266  4584 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:14.077666  4585 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.071455  4673 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:14.222448 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 81340.9us
I20260709 12:21:14.240674 28722 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:14.128504  4513 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:14.129196  4522 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:14.162386  4621 consensus_queue.cc:237] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:14.265671  4665 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:21:14.268754  4673 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:14.269696 28754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 3352) took 1288 ms. Trace:
I20260709 12:21:14.270093 28754 rpcz_store.cc:276] 0709 12:21:12.981750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:12.981850 (+   100us) service_pool.cc:224] Handling call
0709 12:21:12.982131 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:12.985404 (+  3273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:12.985440 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.621381 (+635941us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b2c0001c1c8. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe2378a11 00007f6fe2388372 00007f6fe3abaa01 00007f6fe3a7f43a 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2
0709 12:21:13.621806 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:21:13.918709 (+296903us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:21:13.918766 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.918874 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.269367 (+350493us) raft_consensus.cc:1685] finished
0709 12:21:14.269388 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.269614 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8463,"raft.queue_time_us":3301,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10921,"spinlock_wait_cycles":2901248,"thread_start_us":296500,"threads_started":1,"wal-append.queue_time_us":410180}
I20260709 12:21:14.273584  4586 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.281179  4501 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:14.285110  4524 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.290133 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:14.290903 28674 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:14.338018 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:14.344882 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:14.334041  4567 raft_consensus.cc:493] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.369485  4567 raft_consensus.cc:515] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.372140  4567 leader_election.cc:290] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.242316  4502 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.118s
I20260709 12:21:14.241943  3971 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:21:14.381953  3971 consensus_queue.cc:1243] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer a8342e3fcab94ce89482df67988159ea log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:21:14.246063  4584 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.385972  4584 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.246526  4362 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.140s
I20260709 12:21:14.174615  4674 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.387859  3320 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:14.398928  4557 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:14.399724 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:14.400755 28674 raft_consensus.cc:2393] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 24: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:14.263556  4564 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:14.399690  4557 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.393088  4656 raft_consensus.cc:993] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:14.259006  4513 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:21:14.445345 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 345772us
I20260709 12:21:14.334824  4524 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:14.389200  4522 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:14.393595  4585 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:14.489630 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 372733us
I20260709 12:21:14.490597 29290 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:14.491405 28756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.004s	sys 0.011s
W20260709 12:21:14.491760 28756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.004s	sys 0.011s
I20260709 12:21:14.440963  4499 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:14.495791 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 290465us
I20260709 12:21:14.496719 28572 leader_election.cc:400] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26.
I20260709 12:21:14.497231 28572 leader_election.cc:403] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:14.474373  4502 raft_consensus.cc:1081] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
W20260709 12:21:14.508390 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 267780us
I20260709 12:21:14.512128 29290 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:14.498090  4517 consensus_meta.cc:287] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.004s
I20260709 12:21:14.449204  4564 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:14.520092 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 273299us
I20260709 12:21:14.489892  4524 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.515096  4584 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26.
I20260709 12:21:14.515519  4511 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:14.504554  4499 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.523039  4649 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:14.543589  4676 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:21:14.534018  4303 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:14.521512  4517 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:14.561344  4680 log.cc:927] Time spent T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:21:14.567853 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 322395us
I20260709 12:21:14.577185 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.615541 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.558815  4683 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:14.564340  4670 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:14.669682 28606 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:14.576351  4173 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:14.688740  4499 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.566005  4636 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:14.689901  4636 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.692122  4636 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:14.696693  4674 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.698146  4524 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.699373  4564 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:14.704766  3971 consensus_queue.cc:1059] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:21:14.706318  3971 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:21:14.616637  4303 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.131s
I20260709 12:21:14.687798  4173 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:14.539996  4522 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.720111  4693 raft_consensus.cc:3055] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:14.720835  4693 raft_consensus.cc:740] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:21:14.722404  4681 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:21:14.722179  4693 consensus_queue.cc:260] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.563268  4511 consensus_queue.cc:1048] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.124s
I20260709 12:21:14.672811 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.733139 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.738093 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:14.743039 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:14.743996 28674 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:21:14.744189  4618 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:14.745561  4173 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:14.748703 28679 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:14.748461  4517 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:14.755362  4538 consensus_meta.cc:287] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 12:21:14.729307  4557 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.730351  4524 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:14.760599  4524 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.763984  4524 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.774019 28681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60198 (request call id 1725) took 1035 ms. Trace:
I20260709 12:21:14.774449  4618 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:21:14.803205 29320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.015s	sys 0.048s
W20260709 12:21:14.805230 29320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.015s	sys 0.048s
I20260709 12:21:14.767975 28496 catalog_manager.cc:5697] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 15 to 21, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:14.788925 28681 rpcz_store.cc:276] 0709 12:21:13.738704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.738817 (+   113us) service_pool.cc:224] Handling call
0709 12:21:13.739135 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:21:13.739515 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:13.739544 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:21:13.740088 (+   544us) log.cc:844] Serialized 52 byte log entry
0709 12:21:13.848328 (+108240us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:21:13.897863 (+ 49535us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.901323 (+  3460us) log.cc:844] Serialized 14 byte log entry
0709 12:21:13.901511 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:13.901596 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.377328 (+475732us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b18004aecc0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09602a6 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1
0709 12:21:14.379001 (+  1673us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b18004aecc0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:21:14.769187 (+390186us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b18004aecc0. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe09923f3 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:21:14.773785 (+  4598us) raft_consensus.cc:1685] finished
0709 12:21:14.773807 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.773960 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3010,"prepare.queue_time_us":508902,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2248,"raft.queue_time_us":10137,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":11276,"spinlock_wait_cycles":71746048,"thread_start_us":72320,"threads_started":1,"wal-append.queue_time_us":156717}
I20260709 12:21:14.808450 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.614130  4585 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:14.724354  4693 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:14.785066  4501 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:14.818341 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.782358  4670 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:14.834829 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.828490  4670 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:14.835713 29326 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:21:14.822703  4585 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:14.855365  4621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.033s	sys 0.076s
I20260709 12:21:14.873327 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:14.874328 28603 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 26.
I20260709 12:21:14.875205 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:14.877835 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:14.878522 28603 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
W20260709 12:21:14.879647 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 352580us
I20260709 12:21:14.882004 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:14.871208  4621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.033s	sys 0.076s
I20260709 12:21:14.885994 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:14.890519 28603 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 30.
I20260709 12:21:14.891994 29290 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:14.903292 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:14.908793 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:14.909667 28599 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:14.916371 29326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:14.917341 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:14.920203 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:14.922420 28572 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:14.929778 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 408734us
I20260709 12:21:14.930184 28572 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:14.933647 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:14.934449 28676 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:14.934988 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:14.935992 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:14.936234 28679 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260709 12:21:14.938745 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 362776us
W20260709 12:21:14.912819  4689 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 12:21:14.943387 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:14.944005 28602 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:14.953804 28572 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:14.928524  4621 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:14.896910  4522 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 12:21:14.938289  4333 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:21:14.942725  4695 log.cc:927] Time spent T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:21:14.964282 28572 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:14.968940  4694 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:21:14.943159  4674 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:21:14.913038  4303 consensus_queue.cc:1048] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 12:21:14.924192  4173 consensus_queue.cc:1048] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:21:14.974556  4671 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:14.927132  4524 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 12:21:14.969569  4362 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:14.988081  4362 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:14.988539  4362 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:14.991935  4624 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:21:14.992911  4684 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.276s	user 0.003s	sys 0.000s
I20260709 12:21:14.972157  4703 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:21:14.978209  4529 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:21:14.995404  4513 consensus_meta.cc:287] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 12:21:14.995530 28756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60486 (request call id 3366) took 1132 ms. Trace:
I20260709 12:21:14.981050 28598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42096 (request call id 3467) took 1013 ms. Trace:
I20260709 12:21:14.998664 29320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41580 (request call id 2431) took 1053 ms. Trace:
I20260709 12:21:14.998746 28598 rpcz_store.cc:276] 0709 12:21:13.967563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:14.012320 (+ 44757us) service_pool.cc:224] Handling call
0709 12:21:14.012694 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:14.267781 (+255087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:21:14.267816 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:14.268301 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:21:14.562721 (+294420us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:21:14.562768 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.825758 (+262990us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54003d3954. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:14.825824 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.980748 (+154924us) raft_consensus.cc:1685] finished
0709 12:21:14.980772 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.980993 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1301,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":585765248,"thread_start_us":294037,"threads_started":1,"wal-append.queue_time_us":575394}
W20260709 12:21:14.981223  4690 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:21:14.981702  4697 log.cc:927] Time spent T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:21:14.995923  4513 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:14.977895  4674 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.006228  4674 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:14.965061  4621 raft_consensus.cc:493] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.006924  4621 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:15.008167  4513 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:14.980581  4699 log.cc:927] Time spent T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:21:14.986896  4704 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 12:21:15.009532  4661 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.010000  4661 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.018072 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:15.019043 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:14.995939 28756 rpcz_store.cc:276] 0709 12:21:13.862682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.863046 (+   364us) service_pool.cc:224] Handling call
0709 12:21:13.863343 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:21:13.893594 (+ 30251us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:21:13.893625 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:21:13.894089 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:21:14.492143 (+598054us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:21:14.492187 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.492254 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:21:14.992373 (+500119us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
0709 12:21:14.995225 (+  2852us) raft_consensus.cc:1685] finished
0709 12:21:14.995262 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.995472 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11504,"raft.queue_time_us":30893,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":35158784,"thread_start_us":597762,"threads_started":1,"wal-append.queue_time_us":668326}
I20260709 12:21:15.020161  4533 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:21:15.020737  4533 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.021119  4533 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:15.001027 28606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39434 (request call id 1504) took 1136 ms. Trace:
I20260709 12:21:14.987249 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:15.024406 28602 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
W20260709 12:21:15.024507 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 84967.1us
W20260709 12:21:15.024644 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 48659.7us
I20260709 12:21:15.026710 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:15.034081 28676 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 20.
I20260709 12:21:15.039994 29326 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:21:14.987075  4542 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.020192 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:15.022912 28606 rpcz_store.cc:276] 0709 12:21:13.864202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.864330 (+   128us) service_pool.cc:224] Handling call
0709 12:21:13.864640 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:14.687650 (+823010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:15.000774 (+313124us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54003db3d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:15.000935 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850740096}
I20260709 12:21:15.035456 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:15.041204 29327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:21:15.053233 29327 raft_consensus.cc:493] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:15.053723 29327 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:15.042689 29317 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
W20260709 12:21:15.050371 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 111962us
I20260709 12:21:15.034777  4589 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:15.040745  4608 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:15.056777  4608 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:15.057157  4608 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:21:15.061048 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45229.7us
I20260709 12:21:15.062037 28571 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:15.035586  4661 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.065117  4711 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:21:15.065663  4711 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:15.066552  4711 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.070052  4621 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.071251 29327 raft_consensus.cc:515] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.073220 29327 leader_election.cc:290] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607)
I20260709 12:21:15.073705  4362 raft_consensus.cc:515] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:15.074983 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.077320 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:21:15.078655 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58530.3us
I20260709 12:21:15.078924 28676 raft_consensus.cc:2393] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:15.080684  4585 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:14.999179 29320 rpcz_store.cc:276] 0709 12:21:13.945387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:13.945561 (+   174us) service_pool.cc:224] Handling call
0709 12:21:13.969915 (+ 24354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:21:13.988304 (+ 18389us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:21:14.239003 (+250699us) log.cc:844] Serialized 14 byte log entry
0709 12:21:14.810087 (+571084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:21:14.810173 (+    86us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:21:14.810244 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:21:14.998435 (+188191us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54007a0154. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7fe01 00007f6fe3a7e83e 00007f6fe8a43419 00007f6fe1fbabd4 00007f6fe1fbab62 00007f6fe1fbaa91 00007f6fe1fbaa0c 00007f6fe1fb9cc2 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:14.998482 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:21:14.998607 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":189139,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":3778,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":2628,"spinlock_wait_cycles":41512832,"thread_start_us":815429,"threads_started":2,"wal-append.queue_time_us":627004}
W20260709 12:21:15.081094 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 45732.6us
I20260709 12:21:15.081512  4705 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:15.082157  4705 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:15.083113  4705 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.084645  4674 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.085340 28679 pending_rounds.cc:85] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 11
I20260709 12:21:15.085628 28679 pending_rounds.cc:107] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:21:15.085868 28679 raft_consensus.cc:2889] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:15.086427 28599 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:21:15.086936  4674 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.072233  4621 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:15.088526 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.059913  4670 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.105942 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:15.109977  3320 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:15.110486  3320 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.114001  3320 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:15.106069  4405 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:21:15.118743 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:15.117698  4405 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:21:15.123347 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 206069us
I20260709 12:21:15.124449 29290 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:15.129443  4621 raft_consensus.cc:2804] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:15.129985  4621 raft_consensus.cc:697] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:15.131000  4621 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.133625  4533 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.135136 28676 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 27: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:15.122438  4405 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:21:15.151971 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.159883 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.161139 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.164090 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.165067 28747 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 30: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:15.161825  4452 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:15.175825 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "316dc144dbef470e8e17c2e02887dfd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.159171  4624 raft_consensus.cc:493] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.177621  4624 raft_consensus.cc:515] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.178048 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1548a806b02a4f79b5010615f560d2bb" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.179425 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.179662  4497 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:15.180209  4497 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.180958 29326 raft_consensus.cc:1240] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:15.182297  4497 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:15.183246 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.184103 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.175592  4452 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.185513 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.186311  4452 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.188206  4656 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.188756  4656 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.190419 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:15.192821 28496 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.194339 28647 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:15.194428 28496 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 19 to 20, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 20 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:15.196055 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.161931  4691 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:15.197553 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.198253  4691 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.199116  4557 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:15.208037 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.209569 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:15.212447 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:15.213230 28752 raft_consensus.cc:3055] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:15.213642 28752 raft_consensus.cc:740] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:15.201646 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:15.203680 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea376f5c1af47d79a1871ab80a23cdb" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.205358 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.207631 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.219669 28754 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:21:15.200414 29317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:15.222304 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.207715 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcb1386731ec4c46bd9cc992c2ffc31b" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.211367 28496 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.228586 28749 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:15.173650  4533 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.174800  4670 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.235437 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683aa452755144abbbeaff5aa710e8ca" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.214607 28752 consensus_queue.cc:260] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.200389  4691 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:15.245769 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:15.246515 28750 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:15.239732 28752 raft_consensus.cc:3060] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:15.240852 28647 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:15.215728  4339 raft_consensus.cc:493] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.261636 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.251561 28647 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:15.262107 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:15.263271 29327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:15.265010 29317 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:15.222204  4564 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.232342  4702 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:15.230487  4603 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.235219  4624 leader_election.cc:290] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.274928 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:15.286672 28752 raft_consensus.cc:2468] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:15.290876 29321 raft_consensus.cc:2368] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24.
I20260709 12:21:15.266057  4656 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:15.355985 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:15.359685 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.362180 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.365046 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.266527  4682 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:15.351953 28755 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:21:15.380527 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:15.382350 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:15.383005 28752 raft_consensus.cc:3055] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:21:15.383340 28752 raft_consensus.cc:740] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:15.277261  4542 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:15.272841  4533 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:15.280592  4564 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.288702  4603 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.449795  3320 raft_consensus.cc:993] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:21:15.269325  4608 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.280831  4662 consensus_queue.cc:1059] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 12:21:15.273811  4698 consensus_queue.cc:1059] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.173s
I20260709 12:21:15.432029  4720 raft_consensus.cc:493] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:15.431696  4529 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:15.270020  4339 raft_consensus.cc:515] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.288378  4637 consensus_queue.cc:1059] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.162s
I20260709 12:21:15.453085 28572 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:15.456046  4671 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:15.456389 28749 raft_consensus.cc:1275] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:21:15.456828  4333 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
W20260709 12:21:15.457332 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 102243us
I20260709 12:21:15.459241  4616 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.459911  4711 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.461201  4702 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.384192 28752 consensus_queue.cc:260] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.396514  4501 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:15.486620 28496 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:15.487891  4725 log.cc:927] Time spent T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.109s	user 0.005s	sys 0.000s
I20260709 12:21:15.452400  4502 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.061s
W20260709 12:21:15.547258 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44103.8us
W20260709 12:21:15.559234 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 106238us
I20260709 12:21:15.560223 28572 leader_election.cc:400] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24.
I20260709 12:21:15.560753 28572 leader_election.cc:403] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:21:15.556074 28573 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:15.551364  3971 raft_consensus.cc:1081] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:21:15.564287 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:15.550580  4735 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:21:15.505050  4405 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.567993 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:15.568881 28606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:15.569460 28606 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:15.551851  4702 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:15.571960 28607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:15.572274 28573 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:15.586045 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:15.540010  4720 raft_consensus.cc:515] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.589164 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:15.591856 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975dd4c5a744a1d98c05841000796f8" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:15.592499 28605 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:15.566341  4527 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:15.566193  4618 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:21:15.599808 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:15.568317  4585 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.600555 28599 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 30.
I20260709 12:21:15.615242 28598 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 27: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:15.616241 28606 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:15.613998  4670 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:21:15.618405  4670 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:15.618985  4670 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.619400  4670 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:15.620972  4733 log.cc:927] Time spent T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:21:15.622205 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:15.622454  4734 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:21:15.623523 28604 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: [23.18-23.18]
W20260709 12:21:15.623848  4729 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:15.553474  4616 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.625653 28750 raft_consensus.cc:2468] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:21:15.560623  4501 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:15.624670  4727 log.cc:927] Time spent T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:21:15.629537 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:15.551561  4333 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.600062  4648 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.554381  4711 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.651109  4501 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:15.651481  4711 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.601537  4636 raft_consensus.cc:3055] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:21:15.652606  4636 raft_consensus.cc:740] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:15.653434  4636 consensus_queue.cc:260] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.654578  4636 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:15.643159 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:15.629962  4585 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.613627  4637 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:15.646728  4720 leader_election.cc:290] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.625540  4513 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:15.662868 28605 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
W20260709 12:21:15.667464 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 95304us
I20260709 12:21:15.669369 28573 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:15.670776 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.671449 28678 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:15.673751 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.673887 28573 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:21:15.675365 28570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.671785  4705 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:15.676518  4702 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.677803  4747 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:15.678683  4702 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.679667 28573 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:15.694324  4748 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:21:15.674674  4724 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:21:15.699424 28750 raft_consensus.cc:1240] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:21:15.700505 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:15.680325  4732 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:21:15.723933 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.726811  4749 consensus_queue.cc:1059] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:15.727417  4362 leader_election.cc:290] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.695936  4608 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.675282  4621 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.736152 28603 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:15.675048  4513 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.659994  4648 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.671345  4637 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.740171 28605 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25. Ops: []
W20260709 12:21:15.743582 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.768226 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.768826 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.771095 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.696743  4747 raft_consensus.cc:2749] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:21:15.747644  4670 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.748879  4585 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.749738  4637 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:15.750990  4513 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.753134  4333 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.755746 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.786053 28677 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 21.
I20260709 12:21:15.757579  4173 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:15.788968 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:15.761777  4616 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.776913 28678 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:21:15.780124 28675 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:21:15.781991 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.747188  4339 leader_election.cc:290] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.764588  4405 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 30 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.802552  4648 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.802767 29323 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:21:15.770589  4626 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.804082  4626 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.806227  4626 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.808171 28571 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:15.810540  4670 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:15.812371  4499 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:15.825244  4499 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:15.816917  4524 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:15.825819  4499 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:15.826165  4718 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:15.788417  4173 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:15.834803  4173 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.836050  4173 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:15.844404  4661 raft_consensus.cc:493] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:15.844995  4661 raft_consensus.cc:515] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.846211  4533 raft_consensus.cc:3055] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:15.846788  4533 raft_consensus.cc:740] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:15.847090  4661 leader_election.cc:290] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.743680  4621 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.852265 28496 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 17 to 20, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 20 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:15.854549 28496 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 13 to 20. New cstate: current_term: 20 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:15.862504 28647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.001s	sys 0.017s
W20260709 12:21:15.862978 28647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.001s	sys 0.017s
W20260709 12:21:15.863319 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 586937us
I20260709 12:21:15.870400  4621 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:15.778250 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.878042 29323 raft_consensus.cc:1240] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 18. Current term is 19. Ops: []
I20260709 12:21:15.864243 28647 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:15.896548 28496 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:15.900621 28647 leader_election.cc:304] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:15.902630  4648 raft_consensus.cc:493] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:15.906299  4648 raft_consensus.cc:515] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.847859  4533 consensus_queue.cc:260] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.815421  4527 raft_consensus.cc:2749] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24.
I20260709 12:21:15.903676  4523 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:21:15.904857  4585 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:15.912670 28675 raft_consensus.cc:1240] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:21:15.914186  4533 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:15.921705 28755 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:15.923620  4603 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.924615  4674 raft_consensus.cc:3055] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:15.925006  4674 raft_consensus.cc:740] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:15.925786  4674 consensus_queue.cc:260] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.913041 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:15.926878 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.927759 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.928068 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:15.922827 29292 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:15.928550 28607 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:15.929257 28600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:21:15.929821 28600 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:15.929967 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.930208 28600 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:15.910132  4711 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:21:15.910154  4661 raft_consensus.cc:2749] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:15.932333 28673 raft_consensus.cc:1240] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25. Ops: []
I20260709 12:21:15.942368 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.942931 28673 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:15.943694 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.933975  4707 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:21:15.935050 28681 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:21:15.945214 28752 raft_consensus.cc:3060] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:21:15.946372  4711 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:15.946874  4711 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:15.934999 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad958cd19754b4b9c2817e4b5cd7ded" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:15.948733 28682 raft_consensus.cc:3060] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:15.949663  4303 raft_consensus.cc:3055] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:15.950083  4303 raft_consensus.cc:740] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:15.951016  4303 consensus_queue.cc:260] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.952070  4303 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:15.935680  4173 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:21:15.952710  4173 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:15.953079  4173 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:21:15.953883 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:15.937393 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.956315 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.938545  4564 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.926901  4585 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:15.956458 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:15.958323 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.961301 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:15.972355 28682 raft_consensus.cc:2468] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:15.974350 28752 raft_consensus.cc:2468] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:15.976240 28602 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:21:15.979493 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:15.983368 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 52426.6us
I20260709 12:21:15.984129 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:15.988428 28682 raft_consensus.cc:1240] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:15.913934  4648 leader_election.cc:290] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:15.991189 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:15.980640  4173 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.996490 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:15.994586 28601 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:15.998641 28602 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:21:15.992760 29292 leader_election.cc:304] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:16.002562 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.004033 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.010354 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:16.010632 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:16.009476 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
W20260709 12:21:16.013988 28720 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.014176 28598 raft_consensus.cc:2468] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:16.005302 29292 leader_election.cc:304] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:16.015799 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:16.016165 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:16.017614 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793ab78ecea2432e8fdb088474026ce1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:16.018682 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:16.020200 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:16.020815 28747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:16.021395 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:16.021692 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:16.022096 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:16.020277 28648 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:16.006749 28600 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:15.995097  4707 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:16.024466 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9f78bead97491ebb7f049af3cf869c" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:16.031776 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:16.021632 28747 raft_consensus.cc:2368] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 30. Current term is 31.
I20260709 12:21:15.996929  4674 raft_consensus.cc:3060] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:16.037530 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:15.995011  4497 consensus_queue.cc:1059] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:21:16.038419  4497 raft_consensus.cc:3055] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:21:16.038758  4497 raft_consensus.cc:740] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:16.026925 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bdaade8df945828ab371a3267cd752" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:16.041162  4173 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 31 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:16.034756  4741 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:21:16.041926 29289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.043529 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:16.044342 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:16.003492  4750 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:16.045356 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:16.045368 28752 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:16.046590 28648 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:16.047369 29292 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:16.048236 28678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.048918 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.049202 28600 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:16.025182  4683 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 12:21:16.086928  4497 consensus_queue.cc:260] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:16.018256  4703 raft_consensus.cc:2804] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:21:16.100848  4703 raft_consensus.cc:697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:16.101873  4703 consensus_queue.cc:237] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.106588 28677 raft_consensus.cc:1240] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:21:16.118304 28496 catalog_manager.cc:5697] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 11 to 25. New cstate: current_term: 25 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:16.029609  4716 raft_consensus.cc:2804] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:16.119692  4716 raft_consensus.cc:697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:16.120597  4716 consensus_queue.cc:237] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.123327 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:16.125725 28498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 343) took 22830 ms (client timeout 15000 ms). Trace:
I20260709 12:21:16.043013  4585 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:16.100186  4497 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:16.119714 28496 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 14 to 19, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 19 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:16.139863 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 92561us
I20260709 12:21:16.052632 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243df7b9197c40219914bcac6111faca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:16.135857 28602 raft_consensus.cc:2410] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:21:16.136644 28674 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:21:16.137257 28680 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 30.
I20260709 12:21:16.148372 28674 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:21:16.149541 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:16.152292 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:16.153954 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac62777e94e1417c867cb2ac80a55824" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:16.157191 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 110672us
I20260709 12:21:16.151265 28571 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:16.164994 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:16.165975 28719 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.173496  4748 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:16.174100  4748 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:16.174963  4748 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:16.160718 28496 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:16.178766 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 147212us
I20260709 12:21:16.204763 28600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:16.051138  4707 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:16.271999 28678 raft_consensus.cc:1240] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 26. Ops: []
I20260709 12:21:16.272658 28675 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:21:16.273629 28679 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: []
W20260709 12:21:16.264900  4760 log.cc:927] Time spent T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:21:16.284387 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.286645 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:16.290591 28599 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 30.
I20260709 12:21:16.158620  4750 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:16.126142 28498 rpcz_store.cc:269] 0709 12:20:53.294886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:53.780081 (+485195us) service_pool.cc:224] Handling call
0709 12:20:54.341849 (+561768us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b540002c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e9090 00007f6fe3a87f3a 00007f6fe983de9c 00007f6fe993c04e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc 00007f6fe7dfc392 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:16.125501 (+21783652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:07.936250 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:07.947698 (+ 11448us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:07.947748 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:21:07.947766 (+    18us) tablet.cc:662] Decoding operations
0709 12:21:07.950265 (+  2499us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:07.950326 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:07.950349 (+    23us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:21:07.952688 (+  2339us) tablet.cc:701] Row locks acquired
0709 12:21:07.952700 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:21:07.952812 (+   112us) write_op.cc:270] Start()
0709 12:21:07.952903 (+    91us) write_op.cc:276] Timestamp: P: 1783599667952776 usec, L: 0
0709 12:21:07.952916 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 12:21:08.120732 (+167816us) log.cc:844] Serialized 11795 byte log entry
0709 12:21:08.322490 (+201758us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe09750ac 00007f6fe97cf9a9 00007f6fe099169b 00007f6fe098f93f 00007f6fe0991c02 00007f6fe361920b
0709 12:21:08.515861 (+193371us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b540002c454. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a7ae28 00007f6fe74b5581 00007f6fe74b4d58 00007f6fe74b99f1 00007f6fe74b99a9 00007f6fe74b9939 00007f6fe74b9901 00007f6fe74b8b2d 0000000000388634 0000000000388479
0709 12:21:08.913624 (+397763us) op_driver.cc:464] REPLICATION: finished
0709 12:21:09.277559 (+363935us) write_op.cc:301] APPLY: starting
0709 12:21:09.277701 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:09.612901 (+335200us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:09.612943 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:10.055708 (+442765us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b18004d9200. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe0992522 00007f6fe09947c1 00007f6fe0994779 00007f6fe0994709 00007f6fe09946d1 00007f6fe09939cd 0000000000388634 0000000000388479 00007f6fe097583a
0709 12:21:10.700322 (+644614us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:10.837999 (+137677us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 12:21:10.838080 (+    81us) write_op.cc:312] APPLY: finished
0709 12:21:10.838739 (+   659us) log.cc:844] Serialized 260 byte log entry
0709 12:21:10.953822 (+115083us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:10.976053 (+ 22231us) write_op.cc:454] Released schema lock
0709 12:21:10.976139 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:10.976634 (+   495us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:10.976667 (+    33us) write_op.cc:454] Released schema lock
0709 12:21:11.162556 (+185889us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe08b8c85 00007f6fe08b96a2 00007f6fe362b1db 00007f6fe3626aaf 00007f6fe361a86e 00007f6fe3619bb6 00007f6fe36197d8 00007f6fe3623221 00007f6fe36231d9 00007f6fe3623169
Metrics: {"mutex_wait_us":1195470,"reported_tablets":47,"spinlock_wait_cycles":45036800,"child_traces":[["op",{"apply.queue_time_us":342465,"apply.run_cpu_time_us":69514,"apply.run_wall_time_us":1699079,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129227,"num_ops":30,"prepare.queue_time_us":438827,"prepare.run_cpu_time_us":44441,"prepare.run_wall_time_us":586053,"raft.queue_time_us":222839,"raft.run_cpu_time_us":91468,"raft.run_wall_time_us":239376,"replication_time_us":957172,"spinlock_wait_cycles":278868608,"thread_start_us":1015353,"threads_started":5,"wal-append.queue_time_us":503989,"wal-append.run_cpu_time_us":39392,"wal-append.run_wall_time_us":2817397}]]}
I20260709 12:21:16.295467 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:16.296103 28673 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:21:16.161111  4637 raft_consensus.cc:2804] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:16.178298  4585 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:16.178151  4564 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:16.128636  4621 consensus_queue.cc:1048] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.143s
I20260709 12:21:16.309258 28720 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:16.314505 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:16.315891 28720 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:16.357237 28496 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:16.161598  4499 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.296186  4750 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:16.181701  4513 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.130s
W20260709 12:21:16.330155  4757 log.cc:927] Time spent T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:21:16.318390  4585 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:16.375445  4585 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:16.376791  4683 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:16.377228  4683 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:16.377602  4683 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:16.378852  4693 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:21:16.361228  4718 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:16.361661  4706 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:16.381470  4706 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.383719  4706 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:16.350796  4705 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:16.386790  4499 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:16.388038 28604 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 21. Current term is 22. Ops: []
I20260709 12:21:16.389362 28496 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:16.373474 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57657us
I20260709 12:21:16.407356 28673 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 31.
I20260709 12:21:16.415390 28496 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 18 to 20, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 20 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:16.422474 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
W20260709 12:21:16.361685 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 198080us
W20260709 12:21:16.460456 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 61496.7us
I20260709 12:21:16.376214  4513 consensus_queue.cc:1059] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 24.20, Next index: 21, Last known committed idx: 18, Time since last communication: 0.042s
W20260709 12:21:16.465682  4758 log.cc:927] Time spent T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:21:16.469444 29291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:16.417832  4499 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:16.475397 28748 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:21:16.473829 28572 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
W20260709 12:21:16.478775 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 192214us
I20260709 12:21:16.479838 29290 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:16.316619  4707 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.481036 28720 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:16.484159 29290 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:16.475806  4716 raft_consensus.cc:3055] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:21:16.492352 28498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 311) took 17799 ms (client timeout 15000 ms). Trace:
W20260709 12:21:16.493220 28498 rpcz_store.cc:269] 0709 12:20:58.689683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.482161 (+17792478us) service_pool.cc:211] Skipping call since client already timed out
0709 12:21:16.488614 (+  6453us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:21:16.497807 28720 leader_election.cc:304] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:16.481954  4670 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:16.480249  3971 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.502938 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:16.481698  4621 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:16.518683 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:16.496902  4708 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:16.493157  4716 raft_consensus.cc:740] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:16.482288  4499 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:16.499935  4718 raft_consensus.cc:493] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:16.543704 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49643.3us
I20260709 12:21:16.544778 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:16.549319  4691 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:16.524555  4637 raft_consensus.cc:697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 23 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:16.501945  4766 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
W20260709 12:21:16.548982 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 63080.1us
I20260709 12:21:16.566313 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:16.553555  4501 raft_consensus.cc:2749] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:16.518639  3971 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.570868 28572 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:16.578212  4772 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:16.580855  4637 consensus_queue.cc:237] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.561528  4767 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:16.591747  4499 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:16.548282  4718 raft_consensus.cc:515] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:16.599602 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 441057us
I20260709 12:21:16.554064  4585 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.603897 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:16.601456 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 301703us
I20260709 12:21:16.604748 28752 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:16.568207  4770 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:16.608933  4671 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:16.611485  3971 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:16.612169  4711 consensus_meta.cc:287] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.003s
I20260709 12:21:16.612736  4711 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.615351  4711 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:16.615803 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 95025.4us
I20260709 12:21:16.618458 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:16.619879 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:16.620193 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:16.628484 28603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:16.629122 28681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e1813ffb1124b0d8e8500ca59a1550f" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.636886 28677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "302623a332a2421e848283481e8010f6"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:21:16.637529 28677 raft_consensus.cc:606] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:16.640760 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:16.641913 28571 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:16.643075  4524 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:16.646292 28603 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:21:16.646477 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:16.649746 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44352.7us
W20260709 12:21:16.649235 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 44709.3us
I20260709 12:21:16.615578  4718 leader_election.cc:290] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:16.653517 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 57897.7us
I20260709 12:21:16.669211 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:16.660014 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:16.670111 29319 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:16.576751  4716 consensus_queue.cc:260] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.651440  4564 raft_consensus.cc:493] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:16.655714  4671 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:21:16.686088 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:16.686331 28648 leader_election.cc:304] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:16.651875  4636 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:21:16.717653  4778 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:21:16.721195 28648 leader_election.cc:400] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 30 election: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 30. Current term is 31.
I20260709 12:21:16.723394 28648 leader_election.cc:403] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 30 election: Cancelling election due to peer responding with higher term
W20260709 12:21:16.716190 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 44971.7us
I20260709 12:21:16.674114  3971 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:16.672725  4708 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:16.730047 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:16.732816  4741 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:21:16.734098 28648 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:16.736302  4741 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:16.661092  4693 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:21:16.744367 29325 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:21:16.745204 29325 pending_rounds.cc:85] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Aborting all ops after (but not including) 14
I20260709 12:21:16.745455 29325 pending_rounds.cc:107] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:21:16.745728 29325 raft_consensus.cc:2889] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:16.722815  4747 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:21:16.727358  4405 raft_consensus.cc:2749] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:21:16.742322  4708 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:16.763945  4708 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:16.743294  3971 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.766578  3971 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:16.771544  4775 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:21:16.738916  4771 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:16.780740  4771 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.782938  4771 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:16.728350  4707 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:16.783643  4707 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.785977  4707 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:16.745059  4648 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader election lost for term 30. Reason: Vote denied by peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) with higher term. Message: Invalid argument: T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea for earlier term 30. Current term is 31.
W20260709 12:21:16.796622 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 136730us
I20260709 12:21:16.703581  4564 raft_consensus.cc:515] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:16.787401  4710 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:16.787907  4621 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:16.834446  4564 leader_election.cc:290] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:16.861714 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.862910 28677 raft_consensus.cc:2393] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 24: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:16.866816 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.875366 28679 raft_consensus.cc:1275] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:21:16.795959  4683 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.889994 29320 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:16.882406  4637 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:16.891131  4683 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:16.891233  4637 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.827131  4710 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.893603  4637 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:16.890698 28673 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:21:16.900701 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.894168  4710 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:16.885754  4585 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:16.828838  4621 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:16.909971 28676 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
W20260709 12:21:16.954277 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 229334us
W20260709 12:21:16.901198 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 213850us
I20260709 12:21:16.971967 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:16.982054 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:16.984185 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.984967 28673 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 24.
I20260709 12:21:16.988586 28648 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:16.963681 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:21:16.917287  4783 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:21:16.921860  4497 consensus_meta.cc:287] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.000s
W20260709 12:21:16.936646  4750 consensus_meta.cc:287] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.001s
I20260709 12:21:17.002187 28755 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:16.996210 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:16.907826  4716 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:17.006608  3320 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:16.924588  4621 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:17.007164 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 43596.3us
I20260709 12:21:17.021345  3320 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.024019  3320 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:17.025020 28721 leader_election.cc:304] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.022758 28648 leader_election.cc:304] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.028474 28648 leader_election.cc:304] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.041561 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:16.909891  4711 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.111s
I20260709 12:21:17.042596 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.047340 29320 raft_consensus.cc:2393] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 24: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:17.045375  4405 raft_consensus.cc:2749] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:17.051394  4770 consensus_queue.cc:1048] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:17.036908  4564 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:21:17.007877  4750 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:17.041949  4452 raft_consensus.cc:2749] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:17.041742  4608 raft_consensus.cc:2749] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:17.067119 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.067742 28673 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:17.064352  4750 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:17.072640 28601 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:17.073501  4700 raft_consensus.cc:993] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:17.073992  4700 raft_consensus.cc:1081] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
W20260709 12:21:17.080092 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 105733us
I20260709 12:21:17.083968 28648 leader_election.cc:304] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.085059 29290 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:17.091279 28673 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:17.094403 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.092478 28571 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:17.113130 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.085587  4533 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:17.094707  4700 raft_consensus.cc:2749] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:17.050407  4718 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.064s
I20260709 12:21:17.135411 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:17.136052 28748 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 19.
I20260709 12:21:17.137073 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:17.137718 28756 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:21:17.139923 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
W20260709 12:21:17.140911 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 55978.5us
I20260709 12:21:17.145385 29320 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "302623a332a2421e848283481e8010f6"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:39252
I20260709 12:21:17.145982 29320 raft_consensus.cc:493] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:17.146505 29320 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:17.149029 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
W20260709 12:21:17.128367  4703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.000s	sys 0.039s
I20260709 12:21:17.151074 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:17.123780  4524 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:17.154422 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663f0169fb984cfe963338bade0eabbb" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.154409 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:17.130930  4564 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:17.157181 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:17.158131  3320 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.121798  4452 consensus_queue.cc:1059] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:21:17.134456  4673 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:21:17.153177  4703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.000s	sys 0.040s
I20260709 12:21:17.166649 28604 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:21:17.167071 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:17.152755  4707 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:17.119794  4793 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:21:17.173633 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5dc72678108404787b2aa034d4a7243" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.173867 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.176266  4770 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:17.187309  4770 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:17.187711  4770 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:17.163328  4788 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:21:17.170837  4707 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.189085  4707 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:17.189313  4788 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:21:17.189729  4788 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:17.190595  4788 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.192085  4788 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:17.192719  4452 consensus_queue.cc:1243] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer e3ce74ba14714b4dbd2d75e27f34eb0d log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:21:17.193291  4452 raft_consensus.cc:3055] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:17.193535  3320 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.162438  4524 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.197059  4524 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.199018  4637 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:17.199473  4789 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.200791 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:17.201637  4767 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:21:17.202008  4767 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:17.202371  4767 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:21:17.171208  4673 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:17.206163  4673 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:17.210652  4691 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:21:17.226130 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 52169.4us
I20260709 12:21:17.193620  4452 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:17.228734 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:17.228936 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.244372  4770 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.228186  4782 consensus_queue.cc:1059] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
W20260709 12:21:17.246538 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 66979.1us
I20260709 12:21:17.256104 28573 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:17.256573 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.225018  4691 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:17.251921 28755 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 26.
I20260709 12:21:17.199993  4789 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:17.275336 28755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60486 (request call id 3397) took 1225 ms (client timeout 1528 ms). Trace:
I20260709 12:21:17.279759 28756 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:21:17.263325 28602 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:21:17.265384 28598 raft_consensus.cc:1240] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 26. Current term is 27. Ops: []
I20260709 12:21:17.267874 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:17.275733 28755 rpcz_store.cc:269] 0709 12:21:16.049944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.050073 (+   129us) service_pool.cc:224] Handling call
0709 12:21:17.275106 (+1225033us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54001b49d4. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe39e8571 00007f6fe3a832fa 00007f6fe8a44b17 00007f6fe1fbf6d4 00007f6fe1fbf662 00007f6fe1fbf591 00007f6fe1fbf50c 00007f6fe1fbe7c2 00007f6fe1dba48c 00007f6fe1db98c6 00007f6fe1db926f
0709 12:21:17.275266 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959361920}
I20260709 12:21:17.287575 28749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:17.288198 28749 raft_consensus.cc:606] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 LEADER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:17.293068 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56081.6us
I20260709 12:21:17.303000 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7fa5ed3509d4939885ee0d39a32f20a" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.272094  4779 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:17.309902  4720 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:17.310668  4720 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:17.311476 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 49495.7us
I20260709 12:21:17.283833  4501 raft_consensus.cc:493] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:17.315629  4501 raft_consensus.cc:515] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.316531  4705 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:17.317055  4705 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:17.318830 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 46163us
I20260709 12:21:17.319049  4705 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.319106  4692 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:21:17.319749  4791 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:17.319893 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.320277  4692 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:17.320689  4692 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:17.321707  4776 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:17.321455  4692 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:17.321920  4772 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:17.322980  4589 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.322850  4691 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.323330  4772 consensus_queue.cc:1059] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:17.323477 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.325649  4764 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:21:17.326189  4764 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:17.326957  4789 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:17.327061  4764 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:17.325685  4795 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:17.329069  4795 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:17.331219 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:17.331868 29325 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:17.331269  4795 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:17.328524 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9b05092c214663bd1a274ae3358eb4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:17.337353 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.338936 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.339054 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.342072 28602 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 27: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:17.323519  4589 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.345409 28748 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:21:17.350289 28753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fe68878605a4b8ab3302650b63aae98"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:17.350883 28753 raft_consensus.cc:606] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:21:17.351095 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 97521.1us
I20260709 12:21:17.352025 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.352568  4748 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.352782 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.353088  4748 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.354288 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ca073d2ba7428e8ef693a68c16429b" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.355201  4748 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.356092 28681 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:21:17.356737 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.357326 28680 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:17.358012 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.358462 28648 leader_election.cc:304] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.359817  4603 raft_consensus.cc:2749] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:21:17.351267 28753 raft_consensus.cc:614] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:17.363659 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.324218  4771 raft_consensus.cc:3055] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:21:17.358189  4452 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:17.365969 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.366683 28679 raft_consensus.cc:3060] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:17.367967 28674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.368963 28748 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 12:21:17.369341 28748 pending_rounds.cc:85] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 17
I20260709 12:21:17.369563 28748 pending_rounds.cc:107] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 12:21:17.369792 28748 raft_consensus.cc:2889] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.370250 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05ef99f51b5a4b959e982c258f2aafcc" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.319489  4501 leader_election.cc:290] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.352751 28676 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 27.
I20260709 12:21:17.289871  4711 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:21:17.366820 29320 raft_consensus.cc:515] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:17.378877 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 53754.5us
I20260709 12:21:17.344283  4589 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.392768 28605 raft_consensus.cc:1275] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 12:21:17.387890 28599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.394914 28599 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 27.
W20260709 12:21:17.377478  4768 log.cc:927] Time spent T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:21:17.389210 28722 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.393517 28605 pending_rounds.cc:85] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 15
I20260709 12:21:17.402408 28605 pending_rounds.cc:107] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 12:21:17.372596  4771 raft_consensus.cc:740] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:17.403184 28605 raft_consensus.cc:2889] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.376381  4692 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:17.375856  4708 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.403498 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:17.386870 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.400405 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
W20260709 12:21:17.385784  4799 log.cc:927] Time spent T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:21:17.411094 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.386628  4452 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:17.415490 28722 leader_election.cc:304] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.419976 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.414179 29320 leader_election.cc:290] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:17.425617 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.427764 29318 raft_consensus.cc:2410] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 28 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:21:17.417018 28679 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:21:17.422298 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:17.429280 28720 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:17.429677 28748 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:17.430553 28753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:17.431447 28753 raft_consensus.cc:606] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:17.431903 28753 raft_consensus.cc:614] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:17.433808 29325 raft_consensus.cc:2468] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:21:17.435497 28572 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:17.435793 28721 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:17.441252 29292 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:17.442767 28598 raft_consensus.cc:1240] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 LEADER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:21:17.446087 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302623a332a2421e848283481e8010f6" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.446923 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.447299 28675 raft_consensus.cc:3055] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:21:17.447609 28675 raft_consensus.cc:740] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:17.448349 28675 consensus_queue.cc:260] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.403117  4636 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
W20260709 12:21:17.453016  4805 log.cc:927] Time spent T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:21:17.453137  4804 log.cc:927] Time spent T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:21:17.420503  4708 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.458107  4708 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.385311  4527 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:21:17.460424  4770 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:17.461519  4771 consensus_queue.cc:260] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.462121  4766 raft_consensus.cc:3055] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:17.462589  4766 raft_consensus.cc:740] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:17.462870  4771 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:17.463527  4766 consensus_queue.cc:260] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:17.437580  4807 log.cc:927] Time spent T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:21:17.458801  4720 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.424732  4707 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.466857  4707 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:17.468683 28755 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 24.
I20260709 12:21:17.407027  4797 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:21:17.473170 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 43988us
I20260709 12:21:17.474259 28720 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:17.476876 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.477624 28673 raft_consensus.cc:2368] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25.
I20260709 12:21:17.421309  4711 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:21:17.479238 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.480051 28673 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:17.481645 28604 raft_consensus.cc:1240] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:21:17.483620 28748 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:21:17.487156 29323 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 25. Current term is 26. Ops: []
I20260709 12:21:17.440099  4497 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:17.490372 29290 leader_election.cc:400] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25.
I20260709 12:21:17.490792 29290 leader_election.cc:403] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:21:17.491209 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.436795  4671 raft_consensus.cc:493] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.468421  4776 raft_consensus.cc:2749] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:17.440101  4790 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:17.485062  4626 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:21:17.486960  4766 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:17.484858  4794 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:21:17.506935 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 71240.3us
I20260709 12:21:17.436877  4788 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.059s
W20260709 12:21:17.468675  4716 consensus_queue.cc:1175] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" responder_term: 26 status { last_received { term: 26 index: 17 } last_committed_idx: 17 last_received_current_leader { term: 26 index: 17 } }
I20260709 12:21:17.485877  4711 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.556929  4711 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:17.507894  4626 raft_consensus.cc:493] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:17.560710  4626 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:17.563422  4797 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:17.563814 28673 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
I20260709 12:21:17.493500  4791 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25.
I20260709 12:21:17.486841  4636 consensus_queue.cc:1048] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:21:17.537062  4794 raft_consensus.cc:493] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:17.566890  4794 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:17.575918  3320 raft_consensus.cc:993] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:21:17.576584  4719 raft_consensus.cc:1081] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 LEADER]: Signalling peer e3ce74ba14714b4dbd2d75e27f34eb0d to start an election
I20260709 12:21:17.522543  4708 raft_consensus.cc:2804] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:17.522979  4767 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.499791  4671 raft_consensus.cc:515] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:17.524796  4814 log.cc:927] Time spent T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:21:17.545728 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.486557  4501 raft_consensus.cc:2749] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:17.552718 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:17.554320 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 58725.1us
I20260709 12:21:17.583628 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:17.586184 28573 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:17.596151 29292 leader_election.cc:304] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:17.598737 28601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12"
dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:42096
I20260709 12:21:17.599066 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e0d44a1cde4f32b60dd0ed014922ec" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:17.605760 28601 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:17.606268 28601 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:21:17.608088  4779 raft_consensus.cc:2804] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:17.618212  4779 raft_consensus.cc:697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:17.607779  4708 raft_consensus.cc:697] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
W20260709 12:21:17.621500 29292 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.626386 28601 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.608089  4790 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:17.619109  4779 consensus_queue.cc:237] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.645391 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.649756 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.650421 28676 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:21:17.652393 28601 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 33 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.653332 28720 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:17.653388 28753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:17.654229 28753 raft_consensus.cc:3055] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:21:17.654595 28753 raft_consensus.cc:740] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:17.655273 28753 consensus_queue.cc:260] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.633863  4700 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:17.634362  4790 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:17.663965 28747 raft_consensus.cc:1240] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 25. Current term is 26. Ops: []
I20260709 12:21:17.660382 28753 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:21:17.670234  4790 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:17.680622 28753 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 33.
I20260709 12:21:17.671411  4700 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.684113  4700 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.662724  4764 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:17.683701  4794 raft_consensus.cc:515] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.687311  4794 leader_election.cc:290] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.688663  4626 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.689790 28676 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 33.
I20260709 12:21:17.690480 28681 raft_consensus.cc:1240] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 32. Current term is 33. Ops: []
I20260709 12:21:17.690766 28752 raft_consensus.cc:3060] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:17.661567  4452 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:17.704779 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.709769  4671 leader_election.cc:290] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.710667 28752 raft_consensus.cc:2468] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
I20260709 12:21:17.713500 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:17.719101 28721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:17.720660  4626 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:17.722808 28675 raft_consensus.cc:3060] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:17.725863  4767 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:17.729763  4818 log.cc:927] Time spent T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:21:17.700075  4708 consensus_queue.cc:237] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.733011 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1532cf86464920afb02490b110f356" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.774477 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:17.733579 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: true dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:17.781710 29321 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:21:17.739650 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:17.745929 28571 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:17.751374  4711 raft_consensus.cc:515] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.754612  4782 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.758234 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:17.784384 29323 raft_consensus.cc:2368] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25.
I20260709 12:21:17.759266 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.763685  4691 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:17.766767 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.789340 28677 raft_consensus.cc:3060] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:17.769392  4790 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.783612  4792 raft_consensus.cc:493] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:17.801853 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb84065af5c41b0aaee71485ad69560" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.802881 28679 raft_consensus.cc:2368] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25.
I20260709 12:21:17.808750 28677 raft_consensus.cc:2468] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 28.
I20260709 12:21:17.814350 28572 leader_election.cc:304] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:17.814306 28601 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:17.817718 28721 leader_election.cc:400] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25.
I20260709 12:21:17.818089 28721 leader_election.cc:403] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:21:17.822993  3320 raft_consensus.cc:2749] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25.
I20260709 12:21:17.794950  4748 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:21:17.825937 28751 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:21:17.826524 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:17.829144 28752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:17.829818 28752 raft_consensus.cc:606] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.830153 28752 raft_consensus.cc:614] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:17.801172  4795 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:17.842999  4711 leader_election.cc:290] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:17.840178 29321 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 33.
I20260709 12:21:17.799129  4792 raft_consensus.cc:515] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:17.824461  4673 raft_consensus.cc:2749] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:17.848146  4792 leader_election.cc:290] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:17.849669  4527 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:17.850481  4527 consensus_queue.cc:1243] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:21:17.853705  4748 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:17.836911 29292 leader_election.cc:304] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:17.793780  4782 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.861403 28605 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:21:17.868309 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.854899  4748 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 33, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.885115 28751 pending_rounds.cc:85] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting all ops after (but not including) 13
I20260709 12:21:17.888823 28680 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:21:17.906920 28751 pending_rounds.cc:107] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 12:21:17.892890 28601 raft_consensus.cc:1240] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Rejecting Update request from peer 5b3b2f4041a24b05983f30878f16db9d for earlier term 24. Current term is 25. Ops: []
I20260709 12:21:17.897758 28605 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 31 index: 17. (index mismatch)
I20260709 12:21:17.882860 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:17.908767 29321 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 28: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:17.907241 28751 raft_consensus.cc:2889] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:17.908905 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae65c3f66064ac694864cddddad892d" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:17.899878 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:17.911108 28679 raft_consensus.cc:2393] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 28: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:17.898195 29320 raft_consensus.cc:1240] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 19. Current term is 20. Ops: []
I20260709 12:21:17.879356 28675 raft_consensus.cc:2468] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:21:17.918148 28673 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 31 index: 17. (index mismatch)
I20260709 12:21:17.913579 29290 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:17.921761 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:17.922863 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:17.925976 28676 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
I20260709 12:21:17.929870 28752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa4d3cf35bc44b2b334697ab60648ca" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:17.922286 28720 leader_election.cc:400] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 24. Current term is 25.
I20260709 12:21:17.937390 28571 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:17.874833  4782 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:17.879626  4772 raft_consensus.cc:2804] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:17.941219  4771 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:21:17.943203  4585 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:21:17.953087  4738 consensus_queue.cc:1059] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:21:17.930323  4779 consensus_queue.cc:1059] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 12:21:17.942902  4671 raft_consensus.cc:2749] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:21:17.971021 29290 leader_election.cc:304] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.917402  4793 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:17.979504  4792 raft_consensus.cc:3055] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:21:17.979985  4792 raft_consensus.cc:740] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:17.989676 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:17.991114  4771 raft_consensus.cc:2804] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:21:17.991691  4771 raft_consensus.cc:697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 28 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:17.992578  4771 consensus_queue.cc:237] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:17.981551  4793 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:17.995096 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:17.996085 29321 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:18.000461  4637 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:18.002528 28754 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:18.002632  4637 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.003090  4637 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:18.006712 28756 raft_consensus.cc:606] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:18.007153 28756 raft_consensus.cc:614] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:18.007041  4792 consensus_queue.cc:260] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.008494  4792 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:21:18.016676 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 68459.7us
I20260709 12:21:18.000010  4772 raft_consensus.cc:697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 25 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:18.022904  4772 consensus_queue.cc:237] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.028718 28676 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
W20260709 12:21:18.034057 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 99142.9us
W20260709 12:21:18.062824 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 151603us
I20260709 12:21:18.073035 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:18.043061  4767 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.035s
W20260709 12:21:18.092815 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 74506us
I20260709 12:21:18.124840 28648 leader_election.cc:304] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:18.125622  4700 raft_consensus.cc:2749] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:18.126060 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:18.082319  4748 raft_consensus.cc:493] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:18.105536  4636 raft_consensus.cc:3055] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:21:18.127374  4636 raft_consensus.cc:740] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:18.128300  4636 consensus_queue.cc:260] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.129724  4636 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:18.064044  4795 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:21:18.126888  4700 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:21:18.086236  4826 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:21:18.150319 28751 raft_consensus.cc:1275] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:21:18.154356 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:18.156705 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:18.086238  4637 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.146647  4700 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:18.160187  4700 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:18.178474 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:18.180735 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:18.146198  4790 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:18.211859 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
W20260709 12:21:18.226627 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 55389.8us
I20260709 12:21:18.160344  4637 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:18.235813 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 61626.3us
I20260709 12:21:18.237380 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:18.237953 28676 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:18.150177  4708 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.063s
I20260709 12:21:18.239192 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 32 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:18.246201 28680 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 31.
I20260709 12:21:18.147603  4748 raft_consensus.cc:515] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.259649 28676 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
I20260709 12:21:18.260776 29290 leader_election.cc:304] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:18.185714  4791 consensus_queue.cc:1048] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.064s
I20260709 12:21:18.270663  4637 raft_consensus.cc:2804] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:18.280931  4637 raft_consensus.cc:697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:18.361621 28598 raft_consensus.cc:3060] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:21:18.367136 28677 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:21:18.378489 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 32 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:18.415153  4608 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:18.416486  4608 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.430748  4670 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:18.431730  4670 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:18.435703  4670 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:18.437270  4719 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:21:18.449420  4748 leader_election.cc:290] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:18.431448  4673 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.451205  4673 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.453356  4608 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:18.424981  4637 consensus_queue.cc:237] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.501641  4673 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:18.523671 28598 raft_consensus.cc:2468] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 26.
W20260709 12:21:18.542559 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 139467us
I20260709 12:21:18.557098 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:18.558209 29321 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:18.573338  4793 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:18.577252 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:18.587342 28603 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:21:18.576089 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:18.590523 28755 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:21:18.600651 28674 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:21:18.609041 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:18.610747 28680 raft_consensus.cc:2368] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26.
I20260709 12:21:18.614050 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:18.600525 28571 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:18.621845 28751 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:21:18.629788  4793 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:18.630306  4793 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:18.630826  4793 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:18.638851 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:18.639657 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:18.650934 29325 raft_consensus.cc:1275] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:21:18.650950 29320 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 33 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:21:18.655426 29319 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 25.
I20260709 12:21:18.656782 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:18.657732 28679 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
I20260709 12:21:18.674741 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23bf973b94c463f8da13a996fc7f221" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:18.677134 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 76950.5us
I20260709 12:21:18.678905  4499 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:21:18.679374  4499 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.679716  4499 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:21:18.681406  4671 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:21:18.688582  4792 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:18.689325  4792 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:18.689872  4792 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:18.690898  4716 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.688874 28598 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:18.697016 28677 raft_consensus.cc:1275] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:21:18.691735  4716 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.718514 28571 leader_election.cc:400] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26.
I20260709 12:21:18.719039 28571 leader_election.cc:403] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:21:18.723426 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:18.724354 29319 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 27.
I20260709 12:21:18.739825  4671 raft_consensus.cc:2749] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113) with higher term. Message: Invalid argument: T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 25. Current term is 26.
I20260709 12:21:18.757856  4499 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:18.777663 28674 raft_consensus.cc:1275] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:21:18.793654  4585 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:18.813656  4779 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 12:21:18.814244 28572 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:18.787042  4838 consensus_queue.cc:1048] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.105s
I20260709 12:21:18.829864  4778 consensus_queue.cc:1048] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.016s
I20260709 12:21:18.834455 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 32 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:18.835598  4836 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:18.836272  4836 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:18.837489  4836 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.839154  4499 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 32 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:18.823972  4750 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.025s
I20260709 12:21:18.815455  4636 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.101s
W20260709 12:21:18.846057  4700 consensus_meta.cc:287] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.013s
I20260709 12:21:18.824560  4585 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.846796  4700 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.852466  4791 consensus_queue.cc:1048] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:21:18.864593  4700 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:18.870069 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:21:18.870360 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56369.9us
I20260709 12:21:18.871124 29318 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 23: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:18.872380 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:18.885982  4795 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:18.886883  4795 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.878293  4671 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:21:18.888224  4671 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:18.888597  4671 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:18.901224  4716 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:18.904198  4795 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:18.904896 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:18.905704 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:18.908720 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:18.909631 28598 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:18.915302 28604 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 31. Current term is 32. Ops: [31.17-31.17]
I20260709 12:21:18.919668  4710 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: INVALID_TERM, Last received: 29.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:21:18.923960 28751 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:21:18.929064 28754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 32 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:18.934794 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:18.935537 29319 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:18.935662 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:18.936367  4748 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:21:18.936712 28749 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:18.937217  4793 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:18.937867  4748 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:21:18.948388 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:18.977936 28648 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:18.979074  4608 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:18.979597  4608 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:18.980618  4608 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:18.986091  4793 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:19.012503 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:19.013355 28750 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 27.
I20260709 12:21:19.012661  4624 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:19.014312  4624 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5b3b2f4041a24b05983f30878f16db9d)
I20260709 12:21:19.014742  4624 raft_consensus.cc:3060] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:19.029034  4827 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.029665  4827 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:19.033056  4792 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.038837 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:19.041342 28750 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:19.042833 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:19.031805  4827 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:19.031857  4671 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.045293 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:19.045866 28601 raft_consensus.cc:2393] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 28: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:19.045971 28604 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:19.048543  4671 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:19.049028  4585 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:19.052181 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:19.053182 28602 raft_consensus.cc:2393] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 22: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:19.077275 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:19.070664  4827 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:19.108275 28676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:19.109081 28676 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 22.
I20260709 12:21:19.109232  4792 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:19.111215 28571 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:19.113346  4711 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:21:19.113729  4711 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.114061  4711 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:19.118050 28680 raft_consensus.cc:2393] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d in current term 23: Already voted for candidate a8342e3fcab94ce89482df67988159ea in this term.
W20260709 12:21:19.119117 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 60958.7us
I20260709 12:21:19.124239  4827 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.141600  4772 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.143535  4827 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:19.144361  4339 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:19.206197 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 201559us
W20260709 12:21:19.210268  4850 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:21:19.220582  4772 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.223145  4772 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:19.225361  4339 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.227938  4339 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:19.292461  4624 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.294656  4624 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:19.302961 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 155457us
I20260709 12:21:19.313103 28602 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Rejecting Update request from peer a7ec63b6634944d0b5b5ea92fa2d303e for earlier term 31. Current term is 32. Ops: [31.17-31.17]
I20260709 12:21:19.317366 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:19.326321  4693 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:21:19.326767  4693 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:19.328195  4693 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.17, Last appended by leader: 17, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:19.329507  4693 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:21:19.335084 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 105236us
I20260709 12:21:19.340518 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:19.341114 29325 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:19.346701 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:19.352628 29319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:19.364331 28601 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
W20260709 12:21:19.368460  4846 log.cc:927] Time spent T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.495s	user 0.006s	sys 0.001s
W20260709 12:21:19.372359  4864 log.cc:927] Time spent T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:21:19.387567 29319 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 12:21:19.389290  4849 log.cc:927] Time spent T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:21:19.389927 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:19.432689 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:19.433605 28749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:19.434180 28749 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:21:19.438133 28748 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:19.443372 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:19.449769 29321 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:19.453261 28749 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 28.
I20260709 12:21:19.457355 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:19.459359 29320 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 22.
I20260709 12:21:19.463178 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:19.464766 28602 raft_consensus.cc:2393] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 23: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:19.475379 29323 raft_consensus.cc:2468] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 23.
I20260709 12:21:19.488329 28748 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:21:19.495188 28751 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
I20260709 12:21:19.499213 29325 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 28.
W20260709 12:21:19.502843  4865 log.cc:927] Time spent T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:21:19.505477  4827 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:19.506129 28647 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:19.451831  4711 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.510038  4711 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:19.510413  4564 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:19.510833  4564 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.511159  4564 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:19.501412  4716 raft_consensus.cc:2764] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 12:21:19.515488 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:19.516709  4603 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:19.517349  4603 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:19.518528  4603 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.521570 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:19.522205 28751 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 23.
I20260709 12:21:19.525951 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:19.540663 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:19.539099  4748 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.007s
I20260709 12:21:19.534648 28721 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:19.549646 28679 raft_consensus.cc:1275] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 12:21:19.556741  4777 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:19.557392  4777 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:19.580400 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 100182us
W20260709 12:21:19.589391 28721 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 56166.2us
I20260709 12:21:19.597398 29325 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:19.599871 28755 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:19.609086 28572 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:19.602553  4564 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.629447  3320 raft_consensus.cc:2804] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:19.631386  4671 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:21:19.632072  4671 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:19.634202  4861 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 12:21:19.624619 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:19.562786  4716 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 18, Time since last communication: 0.050s
I20260709 12:21:19.658499 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:19.659153 29320 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:19.652426  4838 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.678417  3320 raft_consensus.cc:697] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:19.662213  4603 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 12:21:19.684762  4564 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:19.711949  3320 consensus_queue.cc:237] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.719447  4771 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:19.719889  4771 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.720067  4827 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:19.720247  4771 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:21:19.724705 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 86752.7us
I20260709 12:21:19.727352 28573 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:19.730084  4777 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:19.732201 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:19.734789 29323 raft_consensus.cc:2393] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 20: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:19.686532  4838 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.748108 29320 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in term 23.
W20260709 12:21:19.764848 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62730.2us
I20260709 12:21:19.709785  4851 consensus_queue.cc:1048] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.106s
I20260709 12:21:19.780845 29320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:19.768455 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:19.782835 29322 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:19.769330  4748 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.023s
I20260709 12:21:19.769584  4774 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:21:19.803992 28496 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 235) took 21378 ms (client timeout 15000 ms). Trace:
W20260709 12:21:19.804500 28496 rpcz_store.cc:269] 0709 12:20:58.425564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:06.427167 (+8001603us) service_pool.cc:224] Handling call
0709 12:21:19.803749 (+13376582us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:17.060610 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:17.061252 (+   642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:17.061319 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:21:17.061345 (+    26us) tablet.cc:662] Decoding operations
0709 12:21:17.062770 (+  1425us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:17.062891 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:17.062922 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:21:17.064142 (+  1220us) tablet.cc:701] Row locks acquired
0709 12:21:17.064195 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:21:17.064372 (+   177us) write_op.cc:270] Start()
0709 12:21:17.156340 (+ 91968us) write_op.cc:276] Timestamp: P: 1783599677064303 usec, L: 0
0709 12:21:17.156371 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:21:17.371523 (+215152us) log.cc:844] Serialized 5558 byte log entry
0709 12:21:17.707160 (+335637us) op_driver.cc:464] REPLICATION: finished
0709 12:21:17.966273 (+259113us) write_op.cc:301] APPLY: starting
0709 12:21:17.966364 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:18.296667 (+330303us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:18.296779 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:18.302826 (+  6047us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:18.303026 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:21:18.303054 (+    28us) write_op.cc:312] APPLY: finished
0709 12:21:18.303278 (+   224us) log.cc:844] Serialized 129 byte log entry
0709 12:21:18.303491 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:18.303648 (+   157us) write_op.cc:454] Released schema lock
0709 12:21:18.303703 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:18.304153 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:18.304191 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2365802,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":258814,"apply.run_cpu_time_us":18030,"apply.run_wall_time_us":337843,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62507,"num_ops":14,"prepare.queue_time_us":444135,"prepare.run_cpu_time_us":9508,"prepare.run_wall_time_us":386992,"raft.queue_time_us":22430,"raft.run_cpu_time_us":53138,"raft.run_wall_time_us":201789,"replication_time_us":545712,"thread_start_us":525406,"threads_started":4,"wal-append.queue_time_us":69474,"wal-append.run_cpu_time_us":8733,"wal-append.run_wall_time_us":1865315}]]}
W20260709 12:21:19.808223  4853 log.cc:927] Time spent T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
I20260709 12:21:19.768954  4671 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.781389  4838 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:19.859575 29322 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
W20260709 12:21:19.868157 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 91395.5us
I20260709 12:21:19.882606 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:19.889966  4771 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.892748 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:19.898188 28748 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:19.899668 28572 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:19.897295 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5c0f8a4f2a47d5bfb86a593b95a1cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:19.894124 28750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:19.905874 28750 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:21:19.875799  4774 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:19.892426  4771 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:19.893460  4764 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.931047  4774 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:19.939616  4764 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.940464 28722 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:19.955852 28748 raft_consensus.cc:2468] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:21:19.957648 28648 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:19.959757  4861 raft_consensus.cc:2804] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:19.960292  4861 raft_consensus.cc:697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:19.961225  4861 consensus_queue.cc:237] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:19.969826  4890 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:21:19.970525  4890 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Leader. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:19.971597  4890 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:19.974920 28750 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:19.975715 29322 raft_consensus.cc:1240] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:21:20.002458 28648 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:19.985019 28682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:20.003328  4792 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:20.003886  4792 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:20.000104  4764 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:20.004881  4792 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:20.016971 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:20.028561 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:20.040567 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:20.055088  4839 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:20.078860 29322 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:20.078830  4564 consensus_queue.cc:1059] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 12:21:20.090916  4564 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:20.091404  4564 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:20.092343  4564 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:20.093768  4564 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:20.100891 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:20.115401 29290 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:20.118170  4637 raft_consensus.cc:2749] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:21:20.123437 28721 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:20.134321  4764 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:20.159716  4339 consensus_queue.cc:1059] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:21:20.183809  4339 raft_consensus.cc:3055] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:21:20.184206  4339 raft_consensus.cc:740] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:20.185051  4339 consensus_queue.cc:260] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:20.186375  4339 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:21:20.192313 28601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c60bef772ef04194a01b6f8f5423dd5f" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:20.249367 28751 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:21:20.281594  4889 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:20.330009 28606 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:20.331075  4774 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.331558  4774 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:20.332518 28756 raft_consensus.cc:1240] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting Update request from peer e3ce74ba14714b4dbd2d75e27f34eb0d for earlier term 23. Current term is 24. Ops: []
I20260709 12:21:20.333676  4774 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:20.335922 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:20.335983  4889 consensus_queue.cc:1059] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:21:20.337939  4889 raft_consensus.cc:3055] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:21:20.338451  4889 raft_consensus.cc:740] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e3ce74ba14714b4dbd2d75e27f34eb0d, State: Running, Role: LEADER
I20260709 12:21:20.339533  4889 consensus_queue.cc:260] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:20.341312  4889 raft_consensus.cc:3060] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:20.352089 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:20.364668 28604 raft_consensus.cc:1240] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 22. Current term is 23. Ops: []
I20260709 12:21:20.365890  4764 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:21:20.408183 29323 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:21:20.408294 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:20.418960 29318 raft_consensus.cc:2410] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:21:20.462524  4748 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 12:21:20.462914 28572 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:20.463652  3320 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:21:20.516014 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 53196.5us
I20260709 12:21:20.474836  4603 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:20.553668 29321 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:21:20.524569  4835 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:20.571888 28675 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Refusing update from remote peer e3ce74ba14714b4dbd2d75e27f34eb0d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 12:21:20.572358 28675 pending_rounds.cc:85] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 14
I20260709 12:21:20.529457  4603 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:20.572592 28675 pending_rounds.cc:107] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:21:20.584771 28675 raft_consensus.cc:2889] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:20.594182 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 207521us
W20260709 12:21:20.675925 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 45476.4us
W20260709 12:21:20.676222 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 117274us
W20260709 12:21:20.700098 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 155439us
W20260709 12:21:20.739854  4904 log.cc:927] Time spent T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:21:20.755267 28601 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 12:21:20.755786 28601 pending_rounds.cc:85] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting all ops after (but not including) 13
I20260709 12:21:20.756050 28601 pending_rounds.cc:107] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 12:21:20.756103 29325 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:21:20.753137 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 74200.7us
I20260709 12:21:20.756410 28601 raft_consensus.cc:2889] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:20.787070 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 92107.9us
W20260709 12:21:20.802441 28646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:21:20.833335  4603 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:20.800920  4774 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
W20260709 12:21:20.954548 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 187791us
I20260709 12:21:20.957532  4774 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:21:20.951350  4603 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:21:20.959686  4920 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
W20260709 12:21:20.978950  4906 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: Append to log took a long time: real 0.397s	user 0.001s	sys 0.002s
I20260709 12:21:20.990886  4915 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:20.991433  4915 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:20.993602  4910 log.cc:927] Time spent T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:21:20.993937  4915 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:20.996486 28598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:20.997237 28598 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 32: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:21.006296  4718 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.006810  4718 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:21.008893  4718 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:21.010622 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 33 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:21.011467 28675 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 33 because replica has last-logged OpId of term: 31 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 16.
I20260709 12:21:21.066002  4886 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:21.066720  4886 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:21.069046  4886 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:21.072860  4771 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.073443  4771 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:21.075551  4771 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:21.083810  4907 log.cc:927] Time spent T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.401s	user 0.006s	sys 0.000s
I20260709 12:21:21.089962 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:21.099680 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:21.105979 29322 raft_consensus.cc:1275] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:21:20.402935 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:21.149397 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" candidate_term: 33 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:21.150563 28751 raft_consensus.cc:2410] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3ce74ba14714b4dbd2d75e27f34eb0d for term 33 because replica has last-logged OpId of term: 31 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 16.
W20260709 12:21:21.161685 28572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 66972.7us
I20260709 12:21:21.277527 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35b6c6fffe3416bb8f69b556040e319" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:21.278271 28497 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 337) took 72166 ms (client timeout 15000 ms). Trace:
I20260709 12:21:21.278756 28755 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:21:21.278748 28497 rpcz_store.cc:269] 0709 12:20:09.111989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.112249 (+   260us) service_pool.cc:224] Handling call
0709 12:20:09.632001 (+519752us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5400002490. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095b640 00007f6fe9832846 00007f6fe993c90e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc 00007f6fe7dfc392 00007f6fe1dba48c 00007f6fe1db98c6
0709 12:21:21.256273 (+71624272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":581351,"reported_tablets":47,"spinlock_wait_cycles":24929024}
I20260709 12:21:21.281482 28748 raft_consensus.cc:1275] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:21:21.283682 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:21.284349 28748 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 32.
W20260709 12:21:21.304543 28571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 184408us
W20260709 12:21:21.310853 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 202052us
I20260709 12:21:21.312891 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae666b5b049a49c0bd0b0969e6b2b154" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:21.329169  4792 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:21.329532 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:21.331084  4792 consensus_queue.cc:1048] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:21.331990  4920 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:21:21.332556  4920 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Starting leader election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:21.332944  4920 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:21:21.340337 28648 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e
I20260709 12:21:21.341169  4603 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:21.358393 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:21.370118 28573 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:21.371093  4836 raft_consensus.cc:2749] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:21:21.375867  4920 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:21.377736 28673 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 32.
I20260709 12:21:21.382814  4693 consensus_queue.cc:1048] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:21:21.398452 28604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" is_pre_election: true
I20260709 12:21:21.398953  4930 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:21.399703  4930 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:21.408600 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:21.409507  4885 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:21.409875 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:21.410585 28677 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:21.416474  4930 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:21.399127 28604 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 32.
I20260709 12:21:21.418301 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:21.420238  4920 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 32 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:21.420529  4693 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:21.420934  4693 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:21.421365  4693 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:21.435487  4693 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:21.437840  4693 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:21.439365 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:21.440224 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:21.443354 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:21.457557 29325 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 24: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:21.445547 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:21.458873 29323 raft_consensus.cc:2393] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 24: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:21.466609 28677 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 24.
I20260709 12:21:21.467665 28755 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 32.
I20260709 12:21:21.467734 28720 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:21.469655 28720 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:21.470597 28648 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:21.470183  4693 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:21.475091  4693 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:21.475510  4909 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:21:21.476078  4693 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:21.471895  4862 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:21:21.477420  4862 raft_consensus.cc:493] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.477809  4862 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:21:21.476092  4909 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 32 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:21.479511  4909 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.17, Last appended by leader: 17, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:21.482556 28502 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:21.493978 28502 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 17 to 19, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 19 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.501317 28502 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:21.489003 28500 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 309) took 75874 ms (client timeout 15000 ms). Trace:
W20260709 12:21:21.504731 28500 rpcz_store.cc:269] 0709 12:20:05.640659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.641626 (+   967us) service_pool.cc:224] Handling call
0709 12:21:21.488810 (+75847184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":742913,"reported_tablets":47}
I20260709 12:21:21.518787  4862 raft_consensus.cc:515] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:21.579315 28605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 32 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:21.583602 28605 raft_consensus.cc:2393] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 32: Already voted for candidate e3ce74ba14714b4dbd2d75e27f34eb0d in this term.
I20260709 12:21:21.593009 28602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
I20260709 12:21:21.593631 28602 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:21:21.600732 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:21.601826 28756 raft_consensus.cc:606] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:21.602286 28756 raft_consensus.cc:614] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:21.617318 28602 raft_consensus.cc:2468] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 33.
I20260709 12:21:21.624758 28722 leader_election.cc:304] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d; no voters: 
I20260709 12:21:21.635654  3320 raft_consensus.cc:2804] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:21:21.636301  3320 raft_consensus.cc:697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:21.642083  3320 consensus_queue.cc:237] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.17, Last appended by leader: 17, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:21.650305 28756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a420de289b844729c03c9625dd9e63c"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:21.650913 28756 raft_consensus.cc:606] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:21.651247 28756 raft_consensus.cc:614] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:21.663514 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecc67b62cf604852ae673df459d4ce67" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 33 candidate_status { last_received { term: 31 index: 17 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:21.666143  4862 leader_election.cc:290] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 33 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:21.811637 28673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a"
dest_uuid: "a8342e3fcab94ce89482df67988159ea"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:60782
I20260709 12:21:21.812427 28673 raft_consensus.cc:606] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:21.812978 28673 raft_consensus.cc:614] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:21.851557 28751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:21.852160 28751 raft_consensus.cc:606] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Received request to transfer leadership to TS e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:21.852658 28751 raft_consensus.cc:614] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:21.923252 28751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5898a5306cc40cb9c97dff5f6ab3cd8"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:21.923890 28751 raft_consensus.cc:606] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:21.924278 28751 raft_consensus.cc:614] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:21:21.928826 29325 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:21:21.930572  4501 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:21:21.939229 28751 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7"
dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
mode: GRACEFUL
new_leader_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:37372
I20260709 12:21:21.939831 28751 raft_consensus.cc:606] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Received request to transfer leadership to TS 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:21.941977 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:21.948661 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:21.949846 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:21.958424  4944 raft_consensus.cc:993] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: : Instructing follower 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:21.958993  4930 raft_consensus.cc:1081] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Signalling peer 5b3b2f4041a24b05983f30878f16db9d to start an election
I20260709 12:21:21.964010 28673 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:21:21.964970 29323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7"
dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
 from {username='slave'} at 127.0.0.1:41580
I20260709 12:21:21.970125  4718 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:21:21.976699 28500 catalog_manager.cc:5697] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 23 to 26, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 26 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:21.978461 28500 catalog_manager.cc:5697] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 10 to 19, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 19 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:21.980494 28751 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 LEADER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 32. Current term is 33. Ops: []
I20260709 12:21:21.980108 28500 catalog_manager.cc:5697] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 23, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 23 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:21.982375  4792 consensus_queue.cc:1059] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:21.982153 28500 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 18 to 20, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 20 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:21.983213  4792 consensus_queue.cc:1243] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [LEADER]: Peer a7ec63b6634944d0b5b5ea92fa2d303e log is divergent from this leader: its last log entry 33.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:21:21.994071  4920 raft_consensus.cc:3055] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:21:21.994539  4920 raft_consensus.cc:740] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 32 LEADER]: Becoming Follower/Learner. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:21.995455  4920 consensus_queue.cc:260] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 32.18, Last appended by leader: 18, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:21.997897  4920 raft_consensus.cc:3060] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:21:22.011893 28502 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 339) took 29289 ms (client timeout 15000 ms). Trace:
I20260709 12:21:22.012846 28500 catalog_manager.cc:5697] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 22 to 23, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 23 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.014493 28500 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 25, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 25 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:22.012326 28502 rpcz_store.cc:269] 0709 12:20:52.919513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:52.919761 (+   248us) service_pool.cc:224] Handling call
0709 12:21:22.011791 (+29092030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:21.674978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:21.675869 (+   891us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:21.675944 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:21:21.675972 (+    28us) tablet.cc:662] Decoding operations
0709 12:21:21.678212 (+  2240us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:21.678303 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:21.678351 (+    48us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:21.678921 (+   570us) tablet.cc:701] Row locks acquired
0709 12:21:21.678981 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:21:21.679186 (+   205us) write_op.cc:270] Start()
0709 12:21:21.679716 (+   530us) write_op.cc:276] Timestamp: P: 1783599681679110 usec, L: 0
0709 12:21:21.679765 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 12:21:21.689194 (+  9429us) log.cc:844] Serialized 1316 byte log entry
0709 12:21:21.860580 (+171386us) op_driver.cc:464] REPLICATION: finished
0709 12:21:21.882982 (+ 22402us) write_op.cc:301] APPLY: starting
0709 12:21:21.883100 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:21.899196 (+ 16096us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b1800245620. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe985aab1 00007f6fe9867281 00007f6fe37be0ec 00007f6fe380ac0a 00007f6fe380a4f7 00007f6fe380a490 00007f6fe37b5754 00007f6fe74d5f13 00007f6fe74d6532 00007f6fe751db93 00007f6fe73cade3
0709 12:21:21.902804 (+  3608us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:21.902842 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:21.909227 (+  6385us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:21.909622 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:21:21.910276 (+   654us) write_op.cc:312] APPLY: finished
0709 12:21:21.910838 (+   562us) log.cc:844] Serialized 41 byte log entry
0709 12:21:21.911035 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:21.911134 (+    99us) write_op.cc:454] Released schema lock
0709 12:21:21.911188 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:21.911621 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:21.911646 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":202404,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":21853,"apply.run_cpu_time_us":10298,"apply.run_wall_time_us":28613,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16637,"num_ops":3,"prepare.queue_time_us":162376,"prepare.run_cpu_time_us":45099,"prepare.run_wall_time_us":126301,"raft.queue_time_us":21463,"raft.run_cpu_time_us":9785,"raft.run_wall_time_us":57726,"replication_time_us":168741,"spinlock_wait_cycles":28422784,"thread_start_us":246842,"threads_started":4,"wal-append.queue_time_us":133093}]]}
I20260709 12:21:22.015822 28500 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 24, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 24 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.037482 28500 catalog_manager.cc:5697] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 7 to 12, term changed from 19 to 21, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130), VOTER a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) evicted. New cstate: current_term: 21 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.048116 28500 catalog_manager.cc:5697] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.049592 28500 catalog_manager.cc:5697] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.050911 28500 catalog_manager.cc:5697] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 16 to 20, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 20 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.052726 28500 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 21 to 26, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 26 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.054167 28500 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 19 to 21, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.058768 28606 raft_consensus.cc:1240] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 FOLLOWER]: Rejecting Update request from peer a8342e3fcab94ce89482df67988159ea for earlier term 32. Current term is 33. Ops: []
I20260709 12:21:22.075819 29323 raft_consensus.cc:493] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:22.076337 29323 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:22.055740 28500 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 16 to 17, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 17 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.078604 28500 catalog_manager.cc:5697] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 19 to 23, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 23 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.086555 29323 raft_consensus.cc:515] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:22.091753 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: true dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:22.080461 28500 catalog_manager.cc:5697] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.097452 28500 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 24 to 32. New cstate: current_term: 32 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.099053 28500 catalog_manager.cc:5697] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.105083 28500 catalog_manager.cc:5697] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 18 to 28, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 28 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.107072 28500 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 19 to 20, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 20 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.111713 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec3dcbf1171d4cc9855730d6a1d6e0d7" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: true dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:22.112352 28751 raft_consensus.cc:3055] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:21:22.112715 28751 raft_consensus.cc:740] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:22.113528 28751 consensus_queue.cc:260] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:22.114701 28751 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:22.108381 28500 catalog_manager.cc:5697] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.125115 28500 catalog_manager.cc:5697] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 16 to 22, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 22 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.126593 28500 catalog_manager.cc:5697] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 18 to 21, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 21 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.128280 28500 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 18 to 24, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 24 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.130201 28500 catalog_manager.cc:5697] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.131498 28500 catalog_manager.cc:5697] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 26, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 26 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.149250 28500 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 18 to 22, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 22 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.150915 28500 catalog_manager.cc:5697] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.152485 28500 catalog_manager.cc:5697] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 24, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 24 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.154007 28500 catalog_manager.cc:5697] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 22, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.177764 28673 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 32 index: 18. Preceding OpId from leader: term: 33 index: 18. (term mismatch)
I20260709 12:21:22.178229 28673 pending_rounds.cc:85] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Aborting all ops after (but not including) 17
I20260709 12:21:22.178455 28673 pending_rounds.cc:107] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: Aborting uncommitted NO_OP operation due to leader change: 32.18
I20260709 12:21:22.178692 28673 raft_consensus.cc:2889] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:22.137105 29323 leader_election.cc:290] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:22.187417  3320 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:21:22.199985 28602 raft_consensus.cc:1275] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 33 index: 18. (index mismatch)
I20260709 12:21:22.205953 28751 raft_consensus.cc:2468] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
I20260709 12:21:22.208937 29292 leader_election.cc:304] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:22.212857  4918 raft_consensus.cc:2804] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:22.213528  4918 raft_consensus.cc:697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 25 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:22.214452  4918 consensus_queue.cc:237] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:22.228792  4718 consensus_queue.cc:1048] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:21:22.285233 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 71661.4us
I20260709 12:21:22.433125 28500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39986 (request call id 236) took 4472 ms. Trace:
I20260709 12:21:22.434823 28500 rpcz_store.cc:276] 0709 12:21:17.959265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.534727 (+3575462us) service_pool.cc:224] Handling call
0709 12:21:22.431612 (+896885us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:22.180599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:22.181209 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:22.181251 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:21:22.181268 (+    17us) tablet.cc:662] Decoding operations
0709 12:21:22.183843 (+  2575us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:22.183898 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:22.183930 (+    32us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:21:22.191660 (+  7730us) tablet.cc:701] Row locks acquired
0709 12:21:22.191676 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:21:22.191819 (+   143us) write_op.cc:270] Start()
0709 12:21:22.191955 (+   136us) write_op.cc:276] Timestamp: P: 1783599682191772 usec, L: 0
0709 12:21:22.191977 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:22.192750 (+   773us) log.cc:844] Serialized 11918 byte log entry
0709 12:21:22.196668 (+  3918us) op_driver.cc:464] REPLICATION: finished
0709 12:21:22.197144 (+   476us) write_op.cc:301] APPLY: starting
0709 12:21:22.197227 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:22.312968 (+115741us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:22.313066 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:22.354463 (+ 41397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:22.354855 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 12:21:22.355140 (+   285us) write_op.cc:312] APPLY: finished
0709 12:21:22.355712 (+   572us) log.cc:844] Serialized 260 byte log entry
0709 12:21:22.356566 (+   854us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:22.356840 (+   274us) write_op.cc:454] Released schema lock
0709 12:21:22.356919 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:22.357297 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:22.357351 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17776,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":259,"apply.run_cpu_time_us":36688,"apply.run_wall_time_us":160081,"cfile_cache_hit":120,"cfile_cache_hit_bytes":125100,"num_ops":30,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":7185,"prepare.run_wall_time_us":12495,"replication_time_us":4347}]]}
I20260709 12:21:22.523383 28499 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet c60bef772ef04194a01b6f8f5423dd5f with cas_config_opid_index 7: aborting the task: latest config opid_index 12; task opid_index 7
I20260709 12:21:22.525792 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet a5dc72678108404787b2aa034d4a7243 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:54532
I20260709 12:21:22.534626 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet a5dc72678108404787b2aa034d4a7243 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
W20260709 12:21:22.565351 28499 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 341) took 74623 ms (client timeout 15000 ms). Trace:
I20260709 12:21:22.568770 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet c60bef772ef04194a01b6f8f5423dd5f with delete_type TABLET_DATA_TOMBSTONED (TS a7ec63b6634944d0b5b5ea92fa2d303e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:34296
W20260709 12:21:22.572904 28492 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3be2bcd2a3b04c82bbf14413a7011c12 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a7ec63b6634944d0b5b5ea92fa2d303e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 33 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:22.576529 28499 rpcz_store.cc:269] 0709 12:20:07.941878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.942157 (+   279us) service_pool.cc:224] Handling call
0709 12:20:08.035046 (+ 92889us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b5400002490. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095b0b2 00007f6fe98d4759 00007f6fe986ca76 00007f6fe983dd58 00007f6fe993c04e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc
0709 12:21:22.565251 (+74530205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":945918,"reported_tablets":47,"spinlock_wait_cycles":11319040}
I20260709 12:21:22.596675  4960 tablet_replica.cc:333] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:22.604094  4960 raft_consensus.cc:2243] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:22.605012  4960 raft_consensus.cc:2272] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:22.615442 28677 raft_consensus.cc:3060] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:22.616451  4960 ts_tablet_manager.cc:1916] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:22.650002 28500 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 23 to 28, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 28 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.651916 28500 catalog_manager.cc:5697] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 19 to 25, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 25 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.653565 28500 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 18 to 21, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 21 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.654369  4960 ts_tablet_manager.cc:1929] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.11
I20260709 12:21:22.655081 28500 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 24 to 25, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 25 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.655148  4960 log.cc:1199] T c60bef772ef04194a01b6f8f5423dd5f P a7ec63b6634944d0b5b5ea92fa2d303e: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/wals/c60bef772ef04194a01b6f8f5423dd5f
I20260709 12:21:22.661360 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet c60bef772ef04194a01b6f8f5423dd5f (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:21:22.663020 28500 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 23, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 23 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.668695 28677 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:21:22.692718 28500 catalog_manager.cc:5697] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 22 to 28, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 28 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.694509 28500 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 32 to 33, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 33 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.695969 28500 catalog_manager.cc:5697] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.701210 28500 catalog_manager.cc:5697] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 25, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 25 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.702986 28500 catalog_manager.cc:5697] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 22 to 23, leader changed from 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 23 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:22.704690 28500 catalog_manager.cc:5697] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 15 to 26, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 26 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:22.701557  4954 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.008s
I20260709 12:21:22.723397 29325 consensus_queue.cc:237] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:22.757863 28755 raft_consensus.cc:1275] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 12:21:22.760798 28501 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 336) took 97376 ms (client timeout 15000 ms). Trace:
W20260709 12:21:22.761308 28501 rpcz_store.cc:269] 0709 12:19:45.384280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.384603 (+   323us) service_pool.cc:224] Handling call
0709 12:21:22.760584 (+97375981us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":228561,"reported_tablets":47}
I20260709 12:21:22.780709 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet c60bef772ef04194a01b6f8f5423dd5f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:34296
I20260709 12:21:22.781939  4954 consensus_queue.cc:1048] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:21:22.786206 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet c60bef772ef04194a01b6f8f5423dd5f (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:21:22.853137 28755 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 12:21:22.857797 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 79778.8us
W20260709 12:21:22.868194 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 107794us
I20260709 12:21:22.905517 28673 raft_consensus.cc:1275] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:21:22.867543  4968 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
W20260709 12:21:22.920907 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54579.6us
I20260709 12:21:22.940671  4971 consensus_queue.cc:1048] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:21:22.970561 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 48045.9us
I20260709 12:21:23.110937  4771 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 7 to 16, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:23.118212 28673 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 7 to 16, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:23.203454 28573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 139135us
W20260709 12:21:23.202383 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 63740.2us
I20260709 12:21:23.209899 28491 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05ef99f51b5a4b959e982c258f2aafcc with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:23.255393 28756 raft_consensus.cc:2955] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 7 to 16, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:23.304067 28500 catalog_manager.cc:5697] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 7 to 16, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 24 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.395560 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet 05ef99f51b5a4b959e982c258f2aafcc with delete_type TABLET_DATA_TOMBSTONED (TS e3ce74ba14714b4dbd2d75e27f34eb0d not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:59654
I20260709 12:21:23.422606  4987 tablet_replica.cc:333] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:23.423889  4987 raft_consensus.cc:2243] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:23.424811  4987 raft_consensus.cc:2272] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:23.433634 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet a5dc72678108404787b2aa034d4a7243 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:54532
W20260709 12:21:23.448938 28503 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 340) took 95170 ms (client timeout 15000 ms). Trace:
W20260709 12:21:23.453068 28503 rpcz_store.cc:269] 0709 12:19:48.278531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:48.278725 (+   194us) service_pool.cc:224] Handling call
0709 12:21:23.448737 (+95170012us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":47}
I20260709 12:21:23.458348  4987 ts_tablet_manager.cc:1916] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:23.481045  4987 ts_tablet_manager.cc:1929] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.15
I20260709 12:21:23.493768 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet a5dc72678108404787b2aa034d4a7243 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:21:23.481536  4987 log.cc:1199] T 05ef99f51b5a4b959e982c258f2aafcc P e3ce74ba14714b4dbd2d75e27f34eb0d: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/wals/05ef99f51b5a4b959e982c258f2aafcc
I20260709 12:21:23.501907 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet 05ef99f51b5a4b959e982c258f2aafcc (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:21:23.524952 28755 consensus_queue.cc:237] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:23.633621 28600 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:21:23.634156 28588 tablet_service.cc:1558] Processing DeleteTablet for tablet 05ef99f51b5a4b959e982c258f2aafcc with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 16)) from {username='slave'} at 127.0.0.1:59654
W20260709 12:21:23.637051 28504 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 310) took 55471 ms (client timeout 15000 ms). Trace:
I20260709 12:21:23.637804 29325 raft_consensus.cc:1275] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:21:23.638480  4964 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:21:23.651005 28504 rpcz_store.cc:269] 0709 12:20:28.203942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:28.205909 (+  1967us) service_pool.cc:224] Handling call
0709 12:21:23.636859 (+55430950us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":47}
I20260709 12:21:23.620457 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:23.635728 28492 catalog_manager.cc:5028] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): tablet 05ef99f51b5a4b959e982c258f2aafcc (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:21:23.668597  3320 consensus_queue.cc:1048] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:23.694732 28498 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 18 to 21, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.698154 28498 catalog_manager.cc:5697] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 17 to 23, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 23 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:23.700323 28498 catalog_manager.cc:5697] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 15 to 22, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.704761 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet c60bef772ef04194a01b6f8f5423dd5f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:34296
I20260709 12:21:23.711750 28498 catalog_manager.cc:5697] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 27 to 30, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 30 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.716897  4964 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 13 to 15, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:23.723522 28600 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 13 to 15, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:23.718798 28505 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 338) took 53761 ms (client timeout 15000 ms). Trace:
I20260709 12:21:23.726192 29325 raft_consensus.cc:2955] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 13 to 15, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:23.732797 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet c60bef772ef04194a01b6f8f5423dd5f (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:21:23.741281 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e5bdaade8df945828ab371a3267cd752 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:21:23.734879 28505 rpcz_store.cc:269] 0709 12:20:29.956863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:29.957102 (+   239us) service_pool.cc:224] Handling call
0709 12:21:23.718612 (+53761510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14199,"reported_tablets":47}
I20260709 12:21:23.724153 28498 catalog_manager.cc:5697] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 11 to 19, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 19 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.763239 28498 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 23 to 25, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 25 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:23.785200 28498 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:23.793138 28498 catalog_manager.cc:5697] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 18 to 21, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
W20260709 12:21:23.887990 28492 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3be2bcd2a3b04c82bbf14413a7011c12 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer e3ce74ba14714b4dbd2d75e27f34eb0d from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 33 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:23.903518 27446 tablet_server.cc:179] TabletServer@127.26.205.129:0 shutting down...
W20260709 12:21:23.937593 28648 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:23.987550 28648 consensus_peers.cc:597] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.004016 28648 consensus_peers.cc:597] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.010169 28505 catalog_manager.cc:5697] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 13 to 15, VOTER a8342e3fcab94ce89482df67988159ea (127.26.205.130) evicted. New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:24.037858 28498 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 05ef99f51b5a4b959e982c258f2aafcc with cas_config_opid_index 7: aborting the task: latest config opid_index 16; task opid_index 7
W20260709 12:21:24.041980 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 56286.8us
W20260709 12:21:24.067363 28492 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet e5bdaade8df945828ab371a3267cd752 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 13 but the committed config has opid_index of 15
I20260709 12:21:24.069635 28738 tablet_service.cc:1558] Processing DeleteTablet for tablet c60bef772ef04194a01b6f8f5423dd5f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:34296
I20260709 12:21:24.072579 28492 catalog_manager.cc:5028] TS a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): tablet c60bef772ef04194a01b6f8f5423dd5f (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
I20260709 12:21:24.081470 28668 tablet_service.cc:1558] Processing DeleteTablet for tablet e5bdaade8df945828ab371a3267cd752 with delete_type TABLET_DATA_TOMBSTONED (TS a8342e3fcab94ce89482df67988159ea not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:54532
I20260709 12:21:24.083778 28496 catalog_manager.cc:5697] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 25 to 26, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 26 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:24.098621 28648 consensus_peers.cc:597] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.101393 28498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54302 (request call id 340) took 10954 ms. Trace:
W20260709 12:21:24.104120 28722 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.082785 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.107818 28722 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.110321 28496 catalog_manager.cc:5697] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 20 to 24, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 24 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.114892 28496 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 20 to 22, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 22 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
W20260709 12:21:24.116314 28722 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.117117 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.101970 28498 rpcz_store.cc:276] 0709 12:21:13.147257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:16.526732 (+3379475us) service_pool.cc:224] Handling call
0709 12:21:24.101281 (+7574549us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:23.822975 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:23.823465 (+   490us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:23.823492 (+    27us) write_op.cc:435] Acquired schema lock
0709 12:21:23.823507 (+    15us) tablet.cc:662] Decoding operations
0709 12:21:23.824374 (+   867us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:23.824449 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:23.824482 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:21:23.825176 (+   694us) tablet.cc:701] Row locks acquired
0709 12:21:23.825196 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:21:23.825346 (+   150us) write_op.cc:270] Start()
0709 12:21:23.825456 (+   110us) write_op.cc:276] Timestamp: P: 1783599683825292 usec, L: 0
0709 12:21:23.825478 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:23.849789 (+ 24311us) log.cc:844] Serialized 3282 byte log entry
0709 12:21:23.889375 (+ 39586us) op_driver.cc:464] REPLICATION: finished
0709 12:21:23.908716 (+ 19341us) write_op.cc:301] APPLY: starting
0709 12:21:23.908811 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:23.944776 (+ 35965us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:23.944883 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:23.989253 (+ 44370us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:23.989470 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:21:23.989518 (+    48us) write_op.cc:312] APPLY: finished
0709 12:21:23.989779 (+   261us) log.cc:844] Serialized 81 byte log entry
0709 12:21:23.989954 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:23.990075 (+   121us) write_op.cc:454] Released schema lock
0709 12:21:23.990123 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:23.990510 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:23.990542 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27425,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":19109,"apply.run_cpu_time_us":12867,"apply.run_wall_time_us":81768,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37487,"num_ops":8,"prepare.queue_time_us":93,"prepare.run_cpu_time_us":3720,"prepare.run_wall_time_us":31243,"replication_time_us":63742,"thread_start_us":962,"threads_started":1}]]}
W20260709 12:21:24.118079 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.117733 28722 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.126343 28722 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.127449 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.134873 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.145012 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.155611 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.198040  4998 tablet_replica.cc:333] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
W20260709 12:21:24.203394 28722 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.208786 28722 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.218606 28648 consensus_peers.cc:597] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.226027 28722 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.229327 28648 consensus_peers.cc:597] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.219858  4998 raft_consensus.cc:2243] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.234880  4998 raft_consensus.cc:2272] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.237258 28497 catalog_manager.cc:5697] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:24.238436  4998 ts_tablet_manager.cc:1916] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:24.240710 28497 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.239030 28496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54300 (request call id 344) took 10038 ms. Trace:
I20260709 12:21:24.241978 28496 rpcz_store.cc:276] 0709 12:21:14.200967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:19.942984 (+5742017us) service_pool.cc:224] Handling call
0709 12:21:24.238966 (+4295982us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:24.130961 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:24.140540 (+  9579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:24.145020 (+  4480us) write_op.cc:435] Acquired schema lock
0709 12:21:24.146550 (+  1530us) tablet.cc:662] Decoding operations
0709 12:21:24.151921 (+  5371us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:24.151990 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:24.152023 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:21:24.152359 (+   336us) tablet.cc:701] Row locks acquired
0709 12:21:24.152378 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:21:24.152567 (+   189us) write_op.cc:270] Start()
0709 12:21:24.153206 (+   639us) write_op.cc:276] Timestamp: P: 1783599684152505 usec, L: 0
0709 12:21:24.153238 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:21:24.153929 (+   691us) log.cc:844] Serialized 1326 byte log entry
0709 12:21:24.157135 (+  3206us) op_driver.cc:464] REPLICATION: finished
0709 12:21:24.157518 (+   383us) write_op.cc:301] APPLY: starting
0709 12:21:24.157607 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:24.159721 (+  2114us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:24.159843 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:24.162386 (+  2543us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:24.162586 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:21:24.162636 (+    50us) write_op.cc:312] APPLY: finished
0709 12:21:24.162860 (+   224us) log.cc:844] Serialized 41 byte log entry
0709 12:21:24.163049 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.163149 (+   100us) write_op.cc:454] Released schema lock
0709 12:21:24.163196 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:24.163583 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.163616 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52251,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":137,"apply.run_cpu_time_us":5654,"apply.run_wall_time_us":6010,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12510,"num_ops":3,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":3355,"prepare.run_wall_time_us":24246,"replication_time_us":3769}]]}
I20260709 12:21:24.246376 28497 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 19 to 22, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:24.251266 28497 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d reported cstate change: term changed from 20 to 21, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 21 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:24.287940 28722 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.297636 28497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54286 (request call id 312) took 6955 ms. Trace:
I20260709 12:21:24.298197 28497 rpcz_store.cc:276] 0709 12:21:17.341890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:21.282489 (+3940599us) service_pool.cc:224] Handling call
0709 12:21:21.457604 (+175115us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b5400002490. stack: 00007f6fe0960343 00007f6fe0960240 00007f6fe02ef1d4 00007f6fea02d304 00007f6fea02d299 00007f6fe081adb1 00007f6fe095ab71 00007f6fe095b0b2 00007f6fe98d4759 00007f6fe986ca76 00007f6fe983dd58 00007f6fe993c04e 00007f6fe7dfd2a4 00007f6fe7dfd232 00007f6fe7dfd161 00007f6fe7dfd0dc
0709 12:21:24.297537 (+2839933us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:24.259709 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:24.260283 (+   574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:24.260322 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:21:24.260342 (+    20us) tablet.cc:662] Decoding operations
0709 12:21:24.260976 (+   634us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:24.261039 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:24.261073 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:21:24.261666 (+   593us) tablet.cc:701] Row locks acquired
0709 12:21:24.261688 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:21:24.261836 (+   148us) write_op.cc:270] Start()
0709 12:21:24.261938 (+   102us) write_op.cc:276] Timestamp: P: 1783599684261788 usec, L: 0
0709 12:21:24.261960 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:21:24.262574 (+   614us) log.cc:844] Serialized 1718 byte log entry
0709 12:21:24.264497 (+  1923us) op_driver.cc:464] REPLICATION: finished
0709 12:21:24.264959 (+   462us) write_op.cc:301] APPLY: starting
0709 12:21:24.265040 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:24.267386 (+  2346us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:24.267478 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:24.269875 (+  2397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:24.270054 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:21:24.270103 (+    49us) write_op.cc:312] APPLY: finished
0709 12:21:24.270327 (+   224us) log.cc:844] Serialized 49 byte log entry
0709 12:21:24.272941 (+  2614us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.273052 (+   111us) write_op.cc:454] Released schema lock
0709 12:21:24.273098 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:24.273443 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:24.273473 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3505,"reported_tablets":47,"spinlock_wait_cycles":72778112,"child_traces":[["op",{"apply.queue_time_us":264,"apply.run_cpu_time_us":6035,"apply.run_wall_time_us":8453,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16680,"num_ops":4,"prepare.queue_time_us":284,"prepare.run_cpu_time_us":3146,"prepare.run_wall_time_us":3145,"replication_time_us":2409}]]}
W20260709 12:21:24.306854 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.308300 28648 consensus_peers.cc:597] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.331945 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:21:24.334867 28648 consensus_peers.cc:597] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.335871 27446 tablet_replica.cc:333] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.337328 27446 raft_consensus.cc:2243] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.338029 27446 raft_consensus.cc:2272] T 316dc144dbef470e8e17c2e02887dfd8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.347489 27446 tablet_replica.cc:333] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
W20260709 12:21:24.347707 28722 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.349153 27446 raft_consensus.cc:2243] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:24.355576 28492 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58065.9us
W20260709 12:21:24.356997 28648 consensus_peers.cc:597] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.360257 27446 raft_consensus.cc:2272] T 683aa452755144abbbeaff5aa710e8ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.363469 27446 tablet_replica.cc:333] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.364518 27446 raft_consensus.cc:2243] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.365515 27446 raft_consensus.cc:2272] T 6828c27180d54395aa62e49037e09909 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.368043 27446 tablet_replica.cc:333] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.359009 28497 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 19 to 24, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129). New cstate: current_term: 24 leader_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:24.370674 28497 catalog_manager.cc:5697] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 25 to 33, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 33 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.372778 28497 catalog_manager.cc:5697] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 22 to 24, leader changed from a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 24 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } }
I20260709 12:21:24.381930 27446 raft_consensus.cc:2243] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.383271 27446 raft_consensus.cc:2272] T f2c936ab911d48fba6cc944d81f99fb1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.384294 28722 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:24.386454 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 05ef99f51b5a4b959e982c258f2aafcc: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:21:24.403816 27446 tablet_replica.cc:333] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.404772 27446 raft_consensus.cc:2243] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.405440 27446 raft_consensus.cc:2272] T 8ea376f5c1af47d79a1871ab80a23cdb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.408310 27446 tablet_replica.cc:333] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.409183 27446 raft_consensus.cc:2243] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.409889 27446 raft_consensus.cc:2272] T 663f0169fb984cfe963338bade0eabbb P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.436743 28647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:46291, user_credentials={real_user=slave}} blocked reactor thread for 49099us
I20260709 12:21:24.445111  4998 ts_tablet_manager.cc:1929] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.14
I20260709 12:21:24.445641  4998 log.cc:1199] T e5bdaade8df945828ab371a3267cd752 P a8342e3fcab94ce89482df67988159ea: Deleting WAL directory at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/wals/e5bdaade8df945828ab371a3267cd752
I20260709 12:21:24.447276 28490 catalog_manager.cc:5028] TS a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): tablet e5bdaade8df945828ab371a3267cd752 (table test-workload [id=8774336601e04021b11d5e9603cef75f]) successfully deleted
W20260709 12:21:24.448580 28722 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.458413 27446 tablet_replica.cc:333] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.459425 27446 raft_consensus.cc:2243] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.460633 27446 raft_consensus.cc:2272] T 09b12c4abe49469ebd1ae7c30355cef2 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.463652 27446 tablet_replica.cc:333] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
W20260709 12:21:24.459947 28648 consensus_peers.cc:597] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.474443 27446 raft_consensus.cc:2243] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.475795 27446 raft_consensus.cc:2272] T 4bc886982591478e97f84ddb724a679a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.477473 28722 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.478979 27446 tablet_replica.cc:333] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.479960 27446 raft_consensus.cc:2243] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.480643 27446 raft_consensus.cc:2272] T e5bdaade8df945828ab371a3267cd752 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.484674 27446 tablet_replica.cc:333] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.485419 27446 raft_consensus.cc:2243] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.485988 27446 raft_consensus.cc:2272] T cb599a2fb1704106b47a69be90b821d0 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.489632 27446 tablet_replica.cc:333] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.490468 27446 raft_consensus.cc:2243] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.491089 27446 raft_consensus.cc:2272] T 3a420de289b844729c03c9625dd9e63c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.505102 27446 tablet_replica.cc:333] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.505856 27446 raft_consensus.cc:2243] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.506506 27446 raft_consensus.cc:2272] T 793ab78ecea2432e8fdb088474026ce1 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.509258 27446 tablet_replica.cc:333] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.510062 27446 raft_consensus.cc:2243] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.513266 27446 raft_consensus.cc:2272] T 509077a515a748899cf8ea0c5bac854a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.519174 27446 tablet_replica.cc:333] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.519985 27446 raft_consensus.cc:2243] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.520735 27446 raft_consensus.cc:2272] T cdf685c3207841c286a253af2d105972 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.523442 27446 tablet_replica.cc:333] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.524092 27446 raft_consensus.cc:2243] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.525079 27446 raft_consensus.cc:2272] T f23bf973b94c463f8da13a996fc7f221 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.527640 27446 tablet_replica.cc:333] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
W20260709 12:21:24.528048 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:24.528455 27446 raft_consensus.cc:2243] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.529323 27446 raft_consensus.cc:2272] T ff1532cf86464920afb02490b110f356 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.532174 27446 tablet_replica.cc:333] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.533020 27446 raft_consensus.cc:2243] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.533592 27446 raft_consensus.cc:2272] T 2e9f78bead97491ebb7f049af3cf869c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.536382 27446 tablet_replica.cc:333] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.537271 27446 raft_consensus.cc:2243] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.537945 27446 raft_consensus.cc:2272] T a5dc72678108404787b2aa034d4a7243 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.541167 27446 tablet_replica.cc:333] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.541939 27446 raft_consensus.cc:2243] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.542469 27446 raft_consensus.cc:2272] T 1ad958cd19754b4b9c2817e4b5cd7ded P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.546170 27446 tablet_replica.cc:333] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.546916 27446 raft_consensus.cc:2243] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.547536 27446 raft_consensus.cc:2272] T 6ae65c3f66064ac694864cddddad892d P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.551703 27446 tablet_replica.cc:333] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.552603 27446 raft_consensus.cc:2243] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.553237 27446 raft_consensus.cc:2272] T f7fa5ed3509d4939885ee0d39a32f20a P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.556160 27446 tablet_replica.cc:333] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.556886 27446 raft_consensus.cc:2243] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.557868 27446 raft_consensus.cc:2272] T 71e53cc7795245709057efe9ca977661 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.560395 27446 tablet_replica.cc:333] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.561163 27446 raft_consensus.cc:2243] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.561766 27446 raft_consensus.cc:2272] T 01095df8e33a4e11bc9089bc7a5cdd37 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.565559 27446 tablet_replica.cc:333] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.566398 27446 raft_consensus.cc:2243] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.567083 27446 raft_consensus.cc:2272] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.570178 27446 tablet_replica.cc:333] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.570891 27446 raft_consensus.cc:2243] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.571421 27446 raft_consensus.cc:2272] T 1aa4d3cf35bc44b2b334697ab60648ca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.585736 27446 tablet_replica.cc:333] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.586479 27446 raft_consensus.cc:2243] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.608047 27446 raft_consensus.cc:2272] T e599bf217cb043a7957d025cd753fea4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.618131 27446 tablet_replica.cc:333] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.618927 27446 raft_consensus.cc:2243] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.620205 27446 raft_consensus.cc:2272] T 3be2bcd2a3b04c82bbf14413a7011c12 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.623153 27446 tablet_replica.cc:333] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.623842 27446 raft_consensus.cc:2243] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.624521 27446 raft_consensus.cc:2272] T dcb1386731ec4c46bd9cc992c2ffc31b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.627996 27446 tablet_replica.cc:333] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.629452 27446 raft_consensus.cc:2243] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.630493 27446 raft_consensus.cc:2272] T 8cace92f719b413eb21f6a0ae2d7d707 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.633466 27446 tablet_replica.cc:333] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.639642 27446 raft_consensus.cc:2243] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.640393 27446 raft_consensus.cc:2272] T 243df7b9197c40219914bcac6111faca P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.643034 27446 tablet_replica.cc:333] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.643769 27446 raft_consensus.cc:2243] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.644416 27446 raft_consensus.cc:2272] T 4fe68878605a4b8ab3302650b63aae98 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.647145 27446 tablet_replica.cc:333] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.647799 27446 raft_consensus.cc:2243] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.648739 27446 raft_consensus.cc:2272] T f6ca073d2ba7428e8ef693a68c16429b P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.651759 27446 tablet_replica.cc:333] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.652477 27446 raft_consensus.cc:2243] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.653018 27446 raft_consensus.cc:2272] T b35b6c6fffe3416bb8f69b556040e319 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.655500 27446 tablet_replica.cc:333] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.656143 27446 raft_consensus.cc:2243] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.656890 27446 raft_consensus.cc:2272] T 2e9b05092c214663bd1a274ae3358eb4 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.659570 27446 tablet_replica.cc:333] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.660274 27446 raft_consensus.cc:2243] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.661332 27446 raft_consensus.cc:2272] T bb3409e46c8446f79a337919b428c7ac P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.663810 27446 tablet_replica.cc:333] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.664553 27446 raft_consensus.cc:2243] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.670960 27446 raft_consensus.cc:2272] T 3e1813ffb1124b0d8e8500ca59a1550f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.673872 27446 tablet_replica.cc:333] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.674746 27446 raft_consensus.cc:2243] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.676151 27446 raft_consensus.cc:2272] T 78db6dee59ca445c95d367900be0ef94 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.684880 27446 tablet_replica.cc:333] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.685665 27446 raft_consensus.cc:2243] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.687170 27446 raft_consensus.cc:2272] T c4d3afd7078b475e884e52f098a3b5cd P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.692062 27446 tablet_replica.cc:333] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.694185 27446 raft_consensus.cc:2243] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.695360 27446 raft_consensus.cc:2272] T 1632d712fbcd489da9624b1f43ff7f96 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.698140 27446 tablet_replica.cc:333] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.698869 27446 raft_consensus.cc:2243] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.700799 27446 raft_consensus.cc:2272] T 1d4b956d8e604e81b411a6c4ce1681ad P e3ce74ba14714b4dbd2d75e27f34eb0d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.703567 27446 tablet_replica.cc:333] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.704285 27446 raft_consensus.cc:2243] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.705068 27446 raft_consensus.cc:2272] T ecc67b62cf604852ae673df459d4ce67 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.707563 27446 tablet_replica.cc:333] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.708269 27446 raft_consensus.cc:2243] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.709805 27446 raft_consensus.cc:2272] T 4fa8c90dea5b494e9adb22b30b41b45c P e3ce74ba14714b4dbd2d75e27f34eb0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.712620 27446 tablet_replica.cc:333] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.713310 27446 raft_consensus.cc:2243] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:21:24.714514 27446 raft_consensus.cc:2272] T 14b09750d07a41f39c2913b5d03c6994 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.717217 27446 tablet_replica.cc:333] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.717882 27446 raft_consensus.cc:2243] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.718513 27446 raft_consensus.cc:2272] T c60bef772ef04194a01b6f8f5423dd5f P e3ce74ba14714b4dbd2d75e27f34eb0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.721091 27446 tablet_replica.cc:333] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.721725 27446 raft_consensus.cc:2243] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.722318 27446 raft_consensus.cc:2272] T a975dd4c5a744a1d98c05841000796f8 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:24.725201 27446 tablet_replica.cc:333] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d: stopping tablet replica
I20260709 12:21:24.725811 27446 raft_consensus.cc:2243] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:24.726447 27446 raft_consensus.cc:2272] T b5e3c15999a1401a85e85110ac625d58 P e3ce74ba14714b4dbd2d75e27f34eb0d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:24.940968 28722 connection.cc:573] client connection to 127.26.205.129:36607 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:21:24.950901 28648 connection.cc:573] client connection to 127.26.205.129:36607 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:21:24.958943 29292 connection.cc:573] client connection to 127.26.205.129:36607 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:21:25.405870  4975 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.406528  4975 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.412803 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:25.414430 29292 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.415279 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.415616  4975 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:25.416198  5011 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:25.448048  5000 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.448761  5000 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.451148  5000 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.453393 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:25.454034 29325 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:21:25.454576 28756 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:21:25.455294 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:25.456142  5000 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:25.456607  5000 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:21:25.456769 28648 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.457481  5000 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:25.476780  4975 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.477411  4975 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.479916  4975 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.482730 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:25.489886 29292 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.491119 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.492383  4975 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:25.494288  5000 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:25.523010 28648 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.525843  4964 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.526500  4964 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.528898  4964 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.530543 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:25.531215 29323 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
W20260709 12:21:25.533179 28722 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.534127 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.535164  4944 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:21:25.535642  4944 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.536094  4944 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:21:25.539105 28721 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb599a2fb1704106b47a69be90b821d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:25.541646 28673 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:21:25.545109  5000 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.546723 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b12c4abe49469ebd1ae7c30355cef2" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:25.547351 29325 raft_consensus.cc:3060] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:25.548949  4693 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:25.550874  4975 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:21:25.551537 28722 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:25.551400  4975 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.554073  4975 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:25.554811 29325 raft_consensus.cc:2468] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 26.
I20260709 12:21:25.557261  4944 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:25.561738 29292 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.562453 28647 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.574301 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:25.575646 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.577093  5000 raft_consensus.cc:2804] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:25.579339  4944 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.580415  5003 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.581071  5003 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.581993 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6828c27180d54395aa62e49037e09909" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:25.582721 29325 raft_consensus.cc:3060] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:21:25.583194  5003 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.588390  4975 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:25.590137 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:25.597695 28648 leader_election.cc:336] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.598163 28648 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.599854  5003 raft_consensus.cc:2749] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:25.604660 28722 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.608592  5000 raft_consensus.cc:697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 26 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:25.617313  5000 consensus_queue.cc:237] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.614511  4944 raft_consensus.cc:2955] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:21:25.619441 28679 raft_consensus.cc:2955] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:21:25.611594 29325 raft_consensus.cc:2468] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 26.
I20260709 12:21:25.633500 28721 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.635111  4964 raft_consensus.cc:2804] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:21:25.635608  4964 raft_consensus.cc:697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:25.636718  4964 consensus_queue.cc:237] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.656121  4693 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.656889  4693 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.659487  4693 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:25.661644 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:25.670254 28722 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.670697 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.671967  4693 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:25.677767 28496 catalog_manager.cc:5697] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 25 to 26, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 26 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:25.678768 28497 catalog_manager.cc:5697] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 25 to 26, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 26 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:25.708356 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet 71e53cc7795245709057efe9ca977661: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.713078  5016 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.714464  5003 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.714802  5016 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:25.715279 28553 auto_rebalancer.cc:629] Failed to schedule move for tablet 78db6dee59ca445c95d367900be0ef94: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.715068  5003 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.719852  5003 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.722297 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:25.722961 28756 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:21:25.724315 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:25.725274  5017 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:21:25.725656  5017 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.726068  5017 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:25.728399  5016 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.730348 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:25.731015 29325 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 23.
I20260709 12:21:25.732944 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:21:25.733538 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 05ef99f51b5a4b959e982c258f2aafcc: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:25.733771 28648 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.735262  5011 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.735764  5011 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:25.738387 28648 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.734251  5016 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:21:25.746591  5016 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.747025  5016 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:21:25.741266  5011 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:25.742687 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
W20260709 12:21:25.748693 29292 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.749265 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.749975  5011 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:25.745800  5017 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.755273  5017 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.756631  5003 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.760870  5003 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.763062  5003 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.763628 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:25.764119 28756 raft_consensus.cc:3060] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:21:25.769565 28756 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 25.
I20260709 12:21:25.780215 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:25.780704  4944 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.781275  4944 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.784785 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:25.786351  5016 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.791704  5016 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:25.792008 28722 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.795778  5003 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.795976 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c936ab911d48fba6cc944d81f99fb1" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:25.809728 29325 raft_consensus.cc:3060] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:21:25.787154 28648 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.809441 28722 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.813643  4944 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.815251  4964 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:21:25.815830 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:25.816419  4693 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.824198  4964 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.824362  5011 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.824697  4693 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.824781  4964 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.824951  5011 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.826690  4693 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:25.826997  4964 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.828115 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:25.820500 28648 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.828671  5003 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.831789  5000 raft_consensus.cc:2804] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:21:25.832757  5003 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.832366  5000 raft_consensus.cc:697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:25.827033  5011 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.836319  5016 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.836853  5016 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.836539  5000 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.838707 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:25.839326 29323 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 20.
I20260709 12:21:25.840631  5016 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.840953 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:25.822631 29325 raft_consensus.cc:2468] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 24.
I20260709 12:21:25.843904 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:25.844161 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:25.844782  5017 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.844861 28755 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:21:25.845319  5017 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.847627  5017 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:25.847687 28722 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.848251 28722 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.848812 29323 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:25.849041  4693 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:21:25.849771 28648 leader_election.cc:336] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.850240 28648 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:25.849236 28722 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.851223 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.851974  4693 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:21:25.852128 29292 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.852391  4693 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.852854  4693 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:25.853229 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.851651 28647 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:25.856019  5016 raft_consensus.cc:2749] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:21:25.869047  5016 raft_consensus.cc:2804] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:21:25.869136 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:25.869872  5016 raft_consensus.cc:697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:25.870832  5016 consensus_queue.cc:237] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:25.872571 28648 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:25.873594 28648 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.874254 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:25.874985 28755 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 26.
I20260709 12:21:25.856600  5009 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:25.877498 28496 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 14, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:25.878947  5009 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.879432  5009 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:25.857216  5017 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:25.881982  5017 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.882364  5017 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:21:25.897109 28648 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.897775 28648 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:25.902083 28648 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.904466  5003 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:25.900638  4964 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.908526  4964 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.910619  5011 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.910779  4964 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:25.911259  5011 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.911456  4693 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.913635  5011 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.911659  5026 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.916018  5026 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.918422  5026 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:25.887641  5009 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.924271  4693 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.926079  4693 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.926648  4693 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.930648  4693 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.949156  5009 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.957692  5017 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:25.958457 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:25.960873 29325 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a7ec63b6634944d0b5b5ea92fa2d303e in current term 21: Already voted for candidate 5b3b2f4041a24b05983f30878f16db9d in this term.
I20260709 12:21:25.963900  5017 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.964630  5017 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.965219  5017 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.967943  5029 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:21:25.966307 29292 leader_election.cc:336] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.968549  5029 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.968909 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:25.968986  5003 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.969677  5003 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:25.970661 28722 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.970877 29323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509077a515a748899cf8ea0c5bac854a" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
W20260709 12:21:25.971283 28722 leader_election.cc:336] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.971457 29323 raft_consensus.cc:3060] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:25.971689  5029 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:25.971824 28722 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.972658  5003 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:25.973740 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:25.973881 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:25.975497 28755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:25.975764  5017 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:25.976267 28755 raft_consensus.cc:2393] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b3b2f4041a24b05983f30878f16db9d in current term 21: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
W20260709 12:21:25.977022 29292 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.978688 29323 raft_consensus.cc:2468] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 21.
I20260709 12:21:25.979175  5029 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:25.979966 28647 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea; no voters: 
W20260709 12:21:25.982604 27446 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28628)
W20260709 12:21:25.983616 28722 leader_election.cc:336] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:25.979770  5029 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:25.985397 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.987898 28721 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:25.988492  5031 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:21:25.988762  4944 raft_consensus.cc:2749] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:21:25.986068  5029 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:25.988124 28496 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 24 to 25, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 25 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:25.990947 28496 catalog_manager.cc:5697] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 23 to 24, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 24 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:25.986703  5003 raft_consensus.cc:2804] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:26.001533 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:26.005391 28722 leader_election.cc:336] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.008421  5017 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
W20260709 12:21:26.019003 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 102039us
I20260709 12:21:26.021088  5011 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:26.022917 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.024169  5009 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:21:26.024668 28722 leader_election.cc:336] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.024943  5017 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.027174  5017 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:26.031001 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:26.031263 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:26.031695 28673 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:21:26.031847 28679 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:21:26.053849 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:26.054183 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:26.054579 28677 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:21:26.054864 28679 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 20.
I20260709 12:21:26.056738 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.057910 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.060570  5033 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:26.060976  5033 raft_consensus.cc:493] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.061354  5033 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:26.062680 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.063541  5031 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:26.070254  5031 raft_consensus.cc:493] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.070670  5031 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:26.064878  4944 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.072783  4944 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.029592  5003 raft_consensus.cc:697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:26.077199  5029 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:26.077744  5029 raft_consensus.cc:493] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.078203  5029 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:26.078648  5003 consensus_queue.cc:237] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.081218 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.082321  4693 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:26.082680  4693 raft_consensus.cc:493] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.082988  4693 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:26.088991  5009 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 33 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.089546  5009 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.092061  5009 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:26.094622 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:26.095252 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 33.
I20260709 12:21:26.093966  4693 raft_consensus.cc:515] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.097164 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.099151  4693 leader_election.cc:290] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:26.099187 29292 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.101923 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:26.102526 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 33.
I20260709 12:21:26.103319 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:26.104221  5034 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:21:26.104823  5034 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.106427  4944 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:26.107372 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:26.107853  5034 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:26.107985 29325 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 26.
I20260709 12:21:26.109128  5033 raft_consensus.cc:515] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.109469 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:21:26.111745 28648 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.113341 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:26.113984 28679 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 33.
I20260709 12:21:26.116742  5030 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.117350  5030 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.118779  4964 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:21:26.119190  4964 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.119526  5030 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:26.119870  5029 raft_consensus.cc:515] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.119575  4964 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:26.122721 29325 raft_consensus.cc:1275] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:21:26.124017 29290 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:26.124878 28648 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.124292 28677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cace92f719b413eb21f6a0ae2d7d707" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:26.125607 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea" is_pre_election: true
I20260709 12:21:26.125804 28677 raft_consensus.cc:3060] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:26.126999  5031 raft_consensus.cc:515] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.129221  5017 consensus_queue.cc:1048] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:21:26.126478 28679 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:26.130813 28748 raft_consensus.cc:2393] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:26.135075  5011 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:21:26.134824  4964 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.135462  5011 raft_consensus.cc:493] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 33 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.135880  5011 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:21:26.136758 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:26.137480 28756 raft_consensus.cc:2393] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8342e3fcab94ce89482df67988159ea in current term 18: Already voted for candidate a7ec63b6634944d0b5b5ea92fa2d303e in this term.
I20260709 12:21:26.137862 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:26.138618 29325 raft_consensus.cc:1275] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:21:26.139575  5026 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:26.139978  5026 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.140313  5026 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:26.145264 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e53cc7795245709057efe9ca977661" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:26.146059 28679 raft_consensus.cc:3060] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:26.147387 28677 raft_consensus.cc:2468] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:26.148658 28720 leader_election.cc:304] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:26.155542  4964 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:26.157145 29325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1632d712fbcd489da9624b1f43ff7f96" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:26.157380  4975 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.157717 29325 raft_consensus.cc:3060] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:26.157964  4975 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.159822  5026 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.157277  4693 raft_consensus.cc:2804] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:26.160144  4975 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:26.161010  4693 raft_consensus.cc:697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:26.125644 28648 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: 5b3b2f4041a24b05983f30878f16db9d, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.166770 29325 raft_consensus.cc:2468] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 27.
W20260709 12:21:26.167696 28648 leader_election.cc:336] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:26.168248 28648 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.171254  5011 raft_consensus.cc:515] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 34 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.140661  4944 consensus_queue.cc:1048] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.002s
I20260709 12:21:26.160794  5029 leader_election.cc:290] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:26.175133 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:26.175395  4693 consensus_queue.cc:237] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.203981 28756 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 28.
W20260709 12:21:26.205433 28722 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.179628  5031 leader_election.cc:290] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:26.173270  5017 raft_consensus.cc:2749] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:21:26.181437  5033 leader_election.cc:290] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:26.187932 28675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3409e46c8446f79a337919b428c7ac" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:26.209975 28675 raft_consensus.cc:3060] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:26.188405 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4b956d8e604e81b411a6c4ce1681ad" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:26.212824 28673 raft_consensus.cc:3060] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:26.117177  5034 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.202654 28679 raft_consensus.cc:2468] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
W20260709 12:21:26.206281 28722 leader_election.cc:336] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:26.206427 29292 leader_election.cc:336] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:26.213922 28722 leader_election.cc:336] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.214217 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:26.214532 28722 leader_election.cc:336] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:26.215103 28722 leader_election.cc:336] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:26.215628 28722 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:26.216125 28722 leader_election.cc:336] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:26.216936 28722 leader_election.cc:336] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.228911 28720 leader_election.cc:304] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.256681 28496 catalog_manager.cc:5697] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 20 to 21, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 21 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:26.281932 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 90847.7us
I20260709 12:21:26.288383 28673 raft_consensus.cc:2468] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:21:26.290432 28721 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.326478 28720 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.321008  5036 ts_tablet_manager.cc:933] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:26.288555  5031 raft_consensus.cc:2804] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:26.309139  4975 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:21:26.348351 28675 raft_consensus.cc:2468] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:21:26.329757  5030 raft_consensus.cc:2804] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:21:26.357687  5011 leader_election.cc:290] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 34 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:26.360646 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:26.361285 28756 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:21:26.361730  5032 raft_consensus.cc:2804] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:21:26.366010 29292 leader_election.cc:336] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:26.374825 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 91994.5us
I20260709 12:21:26.375595 28648 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.384708 28673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2bcd2a3b04c82bbf14413a7011c12" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:26.349797  4975 raft_consensus.cc:493] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Starting leader election (detected failure of leader e3ce74ba14714b4dbd2d75e27f34eb0d)
I20260709 12:21:26.385574  4975 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:21:26.388206 28673 raft_consensus.cc:3060] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:21:26.394632  5034 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:26.383526  5030 raft_consensus.cc:697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:26.402261  5030 consensus_queue.cc:237] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.377429  5032 raft_consensus.cc:697] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:26.403936  5032 consensus_queue.cc:237] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:26.409579 28722 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.377847  5040 raft_consensus.cc:2749] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:21:26.422127 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 95725us
I20260709 12:21:26.428517 28679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78db6dee59ca445c95d367900be0ef94" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a8342e3fcab94ce89482df67988159ea"
I20260709 12:21:26.429308 28679 raft_consensus.cc:3060] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:26.432367 28720 leader_election.cc:304] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.434629  5050 raft_consensus.cc:2804] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:26.435185  5050 raft_consensus.cc:697] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:26.436075  5050 consensus_queue.cc:237] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.444332 28498 catalog_manager.cc:5697] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 20 to 21, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:26.449940 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:26.459209 28756 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 34.
I20260709 12:21:26.388342  5026 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:26.469373 29321 raft_consensus.cc:1275] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 12:21:26.470270 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:26.471134  5034 consensus_queue.cc:1048] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:21:26.520658 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 145130us
I20260709 12:21:26.521507 28648 leader_election.cc:304] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8342e3fcab94ce89482df67988159ea; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.544195 28679 raft_consensus.cc:2468] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:26.536042  5047 raft_consensus.cc:2749] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:26.562882 28673 raft_consensus.cc:2468] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 34.
I20260709 12:21:26.546782  5031 raft_consensus.cc:697] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:26.592096 29290 leader_election.cc:304] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.594499  5049 raft_consensus.cc:2804] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:21:26.595078  5049 raft_consensus.cc:697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 34 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:26.595952 28720 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:26.596131  5049 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.21, Last appended by leader: 21, Current term: 34, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.579763  5036 tablet_copy_client.cc:323] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
W20260709 12:21:26.606737 28722 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:26.607252 28755 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 12:21:26.607441 28722 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.607949 28722 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.608317 28722 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.609124 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.625388 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:26.626874 29325 raft_consensus.cc:1275] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:26.628628 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d3afd7078b475e884e52f098a3b5cd" candidate_uuid: "a8342e3fcab94ce89482df67988159ea" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:26.629217 28756 raft_consensus.cc:3060] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:21:26.633332 28764 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet cb599a2fb1704106b47a69be90b821d0 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:21:26.633929 28764 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet cb599a2fb1704106b47a69be90b821d0 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-cb599a2fb1704106b47a69be90b821d0
I20260709 12:21:26.634019  5051 consensus_queue.cc:1048] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:26.642798  4975 raft_consensus.cc:515] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.644734 28756 raft_consensus.cc:2468] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8342e3fcab94ce89482df67988159ea in term 27.
I20260709 12:21:26.644596  5031 consensus_queue.cc:237] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.611927  5052 raft_consensus.cc:2804] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:26.647995  5052 raft_consensus.cc:697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:26.648875  5052 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:26.653769  4975 leader_election.cc:290] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 29 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:26.655392 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:26.657974 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b09750d07a41f39c2913b5d03c6994" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:26.658563 28751 raft_consensus.cc:3060] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:21:26.682493 28764 tablet_copy_source_session.cc:215] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:26.694118 28751 raft_consensus.cc:2468] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 29.
I20260709 12:21:26.695914 29292 leader_election.cc:304] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:26.700971  5043 raft_consensus.cc:2804] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:21:26.712990  5043 raft_consensus.cc:697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 29 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:26.714080  5043 consensus_queue.cc:237] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:26.698508  5034 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
W20260709 12:21:26.726379 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.727267 29292 leader_election.cc:336] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.731299 28675 raft_consensus.cc:1275] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:21:26.732275 28722 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:26.733791  5026 consensus_queue.cc:1048] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:21:26.737841  5036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb599a2fb1704106b47a69be90b821d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:26.740029 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.766129 28722 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:26.781008 28648 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea; no voters: 
I20260709 12:21:26.783098  5034 raft_consensus.cc:2804] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:21:26.783620  5034 raft_consensus.cc:697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 27 LEADER]: Becoming Leader. State: Replica: a8342e3fcab94ce89482df67988159ea, State: Running, Role: LEADER
I20260709 12:21:26.784518  5034 consensus_queue.cc:237] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:26.784518 28648 consensus_peers.cc:597] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:26.788810 28648 consensus_peers.cc:597] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:26.791211 28648 consensus_peers.cc:597] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:26.791738 28648 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:26.798368 28498 catalog_manager.cc:5697] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 17 to 18, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.801872 28498 catalog_manager.cc:5697] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 26 to 27, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 27 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.803998 28498 catalog_manager.cc:5697] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 17 to 18, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.807717 28498 catalog_manager.cc:5697] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 17 to 18, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.813941 28497 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 33 to 34, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 34 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:26.867041 28722 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.869414 28648 consensus_peers.cc:597] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:26.891932 28498 catalog_manager.cc:5697] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea reported cstate change: term changed from 26 to 27, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a8342e3fcab94ce89482df67988159ea (127.26.205.130). New cstate: current_term: 27 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:26.900463 28648 consensus_peers.cc:597] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.915005 28648 consensus_peers.cc:597] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:26.919842 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 05ef99f51b5a4b959e982c258f2aafcc: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:26.926613 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:26.931316  5036 tablet_copy_client.cc:806] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:26.946395  5036 tablet_copy_client.cc:670] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:26.948602 28496 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 21 to 22, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:26.983093 27446 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 28628)
I20260709 12:21:27.029824 28677 raft_consensus.cc:1275] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:21:27.033725 28722 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:27.035414 28680 raft_consensus.cc:1275] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:21:27.053818 28648 consensus_peers.cc:597] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:27.055598  5036 tablet_copy_client.cc:538] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:21:27.065030 28722 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:27.065614 28722 consensus_peers.cc:597] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:27.066784 28679 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 34 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 33 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
W20260709 12:21:27.068519 28722 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:27.069082  5055 consensus_queue.cc:1048] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:21:27.071254  5055 consensus_queue.cc:1048] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:21:27.077986 28648 consensus_peers.cc:597] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:27.088256 28648 consensus_peers.cc:597] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:27.090073 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:27.097445  5011 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:21:27.102330 29322 raft_consensus.cc:1275] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:21:27.098548 28496 catalog_manager.cc:5697] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 28 to 29, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 29 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:27.108521 28491 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 3be2bcd2a3b04c82bbf14413a7011c12 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:21:27.111374 28722 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:27.111964 28722 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:27.119637  5033 consensus_queue.cc:1048] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:21:27.121034 28680 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:21:27.131234 28648 consensus_peers.cc:597] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:27.131839 28648 consensus_peers.cc:597] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:27.136581  5036 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
I20260709 12:21:27.143991  5033 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:21:27.167236 28722 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:27.191669 28722 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:27.250798 28751 raft_consensus.cc:1275] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
W20260709 12:21:27.251971 28722 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:27.254181 28722 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:27.271813  5075 log.cc:927] Time spent T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: Append to log took a long time: real 0.055s	user 0.000s	sys 0.006s
W20260709 12:21:27.285517 28722 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:27.288653 28675 raft_consensus.cc:1275] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:21:27.288997  5043 consensus_queue.cc:1048] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:21:27.288653 28751 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 34 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 33 index: 21. Preceding OpId from leader: term: 34 index: 22. (index mismatch)
W20260709 12:21:27.296329 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:27.296928 29292 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:27.338766  5045 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.034s
I20260709 12:21:27.315974  5052 consensus_queue.cc:1048] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 12:21:27.384871 28648 consensus_peers.cc:597] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:27.394362 28751 raft_consensus.cc:1275] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
W20260709 12:21:27.401607 28648 consensus_peers.cc:597] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:27.407546  5080 consensus_queue.cc:1048] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
W20260709 12:21:27.452376 28648 consensus_peers.cc:597] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:27.607266  5036 log.cc:927] Time spent T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 12:21:27.745215  5036 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:27.751566  5036 tablet_bootstrap.cc:492] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:21:27.755836  5036 ts_tablet_manager.cc:1403] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.620s	user 0.058s	sys 0.023s
I20260709 12:21:27.780752  5031 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:27.781349  5031 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:27.783595  5031 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:27.785255 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:27.785905 29321 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 21.
I20260709 12:21:27.788306 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:21:27.788887 28722 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:27.793973  4944 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:21:27.794437  4944 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:27.794806  4944 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:27.803815  4944 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:27.817122  5036 raft_consensus.cc:359] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:21:27.818096  5036 raft_consensus.cc:740] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
W20260709 12:21:27.820060 28722 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:27.831306 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa8c90dea5b494e9adb22b30b41b45c" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:27.831907 29321 raft_consensus.cc:3060] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:27.827872  5036 consensus_queue.cc:260] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:21:27.839272  5036 ts_tablet_manager.cc:1434] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:21:27.839244 29321 raft_consensus.cc:2468] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 22.
I20260709 12:21:27.841239 28764 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-cb599a2fb1704106b47a69be90b821d0 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:21:27.841284 28721 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:27.841827 28764 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-cb599a2fb1704106b47a69be90b821d0 on tablet cb599a2fb1704106b47a69be90b821d0 with peer 5b3b2f4041a24b05983f30878f16db9d
I20260709 12:21:27.842237  5031 raft_consensus.cc:2804] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:27.842777  5031 raft_consensus.cc:697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:27.843628  5031 consensus_queue.cc:237] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:27.840152  4944 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 election: Requested vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:27.887322 28498 catalog_manager.cc:5697] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 20 to 22, leader changed from e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:27.983613 27446 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 28628)
I20260709 12:21:28.127092 29321 raft_consensus.cc:1217] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
W20260709 12:21:28.239077 28722 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:28.314108 28722 consensus_peers.cc:597] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:28.366529 28494 maintenance_manager.cc:419] P 8e0de7eff4a840c28e4ee5b7f8b98182: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033366
I20260709 12:21:28.459465 29321 raft_consensus.cc:1275] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:21:28.461091  4944 consensus_queue.cc:1048] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:28.684839  5055 raft_consensus.cc:1064] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:21:28.690994  5055 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:28.742719 28722 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:28.769555 29319 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:21:28.771479  4944 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:21:28.825290 28493 maintenance_manager.cc:643] P 8e0de7eff4a840c28e4ee5b7f8b98182: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.448s	user 0.043s	sys 0.015s Metrics: {"bytes_written":7778,"delete_count":0,"lbm_write_time_us":1370,"lbm_writes_lt_1ms":7,"reinsert_count":0,"update_count":298}
I20260709 12:21:28.828476 28494 maintenance_manager.cc:419] P 8e0de7eff4a840c28e4ee5b7f8b98182: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.366353
I20260709 12:21:28.833515 28673 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:21:28.865276 28722 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:28.894109  5105 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:21:28.901125 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:28.908955 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:28.940799 28648 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111) [suppressed 419 similar messages]
W20260709 12:21:28.945859 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:28.966435 28648 consensus_peers.cc:597] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:28.971340 28648 consensus_peers.cc:597] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:28.972811  5096 raft_consensus.cc:2955] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:28.975100 28682 raft_consensus.cc:2955] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:28.984272 27446 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 28628)
W20260709 12:21:29.014741 28648 consensus_peers.cc:597] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:29.020129 28722 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.047128 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:29.049561 28498 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 14 to 15, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:29.051149 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:29.077961 29322 raft_consensus.cc:2955] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } attrs { replace: true } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:29.088023 28648 consensus_peers.cc:597] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:29.102255 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.117489 28722 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.149724 28722 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.157828 28648 consensus_peers.cc:597] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:29.164564 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.174113 28492 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 77027.4us
W20260709 12:21:29.179867 28722 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.186441 28722 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.205369 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 05ef99f51b5a4b959e982c258f2aafcc: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:29.243814 28722 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.290393 28722 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.305930 28722 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:29.319387 28756 consensus_queue.cc:237] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:29.333307 29322 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:29.334908  5105 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:29.341650  5096 raft_consensus.cc:2955] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:29.343305 29322 raft_consensus.cc:2955] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:29.349251 28682 raft_consensus.cc:1275] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:21:29.350713  5055 consensus_queue.cc:1048] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:21:29.361071 28682 raft_consensus.cc:2955] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:29.364883 28722 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:29.382905 28497 catalog_manager.cc:5697] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: config changed from index 15 to 16, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 21 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:29.396533 28722 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.414147 28722 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:29.421866 28492 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb599a2fb1704106b47a69be90b821d0 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:21:29.441087 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.523238 28648 consensus_peers.cc:597] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.531617 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.533279 28722 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:29.539367 28648 consensus_peers.cc:597] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.591837 28648 consensus_peers.cc:597] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.594190 28648 consensus_peers.cc:597] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:29.608079 28493 maintenance_manager.cc:643] P 8e0de7eff4a840c28e4ee5b7f8b98182: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.778s	user 0.096s	sys 0.019s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":29397,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":10938,"dirs.run_cpu_time_us":579,"dirs.run_wall_time_us":2229,"lbm_read_time_us":2896,"lbm_reads_lt_1ms":26,"lbm_write_time_us":59836,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":9,"peak_mem_usage":312395,"reinsert_count":0,"thread_start_us":30004,"threads_started":2,"update_count":309}
W20260709 12:21:29.611512 28722 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:29.612731 28494 maintenance_manager.cc:419] P 8e0de7eff4a840c28e4ee5b7f8b98182: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:21:29.613641 28493 maintenance_manager.cc:643] P 8e0de7eff4a840c28e4ee5b7f8b98182: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 12:21:29.627928 28648 consensus_peers.cc:597] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.651825 28722 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:29.721071 28722 consensus_peers.cc:597] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:29.725709 28648 consensus_peers.cc:597] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.726665 28722 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.878778 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:29.902631 28648 consensus_peers.cc:597] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.908695 28722 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:29.935299 29292 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:29.984802 27446 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 28628)
W20260709 12:21:30.040659 28722 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:30.106936 28648 consensus_peers.cc:597] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:30.116299 28648 consensus_peers.cc:597] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:30.639434 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 44185.6us
W20260709 12:21:30.673754 28722 consensus_peers.cc:597] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:30.697417 28673 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:21:30.714107 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 116219us
I20260709 12:21:30.725245 28756 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:21:30.728068  5080 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:21:30.738968 28492 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 148820us
W20260709 12:21:30.746066 28648 consensus_peers.cc:597] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:30.762442 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cb599a2fb1704106b47a69be90b821d0: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:30.777942 28647 consensus_peers.cc:597] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e599bf217cb043a7957d025cd753fea4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:30.792943  5080 raft_consensus.cc:2955] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:21:30.794865 28756 raft_consensus.cc:2955] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:21:30.810159 28751 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:21:30.834360 28721 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291): Couldn't send request to peer 5b3b2f4041a24b05983f30878f16db9d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78db6dee59ca445c95d367900be0ef94. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:30.832244 28497 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index -1 to 17, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 25 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:30.842327 28722 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:30.844159 28673 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:21:30.848507  5096 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:21:30.885072  5096 raft_consensus.cc:2955] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:21:30.887363 28680 raft_consensus.cc:2955] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } } }
I20260709 12:21:30.980234 28496 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index -1 to 15, NON_VOTER 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) added. New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:30.986604 27446 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 28628)
W20260709 12:21:31.084052 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.213629  5136 ts_tablet_manager.cc:933] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:31.233589 28648 consensus_peers.cc:597] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.249323  5136 tablet_copy_client.cc:323] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.130:42113
I20260709 12:21:31.251736 28692 tablet_copy_service.cc:140] P a8342e3fcab94ce89482df67988159ea: Received BeginTabletCopySession request for tablet e599bf217cb043a7957d025cd753fea4 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:60198)
I20260709 12:21:31.252329 28692 tablet_copy_service.cc:161] P a8342e3fcab94ce89482df67988159ea: Beginning new tablet copy session on tablet e599bf217cb043a7957d025cd753fea4 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:60198: session id = 5b3b2f4041a24b05983f30878f16db9d-e599bf217cb043a7957d025cd753fea4
W20260709 12:21:31.255142 28648 consensus_peers.cc:597] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:31.260695 29321 consensus_queue.cc:237] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 34.22, Last appended by leader: 21, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:31.270453 28692 tablet_copy_source_session.cc:215] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:31.274894  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e599bf217cb043a7957d025cd753fea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:31.284518 28756 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 34 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 34 index: 23. (index mismatch)
I20260709 12:21:31.286813  5124 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:21:31.289423 28680 raft_consensus.cc:1275] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 34 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 34 index: 22. Preceding OpId from leader: term: 34 index: 23. (index mismatch)
I20260709 12:21:31.294243  5011 consensus_queue.cc:1048] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
W20260709 12:21:31.297842 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.357249  5126 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 34 LEADER]: Committing config change with OpId 34.23: config changed from index 10 to 23, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:31.362062 28680 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 34 FOLLOWER]: Committing config change with OpId 34.23: config changed from index 10 to 23, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:31.376739 28722 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:31.376603 28756 raft_consensus.cc:2955] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 34 FOLLOWER]: Committing config change with OpId 34.23: config changed from index 10 to 23, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:31.396018 28648 consensus_peers.cc:597] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:31.410408 28497 catalog_manager.cc:5697] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea reported cstate change: config changed from index 10 to 23, VOTER e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129) evicted. New cstate: current_term: 34 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:31.413085 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.435452 28491 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3be2bcd2a3b04c82bbf14413a7011c12 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:21:31.435482  5141 ts_tablet_manager.cc:933] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: Initiating tablet copy from peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:31.478355  5136 tablet_copy_client.cc:806] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:31.495041  5136 tablet_copy_client.cc:670] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:31.496838  5141 tablet_copy_client.cc:323] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Beginning tablet copy session from remote peer at address 127.26.205.131:44843
I20260709 12:21:31.503247 28764 tablet_copy_service.cc:140] P a7ec63b6634944d0b5b5ea92fa2d303e: Received BeginTabletCopySession request for tablet 78db6dee59ca445c95d367900be0ef94 from peer 5b3b2f4041a24b05983f30878f16db9d ({username='slave'} at 127.0.0.1:47636)
I20260709 12:21:31.503806 28764 tablet_copy_service.cc:161] P a7ec63b6634944d0b5b5ea92fa2d303e: Beginning new tablet copy session on tablet 78db6dee59ca445c95d367900be0ef94 from peer 5b3b2f4041a24b05983f30878f16db9d at {username='slave'} at 127.0.0.1:47636: session id = 5b3b2f4041a24b05983f30878f16db9d-78db6dee59ca445c95d367900be0ef94
I20260709 12:21:31.509732  5136 tablet_copy_client.cc:538] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:31.523578 28764 tablet_copy_source_session.cc:215] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:21:31.526484 28722 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.527264  5141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78db6dee59ca445c95d367900be0ef94. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:31.577322 28722 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.590086  5136 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
W20260709 12:21:31.637259 28722 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:31.655030 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.670686 28722 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.679224  5141 tablet_copy_client.cc:806] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:31.680747  5141 tablet_copy_client.cc:670] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:31.685467  5141 tablet_copy_client.cc:538] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:21:31.699321 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.702140 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.745713 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.750991  5141 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap starting.
W20260709 12:21:31.753032 28722 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.770916 28722 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.817037 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cb599a2fb1704106b47a69be90b821d0: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:31.866032 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.890049 28722 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.892853 28722 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.890640 28648 consensus_peers.cc:597] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:31.928901 28722 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:31.937556 28722 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:31.943802 28722 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.950911 28648 consensus_peers.cc:597] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:31.974340 28648 consensus_peers.cc:597] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.980497  5141 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:21:31.987249 27446 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 28628)
W20260709 12:21:31.987505 28722 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:31.996209  5141 tablet_bootstrap.cc:492] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:21:31.997489  5141 ts_tablet_manager.cc:1403] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.247s	user 0.050s	sys 0.008s
I20260709 12:21:32.000839  5141 raft_consensus.cc:359] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:21:32.001799  5141 raft_consensus.cc:740] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:21:32.002593  5141 consensus_queue.cc:260] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:21:32.010689  5141 ts_tablet_manager.cc:1434] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:21:32.013134 28764 tablet_copy_service.cc:342] P a7ec63b6634944d0b5b5ea92fa2d303e: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-78db6dee59ca445c95d367900be0ef94 received from {username='slave'} at 127.0.0.1:47636
I20260709 12:21:32.013662 28764 tablet_copy_service.cc:434] P a7ec63b6634944d0b5b5ea92fa2d303e: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-78db6dee59ca445c95d367900be0ef94 on tablet 78db6dee59ca445c95d367900be0ef94 with peer 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:21:32.068924 28648 consensus_peers.cc:597] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:32.079703 28648 consensus_peers.cc:597] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:32.133155  5136 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=3 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:21:32.138788 28648 consensus_peers.cc:597] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:32.154139  5136 tablet_bootstrap.cc:492] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: Bootstrap complete.
I20260709 12:21:32.157729  5136 ts_tablet_manager.cc:1403] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: Time spent bootstrapping tablet: real 0.568s	user 0.044s	sys 0.023s
I20260709 12:21:32.162431  5136 raft_consensus.cc:359] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
W20260709 12:21:32.171160 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:32.172830 28722 consensus_peers.cc:597] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:32.176311  5136 raft_consensus.cc:740] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Initialized, Role: LEARNER
I20260709 12:21:32.177309  5136 consensus_queue.cc:260] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: NON_VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: true } }
I20260709 12:21:32.204831  5136 ts_tablet_manager.cc:1434] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260709 12:21:32.207098 28692 tablet_copy_service.cc:342] P a8342e3fcab94ce89482df67988159ea: Request end of tablet copy session 5b3b2f4041a24b05983f30878f16db9d-e599bf217cb043a7957d025cd753fea4 received from {username='slave'} at 127.0.0.1:60198
I20260709 12:21:32.207546 28692 tablet_copy_service.cc:434] P a8342e3fcab94ce89482df67988159ea: ending tablet copy session 5b3b2f4041a24b05983f30878f16db9d-e599bf217cb043a7957d025cd753fea4 on tablet e599bf217cb043a7957d025cd753fea4 with peer 5b3b2f4041a24b05983f30878f16db9d
W20260709 12:21:32.210469 28648 consensus_peers.cc:597] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:32.232245 28722 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:32.245572 28722 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:32.248318 28722 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:32.252676 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 58147us
W20260709 12:21:32.257266 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:32.524921 29322 raft_consensus.cc:1217] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 12:21:32.534559 29322 raft_consensus.cc:1217] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 LEARNER]: Deduplicated request from leader. Original: 25.16->[25.17-25.17]   Dedup: 25.17->[]
W20260709 12:21:32.556595 28648 consensus_peers.cc:597] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:32.644425 28648 consensus_peers.cc:597] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:32.668689 28722 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:32.754942 28648 consensus_peers.cc:597] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:32.949721  5123 raft_consensus.cc:1064] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:21:32.955816  5123 consensus_queue.cc:237] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 15, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:32.990114 27446 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 28628)
I20260709 12:21:33.006871 29322 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 LEARNER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:21:33.008560  5080 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:21:33.018903 28748 raft_consensus.cc:1275] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Refusing update from remote peer a8342e3fcab94ce89482df67988159ea: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:21:33.022994  5146 consensus_queue.cc:1048] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:21:33.026218 28648 consensus_peers.cc:597] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:33.073629  5080 raft_consensus.cc:2955] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:33.080986 28748 raft_consensus.cc:2955] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:33.112313  5096 raft_consensus.cc:1064] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: attempting to promote NON_VOTER 5b3b2f4041a24b05983f30878f16db9d to VOTER
I20260709 12:21:33.113127 29319 raft_consensus.cc:2955] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:33.115423  5096 consensus_queue.cc:237] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:33.126946 28497 catalog_manager.cc:5697] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 17 to 18, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "a8342e3fcab94ce89482df67988159ea" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:33.175141 29319 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEARNER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:33.177278  5147 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:21:33.217151 28722 consensus_peers.cc:597] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:33.233654 28680 raft_consensus.cc:1275] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:33.250510  5147 consensus_queue.cc:1048] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
W20260709 12:21:33.340488 28722 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:33.416864 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:33.415723 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 80972.4us
I20260709 12:21:33.419910  5164 raft_consensus.cc:2955] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:33.444649 28673 raft_consensus.cc:2955] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
W20260709 12:21:33.458705 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 05ef99f51b5a4b959e982c258f2aafcc: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:33.465153 29321 raft_consensus.cc:2955] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } } }
I20260709 12:21:33.498157 28496 catalog_manager.cc:5697] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: config changed from index 15 to 16, 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:21:33.560257 28648 consensus_peers.cc:597] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:33.754001 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:33.890610 28648 consensus_peers.cc:597] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:33.920663 28722 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:33.934939 28722 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:33.943805 28648 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111) [suppressed 464 similar messages]
W20260709 12:21:33.991010 27446 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 28628)
W20260709 12:21:33.992235 28648 consensus_peers.cc:597] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:34.017640 28722 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.041229 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.106498 28722 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:34.123383 28722 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.134763 28722 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.172845 28722 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:34.183718 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.212502 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.228503 28722 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.238000 28722 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.256129 28722 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.301844 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.326171 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.439837 28648 consensus_peers.cc:597] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.445060 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.496057 28648 consensus_peers.cc:597] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.586894 28722 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.602862 28648 consensus_peers.cc:597] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.625988 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.671952 28648 consensus_peers.cc:597] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.672916 28722 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.709995 28648 consensus_peers.cc:597] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.713310 28722 consensus_peers.cc:597] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:34.758608 28722 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:34.767802 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:34.773188 28648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 54056us
W20260709 12:21:34.781093 28722 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.785878 28648 consensus_peers.cc:597] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:34.789198 28648 consensus_peers.cc:597] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.883546 28722 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:34.969554 28722 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:34.991490 27446 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 28628)
W20260709 12:21:35.006966 28648 consensus_peers.cc:597] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:35.063967 28648 consensus_peers.cc:597] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:35.173260 28648 consensus_peers.cc:597] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:35.192170 28722 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:35.720309 28648 consensus_peers.cc:597] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:35.953218 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3be2bcd2a3b04c82bbf14413a7011c12: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:35.992067 27446 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 28628)
W20260709 12:21:36.001295 28722 consensus_peers.cc:597] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:36.011688 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.032189 28722 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:36.153230 28648 consensus_peers.cc:597] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.283620 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.289695 28648 consensus_peers.cc:597] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:36.394685 28722 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.455770 28722 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.470124 28722 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:36.479018 28722 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.619483 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.651746 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:36.675287 27446 tablet_server.cc:196] TabletServer@127.26.205.129:0 shutdown complete.
W20260709 12:21:36.682135 28648 consensus_peers.cc:597] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:36.710367 28722 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.726711 28722 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:36.729984 28722 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:36.757385 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.810622 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.848166 28722 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.856074 28648 consensus_peers.cc:597] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.857885 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.875403 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.878400 28722 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.942705 28648 consensus_peers.cc:597] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.960642 28722 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:36.982914 28722 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:37.031951 28722 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:37.061671 27446 tablet_server.cc:179] TabletServer@127.26.205.130:0 shutting down...
W20260709 12:21:37.074510 29290 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.077590 28722 consensus_peers.cc:597] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:37.077642 28720 consensus_peers.cc:597] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.087795 28720 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.116227 29290 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.117532 28720 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.119234 28648 consensus_peers.cc:597] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:37.163077 28648 consensus_peers.cc:597] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:37.169121 28648 consensus_peers.cc:597] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:37.177234 29290 consensus_peers.cc:597] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.178133 28720 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.184568 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:37.199689 28648 consensus_peers.cc:597] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:37.224218 28720 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.226356 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:21:37.237802 29290 consensus_peers.cc:597] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.241063 28720 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.244273 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:21:37.252326 28648 consensus_peers.cc:597] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:37.264379 28720 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.253996 27446 tablet_replica.cc:333] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
W20260709 12:21:37.271837 29290 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.272143 27446 raft_consensus.cc:2243] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.274706 27446 raft_consensus.cc:2272] T 316dc144dbef470e8e17c2e02887dfd8 P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.292003 27446 tablet_replica.cc:333] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.294116 27446 raft_consensus.cc:2243] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.295140 27446 raft_consensus.cc:2272] T cb599a2fb1704106b47a69be90b821d0 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.298198 27446 tablet_replica.cc:333] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.299057 27446 raft_consensus.cc:2243] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.300028 27446 raft_consensus.cc:2272] T 3a420de289b844729c03c9625dd9e63c P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.304426 27446 tablet_replica.cc:333] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.305449 27446 raft_consensus.cc:2243] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.306111 27446 raft_consensus.cc:2272] T 793ab78ecea2432e8fdb088474026ce1 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.309057 27446 tablet_replica.cc:333] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.310248 27446 raft_consensus.cc:2243] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.311529 27446 raft_consensus.cc:2272] T 509077a515a748899cf8ea0c5bac854a P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.318235 28720 consensus_peers.cc:597] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.316931 27446 tablet_replica.cc:333] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.319585 27446 raft_consensus.cc:2243] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.320863 27446 raft_consensus.cc:2272] T d2cf259cdc3c4cdfb64950de8d1adb98 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.323626 27446 tablet_replica.cc:333] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.324498 27446 raft_consensus.cc:2243] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.325738 27446 raft_consensus.cc:2272] T 30c9fa2ab7fb487da44a0d6de40286ff P a8342e3fcab94ce89482df67988159ea [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.338092 28720 consensus_peers.cc:597] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.328831 27446 tablet_replica.cc:333] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.340117 27446 raft_consensus.cc:2243] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.341328 27446 raft_consensus.cc:2272] T f7fa5ed3509d4939885ee0d39a32f20a P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.353729 29290 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.354148 28722 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:37.344092 27446 tablet_replica.cc:333] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.358425 27446 raft_consensus.cc:2243] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.359126 27446 raft_consensus.cc:2272] T ecb84065af5c41b0aaee71485ad69560 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.362581 27446 tablet_replica.cc:333] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.363521 27446 raft_consensus.cc:2243] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.364369 27446 raft_consensus.cc:2272] T 1ad958cd19754b4b9c2817e4b5cd7ded P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.373522 27446 tablet_replica.cc:333] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.374505 27446 raft_consensus.cc:2243] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.378645 27446 raft_consensus.cc:2272] T 6ae65c3f66064ac694864cddddad892d P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.382738 28722 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:37.394912 27446 tablet_replica.cc:333] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
W20260709 12:21:37.403298 28720 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.404217 27446 raft_consensus.cc:2243] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.405280 27446 raft_consensus.cc:2272] T 01095df8e33a4e11bc9089bc7a5cdd37 P a8342e3fcab94ce89482df67988159ea [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.414377 29290 consensus_peers.cc:597] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.417531 27446 tablet_replica.cc:333] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.419682 27446 raft_consensus.cc:2243] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.420387 27446 raft_consensus.cc:2272] T 71e53cc7795245709057efe9ca977661 P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.438113 27446 tablet_replica.cc:333] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
W20260709 12:21:37.449646 28720 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.460922 28720 consensus_peers.cc:597] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.469630 28720 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.474768 29290 consensus_peers.cc:597] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.480018 28722 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:37.439208 27446 raft_consensus.cc:2243] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.485675 27446 raft_consensus.cc:2272] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.490834 27446 tablet_replica.cc:333] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.491899 27446 raft_consensus.cc:2243] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:37.495647 29290 consensus_peers.cc:597] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.495743 27446 raft_consensus.cc:2272] T 2e9f78bead97491ebb7f049af3cf869c P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.498116 28720 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:37.503895 28720 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.505321 27446 tablet_replica.cc:333] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.506314 27446 raft_consensus.cc:2243] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.507582 27446 raft_consensus.cc:2272] T aacf3b2dee3345268f9d3c9b6a1e4779 P a8342e3fcab94ce89482df67988159ea [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.510557 27446 tablet_replica.cc:333] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.511550 27446 raft_consensus.cc:2243] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.512387 27446 raft_consensus.cc:2272] T f23bf973b94c463f8da13a996fc7f221 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.515373 27446 tablet_replica.cc:333] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.516192 27446 raft_consensus.cc:2243] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.517321 27446 raft_consensus.cc:2272] T 09b12c4abe49469ebd1ae7c30355cef2 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.520900 27446 tablet_replica.cc:333] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
W20260709 12:21:37.521739 29290 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.521714 27446 raft_consensus.cc:2243] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.526510 27446 raft_consensus.cc:2272] T 302623a332a2421e848283481e8010f6 P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.532038 27446 tablet_replica.cc:333] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.533066 27446 raft_consensus.cc:2243] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Raft consensus shutting down.
W20260709 12:21:37.543910 29290 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.547744 27446 raft_consensus.cc:2272] T f6ca073d2ba7428e8ef693a68c16429b P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.551079 27446 tablet_replica.cc:333] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.552119 27446 raft_consensus.cc:2243] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.553033 27446 raft_consensus.cc:2272] T 05ef99f51b5a4b959e982c258f2aafcc P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.556025 27446 tablet_replica.cc:333] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.556939 27446 raft_consensus.cc:2243] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.562315 27446 raft_consensus.cc:2272] T 3be2bcd2a3b04c82bbf14413a7011c12 P a8342e3fcab94ce89482df67988159ea [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.565095 27446 tablet_replica.cc:333] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.565927 27446 raft_consensus.cc:2243] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.567207 27446 raft_consensus.cc:2272] T dcb1386731ec4c46bd9cc992c2ffc31b P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.576860 27446 tablet_replica.cc:333] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.577852 27446 raft_consensus.cc:2243] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:37.583732 28648 consensus_peers.cc:597] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:37.584750 27446 raft_consensus.cc:2272] T 1548a806b02a4f79b5010615f560d2bb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.587877 27446 tablet_replica.cc:333] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.592252 27446 raft_consensus.cc:2243] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:37.596902 28722 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:21:37.598230 27446 raft_consensus.cc:2272] T 8cace92f719b413eb21f6a0ae2d7d707 P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.606643 29290 consensus_peers.cc:597] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.611202 27446 tablet_replica.cc:333] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.612334 27446 raft_consensus.cc:2243] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.613267 27446 raft_consensus.cc:2272] T 243df7b9197c40219914bcac6111faca P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.616122 27446 tablet_replica.cc:333] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.617101 27446 raft_consensus.cc:2243] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.618045 27446 raft_consensus.cc:2272] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a8342e3fcab94ce89482df67988159ea [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.621685 27446 tablet_replica.cc:333] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.622547 27446 raft_consensus.cc:2243] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.623301 27446 raft_consensus.cc:2272] T 1aa4d3cf35bc44b2b334697ab60648ca P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.626216 27446 tablet_replica.cc:333] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.627117 27446 raft_consensus.cc:2243] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.628754 27446 raft_consensus.cc:2272] T e599bf217cb043a7957d025cd753fea4 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.636955 28720 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:37.640196 27446 tablet_replica.cc:333] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.641104 27446 raft_consensus.cc:2243] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.641969 27446 raft_consensus.cc:2272] T 52e0d44a1cde4f32b60dd0ed014922ec P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.656379 27446 tablet_replica.cc:333] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.657245 27446 raft_consensus.cc:2243] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.657956 27446 raft_consensus.cc:2272] T ac62777e94e1417c867cb2ac80a55824 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.674491 27446 tablet_replica.cc:333] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.675482 27446 raft_consensus.cc:2243] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.676235 27446 raft_consensus.cc:2272] T ecc67b62cf604852ae673df459d4ce67 P a8342e3fcab94ce89482df67988159ea [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.679500 27446 tablet_replica.cc:333] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.681504 27446 raft_consensus.cc:2243] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.682229 27446 raft_consensus.cc:2272] T ae666b5b049a49c0bd0b0969e6b2b154 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.685242 27446 tablet_replica.cc:333] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.686069 27446 raft_consensus.cc:2243] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.687398 27446 raft_consensus.cc:2272] T b5e3c15999a1401a85e85110ac625d58 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:37.699913 28722 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:37.701169 27446 tablet_replica.cc:333] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.702145 27446 raft_consensus.cc:2243] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.702904 27446 raft_consensus.cc:2272] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a8342e3fcab94ce89482df67988159ea [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.705921 27446 tablet_replica.cc:333] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.706779 27446 raft_consensus.cc:2243] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.710415 27446 raft_consensus.cc:2272] T c60bef772ef04194a01b6f8f5423dd5f P a8342e3fcab94ce89482df67988159ea [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.726734 27446 tablet_replica.cc:333] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.727648 27446 raft_consensus.cc:2243] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.728338 27446 raft_consensus.cc:2272] T a7f9c29f436b4c6bbfb909b71ca1d309 P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.738771 27446 tablet_replica.cc:333] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.739997 27446 raft_consensus.cc:2243] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.741286 27446 raft_consensus.cc:2272] T f2c936ab911d48fba6cc944d81f99fb1 P a8342e3fcab94ce89482df67988159ea [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.750293 27446 tablet_replica.cc:333] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.751075 27446 raft_consensus.cc:2243] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.752569 27446 raft_consensus.cc:2272] T 3e1813ffb1124b0d8e8500ca59a1550f P a8342e3fcab94ce89482df67988159ea [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.755448 27446 tablet_replica.cc:333] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.756289 27446 raft_consensus.cc:2243] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.757165 27446 raft_consensus.cc:2272] T 78db6dee59ca445c95d367900be0ef94 P a8342e3fcab94ce89482df67988159ea [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.759897 27446 tablet_replica.cc:333] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.760712 27446 raft_consensus.cc:2243] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.761987 27446 raft_consensus.cc:2272] T c4d3afd7078b475e884e52f098a3b5cd P a8342e3fcab94ce89482df67988159ea [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.768162 27446 tablet_replica.cc:333] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.768899 27446 raft_consensus.cc:2243] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.769677 27446 raft_consensus.cc:2272] T 2e9b05092c214663bd1a274ae3358eb4 P a8342e3fcab94ce89482df67988159ea [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.774457 27446 tablet_replica.cc:333] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.777791 27446 raft_consensus.cc:2243] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.781814 27446 raft_consensus.cc:2272] T bb3409e46c8446f79a337919b428c7ac P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.795519 27446 tablet_replica.cc:333] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.796341 27446 raft_consensus.cc:2243] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:37.797556 27446 raft_consensus.cc:2272] T 663f0169fb984cfe963338bade0eabbb P a8342e3fcab94ce89482df67988159ea [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:37.800768 27446 tablet_replica.cc:333] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea: stopping tablet replica
I20260709 12:21:37.801492 27446 raft_consensus.cc:2243] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:37.802376 27446 raft_consensus.cc:2272] T 1d4b956d8e604e81b411a6c4ce1681ad P a8342e3fcab94ce89482df67988159ea [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:38.034684 28647 connection.cc:466] server connection from 127.0.0.1:34884 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34884 (request call id 3966) could send its response
W20260709 12:21:38.106632 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cb599a2fb1704106b47a69be90b821d0: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.285508  5178 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.286113  5178 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.288396  5178 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:38.292690 28720 leader_election.cc:336] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.293749 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:38.295548 28721 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:38.296833  5164 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.297318  5164 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:38.299453  5164 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:38.299926  5164 raft_consensus.cc:2749] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:21:38.308301 28720 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:38.310139 28722 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.310559 28722 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:38.311542  5172 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:38.352291  5172 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.352857  5172 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.355289  5172 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:38.356591 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
W20260709 12:21:38.360301 28720 leader_election.cc:336] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.360742 28720 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 5b3b2f4041a24b05983f30878f16db9d, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:38.361510  5172 raft_consensus.cc:2749] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:38.384941 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:38.546451  5169 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.546980  5169 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.548924  5169 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:38.559963 29290 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:38.561631 29292 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.562049 29292 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:38.563581  5124 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:38.568377  5169 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.568933  5169 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.571653  5169 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:38.575557  5124 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.576588 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:38.576809  5124 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.579351  5124 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:38.581586  5164 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.583320  5164 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:38.585225  5164 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:38.582204 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
W20260709 12:21:38.593950 28720 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:38.595484 29290 leader_election.cc:336] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.595966 29290 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:38.597386 28722 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:38.598599 28722 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.599920 28722 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:38.601356 29292 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.601478  5172 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:38.598057  5124 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:21:38.602177 29292 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:38.621279 29290 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.623901  5183 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:21:38.653972 28722 consensus_peers.cc:597] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:21:38.687086  5183 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.687995  5183 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.689139  5124 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.689705  5124 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.690692  5183 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:38.691694  5124 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:38.689294  5169 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.692620  5169 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.694437  5169 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:38.695102 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:38.695693 28756 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
W20260709 12:21:38.705008 29292 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.708345  5169 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.708581 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:38.708868  5169 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.710851  5169 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:38.711320  5169 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:21:38.711447 29290 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.712076 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:38.716202  5124 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:38.716424 29290 leader_election.cc:336] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:38.717446 29290 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.711627  5169 raft_consensus.cc:493] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.720500  5169 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:21:38.724625 29292 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.725159 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:38.725901  5124 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:38.732337 29292 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.737721  5169 raft_consensus.cc:515] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.739809  5169 leader_election.cc:290] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:38.741497 29290 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.742012 29290 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:38.743736 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf259cdc3c4cdfb64950de8d1adb98" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:38.744350 28756 raft_consensus.cc:3060] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:21:38.745030  5183 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:21:38.751648 28756 raft_consensus.cc:2468] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 22.
I20260709 12:21:38.753863 29292 leader_election.cc:304] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
W20260709 12:21:38.754870 29290 leader_election.cc:336] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.755774  5124 raft_consensus.cc:2804] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:21:38.756325  5124 raft_consensus.cc:697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
W20260709 12:21:38.756894 28536 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 12:21:38.757104  5124 consensus_queue.cc:237] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.765758  5183 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.766383  5183 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.768597  5183 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:38.819582 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:38.821532 28756 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 20.
I20260709 12:21:38.823863  5186 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.824994  5186 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.831530  5186 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:38.837529 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:38.838726 29322 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 17.
I20260709 12:21:38.845721 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:38.847339  5186 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:21:38.847752  5186 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.848196  5186 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:21:38.856679 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:38.859732  5124 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:21:38.860136  5124 raft_consensus.cc:493] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Starting leader election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.860494  5124 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:38.861172  5186 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.863462  5186 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
I20260709 12:21:38.863607 28497 catalog_manager.cc:5697] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 21 to 22, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 22 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.868654 29321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aacf3b2dee3345268f9d3c9b6a1e4779" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d"
I20260709 12:21:38.869496 29321 raft_consensus.cc:3060] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:21:38.870205 28722 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:38.872105  5169 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.873083  5169 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.877131  5169 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:38.877530 29290 leader_election.cc:336] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:38.895434 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:38.897064  5124 raft_consensus.cc:515] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:38.896855 29290 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.903359  5188 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.904071  5188 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:38.908116  5188 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:38.904049 29292 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.908721 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:38.909641  5183 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:38.909978  5188 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.910825  5188 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:38.913094 28722 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.913614  5188 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:38.921504  5124 leader_election.cc:290] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Requested vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:38.924507 29321 raft_consensus.cc:2468] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 18.
I20260709 12:21:38.925709  5169 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:38.926800  5169 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.931319 28721 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: 
I20260709 12:21:38.937126  5186 raft_consensus.cc:2804] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:21:38.937788  5186 raft_consensus.cc:697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Becoming Leader. State: Replica: a7ec63b6634944d0b5b5ea92fa2d303e, State: Running, Role: LEADER
I20260709 12:21:38.939365  5186 consensus_queue.cc:237] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:38.947008 29290 leader_election.cc:336] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:38.947557 28720 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111) [suppressed 516 similar messages]
W20260709 12:21:38.950771 28722 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:38.951683  5169 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:38.963709 28720 leader_election.cc:336] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:38.965209 28720 leader_election.cc:336] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.968618  5188 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:38.970177 29290 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:38.973663 29292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:44843, user_credentials={real_user=slave}} blocked reactor thread for 62608.9us
I20260709 12:21:38.980680 28756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30c9fa2ab7fb487da44a0d6de40286ff" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e"
I20260709 12:21:38.981331 28756 raft_consensus.cc:3060] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:21:38.969511  5188 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:38.984781  5188 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:38.987589 28720 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:38.988029 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:38.989138 29322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:38.990226 29322 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:21:38.994206  5164 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:21:38.997679 28722 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:39.003587 28756 raft_consensus.cc:2468] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 21.
I20260709 12:21:39.016738 29292 leader_election.cc:304] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea
I20260709 12:21:39.017613  5183 raft_consensus.cc:2804] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:21:39.018211  5183 raft_consensus.cc:697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Becoming Leader. State: Replica: 5b3b2f4041a24b05983f30878f16db9d, State: Running, Role: LEADER
I20260709 12:21:39.018128 28496 catalog_manager.cc:5697] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e reported cstate change: term changed from 17 to 18, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131). New cstate: current_term: 18 leader_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.019673  5183 consensus_queue.cc:237] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:39.025022 28720 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:39.025539 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:39.027767  5164 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:21:39.031376  5191 log.cc:927] Time spent T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:21:39.045218 29292 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:39.045969 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:39.049814 27446 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28703)
W20260709 12:21:39.057441 28722 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.059778 28720 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:39.060282 28720 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:39.061127  5190 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:39.064402  5164 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:39.088325  5169 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
W20260709 12:21:39.089237 28722 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:21:39.089138  5169 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:39.091472  5169 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:39.097270 29290 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:39.107923 28722 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.111613 29292 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:39.113211 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:39.114449  5183 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:39.123709 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:39.129881 28496 catalog_manager.cc:5697] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d reported cstate change: term changed from 20 to 21, leader changed from a8342e3fcab94ce89482df67988159ea (127.26.205.130) to 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132). New cstate: current_term: 21 leader_uuid: "5b3b2f4041a24b05983f30878f16db9d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.137706  5169 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:39.138507  5169 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:39.140586  5169 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:39.144671 29292 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:39.146773 29290 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:39.147379 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:39.149085  5183 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:39.165036 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.166196 29290 consensus_peers.cc:597] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.211923  5178 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:39.213868  5178 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:39.225389 28720 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:39.233855  5178 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:39.234820 28722 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.235437 28722 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:39.235925 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:39.237248  5178 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:39.280700 28756 raft_consensus.cc:1275] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:21:39.282450  5183 consensus_queue.cc:1048] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:21:39.287686 28722 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:39.306794 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.330381 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.352993 28722 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.399341 28722 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:39.418205 28722 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.424621 28720 consensus_peers.cc:597] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:39.433894 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.476130 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.497961 29290 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:39.504364 28748 raft_consensus.cc:1275] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Refusing update from remote peer 5b3b2f4041a24b05983f30878f16db9d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:21:39.506404  5169 consensus_queue.cc:1048] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:21:39.524148 28720 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.515565 28722 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.545655 29290 consensus_peers.cc:597] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.558686 29290 consensus_peers.cc:597] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.575023 29322 raft_consensus.cc:1275] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Refusing update from remote peer a7ec63b6634944d0b5b5ea92fa2d303e: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:21:39.578051  5186 consensus_queue.cc:1048] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:21:39.588752 28720 consensus_peers.cc:597] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.595355 28722 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.595875 28722 consensus_peers.cc:597] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:39.601339 28720 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.656807 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:39.666822 28722 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:39.692582 28720 consensus_peers.cc:597] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.705859 28720 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.720904 28720 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.728329 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:39.737171 29290 consensus_peers.cc:597] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.816402 29290 consensus_peers.cc:597] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.825091 28720 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.825702 28720 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.853173 29290 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.857024 28720 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.865513 29290 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.884101 28720 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.894146 29290 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.910005 29290 consensus_peers.cc:597] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:39.995934 28722 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:40.011463 28722 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:40.050580 27446 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 28703)
W20260709 12:21:40.051793 29290 consensus_peers.cc:597] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:40.060492 28720 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:40.074828 28720 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:40.089435 28722 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:40.131563 28720 consensus_peers.cc:597] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:40.136667 28720 consensus_peers.cc:597] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:40.148573 29290 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:40.149276  5186 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.163971  5186 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:40.172596 29290 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:40.170902  5186 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:40.223591 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3be2bcd2a3b04c82bbf14413a7011c12: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:40.225519 28722 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:40.229761 28722 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:40.255700 28722 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:40.358498 29290 consensus_peers.cc:597] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:40.362532  5186 raft_consensus.cc:493] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.363281  5186 raft_consensus.cc:515] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:40.366549  5186 leader_election.cc:290] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:40.373587  5190 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.374366  5190 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:40.378687  5190 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:40.396719 29292 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:40.406418 28722 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:40.418144 29290 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:40.418779 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:40.419631  5183 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:40.517360  5183 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.517978  5183 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:40.519996  5183 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:40.543553 29292 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:40.554167 29290 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:40.556887 29290 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:40.565677  5190 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:40.586423  5164 raft_consensus.cc:493] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.586975  5164 raft_consensus.cc:515] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:40.589301  5164 leader_election.cc:290] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:40.594340  5183 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.595073  5183 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:40.597391  5183 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:40.611577  5183 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.612210  5183 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:40.614866  5183 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:40.630477 29290 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:40.632472 29292 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:40.637820 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:40.638736  5183 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:21:40.641665 29290 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:40.645150 28722 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:40.648272 29292 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:40.648865 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:40.649721  5183 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:40.729176  5183 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.730005  5183 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:40.778199 29292 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:40.783962  5183 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:40.792742 28748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "5b3b2f4041a24b05983f30878f16db9d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" is_pre_election: true
I20260709 12:21:40.793790 28748 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b3b2f4041a24b05983f30878f16db9d in term 25.
W20260709 12:21:40.852587 29290 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:40.853073 29290 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:40.859921  5207 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:40.873777  5206 raft_consensus.cc:493] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.874769  5206 raft_consensus.cc:515] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
W20260709 12:21:40.884984 28722 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:40.889499  5207 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:40.890139  5207 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:40.896553  5206 leader_election.cc:290] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:40.892460  5207 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:40.910233 29292 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:40.913862 29290 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:40.914368 29290 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:40.916015  5207 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:41.051056 27446 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 28703)
I20260709 12:21:41.055080  5208 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:41.055776  5208 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:41.059502  5208 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:41.070051  5208 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:41.070901  5208 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:41.079550  5208 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:41.126648 29292 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:41.135636 29292 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:41.142639 29290 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:41.157016 29290 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:41.167408  5208 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:41.176481 29290 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:41.182052 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:41.188657  5207 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:41.217248 28720 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:41.217988 28720 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:41.219298 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:41.226146  5178 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:41.228256 28722 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:41.228865  5207 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:41.235061  5207 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:41.240939  5207 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:41.243892 28722 consensus_peers.cc:597] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:21:41.230679 28720 leader_election.cc:336] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:41.245704 28720 leader_election.cc:304] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:41.266598  5206 raft_consensus.cc:2749] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:21:41.268041 28720 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:41.280226 28720 leader_election.cc:336] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:41.283732 28720 leader_election.cc:304] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:41.289944 28722 consensus_peers.cc:597] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.283232 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:41.290571  5206 raft_consensus.cc:2749] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:21:41.291685 28720 leader_election.cc:336] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:41.296625 28720 leader_election.cc:304] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:41.287336 29290 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:41.301276 29292 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:41.301854  5206 raft_consensus.cc:2749] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:21:41.309504 29292 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:41.327011  5208 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:41.449808  5186 raft_consensus.cc:493] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:41.450639  5186 raft_consensus.cc:515] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:41.456357  5186 leader_election.cc:290] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:41.506625 28722 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:41.514912 28720 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:41.558990 28720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 44108.7us
W20260709 12:21:41.559556 28722 leader_election.cc:336] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:41.563977 28722 leader_election.cc:304] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:41.572422  5164 raft_consensus.cc:2749] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:21:41.578841 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.636353 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.715826 29290 consensus_peers.cc:597] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:41.714859 28722 consensus_peers.cc:597] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.729267 28722 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.731911 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 05ef99f51b5a4b959e982c258f2aafcc: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:41.734217 28722 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:41.764444 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.823292 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.866582 28722 consensus_peers.cc:597] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.870087 28722 consensus_peers.cc:597] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.890106 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.903548 28722 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:41.923820 28722 consensus_peers.cc:597] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:41.942581 28722 consensus_peers.cc:597] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:42.051663 27446 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 28703)
I20260709 12:21:42.534788  5213 raft_consensus.cc:493] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:42.545707  5213 raft_consensus.cc:515] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:42.541679 29290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:42113, user_credentials={real_user=slave}} blocked reactor thread for 567932us
I20260709 12:21:42.550158  5213 leader_election.cc:290] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:42.588706  5221 raft_consensus.cc:493] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:42.593608  5221 raft_consensus.cc:515] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:42.604714  5221 leader_election.cc:290] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:42.614802 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:42.615741 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:42.616616 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:42.616813  5223 raft_consensus.cc:493] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:42.617419  5223 raft_consensus.cc:515] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:42.620129  5223 leader_election.cc:290] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:42.622254 29290 consensus_peers.cc:597] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.622751 29290 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:42.627637 29292 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:42.628553 28722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:36607, user_credentials={real_user=slave}} blocked reactor thread for 84461.2us
W20260709 12:21:42.632546 29290 consensus_peers.cc:597] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.637650 29290 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.641076 29290 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.643581 29292 leader_election.cc:336] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:42.644136 29292 leader_election.cc:304] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:42.645409  5223 raft_consensus.cc:2749] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:21:42.648296 28722 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:42.648974 28722 consensus_peers.cc:597] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:42.649528 28722 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:21:42.650429 29290 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:42.651103 29290 consensus_peers.cc:597] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:42.651206 29292 leader_election.cc:336] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:42.651563 29290 leader_election.cc:336] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:42.651813 29292 leader_election.cc:304] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:42.652074 29290 leader_election.cc:304] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:42.652706  5223 raft_consensus.cc:2749] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:42.652992  5231 raft_consensus.cc:2749] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:42.654357 29290 consensus_peers.cc:597] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.654850 29290 consensus_peers.cc:597] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.657123 28722 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:42.659247 28720 consensus_peers.cc:597] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.660542 28720 consensus_peers.cc:597] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.683540 28720 consensus_peers.cc:597] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.697755 28720 consensus_peers.cc:597] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:42.781711  5219 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:42.782444  5219 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:42.793788 28720 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:42.796626 29318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e599bf217cb043a7957d025cd753fea4" candidate_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "5b3b2f4041a24b05983f30878f16db9d" is_pre_election: true
I20260709 12:21:42.797390 29318 raft_consensus.cc:2468] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7ec63b6634944d0b5b5ea92fa2d303e in term 25.
I20260709 12:21:42.799026  5219 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), 5b3b2f4041a24b05983f30878f16db9d (127.26.205.132:46291)
W20260709 12:21:42.812390 28722 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:42.813000 28722 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d, a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:42.813867  5219 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:21:42.818472 28722 consensus_peers.cc:597] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:42.833389 28720 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.922180 28720 consensus_peers.cc:597] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:42.947602  5223 raft_consensus.cc:493] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:42.948210  5223 raft_consensus.cc:515] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:42.950555  5223 leader_election.cc:290] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:42.955994 29290 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:42.957892 29292 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:42.961061 29290 leader_election.cc:336] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:42.961597 29290 leader_election.cc:304] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
W20260709 12:21:42.963131 28722 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:21:42.963657  5231 raft_consensus.cc:2749] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:21:42.968664 28722 consensus_peers.cc:597] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:42.972515 29290 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:43.002789  5231 raft_consensus.cc:493] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:43.003472  5231 raft_consensus.cc:515] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:43.006199  5231 leader_election.cc:290] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:43.014120 29290 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.021739 29292 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:43.023056 29290 leader_election.cc:336] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:43.023608 29290 leader_election.cc:304] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:43.025456  5223 raft_consensus.cc:2749] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:43.040923 28720 consensus_peers.cc:597] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.048255 29290 consensus_peers.cc:597] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.048960 29290 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.052340 27446 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 28703)
I20260709 12:21:43.094002  5231 raft_consensus.cc:493] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:43.094722  5231 raft_consensus.cc:515] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:43.097723  5231 leader_election.cc:290] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:43.097718 28720 consensus_peers.cc:597] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.112892 29290 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:43.117383 29292 leader_election.cc:336] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:43.117894 29292 leader_election.cc:304] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:43.118613  5231 raft_consensus.cc:2749] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:43.129278 29290 consensus_peers.cc:597] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.129276 28722 consensus_peers.cc:597] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:43.159443 28722 consensus_peers.cc:597] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:21:43.161019 28720 consensus_peers.cc:597] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.171933 28720 consensus_peers.cc:597] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.180600 28720 consensus_peers.cc:597] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:43.332284 28720 consensus_peers.cc:597] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.349606 28720 consensus_peers.cc:597] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.460685 28720 consensus_peers.cc:597] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:43.478349 27446 tablet_server.cc:196] TabletServer@127.26.205.130:0 shutdown complete.
W20260709 12:21:43.550662 28720 consensus_peers.cc:597] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.558380 29348 debug-util.cc:398] Leaking SignalData structure 0x7b08003da740 after lost signal to thread 27449
W20260709 12:21:43.559738 29348 debug-util.cc:398] Leaking SignalData structure 0x7b08003d52e0 after lost signal to thread 28539
W20260709 12:21:43.561327 29348 debug-util.cc:398] Leaking SignalData structure 0x7b080019e880 after lost signal to thread 28780
W20260709 12:21:43.562758 29348 debug-util.cc:398] Leaking SignalData structure 0x7b08003769e0 after lost signal to thread 29351
I20260709 12:21:43.578866  5206 raft_consensus.cc:493] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:43.579461  5206 raft_consensus.cc:515] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } }
I20260709 12:21:43.581627  5206 leader_election.cc:290] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:43.597963 28720 consensus_peers.cc:597] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:43.600920 28722 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:43.608269 28720 leader_election.cc:336] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:43.608889 28720 leader_election.cc:304] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7ec63b6634944d0b5b5ea92fa2d303e; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:43.609784  5218 raft_consensus.cc:2749] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:43.689076 27446 tablet_server.cc:179] TabletServer@127.26.205.131:0 shutting down...
I20260709 12:21:43.700176  5221 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:43.700843  5221 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:43.707794 29292 consensus_peers.cc:597] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:43.710474 29290 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:43.720536  5221 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:43.721594 29292 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:43.722149 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:43.725203  5221 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:43.775172 29292 consensus_peers.cc:597] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.777321 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:43.778432 27446 tablet_replica.cc:333] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.779361 27446 raft_consensus.cc:2243] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.780369 27446 raft_consensus.cc:2272] T 683aa452755144abbbeaff5aa710e8ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.784493 27446 tablet_replica.cc:333] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.785501 27446 raft_consensus.cc:2243] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.787070 27446 raft_consensus.cc:2272] T 6828c27180d54395aa62e49037e09909 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.790043 27446 tablet_replica.cc:333] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.792109 27446 raft_consensus.cc:2243] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.793316 27446 raft_consensus.cc:2272] T 8ea376f5c1af47d79a1871ab80a23cdb P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.796613 27446 tablet_replica.cc:333] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.797500 27446 raft_consensus.cc:2243] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.798516 27446 raft_consensus.cc:2272] T 3be2bcd2a3b04c82bbf14413a7011c12 P a7ec63b6634944d0b5b5ea92fa2d303e [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.801380 27446 tablet_replica.cc:333] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
W20260709 12:21:43.802060 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.802289 27446 raft_consensus.cc:2243] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.803586 27446 raft_consensus.cc:2272] T e5bdaade8df945828ab371a3267cd752 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.805959 27446 tablet_replica.cc:333] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.806619 27446 raft_consensus.cc:2243] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.807554 27446 raft_consensus.cc:2272] T cb599a2fb1704106b47a69be90b821d0 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.809649 27446 tablet_replica.cc:333] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.810314 27446 raft_consensus.cc:2243] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.811600 27446 raft_consensus.cc:2272] T 4bc886982591478e97f84ddb724a679a P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.814471 27446 tablet_replica.cc:333] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.815304 27446 raft_consensus.cc:2243] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.816000 27446 raft_consensus.cc:2272] T 3a420de289b844729c03c9625dd9e63c P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.818544 27446 tablet_replica.cc:333] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.819161 27446 raft_consensus.cc:2243] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.819641 27446 raft_consensus.cc:2272] T ff1532cf86464920afb02490b110f356 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.821764 27446 tablet_replica.cc:333] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.822422 27446 raft_consensus.cc:2243] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.823312 27446 raft_consensus.cc:2272] T aacf3b2dee3345268f9d3c9b6a1e4779 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.825258 27446 tablet_replica.cc:333] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.825944 27446 raft_consensus.cc:2243] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.826508 27446 raft_consensus.cc:2272] T ecb84065af5c41b0aaee71485ad69560 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.828540 27446 tablet_replica.cc:333] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.829238 27446 raft_consensus.cc:2243] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.830158 27446 raft_consensus.cc:2272] T a5dc72678108404787b2aa034d4a7243 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.832499 27446 tablet_replica.cc:333] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.833221 27446 raft_consensus.cc:2243] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.833832 27446 raft_consensus.cc:2272] T d2cf259cdc3c4cdfb64950de8d1adb98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.836412 27446 tablet_replica.cc:333] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.837246 27446 raft_consensus.cc:2243] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.837800 27446 raft_consensus.cc:2272] T 30c9fa2ab7fb487da44a0d6de40286ff P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.840504 27446 tablet_replica.cc:333] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.841274 27446 raft_consensus.cc:2243] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.842008 27446 raft_consensus.cc:2272] T 302623a332a2421e848283481e8010f6 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.844751 27446 tablet_replica.cc:333] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.845796 27446 raft_consensus.cc:2243] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.847091 27446 raft_consensus.cc:2272] T 2e9f78bead97491ebb7f049af3cf869c P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:43.847857 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.850124 27446 tablet_replica.cc:333] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
W20260709 12:21:43.850343 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.851044 27446 raft_consensus.cc:2243] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.852150 27446 raft_consensus.cc:2272] T 2e9b05092c214663bd1a274ae3358eb4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.854709 27446 tablet_replica.cc:333] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.855722 27446 raft_consensus.cc:2243] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.857206 27446 raft_consensus.cc:2272] T bb3409e46c8446f79a337919b428c7ac P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.860008 27446 tablet_replica.cc:333] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.860821 27446 raft_consensus.cc:2243] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.862161 27446 raft_consensus.cc:2272] T 1548a806b02a4f79b5010615f560d2bb P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.865049 27446 tablet_replica.cc:333] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.865799 27446 raft_consensus.cc:2243] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.866992 27446 raft_consensus.cc:2272] T a7f9c29f436b4c6bbfb909b71ca1d309 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.869928 27446 tablet_replica.cc:333] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.870707 27446 raft_consensus.cc:2243] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.871814 27446 raft_consensus.cc:2272] T cdf685c3207841c286a253af2d105972 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.874832 27446 tablet_replica.cc:333] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.875712 27446 raft_consensus.cc:2243] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.876698 27446 raft_consensus.cc:2272] T f6ca073d2ba7428e8ef693a68c16429b P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.879503 27446 tablet_replica.cc:333] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.880301 27446 raft_consensus.cc:2243] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.881057 27446 raft_consensus.cc:2272] T 05ef99f51b5a4b959e982c258f2aafcc P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.883810 27446 tablet_replica.cc:333] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.884613 27446 raft_consensus.cc:2243] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.885684 27446 raft_consensus.cc:2272] T 01095df8e33a4e11bc9089bc7a5cdd37 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.887928 27446 tablet_replica.cc:333] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.888605 27446 raft_consensus.cc:2243] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.889634 27446 raft_consensus.cc:2272] T 71e53cc7795245709057efe9ca977661 P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.893172 27446 tablet_replica.cc:333] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.893937 27446 raft_consensus.cc:2243] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.894737 27446 raft_consensus.cc:2272] T 3f5c0f8a4f2a47d5bfb86a593b95a1cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.897393 27446 tablet_replica.cc:333] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.898200 27446 raft_consensus.cc:2243] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:21:43.898756 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.899420 27446 raft_consensus.cc:2272] T 8cace92f719b413eb21f6a0ae2d7d707 P a7ec63b6634944d0b5b5ea92fa2d303e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.902294 27446 tablet_replica.cc:333] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.903085 27446 raft_consensus.cc:2243] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.904284 27446 raft_consensus.cc:2272] T 243df7b9197c40219914bcac6111faca P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.906958 27446 tablet_replica.cc:333] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.907778 27446 raft_consensus.cc:2243] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.908506 27446 raft_consensus.cc:2272] T 4fe68878605a4b8ab3302650b63aae98 P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.911127 27446 tablet_replica.cc:333] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.911922 27446 raft_consensus.cc:2243] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.912667 27446 raft_consensus.cc:2272] T ac62777e94e1417c867cb2ac80a55824 P a7ec63b6634944d0b5b5ea92fa2d303e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.915577 27446 tablet_replica.cc:333] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.916386 27446 raft_consensus.cc:2243] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.917114 27446 raft_consensus.cc:2272] T c5898a5306cc40cb9c97dff5f6ab3cd8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.919633 27446 tablet_replica.cc:333] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.920516 27446 raft_consensus.cc:2243] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.921674 27446 raft_consensus.cc:2272] T 1aa4d3cf35bc44b2b334697ab60648ca P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.924228 27446 tablet_replica.cc:333] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.924999 27446 raft_consensus.cc:2243] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.926222 27446 raft_consensus.cc:2272] T 52e0d44a1cde4f32b60dd0ed014922ec P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.928550 27446 tablet_replica.cc:333] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.929117 27446 raft_consensus.cc:2243] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.930231 27446 raft_consensus.cc:2272] T e599bf217cb043a7957d025cd753fea4 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.932766 27446 tablet_replica.cc:333] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.933498 27446 raft_consensus.cc:2243] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.934249 27446 raft_consensus.cc:2272] T 3e1813ffb1124b0d8e8500ca59a1550f P a7ec63b6634944d0b5b5ea92fa2d303e [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.937089 27446 tablet_replica.cc:333] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.937844 27446 raft_consensus.cc:2243] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.939792 27446 raft_consensus.cc:2272] T 78db6dee59ca445c95d367900be0ef94 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.942065 27446 tablet_replica.cc:333] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.942710 27446 raft_consensus.cc:2243] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.943378 27446 raft_consensus.cc:2272] T c4d3afd7078b475e884e52f098a3b5cd P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.945573 27446 tablet_replica.cc:333] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.946085 27446 raft_consensus.cc:2243] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.947095 27446 raft_consensus.cc:2272] T 1632d712fbcd489da9624b1f43ff7f96 P a7ec63b6634944d0b5b5ea92fa2d303e [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.949096 27446 tablet_replica.cc:333] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.949640 27446 raft_consensus.cc:2243] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.950827 27446 raft_consensus.cc:2272] T 4fa8c90dea5b494e9adb22b30b41b45c P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.953542 27446 tablet_replica.cc:333] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
W20260709 12:21:43.953642 29290 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111) [suppressed 616 similar messages]
I20260709 12:21:43.954285 27446 raft_consensus.cc:2243] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.954977 27446 raft_consensus.cc:2272] T 14b09750d07a41f39c2913b5d03c6994 P a7ec63b6634944d0b5b5ea92fa2d303e [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.957866 27446 tablet_replica.cc:333] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.958567 27446 raft_consensus.cc:2243] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.959836 27446 raft_consensus.cc:2272] T ecc67b62cf604852ae673df459d4ce67 P a7ec63b6634944d0b5b5ea92fa2d303e [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.962469 27446 tablet_replica.cc:333] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.963143 27446 raft_consensus.cc:2243] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.963738 27446 raft_consensus.cc:2272] T a975dd4c5a744a1d98c05841000796f8 P a7ec63b6634944d0b5b5ea92fa2d303e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.966317 27446 tablet_replica.cc:333] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.967026 27446 raft_consensus.cc:2243] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.967983 27446 raft_consensus.cc:2272] T ae666b5b049a49c0bd0b0969e6b2b154 P a7ec63b6634944d0b5b5ea92fa2d303e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.970597 27446 tablet_replica.cc:333] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.971266 27446 raft_consensus.cc:2243] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:43.971822 27446 raft_consensus.cc:2272] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P a7ec63b6634944d0b5b5ea92fa2d303e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.974535 27446 tablet_replica.cc:333] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.975136 27446 raft_consensus.cc:2243] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.976269 27446 raft_consensus.cc:2272] T b35b6c6fffe3416bb8f69b556040e319 P a7ec63b6634944d0b5b5ea92fa2d303e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:43.978852 27446 tablet_replica.cc:333] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e: stopping tablet replica
I20260709 12:21:43.979457 27446 raft_consensus.cc:2243] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:21:43.980638 27446 raft_consensus.cc:2272] T 1d4b956d8e604e81b411a6c4ce1681ad P a7ec63b6634944d0b5b5ea92fa2d303e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:44.001535 29292 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:44.005972 29292 consensus_peers.cc:597] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:44.063990 29292 consensus_peers.cc:597] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:44.072192 29292 consensus_peers.cc:597] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:44.106693 29292 consensus_peers.cc:597] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:44.117304 29292 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:44.123728 29292 consensus_peers.cc:597] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:44.174901 29292 consensus_peers.cc:597] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d -> Peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Couldn't send request to peer a7ec63b6634944d0b5b5ea92fa2d303e. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:44.275945  5231 raft_consensus.cc:493] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:44.276582  5231 raft_consensus.cc:515] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:44.278959  5231 leader_election.cc:290] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
W20260709 12:21:44.284296 29290 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:44.290449 29292 leader_election.cc:336] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:44.290885 29292 leader_election.cc:304] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:44.301311  5237 raft_consensus.cc:2749] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:44.345649 29292 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:44.455744 29292 consensus_peers.cc:597] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:44.657359 29290 consensus_peers.cc:597] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:44.699965 29292 consensus_peers.cc:597] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:44.770987 29292 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:21:44.799379 29292 consensus_peers.cc:597] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:44.877900  5237 raft_consensus.cc:493] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:44.878477  5237 raft_consensus.cc:515] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:44.880663  5237 leader_election.cc:290] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:44.889993 29292 consensus_peers.cc:597] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:44.894378  5236 raft_consensus.cc:493] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:44.898092  5236 raft_consensus.cc:515] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:44.897233 29290 consensus_peers.cc:597] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:44.901278  5236 leader_election.cc:290] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:44.908093 29290 consensus_peers.cc:597] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:44.917487 29292 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
W20260709 12:21:44.919955 29292 leader_election.cc:336] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:44.920498 29292 leader_election.cc:304] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:44.921526  5237 raft_consensus.cc:2749] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:44.928115 29292 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
W20260709 12:21:44.928965 29292 leader_election.cc:336] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:44.929405 29292 leader_election.cc:304] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:44.930198  5237 raft_consensus.cc:2749] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:21:44.942373  5237 raft_consensus.cc:493] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:44.942935  5237 raft_consensus.cc:515] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:44.952610 29290 leader_election.cc:336] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:44.953902  5237 leader_election.cc:290] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:44.956869  5237 raft_consensus.cc:493] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:44.957576  5237 raft_consensus.cc:515] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:44.959524  5236 raft_consensus.cc:493] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:44.960107  5236 raft_consensus.cc:515] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:44.962287  5236 leader_election.cc:290] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:44.963425  5237 leader_election.cc:290] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:44.980314 29292 leader_election.cc:336] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:44.980922 29292 leader_election.cc:304] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:44.981724  5237 raft_consensus.cc:2749] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:44.989167 29292 leader_election.cc:336] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:44.989825 29292 leader_election.cc:336] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:44.990485 29292 leader_election.cc:336] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:44.990911 29292 leader_election.cc:304] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:44.991734  5237 raft_consensus.cc:2749] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:44.992929 29292 leader_election.cc:336] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:44.993448 29292 leader_election.cc:304] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:44.994287  5237 raft_consensus.cc:2749] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:45.004215  5237 raft_consensus.cc:493] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.004832  5237 raft_consensus.cc:515] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.007128  5237 leader_election.cc:290] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:45.027585  5236 raft_consensus.cc:493] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.028160  5236 raft_consensus.cc:515] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.030390  5236 leader_election.cc:290] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:45.039173 29290 leader_election.cc:336] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:45.043365 29292 leader_election.cc:336] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:45.046726 29292 leader_election.cc:336] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.047281 29292 leader_election.cc:304] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:45.048535  5237 raft_consensus.cc:2749] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:21:45.051924 29292 leader_election.cc:336] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.053642 29292 leader_election.cc:304] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:45.054435  5237 raft_consensus.cc:2749] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:45.057667  5237 raft_consensus.cc:493] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.058189  5237 raft_consensus.cc:515] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.064103  5237 leader_election.cc:290] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:45.070302 29290 leader_election.cc:336] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:45.071538  5237 raft_consensus.cc:493] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.072178  5237 raft_consensus.cc:515] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.074594  5237 leader_election.cc:290] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:45.080212 29290 leader_election.cc:336] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:45.089640 29292 consensus_peers.cc:597] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:21:45.090389  5237 raft_consensus.cc:493] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.091143  5237 raft_consensus.cc:515] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.093617  5235 raft_consensus.cc:493] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.094343  5235 raft_consensus.cc:515] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } attrs { replace: true } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.097419  5236 raft_consensus.cc:493] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.098044  5236 raft_consensus.cc:515] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.100272  5236 leader_election.cc:290] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:45.101547  5235 leader_election.cc:290] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:45.107782 29290 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:45.109092  5237 leader_election.cc:290] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:45.113673  5237 raft_consensus.cc:493] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.114296  5237 raft_consensus.cc:515] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.116914  5237 leader_election.cc:290] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:45.123126 29292 leader_election.cc:336] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.123849 29292 leader_election.cc:304] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:45.124850  5237 raft_consensus.cc:2749] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:21:45.135247 29290 consensus_peers.cc:597] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:45.136565 29292 leader_election.cc:336] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.137188 29292 leader_election.cc:304] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:45.138065  5237 raft_consensus.cc:2749] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:21:45.149215  5237 raft_consensus.cc:493] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.149844  5237 raft_consensus.cc:515] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:45.159442 29290 leader_election.cc:336] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:45.165709  5237 leader_election.cc:290] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:45.170166 29292 leader_election.cc:336] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
W20260709 12:21:45.170778 29292 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.171197 29292 leader_election.cc:304] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
W20260709 12:21:45.171914 29292 leader_election.cc:336] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.176369  5235 raft_consensus.cc:2749] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:45.184628 29292 leader_election.cc:336] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:45.185436 29290 consensus_peers.cc:597] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:45.191236 29290 consensus_peers.cc:597] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:45.185767 29292 leader_election.cc:336] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:45.196637 29292 leader_election.cc:304] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:45.197396  5237 raft_consensus.cc:2749] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:45.197615 29292 leader_election.cc:336] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:45.198071 29292 leader_election.cc:304] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:45.198733  5237 raft_consensus.cc:2749] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:45.198952 29292 leader_election.cc:336] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:45.202378 29292 leader_election.cc:336] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.202768 29292 leader_election.cc:304] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:45.203619  5235 raft_consensus.cc:2749] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:21:45.203855 29292 leader_election.cc:336] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.204278 29292 leader_election.cc:304] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:45.205116  5235 raft_consensus.cc:2749] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:21:45.230438 27446 tablet_server.cc:196] TabletServer@127.26.205.131:0 shutdown complete.
W20260709 12:21:45.265209 29290 consensus_peers.cc:597] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:21:45.267900 29292 consensus_peers.cc:597] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d -> Peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Couldn't send request to peer e3ce74ba14714b4dbd2d75e27f34eb0d. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:21:45.277684  5237 raft_consensus.cc:493] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.278326  5237 raft_consensus.cc:515] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.280753  5237 leader_election.cc:290] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:45.286684  5237 raft_consensus.cc:493] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.287847  5237 raft_consensus.cc:515] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
W20260709 12:21:45.295754 29290 leader_election.cc:336] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
I20260709 12:21:45.297304  5237 leader_election.cc:290] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:45.306082 29292 leader_election.cc:336] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
W20260709 12:21:45.308086 29292 leader_election.cc:336] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:45.308657 29292 leader_election.cc:304] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:45.309508  5237 raft_consensus.cc:2749] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:21:45.313094 29292 leader_election.cc:336] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.313690 29292 leader_election.cc:304] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, a8342e3fcab94ce89482df67988159ea
I20260709 12:21:45.314638  5237 raft_consensus.cc:2749] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:21:45.376509 27446 tablet_server.cc:179] TabletServer@127.26.205.132:0 shutting down...
W20260709 12:21:45.378726 29290 consensus_peers.cc:597] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:45.379441  5237 raft_consensus.cc:493] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a7ec63b6634944d0b5b5ea92fa2d303e)
I20260709 12:21:45.381672  5237 raft_consensus.cc:515] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.383312  5235 raft_consensus.cc:493] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:45.384112  5237 leader_election.cc:290] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
I20260709 12:21:45.383874  5235 raft_consensus.cc:515] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "a7ec63b6634944d0b5b5ea92fa2d303e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 44843 } attrs { replace: true } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.386629  5235 leader_election.cc:290] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113), a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843)
W20260709 12:21:45.392026 29290 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:45.400053 29292 leader_election.cc:336] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
W20260709 12:21:45.401010 29292 leader_election.cc:336] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:45.401429 29292 leader_election.cc:304] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a7ec63b6634944d0b5b5ea92fa2d303e, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:45.402149  5235 raft_consensus.cc:2749] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:21:45.402288 29292 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:45.402796 29292 leader_election.cc:304] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:45.403475  5235 raft_consensus.cc:2749] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:21:45.405530 29292 leader_election.cc:336] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a7ec63b6634944d0b5b5ea92fa2d303e (127.26.205.131:44843): Network error: Client connection negotiation failed: client connection to 127.26.205.131:44843: connect: Connection refused (error 111)
I20260709 12:21:45.452663 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:45.455721 27446 tablet_replica.cc:333] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.456812 27446 raft_consensus.cc:2243] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.457764 27446 raft_consensus.cc:2272] T cb599a2fb1704106b47a69be90b821d0 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.460970 27446 tablet_replica.cc:333] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.461771 27446 raft_consensus.cc:2243] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.462930 27446 raft_consensus.cc:2272] T 05ef99f51b5a4b959e982c258f2aafcc P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:45.464660 29290 consensus_peers.cc:597] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:45.465938 27446 tablet_replica.cc:333] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.466846 27446 raft_consensus.cc:2243] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.467579 27446 raft_consensus.cc:2272] T b5e3c15999a1401a85e85110ac625d58 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.470479 27446 tablet_replica.cc:333] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.471391 27446 raft_consensus.cc:2243] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.472136 27446 raft_consensus.cc:2272] T c60bef772ef04194a01b6f8f5423dd5f P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.474953 27446 tablet_replica.cc:333] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.475723 27446 raft_consensus.cc:2243] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.476636 27446 raft_consensus.cc:2272] T cdf685c3207841c286a253af2d105972 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.479432 27446 tablet_replica.cc:333] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.480269 27446 raft_consensus.cc:2243] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.481343 27446 raft_consensus.cc:2272] T 30c9fa2ab7fb487da44a0d6de40286ff P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.483788 27446 tablet_replica.cc:333] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.484624 27446 raft_consensus.cc:2243] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.485404 27446 raft_consensus.cc:2272] T 663f0169fb984cfe963338bade0eabbb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.488094 27446 tablet_replica.cc:333] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.488903 27446 raft_consensus.cc:2243] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Raft consensus shutting down.
W20260709 12:21:45.488965 29290 consensus_peers.cc:597] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:45.490028 27446 raft_consensus.cc:2272] T 302623a332a2421e848283481e8010f6 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.492923 27446 tablet_replica.cc:333] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.493762 27446 raft_consensus.cc:2243] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.494517 27446 raft_consensus.cc:2272] T 683aa452755144abbbeaff5aa710e8ca P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.497371 27446 tablet_replica.cc:333] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.498178 27446 raft_consensus.cc:2243] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.499275 27446 raft_consensus.cc:2272] T 4fe68878605a4b8ab3302650b63aae98 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.501979 27446 tablet_replica.cc:333] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.502840 27446 raft_consensus.cc:2243] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.503899 27446 raft_consensus.cc:2272] T 793ab78ecea2432e8fdb088474026ce1 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.506582 27446 tablet_replica.cc:333] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.507396 27446 raft_consensus.cc:2243] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.508423 27446 raft_consensus.cc:2272] T a975dd4c5a744a1d98c05841000796f8 P 5b3b2f4041a24b05983f30878f16db9d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.511091 27446 tablet_replica.cc:333] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.511987 27446 raft_consensus.cc:2243] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.512801 27446 raft_consensus.cc:2272] T e599bf217cb043a7957d025cd753fea4 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.515798 27446 tablet_replica.cc:333] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.516561 27446 raft_consensus.cc:2243] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.517196 27446 raft_consensus.cc:2272] T 52e0d44a1cde4f32b60dd0ed014922ec P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.519786 27446 tablet_replica.cc:333] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.520569 27446 raft_consensus.cc:2243] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.521646 27446 raft_consensus.cc:2272] T c5898a5306cc40cb9c97dff5f6ab3cd8 P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.524125 27446 tablet_replica.cc:333] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.524852 27446 raft_consensus.cc:2243] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.525457 27446 raft_consensus.cc:2272] T 4fa8c90dea5b494e9adb22b30b41b45c P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.528071 27446 tablet_replica.cc:333] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.528863 27446 raft_consensus.cc:2243] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 34 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.529965 27446 raft_consensus.cc:2272] T 3be2bcd2a3b04c82bbf14413a7011c12 P 5b3b2f4041a24b05983f30878f16db9d [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.532730 27446 tablet_replica.cc:333] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.533434 27446 raft_consensus.cc:2243] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.534049 27446 raft_consensus.cc:2272] T 1548a806b02a4f79b5010615f560d2bb P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.536811 27446 tablet_replica.cc:333] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.537552 27446 raft_consensus.cc:2243] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.538246 27446 raft_consensus.cc:2272] T 09b12c4abe49469ebd1ae7c30355cef2 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.540925 27446 tablet_replica.cc:333] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.541657 27446 raft_consensus.cc:2243] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.542294 27446 raft_consensus.cc:2272] T 6828c27180d54395aa62e49037e09909 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.545133 27446 tablet_replica.cc:333] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.545934 27446 raft_consensus.cc:2243] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.546651 27446 raft_consensus.cc:2272] T 78db6dee59ca445c95d367900be0ef94 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:45.549525 29290 consensus_peers.cc:597] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d -> Peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Couldn't send request to peer a8342e3fcab94ce89482df67988159ea. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:21:45.549674 27446 tablet_replica.cc:333] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.550714 27446 raft_consensus.cc:2243] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.551370 27446 raft_consensus.cc:2272] T f2c936ab911d48fba6cc944d81f99fb1 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.554283 27446 tablet_replica.cc:333] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.555043 27446 raft_consensus.cc:2243] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.556098 27446 raft_consensus.cc:2272] T b35b6c6fffe3416bb8f69b556040e319 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.558938 27446 tablet_replica.cc:333] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.559717 27446 raft_consensus.cc:2243] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.560863 27446 raft_consensus.cc:2272] T ac62777e94e1417c867cb2ac80a55824 P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.563588 27446 tablet_replica.cc:333] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.564342 27446 raft_consensus.cc:2243] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.565264 27446 raft_consensus.cc:2272] T 8ea376f5c1af47d79a1871ab80a23cdb P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.567903 27446 tablet_replica.cc:333] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.568719 27446 raft_consensus.cc:2243] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.569802 27446 raft_consensus.cc:2272] T 14b09750d07a41f39c2913b5d03c6994 P 5b3b2f4041a24b05983f30878f16db9d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.572602 27446 tablet_replica.cc:333] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.573393 27446 raft_consensus.cc:2243] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.574061 27446 raft_consensus.cc:2272] T dcb1386731ec4c46bd9cc992c2ffc31b P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.576785 27446 tablet_replica.cc:333] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.577560 27446 raft_consensus.cc:2243] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.578354 27446 raft_consensus.cc:2272] T 1632d712fbcd489da9624b1f43ff7f96 P 5b3b2f4041a24b05983f30878f16db9d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.580897 27446 tablet_replica.cc:333] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.581658 27446 raft_consensus.cc:2243] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.582746 27446 raft_consensus.cc:2272] T 316dc144dbef470e8e17c2e02887dfd8 P 5b3b2f4041a24b05983f30878f16db9d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.585659 27446 tablet_replica.cc:333] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.586426 27446 raft_consensus.cc:2243] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.587594 27446 raft_consensus.cc:2272] T f23bf973b94c463f8da13a996fc7f221 P 5b3b2f4041a24b05983f30878f16db9d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.590477 27446 tablet_replica.cc:333] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.591217 27446 raft_consensus.cc:2243] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.591837 27446 raft_consensus.cc:2272] T 4bc886982591478e97f84ddb724a679a P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.594532 27446 tablet_replica.cc:333] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.595350 27446 raft_consensus.cc:2243] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.596473 27446 raft_consensus.cc:2272] T ec3dcbf1171d4cc9855730d6a1d6e0d7 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.599347 27446 tablet_replica.cc:333] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.600123 27446 raft_consensus.cc:2243] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.600878 27446 raft_consensus.cc:2272] T a5dc72678108404787b2aa034d4a7243 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.603663 27446 tablet_replica.cc:333] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.604521 27446 raft_consensus.cc:2243] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.605643 27446 raft_consensus.cc:2272] T 6ae65c3f66064ac694864cddddad892d P 5b3b2f4041a24b05983f30878f16db9d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.608562 27446 tablet_replica.cc:333] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.609264 27446 raft_consensus.cc:2243] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.610317 27446 raft_consensus.cc:2272] T ecb84065af5c41b0aaee71485ad69560 P 5b3b2f4041a24b05983f30878f16db9d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.611896  5237 raft_consensus.cc:493] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a8342e3fcab94ce89482df67988159ea)
I20260709 12:21:45.612319  5237 raft_consensus.cc:515] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e3ce74ba14714b4dbd2d75e27f34eb0d" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 36607 } } peers { permanent_uuid: "a8342e3fcab94ce89482df67988159ea" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 42113 } } peers { permanent_uuid: "5b3b2f4041a24b05983f30878f16db9d" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 46291 } attrs { promote: false } }
I20260709 12:21:45.612900 27446 tablet_replica.cc:333] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.613718 27446 raft_consensus.cc:2243] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.614214  5237 leader_election.cc:290] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607), a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113)
I20260709 12:21:45.614833 27446 raft_consensus.cc:2272] T d2cf259cdc3c4cdfb64950de8d1adb98 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.617563 27446 tablet_replica.cc:333] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.618257 27446 raft_consensus.cc:2243] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.618804 27446 raft_consensus.cc:2272] T 509077a515a748899cf8ea0c5bac854a P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:45.620018 29290 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a8342e3fcab94ce89482df67988159ea (127.26.205.130:42113): Network error: Client connection negotiation failed: client connection to 127.26.205.130:42113: connect: Connection refused (error 111)
W20260709 12:21:45.620884 29292 leader_election.cc:336] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:21:45.621233 29292 leader_election.cc:304] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b3b2f4041a24b05983f30878f16db9d; no voters: a8342e3fcab94ce89482df67988159ea, e3ce74ba14714b4dbd2d75e27f34eb0d
I20260709 12:21:45.621387 27446 tablet_replica.cc:333] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.621868  5237 raft_consensus.cc:2749] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:21:45.622205 27446 raft_consensus.cc:2243] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.623390 27446 raft_consensus.cc:2272] T 1ad958cd19754b4b9c2817e4b5cd7ded P 5b3b2f4041a24b05983f30878f16db9d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.625823 27446 tablet_replica.cc:333] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.626535 27446 raft_consensus.cc:2243] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.627506 27446 raft_consensus.cc:2272] T a7f9c29f436b4c6bbfb909b71ca1d309 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.630025 27446 tablet_replica.cc:333] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.630667 27446 raft_consensus.cc:2243] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.631193 27446 raft_consensus.cc:2272] T ae666b5b049a49c0bd0b0969e6b2b154 P 5b3b2f4041a24b05983f30878f16db9d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.633730 27446 tablet_replica.cc:333] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.634387 27446 raft_consensus.cc:2243] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.635206 27446 raft_consensus.cc:2272] T e5bdaade8df945828ab371a3267cd752 P 5b3b2f4041a24b05983f30878f16db9d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.637939 27446 tablet_replica.cc:333] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.638608 27446 raft_consensus.cc:2243] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:21:45.639640 27446 raft_consensus.cc:2272] T ff1532cf86464920afb02490b110f356 P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.642156 27446 tablet_replica.cc:333] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.642767 27446 raft_consensus.cc:2243] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.643362 27446 raft_consensus.cc:2272] T aacf3b2dee3345268f9d3c9b6a1e4779 P 5b3b2f4041a24b05983f30878f16db9d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:45.645732 27446 tablet_replica.cc:333] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d: stopping tablet replica
I20260709 12:21:45.646329 27446 raft_consensus.cc:2243] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:45.647418 27446 raft_consensus.cc:2272] T f7fa5ed3509d4939885ee0d39a32f20a P 5b3b2f4041a24b05983f30878f16db9d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:46.234249 27446 tablet_server.cc:196] TabletServer@127.26.205.132:0 shutdown complete.
I20260709 12:21:46.313285 27446 master.cc:562] Master@127.26.205.190:43093 shutting down...
W20260709 12:21:46.346764 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cb599a2fb1704106b47a69be90b821d0: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:46.354835 28553 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:21:46.355111 28553 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:21:46.355273 28553 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:21:48.451026 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3be2bcd2a3b04c82bbf14413a7011c12: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:21:58.143216 28492 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111) [suppressed 158 similar messages]
W20260709 12:21:58.146939 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 05ef99f51b5a4b959e982c258f2aafcc: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
W20260709 12:22:02.775228 28492 catalog_manager.cc:4755] TS e3ce74ba14714b4dbd2d75e27f34eb0d (127.26.205.129:36607): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cb599a2fb1704106b47a69be90b821d0: Network error: Client connection negotiation failed: client connection to 127.26.205.129:36607: connect: Connection refused (error 111)
I20260709 12:22:03.366065 27446 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:03.367194 27446 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:03.367691 27446 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8e0de7eff4a840c28e4ee5b7f8b98182: stopping tablet replica
I20260709 12:22:03.513080 27446 master.cc:584] Master@127.26.205.190:43093 shutdown complete.
I20260709 12:22:03.566645 27446 test_util.cc:182] -----------------------------------------------
I20260709 12:22:03.566901 27446 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599367894863-27446-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (294141 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:22:03.570699 27446 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.205.190:40179
I20260709 12:22:03.571841 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:03.577733  5251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:03.577728  5252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:03.578557  5254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:03.579568 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:03.582630 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:03.582823 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:03.582934 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599723582924 us; error 0 us; skew 500 ppm
I20260709 12:22:03.583395 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:03.585764 27446 webserver.cc:533] Webserver started at http://127.26.205.190:35407/ using document root <none> and password file <none>
I20260709 12:22:03.586218 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:03.586367 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:03.586581 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:03.587802 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/master-0-root/instance:
uuid: "57e4204dd50548b3ba01d7cc1ea259dd"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-673s"
I20260709 12:22:03.592190 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:22:03.595487  5259 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:03.596232 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:03.596558 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/master-0-root
uuid: "57e4204dd50548b3ba01d7cc1ea259dd"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-673s"
I20260709 12:22:03.596840 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:03.619938 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:03.621335 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:03.661290 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.190:40179
I20260709 12:22:03.661415  5310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.190:40179 every 8 connection(s)
I20260709 12:22:03.665596  5311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.678676  5311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd: Bootstrap starting.
I20260709 12:22:03.683593  5311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.687870  5311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd: No bootstrap required, opened a new log
I20260709 12:22:03.690150  5311 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4204dd50548b3ba01d7cc1ea259dd" member_type: VOTER }
I20260709 12:22:03.690574  5311 raft_consensus.cc:385] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.690752  5311 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57e4204dd50548b3ba01d7cc1ea259dd, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.691260  5311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4204dd50548b3ba01d7cc1ea259dd" member_type: VOTER }
I20260709 12:22:03.691674  5311 raft_consensus.cc:399] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:03.691871  5311 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:03.692087  5311 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.697297  5311 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4204dd50548b3ba01d7cc1ea259dd" member_type: VOTER }
I20260709 12:22:03.697759  5311 leader_election.cc:304] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57e4204dd50548b3ba01d7cc1ea259dd; no voters: 
I20260709 12:22:03.699012  5311 leader_election.cc:290] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:03.699342  5314 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.700726  5314 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 1 LEADER]: Becoming Leader. State: Replica: 57e4204dd50548b3ba01d7cc1ea259dd, State: Running, Role: LEADER
I20260709 12:22:03.701432  5314 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4204dd50548b3ba01d7cc1ea259dd" member_type: VOTER }
I20260709 12:22:03.702049  5311 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:03.708200  5315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57e4204dd50548b3ba01d7cc1ea259dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4204dd50548b3ba01d7cc1ea259dd" member_type: VOTER } }
I20260709 12:22:03.708123  5316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57e4204dd50548b3ba01d7cc1ea259dd. Latest consensus state: current_term: 1 leader_uuid: "57e4204dd50548b3ba01d7cc1ea259dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e4204dd50548b3ba01d7cc1ea259dd" member_type: VOTER } }
I20260709 12:22:03.708946  5315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:03.709046  5316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:03.716146  5322 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:03.721376  5322 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:03.722539 27446 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:03.730351  5322 catalog_manager.cc:1383] Generated new cluster ID: 67d32578c63f475fa01d69abbdf46b6e
I20260709 12:22:03.730644  5322 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:03.748991  5322 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:03.750370  5322 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:03.770021  5322 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd: Generated new TSK 0
I20260709 12:22:03.770680  5322 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:03.789433 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:03.795660  5332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:03.797020  5333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:03.800175  5335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:03.802795 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:03.807202 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:03.807427 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:03.807626 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599723807605 us; error 0 us; skew 500 ppm
I20260709 12:22:03.808210 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:03.810508 27446 webserver.cc:533] Webserver started at http://127.26.205.129:40953/ using document root <none> and password file <none>
I20260709 12:22:03.810995 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:03.811194 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:03.811479 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:03.812800 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/instance:
uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-673s"
I20260709 12:22:03.817327 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:22:03.820670  5341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:03.821342 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:22:03.821646 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-673s"
I20260709 12:22:03.821936 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:03.833914 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:03.835106 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:03.836602 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:03.838899 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:03.839143 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:03.839389 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:03.839581 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:03.883831 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:39599
I20260709 12:22:03.883934  5403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:39599 every 8 connection(s)
I20260709 12:22:03.889276 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:03.896945  5408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:03.898074  5409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:03.901567 27446 server_base.cc:1061] running on GCE node
W20260709 12:22:03.902273  5412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:03.904704  5404 heartbeater.cc:344] Connected to a master server at 127.26.205.190:40179
I20260709 12:22:03.905143  5404 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:03.905160 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:03.905582 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:03.905763 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599723905729 us; error 0 us; skew 500 ppm
I20260709 12:22:03.906313  5404 heartbeater.cc:507] Master 127.26.205.190:40179 requested a full tablet report, sending...
I20260709 12:22:03.906384 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:03.909184  5276 ts_manager.cc:194] Registered new tserver with Master: 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:03.909477 27446 webserver.cc:533] Webserver started at http://127.26.205.130:38081/ using document root <none> and password file <none>
I20260709 12:22:03.910122 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:03.910358 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:03.910683 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:03.911829  5276 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59140
I20260709 12:22:03.912387 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/instance:
uuid: "7eb36fa55fb24fc6a0531b58835695d7"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-673s"
I20260709 12:22:03.917246 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:22:03.920506  5416 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:03.921244 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:03.921530 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-1-root
uuid: "7eb36fa55fb24fc6a0531b58835695d7"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-673s"
I20260709 12:22:03.921808 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:03.947907 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:03.949287 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:03.950845 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:03.953100 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:03.953341 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:03.953578 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:03.953756 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:03.995411 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.130:34515
I20260709 12:22:03.995515  5479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.130:34515 every 8 connection(s)
I20260709 12:22:04.000727 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:04.008769  5483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:04.008852  5484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.011853  5480 heartbeater.cc:344] Connected to a master server at 127.26.205.190:40179
I20260709 12:22:04.012310  5480 heartbeater.cc:461] Registering TS with master...
W20260709 12:22:04.012467  5487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.013283 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:04.013302  5480 heartbeater.cc:507] Master 127.26.205.190:40179 requested a full tablet report, sending...
I20260709 12:22:04.014585 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:04.014846 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:04.015044 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599724015023 us; error 0 us; skew 500 ppm
I20260709 12:22:04.015656 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:04.015892  5276 ts_manager.cc:194] Registered new tserver with Master: 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:04.017758  5276 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59146
I20260709 12:22:04.018577 27446 webserver.cc:533] Webserver started at http://127.26.205.131:41639/ using document root <none> and password file <none>
I20260709 12:22:04.019280 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:04.019481 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:04.019773 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:04.021107 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/instance:
uuid: "fddd18e8ee414562a16b88c1a12413fc"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-673s"
I20260709 12:22:04.025866 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:04.029146  5491 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.029927 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:04.030228 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-2-root
uuid: "fddd18e8ee414562a16b88c1a12413fc"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-673s"
I20260709 12:22:04.030560 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:04.054194 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:04.055488 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:04.056988 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:04.059248 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:04.059489 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.059734 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:04.059916 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.102123 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.131:41985
I20260709 12:22:04.102285  5553 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.131:41985 every 8 connection(s)
I20260709 12:22:04.107421 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:04.114619  5557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:04.115299  5558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.118152 27446 server_base.cc:1061] running on GCE node
W20260709 12:22:04.118611  5561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:04.119426  5554 heartbeater.cc:344] Connected to a master server at 127.26.205.190:40179
I20260709 12:22:04.119758 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:22:04.119827  5554 heartbeater.cc:461] Registering TS with master...
W20260709 12:22:04.120105 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:04.120378 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599724120356 us; error 0 us; skew 500 ppm
I20260709 12:22:04.120952  5554 heartbeater.cc:507] Master 127.26.205.190:40179 requested a full tablet report, sending...
I20260709 12:22:04.121055 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:04.123378  5276 ts_manager.cc:194] Registered new tserver with Master: fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:04.124907  5276 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59160
I20260709 12:22:04.126252 27446 webserver.cc:533] Webserver started at http://127.26.205.132:37933/ using document root <none> and password file <none>
I20260709 12:22:04.126834 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:04.127058 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:04.127334 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:04.128590 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-3-root/instance:
uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-673s"
I20260709 12:22:04.133111 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:22:04.136372  5565 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.137183 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:22:04.137483 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-3-root
uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
format_stamp: "Formatted at 2026-07-09 12:22:04 on dist-test-slave-673s"
I20260709 12:22:04.137781 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:04.165287 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:04.166682 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:04.168311 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:04.170627 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:04.170876 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.171129 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:04.171326 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:04.214176 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.132:38145
I20260709 12:22:04.214289  5628 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.132:38145 every 8 connection(s)
I20260709 12:22:04.229451  5629 heartbeater.cc:344] Connected to a master server at 127.26.205.190:40179
I20260709 12:22:04.229825  5629 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:04.230523  5629 heartbeater.cc:507] Master 127.26.205.190:40179 requested a full tablet report, sending...
I20260709 12:22:04.232483  5276 ts_manager.cc:194] Registered new tserver with Master: 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:04.232642 27446 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015053102s
I20260709 12:22:04.234400  5276 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59168
I20260709 12:22:04.259339  5276 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:22:04.502223  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 81434dfcd51a4772a9f3c8b182f6a9f6 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:04.503851  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81434dfcd51a4772a9f3c8b182f6a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.509353  5444 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc00f3869334c9785c100fd236007c5 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:04.511029  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc00f3869334c9785c100fd236007c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.515657  5369 tablet_service.cc:1511] Processing CreateTablet for tablet 81434dfcd51a4772a9f3c8b182f6a9f6 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:04.516485  5367 tablet_service.cc:1511] Processing CreateTablet for tablet 20bc52dfebc342d381e8f38949578038 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:04.516530  5443 tablet_service.cc:1511] Processing CreateTablet for tablet ca2596641aca47a4b72b31401defeac3 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:04.518180  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2596641aca47a4b72b31401defeac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.518662  5368 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc00f3869334c9785c100fd236007c5 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:04.517167  5369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81434dfcd51a4772a9f3c8b182f6a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.520340  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bc52dfebc342d381e8f38949578038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.528838  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc00f3869334c9785c100fd236007c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.538105  5594 tablet_service.cc:1511] Processing CreateTablet for tablet 81434dfcd51a4772a9f3c8b182f6a9f6 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:04.539644  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81434dfcd51a4772a9f3c8b182f6a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.541684  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 20bc52dfebc342d381e8f38949578038 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:04.543114  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bc52dfebc342d381e8f38949578038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.548009  5366 tablet_service.cc:1511] Processing CreateTablet for tablet b6b59df10e4c4aa38e5dbd6cc3b2ed67 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:04.548975  5592 tablet_service.cc:1511] Processing CreateTablet for tablet ca2596641aca47a4b72b31401defeac3 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:04.550084  5366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b59df10e4c4aa38e5dbd6cc3b2ed67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.550387  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2596641aca47a4b72b31401defeac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.560657  5442 tablet_service.cc:1511] Processing CreateTablet for tablet b6b59df10e4c4aa38e5dbd6cc3b2ed67 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:04.562171  5442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b59df10e4c4aa38e5dbd6cc3b2ed67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.569389  5518 tablet_service.cc:1511] Processing CreateTablet for tablet 20bc52dfebc342d381e8f38949578038 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:04.571291  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bc52dfebc342d381e8f38949578038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.567193  5519 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc00f3869334c9785c100fd236007c5 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:04.573727  5519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc00f3869334c9785c100fd236007c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.594269  5649 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:04.601609  5649 tablet_bootstrap.cc:654] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:04.607736  5517 tablet_service.cc:1511] Processing CreateTablet for tablet ca2596641aca47a4b72b31401defeac3 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:04.609258  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2596641aca47a4b72b31401defeac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.609882  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 4058efce24824bdab7ff7d90f5c1c9ce (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:04.611382  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4058efce24824bdab7ff7d90f5c1c9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.612192  5367 tablet_service.cc:1511] Processing CreateTablet for tablet 4058efce24824bdab7ff7d90f5c1c9ce (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:04.613629  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4058efce24824bdab7ff7d90f5c1c9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.613680  5516 tablet_service.cc:1511] Processing CreateTablet for tablet b6b59df10e4c4aa38e5dbd6cc3b2ed67 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:04.615211  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b59df10e4c4aa38e5dbd6cc3b2ed67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.637585  5648 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:04.648003  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 4058efce24824bdab7ff7d90f5c1c9ce (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:04.649413  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4058efce24824bdab7ff7d90f5c1c9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.651037  5515 tablet_service.cc:1511] Processing CreateTablet for tablet 9d726792b00846af91fe7eaee674790a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:04.652231  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 9d726792b00846af91fe7eaee674790a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:04.652370  5515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d726792b00846af91fe7eaee674790a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.654623  5443 tablet_service.cc:1511] Processing CreateTablet for tablet 402cf513fa7f4e30917381ee64a96070 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:04.654966  5366 tablet_service.cc:1511] Processing CreateTablet for tablet 9d726792b00846af91fe7eaee674790a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:04.655944  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402cf513fa7f4e30917381ee64a96070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.656199  5366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d726792b00846af91fe7eaee674790a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.658958  5589 tablet_service.cc:1511] Processing CreateTablet for tablet 402cf513fa7f4e30917381ee64a96070 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:04.659317  5367 tablet_service.cc:1511] Processing CreateTablet for tablet d75d2cbd8eac4a4aa3b08cecc781b081 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:04.660789  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75d2cbd8eac4a4aa3b08cecc781b081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.661232  5444 tablet_service.cc:1511] Processing CreateTablet for tablet d75d2cbd8eac4a4aa3b08cecc781b081 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:04.662627  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75d2cbd8eac4a4aa3b08cecc781b081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.662740  5649 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:04.663273  5649 ts_tablet_manager.cc:1403] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.000s
I20260709 12:22:04.666193  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 402cf513fa7f4e30917381ee64a96070 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:04.667593  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402cf513fa7f4e30917381ee64a96070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.653640  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d726792b00846af91fe7eaee674790a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.671828  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402cf513fa7f4e30917381ee64a96070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.677575  5649 raft_consensus.cc:359] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:04.678517  5649 raft_consensus.cc:385] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:04.678834  5649 raft_consensus.cc:740] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.679659  5649 consensus_queue.cc:260] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:04.687829  5513 tablet_service.cc:1511] Processing CreateTablet for tablet d75d2cbd8eac4a4aa3b08cecc781b081 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:04.689378  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75d2cbd8eac4a4aa3b08cecc781b081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.690747  5588 tablet_service.cc:1511] Processing CreateTablet for tablet 95ab26a4132c42e7b6a9ed53a0d4d98b (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:04.692309  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ab26a4132c42e7b6a9ed53a0d4d98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.699958  5368 tablet_service.cc:1511] Processing CreateTablet for tablet 95ab26a4132c42e7b6a9ed53a0d4d98b (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:04.701347  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ab26a4132c42e7b6a9ed53a0d4d98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.706822  5442 tablet_service.cc:1511] Processing CreateTablet for tablet 95ab26a4132c42e7b6a9ed53a0d4d98b (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:04.708184  5442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ab26a4132c42e7b6a9ed53a0d4d98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.711686  5518 tablet_service.cc:1511] Processing CreateTablet for tablet f267030285b54db4bfe6e2293754df95 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
W20260709 12:22:04.718160  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:04.724188  5651 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:04.737767  5648 tablet_bootstrap.cc:654] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:04.729435  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f267030285b54db4bfe6e2293754df95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.744246  5649 ts_tablet_manager.cc:1434] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.015s
I20260709 12:22:04.745198  5404 heartbeater.cc:499] Master 127.26.205.190:40179 was elected leader, sending a full tablet report...
I20260709 12:22:04.757114  5649 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:04.768054  5594 tablet_service.cc:1511] Processing CreateTablet for tablet f267030285b54db4bfe6e2293754df95 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:04.770027  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f267030285b54db4bfe6e2293754df95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.786531  5367 tablet_service.cc:1511] Processing CreateTablet for tablet f267030285b54db4bfe6e2293754df95 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:04.787966  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f267030285b54db4bfe6e2293754df95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.791720  5369 tablet_service.cc:1511] Processing CreateTablet for tablet 60dcd080cf4b413583707e93ec56d4b9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:04.798904  5649 tablet_bootstrap.cc:654] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:04.798628  5590 tablet_service.cc:1511] Processing CreateTablet for tablet bf71ad7e2ac54415ab73c6499883c3b4 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:04.795279  5589 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0acea6bb584b6ca4cdb21390af1cf5 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:04.799966  5365 tablet_service.cc:1511] Processing CreateTablet for tablet bf71ad7e2ac54415ab73c6499883c3b4 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:04.799953  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf71ad7e2ac54415ab73c6499883c3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.801895  5654 tablet_bootstrap.cc:492] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:04.802250  5517 tablet_service.cc:1511] Processing CreateTablet for tablet 39c21b5980204d2a84e53916eab2d0a0 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:04.803488  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c21b5980204d2a84e53916eab2d0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.805049  5369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dcd080cf4b413583707e93ec56d4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.808775  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0acea6bb584b6ca4cdb21390af1cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.809514  5648 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:04.810031  5648 ts_tablet_manager.cc:1403] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.173s	user 0.031s	sys 0.023s
I20260709 12:22:04.796219  5515 tablet_service.cc:1511] Processing CreateTablet for tablet 60dcd080cf4b413583707e93ec56d4b9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:04.812740  5515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dcd080cf4b413583707e93ec56d4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.795462  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0acea6bb584b6ca4cdb21390af1cf5 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:04.818008  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0acea6bb584b6ca4cdb21390af1cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.818951  5441 tablet_service.cc:1511] Processing CreateTablet for tablet bf71ad7e2ac54415ab73c6499883c3b4 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:04.820379  5441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf71ad7e2ac54415ab73c6499883c3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.822392  5654 tablet_bootstrap.cc:654] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:04.823189  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf71ad7e2ac54415ab73c6499883c3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.823788  5444 tablet_service.cc:1511] Processing CreateTablet for tablet 60dcd080cf4b413583707e93ec56d4b9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:04.824841  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 39c21b5980204d2a84e53916eab2d0a0 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:04.843990  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 69e86de2926d4f3eafdf9f57553e3211 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:04.845032  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c21b5980204d2a84e53916eab2d0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.828696  5443 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0acea6bb584b6ca4cdb21390af1cf5 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:04.832064  5368 tablet_service.cc:1511] Processing CreateTablet for tablet 39c21b5980204d2a84e53916eab2d0a0 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:04.836707  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 69e86de2926d4f3eafdf9f57553e3211 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:04.850097  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39c21b5980204d2a84e53916eab2d0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.838009  5651 tablet_bootstrap.cc:654] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:04.840348  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 69e86de2926d4f3eafdf9f57553e3211 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:04.846518  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e86de2926d4f3eafdf9f57553e3211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.845033  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dcd080cf4b413583707e93ec56d4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.853302  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e86de2926d4f3eafdf9f57553e3211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.854678  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69e86de2926d4f3eafdf9f57553e3211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.855340  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0acea6bb584b6ca4cdb21390af1cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.862218  5649 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:04.862905  5649 ts_tablet_manager.cc:1403] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.106s	user 0.003s	sys 0.026s
I20260709 12:22:04.866210  5649 raft_consensus.cc:359] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:04.866990  5649 raft_consensus.cc:385] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:04.867395  5649 raft_consensus.cc:740] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.868810  5649 consensus_queue.cc:260] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
W20260709 12:22:04.888913  5405 tablet.cc:2406] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:04.867092  5648 raft_consensus.cc:359] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:04.884276  5366 tablet_service.cc:1511] Processing CreateTablet for tablet 7a31cf131ed6430ea825e8d57e6433cb (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:04.895081  5366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a31cf131ed6430ea825e8d57e6433cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.886339  5516 tablet_service.cc:1511] Processing CreateTablet for tablet 7a31cf131ed6430ea825e8d57e6433cb (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:04.893750  5649 ts_tablet_manager.cc:1434] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.030s	user 0.000s	sys 0.006s
I20260709 12:22:04.901221  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a31cf131ed6430ea825e8d57e6433cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.901639  5649 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:04.904556  5648 raft_consensus.cc:385] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:04.904903  5648 raft_consensus.cc:740] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.893996  5651 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:04.905810  5648 consensus_queue.cc:260] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:04.906443  5651 ts_tablet_manager.cc:1403] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.183s	user 0.013s	sys 0.004s
I20260709 12:22:04.904211  5588 tablet_service.cc:1511] Processing CreateTablet for tablet 4d84f9d6d8dd4f7e96a52cf86006235c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:04.908924  5364 tablet_service.cc:1511] Processing CreateTablet for tablet 4d84f9d6d8dd4f7e96a52cf86006235c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:04.910387  5651 raft_consensus.cc:359] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:04.933641  5651 raft_consensus.cc:385] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:04.933908  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d84f9d6d8dd4f7e96a52cf86006235c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.934024  5651 raft_consensus.cc:740] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.915742  5649 tablet_bootstrap.cc:654] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:04.925344  5443 tablet_service.cc:1511] Processing CreateTablet for tablet 4d84f9d6d8dd4f7e96a52cf86006235c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:04.930944  5589 tablet_service.cc:1511] Processing CreateTablet for tablet e3420ee8c43745c5af1bb3648726e7d0 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:04.932150  5441 tablet_service.cc:1511] Processing CreateTablet for tablet 7a31cf131ed6430ea825e8d57e6433cb (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:04.934966  5651 consensus_queue.cc:260] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:04.935972  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d84f9d6d8dd4f7e96a52cf86006235c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.945008  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3420ee8c43745c5af1bb3648726e7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.939035  5518 tablet_service.cc:1511] Processing CreateTablet for tablet e3420ee8c43745c5af1bb3648726e7d0 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:04.943248  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 79dc98f9fe994e9488ec27c89efce84d (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:04.952677  5365 tablet_service.cc:1511] Processing CreateTablet for tablet d3c9acfac3f7442eb0892615a08fe453 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:04.953892  5441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a31cf131ed6430ea825e8d57e6433cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.954897  5368 tablet_service.cc:1511] Processing CreateTablet for tablet e3420ee8c43745c5af1bb3648726e7d0 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:04.955063  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 79dc98f9fe994e9488ec27c89efce84d (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:04.948529  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 79dc98f9fe994e9488ec27c89efce84d (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:04.957563  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79dc98f9fe994e9488ec27c89efce84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.953979  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c9acfac3f7442eb0892615a08fe453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.960989  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3420ee8c43745c5af1bb3648726e7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.966974  5444 tablet_service.cc:1511] Processing CreateTablet for tablet d3c9acfac3f7442eb0892615a08fe453 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:04.967571  5515 tablet_service.cc:1511] Processing CreateTablet for tablet d3c9acfac3f7442eb0892615a08fe453 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:04.969501  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 4116669c74d4417d993b6fe905fab3c2 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:04.971648  5363 tablet_service.cc:1511] Processing CreateTablet for tablet 4116669c74d4417d993b6fe905fab3c2 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:04.973136  5480 heartbeater.cc:499] Master 127.26.205.190:40179 was elected leader, sending a full tablet report...
I20260709 12:22:04.973657  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4116669c74d4417d993b6fe905fab3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.962117  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79dc98f9fe994e9488ec27c89efce84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.971673  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4116669c74d4417d993b6fe905fab3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.978998  5442 tablet_service.cc:1511] Processing CreateTablet for tablet 4116669c74d4417d993b6fe905fab3c2 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:04.983527  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d84f9d6d8dd4f7e96a52cf86006235c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.982810  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3420ee8c43745c5af1bb3648726e7d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.988705  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79dc98f9fe994e9488ec27c89efce84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.988469  5517 tablet_service.cc:1511] Processing CreateTablet for tablet 18a56a6374454cf6b3c48e13d1daf5d9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:04.989794  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a56a6374454cf6b3c48e13d1daf5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.991478  5515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c9acfac3f7442eb0892615a08fe453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.992746  5442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4116669c74d4417d993b6fe905fab3c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.994454  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c9acfac3f7442eb0892615a08fe453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:04.997139  5648 ts_tablet_manager.cc:1434] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.187s	user 0.006s	sys 0.005s
I20260709 12:22:04.998325  5648 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:05.010613  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 18a56a6374454cf6b3c48e13d1daf5d9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:05.012020  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a56a6374454cf6b3c48e13d1daf5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.030838  5554 heartbeater.cc:499] Master 127.26.205.190:40179 was elected leader, sending a full tablet report...
I20260709 12:22:05.038388  5649 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:05.039124  5649 ts_tablet_manager.cc:1403] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.138s	user 0.003s	sys 0.015s
I20260709 12:22:05.043604  5369 tablet_service.cc:1511] Processing CreateTablet for tablet 18a56a6374454cf6b3c48e13d1daf5d9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:05.045485  5369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a56a6374454cf6b3c48e13d1daf5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.047648  5652 raft_consensus.cc:493] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.048290  5652 raft_consensus.cc:515] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:05.055930  5658 raft_consensus.cc:493] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.056653  5658 raft_consensus.cc:515] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:05.067142  5654 tablet_bootstrap.cc:492] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
W20260709 12:22:05.072741  5262 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.205.129:39599, user_credentials={real_user=slave}} blocked reactor thread for 59274.9us
I20260709 12:22:05.093943  5654 ts_tablet_manager.cc:1403] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.292s	user 0.012s	sys 0.023s
I20260709 12:22:05.086210  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 12444cef6727421b9d5186006a5dda8b (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:05.096696  5440 tablet_service.cc:1511] Processing CreateTablet for tablet 12444cef6727421b9d5186006a5dda8b (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:05.098132  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12444cef6727421b9d5186006a5dda8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.093344  5652 leader_election.cc:290] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:05.097150  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12444cef6727421b9d5186006a5dda8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.089978  5651 ts_tablet_manager.cc:1434] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.183s	user 0.013s	sys 0.009s
I20260709 12:22:05.107523  5658 leader_election.cc:290] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:05.159335  5654 raft_consensus.cc:359] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:05.170404  5516 tablet_service.cc:1511] Processing CreateTablet for tablet 8b64afdc610b42868a6cd77183a441d7 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:05.171929  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b64afdc610b42868a6cd77183a441d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.143128  5649 raft_consensus.cc:359] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.170511  5439 tablet_service.cc:1511] Processing CreateTablet for tablet 8b64afdc610b42868a6cd77183a441d7 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:05.174501  5649 raft_consensus.cc:385] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.174894  5649 raft_consensus.cc:740] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.175297  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b64afdc610b42868a6cd77183a441d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.175828  5649 consensus_queue.cc:260] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.177155  5438 tablet_service.cc:1511] Processing CreateTablet for tablet bebc67e8ff7b4d9484156a204358eef2 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:05.179962  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bebc67e8ff7b4d9484156a204358eef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.186432  5648 tablet_bootstrap.cc:654] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.189874  5651 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:05.185698  5654 raft_consensus.cc:385] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.204701  5654 raft_consensus.cc:740] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.201653  5518 tablet_service.cc:1511] Processing CreateTablet for tablet 08fad4ce0c2a44c8b885dcbca5bfde87 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:05.205687  5654 consensus_queue.cc:260] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:05.207093  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fad4ce0c2a44c8b885dcbca5bfde87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.202589  5649 ts_tablet_manager.cc:1434] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.163s	user 0.010s	sys 0.000s
I20260709 12:22:05.205720  5589 tablet_service.cc:1511] Processing CreateTablet for tablet 12444cef6727421b9d5186006a5dda8b (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:05.221406  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12444cef6727421b9d5186006a5dda8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.232059  5651 tablet_bootstrap.cc:654] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.236069  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:05.237776  5629 heartbeater.cc:499] Master 127.26.205.190:40179 was elected leader, sending a full tablet report...
I20260709 12:22:05.241122  5649 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:05.241942  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 08fad4ce0c2a44c8b885dcbca5bfde87 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:05.243667  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fad4ce0c2a44c8b885dcbca5bfde87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.246901  5592 tablet_service.cc:1511] Processing CreateTablet for tablet bebc67e8ff7b4d9484156a204358eef2 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:05.264621  5364 tablet_service.cc:1511] Processing CreateTablet for tablet bebc67e8ff7b4d9484156a204358eef2 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:05.264853  5439 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7777356542417f8aa0e1ca2a9955ec (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:05.266037  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bebc67e8ff7b4d9484156a204358eef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.266289  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7777356542417f8aa0e1ca2a9955ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.264957  5366 tablet_service.cc:1511] Processing CreateTablet for tablet 08fad4ce0c2a44c8b885dcbca5bfde87 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:05.268591  5365 tablet_service.cc:1511] Processing CreateTablet for tablet 8b64afdc610b42868a6cd77183a441d7 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:05.269415  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bebc67e8ff7b4d9484156a204358eef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.269621  5366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fad4ce0c2a44c8b885dcbca5bfde87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.270417  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b64afdc610b42868a6cd77183a441d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:05.272706  5418 leader_election.cc:343] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.276468  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:05.284355  5654 ts_tablet_manager.cc:1434] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.190s	user 0.011s	sys 0.013s
I20260709 12:22:05.283994  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7777356542417f8aa0e1ca2a9955ec (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:05.286314  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7777356542417f8aa0e1ca2a9955ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.288757  5654 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
W20260709 12:22:05.314224  5343 leader_election.cc:343] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.344385  5652 raft_consensus.cc:493] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.345216  5652 raft_consensus.cc:515] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:05.351778  5648 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:05.352753  5652 leader_election.cc:290] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:05.352423  5648 ts_tablet_manager.cc:1403] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.354s	user 0.005s	sys 0.027s
I20260709 12:22:05.357447  5648 raft_consensus.cc:359] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.358198  5648 raft_consensus.cc:385] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.358566  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:05.359866  5660 raft_consensus.cc:493] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:05.361197  5419 leader_election.cc:343] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.361711  5419 leader_election.cc:304] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:05.362540  5658 raft_consensus.cc:2749] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:05.360420  5660 raft_consensus.cc:515] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.373484  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:05.375098  5343 leader_election.cc:343] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.377154  5651 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:05.378649  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 4a7777356542417f8aa0e1ca2a9955ec (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:05.380157  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a7777356542417f8aa0e1ca2a9955ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.385566  5651 ts_tablet_manager.cc:1403] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.243s	user 0.031s	sys 0.042s
I20260709 12:22:05.386380  5365 tablet_service.cc:1511] Processing CreateTablet for tablet 324177360e04468a9795c4da53cdbd1c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:05.387745  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 324177360e04468a9795c4da53cdbd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.389955  5651 raft_consensus.cc:359] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:05.368409  5660 leader_election.cc:290] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:05.391003  5651 raft_consensus.cc:385] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.391455  5651 raft_consensus.cc:740] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.392395  5651 consensus_queue.cc:260] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:05.388291  5649 tablet_bootstrap.cc:654] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.406508  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 324177360e04468a9795c4da53cdbd1c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:05.407902  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 324177360e04468a9795c4da53cdbd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.409098  5651 ts_tablet_manager.cc:1434] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.002s
I20260709 12:22:05.358543  5648 raft_consensus.cc:740] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.422618  5588 tablet_service.cc:1511] Processing CreateTablet for tablet afa51550cc1e48779233015cd4d9e0c9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:05.423990  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa51550cc1e48779233015cd4d9e0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.418840  5651 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:05.438777  5654 tablet_bootstrap.cc:654] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.438407  5444 tablet_service.cc:1511] Processing CreateTablet for tablet afa51550cc1e48779233015cd4d9e0c9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:05.439921  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa51550cc1e48779233015cd4d9e0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.451432  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:05.453033  5343 leader_election.cc:343] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.453497  5343 leader_election.cc:304] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:05.454886  5652 raft_consensus.cc:2749] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:05.459136  5660 raft_consensus.cc:493] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.459632  5660 raft_consensus.cc:515] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:05.462101  5660 leader_election.cc:290] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:05.431628  5648 consensus_queue.cc:260] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.482880  5594 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:05.491925  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:05.494544  5649 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:05.501637  5649 ts_tablet_manager.cc:1403] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.261s	user 0.016s	sys 0.010s
I20260709 12:22:05.506326  5648 ts_tablet_manager.cc:1434] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.152s	user 0.007s	sys 0.000s
I20260709 12:22:05.507645  5648 tablet_bootstrap.cc:492] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:05.509176  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5a0e2e4c2a4f8c9a8bfa8ea813be51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:05.510048  5344 leader_election.cc:343] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.509888  5364 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:05.510602  5344 leader_election.cc:304] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:05.511274  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5a0e2e4c2a4f8c9a8bfa8ea813be51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.511790  5652 raft_consensus.cc:2749] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:05.508108  5649 raft_consensus.cc:359] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.512982  5649 raft_consensus.cc:385] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.513375  5649 raft_consensus.cc:740] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.515554  5516 tablet_service.cc:1511] Processing CreateTablet for tablet 324177360e04468a9795c4da53cdbd1c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:05.516187  5649 consensus_queue.cc:260] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.516847  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 324177360e04468a9795c4da53cdbd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.520605  5649 ts_tablet_manager.cc:1434] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:22:05.521596  5649 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:05.524516  5363 tablet_service.cc:1511] Processing CreateTablet for tablet afa51550cc1e48779233015cd4d9e0c9 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:05.524801  5439 tablet_service.cc:1511] Processing CreateTablet for tablet 887ea6f2292649de80a0e337800fd7cb (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:05.525878  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa51550cc1e48779233015cd4d9e0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.526131  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 887ea6f2292649de80a0e337800fd7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.531543  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 887ea6f2292649de80a0e337800fd7cb (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:05.502251  5651 tablet_bootstrap.cc:654] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.535897  5365 tablet_service.cc:1511] Processing CreateTablet for tablet f41986298fd9435e9b41fe9ad22ccdc1 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:05.537744  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41986298fd9435e9b41fe9ad22ccdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.537871  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:05.539158  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5a0e2e4c2a4f8c9a8bfa8ea813be51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.543642  5440 tablet_service.cc:1511] Processing CreateTablet for tablet f41986298fd9435e9b41fe9ad22ccdc1 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:05.544943  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41986298fd9435e9b41fe9ad22ccdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.548863  5652 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.551412  5652 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.567242  5517 tablet_service.cc:1511] Processing CreateTablet for tablet 887ea6f2292649de80a0e337800fd7cb (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:05.569190  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 887ea6f2292649de80a0e337800fd7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.575971  5515 tablet_service.cc:1511] Processing CreateTablet for tablet f41986298fd9435e9b41fe9ad22ccdc1 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:05.577471  5515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f41986298fd9435e9b41fe9ad22ccdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.578320  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 887ea6f2292649de80a0e337800fd7cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.594717  5669 raft_consensus.cc:493] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.595534  5669 raft_consensus.cc:515] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:05.618230  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc00f3869334c9785c100fd236007c5" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:05.619010  5379 raft_consensus.cc:2468] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:05.619712  5649 tablet_bootstrap.cc:654] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.620296  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:05.621006  5378 raft_consensus.cc:2468] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:05.622673  5494 leader_election.cc:304] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:05.623688  5660 raft_consensus.cc:2804] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.623943  5654 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:05.624055  5660 raft_consensus.cc:493] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.624589  5660 raft_consensus.cc:3060] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.624589  5654 ts_tablet_manager.cc:1403] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.338s	user 0.024s	sys 0.051s
I20260709 12:22:05.628872  5494 leader_election.cc:304] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:05.629813  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:05.641184  5660 raft_consensus.cc:515] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.642364  5652 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:05.643666  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:05.645308  5344 leader_election.cc:343] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.636368  5654 raft_consensus.cc:359] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.645978  5654 raft_consensus.cc:385] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.646310  5654 raft_consensus.cc:740] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.646418  5369 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc39fb0872d49eda4aaa7170e421978 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:05.647846  5369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc39fb0872d49eda4aaa7170e421978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.650295  5660 leader_election.cc:290] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:05.650534  5444 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc39fb0872d49eda4aaa7170e421978 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:05.651938  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc39fb0872d49eda4aaa7170e421978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.646720  5589 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc39fb0872d49eda4aaa7170e421978 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:05.657437  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc39fb0872d49eda4aaa7170e421978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.650918  5660 raft_consensus.cc:2804] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.647323  5654 consensus_queue.cc:260] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:05.664055  5660 raft_consensus.cc:493] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.682989  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 78a654b632744c53946820d8bb4c5fb8 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:05.685021  5364 tablet_service.cc:1511] Processing CreateTablet for tablet 0174a8220da546bba7e2ccf232f59244 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:05.686830  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0174a8220da546bba7e2ccf232f59244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.691221  5442 tablet_service.cc:1511] Processing CreateTablet for tablet 82fedcb24a7843748efb4e0db04fd967 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:05.694372  5368 tablet_service.cc:1511] Processing CreateTablet for tablet 82fedcb24a7843748efb4e0db04fd967 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:05.698170  5438 tablet_service.cc:1511] Processing CreateTablet for tablet aedcb0fbb15b4f14949afe776218f367 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:05.699160  5367 tablet_service.cc:1511] Processing CreateTablet for tablet aedcb0fbb15b4f14949afe776218f367 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:05.701269  5442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fedcb24a7843748efb4e0db04fd967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.702158  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedcb0fbb15b4f14949afe776218f367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.709717  5362 tablet_service.cc:1511] Processing CreateTablet for tablet d5fd56f4297c4405b24eaad2e3f296fa (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:05.713259  5361 tablet_service.cc:1511] Processing CreateTablet for tablet 521044053aaa4980a83c1d2f14d14524 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:05.717056  5441 tablet_service.cc:1511] Processing CreateTablet for tablet 521044053aaa4980a83c1d2f14d14524 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:05.717489  5443 tablet_service.cc:1511] Processing CreateTablet for tablet 44fd276ebc024672a5c9eafb8f805442 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:05.718370  5441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521044053aaa4980a83c1d2f14d14524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.719262  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fd276ebc024672a5c9eafb8f805442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.720868  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a654b632744c53946820d8bb4c5fb8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:05.720978  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:05.738070  5360 tablet_service.cc:1511] Processing CreateTablet for tablet a0c71518e1df4ec39ce7f29b4be4a21c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:05.744477  5438 tablet_service.cc:1511] Processing CreateTablet for tablet a0c71518e1df4ec39ce7f29b4be4a21c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:05.744719  5437 tablet_service.cc:1511] Processing CreateTablet for tablet 57f641edcab549deae1aa846ded8f15c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:05.747323  5437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f641edcab549deae1aa846ded8f15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.748265  5436 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3cc33a5e1c49a79a13e57852104de3 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:05.750162  5436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3cc33a5e1c49a79a13e57852104de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.757748  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0c71518e1df4ec39ce7f29b4be4a21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.758584  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fedcb24a7843748efb4e0db04fd967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.760700  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedcb0fbb15b4f14949afe776218f367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.762701  5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0c71518e1df4ec39ce7f29b4be4a21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.764279  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fd56f4297c4405b24eaad2e3f296fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.765837  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521044053aaa4980a83c1d2f14d14524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.762251  5441 tablet_service.cc:1511] Processing CreateTablet for tablet 12167beadba54b97bfef03d91a5725aa (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:05.768195  5441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12167beadba54b97bfef03d91a5725aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.794616  5437 tablet_service.cc:1511] Processing CreateTablet for tablet c48cbeaeff384cbd8556c14de06a2c41 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:05.796038  5437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48cbeaeff384cbd8556c14de06a2c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.673091  5604 raft_consensus.cc:2468] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:05.674988  5660 raft_consensus.cc:3060] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.808537  5648 tablet_bootstrap.cc:700] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent opening tablet: real 0.152s	user 0.001s	sys 0.001s
I20260709 12:22:05.809264  5648 tablet_bootstrap.cc:654] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:05.816026  5651 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:05.830360  5366 tablet_service.cc:1511] Processing CreateTablet for tablet 793b2585318747d0b1c32b60839d07e7 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:05.831704  5366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793b2585318747d0b1c32b60839d07e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:05.821374  5494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:39599, user_credentials={real_user=slave}} blocked reactor thread for 192575us
I20260709 12:22:05.843061  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc00f3869334c9785c100fd236007c5" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:05.843717  5378 raft_consensus.cc:3060] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.844499  5516 tablet_service.cc:1511] Processing CreateTablet for tablet 0174a8220da546bba7e2ccf232f59244 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:05.845978  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0174a8220da546bba7e2ccf232f59244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.847182  5588 tablet_service.cc:1511] Processing CreateTablet for tablet 0174a8220da546bba7e2ccf232f59244 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:05.799922  5441 tablet_service.cc:1511] Processing CreateTablet for tablet 30b377cee535487cadb7a1c9c5cbbf02 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:05.823415  5651 ts_tablet_manager.cc:1403] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.412s	user 0.021s	sys 0.019s
I20260709 12:22:05.860899  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0174a8220da546bba7e2ccf232f59244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.877857  5518 tablet_service.cc:1511] Processing CreateTablet for tablet 78a654b632744c53946820d8bb4c5fb8 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:05.878329  5649 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:05.878921  5649 ts_tablet_manager.cc:1403] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.358s	user 0.019s	sys 0.011s
I20260709 12:22:05.879262  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a654b632744c53946820d8bb4c5fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.826653  5669 leader_election.cc:290] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:05.893117  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc00f3869334c9785c100fd236007c5" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:05.894582  5343 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:05.893616  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc00f3869334c9785c100fd236007c5" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:05.896023  5652 raft_consensus.cc:2804] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:05.896399  5652 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.896760  5652 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:05.897074  5440 tablet_service.cc:1511] Processing CreateTablet for tablet d4e076c07c0947d5a199139898ffba03 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:05.899863  5365 tablet_service.cc:1511] Processing CreateTablet for tablet 12167beadba54b97bfef03d91a5725aa (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:05.915598  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12167beadba54b97bfef03d91a5725aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.916239  5590 tablet_service.cc:1511] Processing CreateTablet for tablet aedcb0fbb15b4f14949afe776218f367 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:05.917570  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedcb0fbb15b4f14949afe776218f367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.920091  5519 tablet_service.cc:1511] Processing CreateTablet for tablet d5fd56f4297c4405b24eaad2e3f296fa (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:05.921407  5519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fd56f4297c4405b24eaad2e3f296fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.921464  5592 tablet_service.cc:1511] Processing CreateTablet for tablet d5fd56f4297c4405b24eaad2e3f296fa (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:05.922854  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5fd56f4297c4405b24eaad2e3f296fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.924470  5512 tablet_service.cc:1511] Processing CreateTablet for tablet 44fd276ebc024672a5c9eafb8f805442 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:05.925418  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 44fd276ebc024672a5c9eafb8f805442 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:05.926721  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fd276ebc024672a5c9eafb8f805442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.927201  5511 tablet_service.cc:1511] Processing CreateTablet for tablet 521044053aaa4980a83c1d2f14d14524 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:05.929540  5510 tablet_service.cc:1511] Processing CreateTablet for tablet 793b2585318747d0b1c32b60839d07e7 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:05.929695  5587 tablet_service.cc:1511] Processing CreateTablet for tablet a0c71518e1df4ec39ce7f29b4be4a21c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:05.900669  5455 raft_consensus.cc:2468] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:05.931059  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0c71518e1df4ec39ce7f29b4be4a21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.910460  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 82fedcb24a7843748efb4e0db04fd967 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:05.925818  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fd276ebc024672a5c9eafb8f805442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.932829  5586 tablet_service.cc:1511] Processing CreateTablet for tablet 793b2585318747d0b1c32b60839d07e7 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:05.934346  5586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793b2585318747d0b1c32b60839d07e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.941075  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:05.942615  5493 leader_election.cc:343] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.908643  5441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b377cee535487cadb7a1c9c5cbbf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.932792  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fedcb24a7843748efb4e0db04fd967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.949342  5378 raft_consensus.cc:2468] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:05.951529  5585 tablet_service.cc:1511] Processing CreateTablet for tablet 57f641edcab549deae1aa846ded8f15c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:05.952955  5585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f641edcab549deae1aa846ded8f15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.871179  5660 raft_consensus.cc:515] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:05.970062  5594 tablet_service.cc:1511] Processing CreateTablet for tablet 78a654b632744c53946820d8bb4c5fb8 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:05.970597  5648 tablet_bootstrap.cc:492] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:05.971204  5648 ts_tablet_manager.cc:1403] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.464s	user 0.018s	sys 0.010s
I20260709 12:22:05.971524  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78a654b632744c53946820d8bb4c5fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.972872  5511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521044053aaa4980a83c1d2f14d14524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.976748  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793b2585318747d0b1c32b60839d07e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:05.978636  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2596641aca47a4b72b31401defeac3" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:05.984862  5568 leader_election.cc:343] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:05.985697  5651 raft_consensus.cc:359] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:05.986521  5651 raft_consensus.cc:385] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:05.986828  5651 raft_consensus.cc:740] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:05.987654  5651 consensus_queue.cc:260] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:05.989691  5439 tablet_service.cc:1511] Processing CreateTablet for tablet e5495488e26d44d3be7dd371d31e169a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:05.993530  5648 raft_consensus.cc:359] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:05.994052  5494 leader_election.cc:304] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:05.970635  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 12167beadba54b97bfef03d91a5725aa (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:05.995453  5681 raft_consensus.cc:2804] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:05.996146  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12167beadba54b97bfef03d91a5725aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.005023  5364 tablet_service.cc:1511] Processing CreateTablet for tablet 30b377cee535487cadb7a1c9c5cbbf02 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:06.006309  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b377cee535487cadb7a1c9c5cbbf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.006805  5444 tablet_service.cc:1511] Processing CreateTablet for tablet f004b323a1d24685bf59c122a46fec9f (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:06.011852  5368 tablet_service.cc:1511] Processing CreateTablet for tablet d4e076c07c0947d5a199139898ffba03 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:06.014000  5660 leader_election.cc:290] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:05.994287  5648 raft_consensus.cc:385] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.014191  5649 raft_consensus.cc:359] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.015496  5649 raft_consensus.cc:385] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.016927  5363 tablet_service.cc:1511] Processing CreateTablet for tablet b79772c58ae14912b3ac47484ae94bbd (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:06.018258  5369 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3cc33a5e1c49a79a13e57852104de3 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:05.966127  5652 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:06.022023  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2596641aca47a4b72b31401defeac3" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:06.022406  5652 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:06.023579  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
W20260709 12:22:06.025089  5344 leader_election.cc:343] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.025436  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:06.026328  5603 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.029466  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:06.030284  5378 raft_consensus.cc:3060] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.030205  5517 tablet_service.cc:1511] Processing CreateTablet for tablet 57f641edcab549deae1aa846ded8f15c (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:06.032783  5654 ts_tablet_manager.cc:1434] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.405s	user 0.029s	sys 0.025s
W20260709 12:22:06.033195  5567 leader_election.cc:343] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.033926  5654 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:06.033859  5567 leader_election.cc:304] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:06.035216  5683 raft_consensus.cc:2749] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:06.039290  5361 tablet_service.cc:1511] Processing CreateTablet for tablet 1af71d02653944509494d122128ee567 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:06.042567  5516 tablet_service.cc:1511] Processing CreateTablet for tablet a3b77c24029e4efbbd5c2679556ef30e (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:06.013998  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e076c07c0947d5a199139898ffba03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.014740  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:06.048671  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e076c07c0947d5a199139898ffba03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.014842  5648 raft_consensus.cc:740] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.052371  5360 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ce82f087341228c390906bb0d6802 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:06.055572  5648 consensus_queue.cc:260] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.057585  5519 tablet_service.cc:1511] Processing CreateTablet for tablet c48cbeaeff384cbd8556c14de06a2c41 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:22:06.068953  5493 leader_election.cc:343] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.002135  5362 tablet_service.cc:1511] Processing CreateTablet for tablet a3b77c24029e4efbbd5c2679556ef30e (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:06.078929  5443 tablet_service.cc:1511] Processing CreateTablet for tablet f42967958ae64becbb47efba2703dc6a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:06.081758  5442 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ce82f087341228c390906bb0d6802 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:06.088359  5366 tablet_service.cc:1511] Processing CreateTablet for tablet d541fc6b63b5452aa4505d8f4275b875 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:06.090134  5515 tablet_service.cc:1511] Processing CreateTablet for tablet 30b377cee535487cadb7a1c9c5cbbf02 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:06.098313  5438 tablet_service.cc:1511] Processing CreateTablet for tablet b79772c58ae14912b3ac47484ae94bbd (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:06.120229  5365 tablet_service.cc:1511] Processing CreateTablet for tablet c7de8fac5809466d88f4b46fcee34489 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:06.121626  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7de8fac5809466d88f4b46fcee34489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.101732  5442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ce82f087341228c390906bb0d6802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.104600  5367 tablet_service.cc:1511] Processing CreateTablet for tablet f004b323a1d24685bf59c122a46fec9f (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:06.124519  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f004b323a1d24685bf59c122a46fec9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.016939  5649 raft_consensus.cc:740] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.106814  5518 tablet_service.cc:1511] Processing CreateTablet for tablet 1af71d02653944509494d122128ee567 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:06.112883  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57f641edcab549deae1aa846ded8f15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.101990  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3cc33a5e1c49a79a13e57852104de3 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:06.135972  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af71d02653944509494d122128ee567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.128697  5593 tablet_service.cc:1511] Processing CreateTablet for tablet a3b77c24029e4efbbd5c2679556ef30e (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:06.129966  5603 raft_consensus.cc:2468] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:06.141499  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b77c24029e4efbbd5c2679556ef30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.142716  5648 ts_tablet_manager.cc:1434] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.171s	user 0.014s	sys 0.003s
I20260709 12:22:06.145097  5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ce82f087341228c390906bb0d6802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.145790  5369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3cc33a5e1c49a79a13e57852104de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.147101  5343 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:06.148594  5652 raft_consensus.cc:2804] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.152849  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79772c58ae14912b3ac47484ae94bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.153712  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5495488e26d44d3be7dd371d31e169a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.157864  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42967958ae64becbb47efba2703dc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.158593  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f004b323a1d24685bf59c122a46fec9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.159544  5648 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:06.159749  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79772c58ae14912b3ac47484ae94bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.160533  5649 consensus_queue.cc:260] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.165539  5366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d541fc6b63b5452aa4505d8f4275b875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.166306  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b77c24029e4efbbd5c2679556ef30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.168962  5515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30b377cee535487cadb7a1c9c5cbbf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.148116  5364 tablet_service.cc:1511] Processing CreateTablet for tablet 0db9822ea4574d15bd17a42e91fb030e (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:06.173910  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db9822ea4574d15bd17a42e91fb030e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.174041  5437 tablet_service.cc:1511] Processing CreateTablet for tablet d541fc6b63b5452aa4505d8f4275b875 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:06.175915  5378 raft_consensus.cc:2468] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:06.177354  5494 leader_election.cc:304] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:06.130203  5681 raft_consensus.cc:697] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:06.188218  5437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d541fc6b63b5452aa4505d8f4275b875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.194499  5651 ts_tablet_manager.cc:1434] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.332s	user 0.013s	sys 0.006s
I20260709 12:22:06.179780  5687 raft_consensus.cc:2804] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.195348  5519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48cbeaeff384cbd8556c14de06a2c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.205296  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3cc33a5e1c49a79a13e57852104de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.208616  5687 raft_consensus.cc:697] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:06.209676  5687 consensus_queue.cc:237] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.188285  5681 consensus_queue.cc:237] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:06.217563  5511 tablet_service.cc:1511] Processing CreateTablet for tablet e5495488e26d44d3be7dd371d31e169a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:06.221803  5651 tablet_bootstrap.cc:492] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:06.231374  5513 tablet_service.cc:1511] Processing CreateTablet for tablet f004b323a1d24685bf59c122a46fec9f (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:06.237207  5688 raft_consensus.cc:493] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.237874  5688 raft_consensus.cc:515] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.238583  5510 tablet_service.cc:1511] Processing CreateTablet for tablet c7de8fac5809466d88f4b46fcee34489 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:06.241639  5652 raft_consensus.cc:697] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:06.242527  5589 tablet_service.cc:1511] Processing CreateTablet for tablet c48cbeaeff384cbd8556c14de06a2c41 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:06.242581  5652 consensus_queue.cc:237] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:06.246814  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af71d02653944509494d122128ee567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.248766  5511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5495488e26d44d3be7dd371d31e169a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.252758  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f004b323a1d24685bf59c122a46fec9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.242187  5654 tablet_bootstrap.cc:654] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.257535  5648 tablet_bootstrap.cc:654] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.238575  5649 ts_tablet_manager.cc:1434] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.359s	user 0.012s	sys 0.008s
I20260709 12:22:06.263494  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:06.264648  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:06.272495  5378 raft_consensus.cc:2468] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
W20260709 12:22:06.273387  5494 leader_election.cc:343] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.274192  5494 leader_election.cc:304] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:06.275090  5660 raft_consensus.cc:2804] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:06.275467  5660 raft_consensus.cc:493] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.275799  5660 raft_consensus.cc:3060] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.278872  5594 tablet_service.cc:1511] Processing CreateTablet for tablet d4e076c07c0947d5a199139898ffba03 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:06.280690  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7de8fac5809466d88f4b46fcee34489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.282130  5588 tablet_service.cc:1511] Processing CreateTablet for tablet e5495488e26d44d3be7dd371d31e169a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:06.267486  5585 tablet_service.cc:1511] Processing CreateTablet for tablet 1af71d02653944509494d122128ee567 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:06.269356  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b77c24029e4efbbd5c2679556ef30e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.271025  5592 tablet_service.cc:1511] Processing CreateTablet for tablet f42967958ae64becbb47efba2703dc6a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:06.274389  5649 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:06.265559  5688 leader_election.cc:290] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:06.299782  5591 tablet_service.cc:1511] Processing CreateTablet for tablet ff7ce82f087341228c390906bb0d6802 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:06.300972  5689 raft_consensus.cc:493] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.304368  5689 raft_consensus.cc:515] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.306213  5651 tablet_bootstrap.cc:654] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.301258  5274 catalog_manager.cc:5697] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.314211  5689 leader_election.cc:290] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:06.339047  5587 tablet_service.cc:1511] Processing CreateTablet for tablet c7de8fac5809466d88f4b46fcee34489 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:06.329089  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e076c07c0947d5a199139898ffba03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.349675  5275 catalog_manager.cc:5697] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.353595  5654 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:06.354161  5654 ts_tablet_manager.cc:1403] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.320s	user 0.013s	sys 0.004s
I20260709 12:22:06.355314  5512 tablet_service.cc:1511] Processing CreateTablet for tablet f42967958ae64becbb47efba2703dc6a (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:06.362448  5660 raft_consensus.cc:515] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
W20260709 12:22:06.365144  5692 log.cc:927] Time spent T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:22:06.365502  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:06.366274  5378 raft_consensus.cc:3060] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.369343  5649 tablet_bootstrap.cc:654] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.371755  5517 tablet_service.cc:1511] Processing CreateTablet for tablet b79772c58ae14912b3ac47484ae94bbd (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:06.374488  5654 raft_consensus.cc:359] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.375233  5654 raft_consensus.cc:385] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.375520  5654 raft_consensus.cc:740] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.388854  5652 raft_consensus.cc:493] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.386374  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48cbeaeff384cbd8556c14de06a2c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.389400  5652 raft_consensus.cc:515] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.389982  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
W20260709 12:22:06.391463  5494 leader_election.cc:343] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.390190  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42967958ae64becbb47efba2703dc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.391729  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2596641aca47a4b72b31401defeac3" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:06.392472  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7de8fac5809466d88f4b46fcee34489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.392482  5603 raft_consensus.cc:2468] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:06.392943  5660 leader_election.cc:290] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:06.394023  5418 leader_election.cc:304] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:06.395087  5652 leader_election.cc:290] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:06.395661  5689 raft_consensus.cc:2804] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:06.396039  5689 raft_consensus.cc:493] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.396350  5689 raft_consensus.cc:3060] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.396723  5585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af71d02653944509494d122128ee567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.398558  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:06.398902  5588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5495488e26d44d3be7dd371d31e169a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:06.400204  5343 leader_election.cc:343] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.405289  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:06.405941  5455 raft_consensus.cc:2468] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:06.406999  5344 leader_election.cc:304] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:06.383720  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42967958ae64becbb47efba2703dc6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.410921  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7ce82f087341228c390906bb0d6802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.419687  5689 raft_consensus.cc:515] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.409338  5652 raft_consensus.cc:2804] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:06.385013  5654 consensus_queue.cc:260] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.434779  5654 ts_tablet_manager.cc:1434] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.002s
I20260709 12:22:06.435873  5654 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:06.426862  5652 raft_consensus.cc:493] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.436650  5652 raft_consensus.cc:3060] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.440696  5590 tablet_service.cc:1511] Processing CreateTablet for tablet d541fc6b63b5452aa4505d8f4275b875 (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:06.442143  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d541fc6b63b5452aa4505d8f4275b875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.442752  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 0db9822ea4574d15bd17a42e91fb030e (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:06.444027  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db9822ea4574d15bd17a42e91fb030e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.462201  5519 tablet_service.cc:1511] Processing CreateTablet for tablet 0db9822ea4574d15bd17a42e91fb030e (DEFAULT_TABLE table=test-workload [id=5d80bd6e1ba34bd69a8d86a62450e500]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:06.463636  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b79772c58ae14912b3ac47484ae94bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.467222  5689 leader_election.cc:290] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:06.479444  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2596641aca47a4b72b31401defeac3" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:06.480113  5603 raft_consensus.cc:3060] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.484908  5519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db9822ea4574d15bd17a42e91fb030e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:06.512557  5648 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:06.513154  5648 ts_tablet_manager.cc:1403] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.354s	user 0.019s	sys 0.005s
I20260709 12:22:06.516014  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2596641aca47a4b72b31401defeac3" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:06.517496  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2596641aca47a4b72b31401defeac3" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
W20260709 12:22:06.519235  5418 leader_election.cc:343] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:06.521675  5418 leader_election.cc:343] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.537642  5603 raft_consensus.cc:2468] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:06.537638  5378 raft_consensus.cc:2468] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:06.539387  5418 leader_election.cc:304] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:06.539647  5494 leader_election.cc:304] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:06.540649  5689 raft_consensus.cc:2804] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.540934  5687 raft_consensus.cc:2804] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.541460  5687 raft_consensus.cc:697] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:06.542311  5687 consensus_queue.cc:237] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.556223  5649 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:06.556836  5649 ts_tablet_manager.cc:1403] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.283s	user 0.005s	sys 0.018s
I20260709 12:22:06.559973  5649 raft_consensus.cc:359] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.560722  5649 raft_consensus.cc:385] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.561028  5649 raft_consensus.cc:740] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.561712  5649 consensus_queue.cc:260] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.565495  5649 ts_tablet_manager.cc:1434] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:06.566622  5649 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:06.574082  5651 tablet_bootstrap.cc:492] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:06.574977  5651 ts_tablet_manager.cc:1403] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.353s	user 0.011s	sys 0.029s
I20260709 12:22:06.577241  5649 tablet_bootstrap.cc:654] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.580415  5652 raft_consensus.cc:515] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.516327  5648 raft_consensus.cc:359] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.595655  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:06.596529  5648 raft_consensus.cc:385] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.596880  5455 raft_consensus.cc:3060] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.598590  5660 consensus_queue.cc:1048] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.596921  5648 raft_consensus.cc:740] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.605165  5654 tablet_bootstrap.cc:654] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.609190  5652 leader_election.cc:290] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:06.610306  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:06.610827  5455 raft_consensus.cc:2468] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:06.612040  5344 leader_election.cc:304] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
W20260709 12:22:06.584620  5262 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.205.129:39599, user_credentials={real_user=slave}} blocked reactor thread for 47730.9us
W20260709 12:22:06.612792  5343 leader_election.cc:343] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.613093  5652 raft_consensus.cc:2804] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.613590  5652 raft_consensus.cc:697] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:06.618657  5689 raft_consensus.cc:697] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:06.614706  5652 consensus_queue.cc:237] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.591692  5651 raft_consensus.cc:359] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.625003  5651 raft_consensus.cc:385] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.625079  5648 consensus_queue.cc:260] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.627172  5651 raft_consensus.cc:740] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.626964  5689 consensus_queue.cc:237] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.628800  5651 consensus_queue.cc:260] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.642804  5651 ts_tablet_manager.cc:1434] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.067s	user 0.002s	sys 0.006s
I20260709 12:22:06.676999  5649 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:06.677805  5649 ts_tablet_manager.cc:1403] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.111s	user 0.021s	sys 0.006s
I20260709 12:22:06.683223  5651 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:06.688316  5455 raft_consensus.cc:3060] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.689502  5274 catalog_manager.cc:5697] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:06.693790  5274 catalog_manager.cc:5697] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.699894  5648 ts_tablet_manager.cc:1434] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.186s	user 0.023s	sys 0.007s
I20260709 12:22:06.700619  5654 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:06.701045  5648 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:06.701144  5654 ts_tablet_manager.cc:1403] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.265s	user 0.011s	sys 0.019s
I20260709 12:22:06.704701  5654 raft_consensus.cc:359] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.704571  5276 catalog_manager.cc:5697] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.705504  5654 raft_consensus.cc:385] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.706984  5654 raft_consensus.cc:740] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.708621  5687 consensus_queue.cc:1048] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:06.708359  5275 catalog_manager.cc:5697] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.708459  5649 raft_consensus.cc:359] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.713207  5649 raft_consensus.cc:385] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.713616  5649 raft_consensus.cc:740] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.714416  5654 consensus_queue.cc:260] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.714643  5649 consensus_queue.cc:260] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.720831  5649 ts_tablet_manager.cc:1434] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 12:22:06.722121  5652 consensus_queue.cc:1048] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:22:06.721086  5654 ts_tablet_manager.cc:1434] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:22:06.723973  5690 raft_consensus.cc:493] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.730865  5690 raft_consensus.cc:515] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.731644  5654 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:06.733179  5690 leader_election.cc:290] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:06.735208  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75d2cbd8eac4a4aa3b08cecc781b081" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:06.736559  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75d2cbd8eac4a4aa3b08cecc781b081" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:06.738047  5343 leader_election.cc:343] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:06.739109  5344 leader_election.cc:343] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.739501  5654 tablet_bootstrap.cc:654] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.739722  5344 leader_election.cc:304] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:06.740737  5690 raft_consensus.cc:2749] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:06.742833  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:06.722777  5648 tablet_bootstrap.cc:654] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.722745  5651 tablet_bootstrap.cc:654] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.728634  5649 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
W20260709 12:22:06.763118  5344 consensus_peers.cc:597] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:06.763540  5651 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:06.764194  5651 ts_tablet_manager.cc:1403] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.000s
I20260709 12:22:06.767464  5651 raft_consensus.cc:359] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.768180  5651 raft_consensus.cc:385] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.775056  5651 raft_consensus.cc:740] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.780755  5651 consensus_queue.cc:260] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.782147  5687 consensus_queue.cc:1048] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:06.783052  5651 ts_tablet_manager.cc:1434] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 12:22:06.791456  5683 raft_consensus.cc:493] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.792016  5683 raft_consensus.cc:515] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.793058  5651 tablet_bootstrap.cc:492] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:06.795296  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:06.809773  5649 tablet_bootstrap.cc:654] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.798496  5683 leader_election.cc:290] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:06.810941  5651 tablet_bootstrap.cc:654] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.825425  5654 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:06.826054  5654 ts_tablet_manager.cc:1403] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.095s	user 0.025s	sys 0.036s
I20260709 12:22:06.829155  5654 raft_consensus.cc:359] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.829906  5654 raft_consensus.cc:385] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.830209  5654 raft_consensus.cc:740] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.832036  5654 consensus_queue.cc:260] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.835321  5654 ts_tablet_manager.cc:1434] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:06.836647  5648 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:06.836661  5654 tablet_bootstrap.cc:492] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:06.837311  5648 ts_tablet_manager.cc:1403] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.001s
I20260709 12:22:06.840716  5648 raft_consensus.cc:359] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.852977  5648 raft_consensus.cc:385] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.853394  5648 raft_consensus.cc:740] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.854327  5648 consensus_queue.cc:260] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.855741  5603 raft_consensus.cc:3060] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.852313  5649 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:06.859166  5649 ts_tablet_manager.cc:1403] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.137s	user 0.021s	sys 0.003s
I20260709 12:22:06.846629  5654 tablet_bootstrap.cc:654] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.861989  5649 raft_consensus.cc:359] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:06.862740  5649 raft_consensus.cc:385] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.863013  5649 raft_consensus.cc:740] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.863641  5649 consensus_queue.cc:260] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:06.865660  5649 ts_tablet_manager.cc:1434] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:06.866576  5649 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:06.858516  5648 ts_tablet_manager.cc:1434] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:22:06.873358  5648 tablet_bootstrap.cc:492] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:06.874001  5652 raft_consensus.cc:493] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.874648  5652 raft_consensus.cc:515] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.877276  5652 leader_election.cc:290] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:06.878840  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:06.879667  5604 raft_consensus.cc:2468] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:06.881072  5343 leader_election.cc:304] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:06.881319  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:06.882196  5528 raft_consensus.cc:2468] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:06.882509  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:06.883504  5649 tablet_bootstrap.cc:654] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.884018  5568 leader_election.cc:304] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:06.884898  5652 raft_consensus.cc:2804] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:06.886067  5651 tablet_bootstrap.cc:492] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:06.889186  5683 raft_consensus.cc:2749] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:06.890463  5652 raft_consensus.cc:493] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.890625  5688 consensus_queue.cc:1048] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:06.891417  5652 raft_consensus.cc:3060] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.895130  5648 tablet_bootstrap.cc:654] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.895529  5651 ts_tablet_manager.cc:1403] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.103s	user 0.039s	sys 0.013s
I20260709 12:22:06.900060  5651 raft_consensus.cc:359] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.901057  5651 raft_consensus.cc:385] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.901418  5651 raft_consensus.cc:740] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.904173  5654 tablet_bootstrap.cc:492] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:06.904752  5654 ts_tablet_manager.cc:1403] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.068s	user 0.034s	sys 0.009s
I20260709 12:22:06.902321  5651 consensus_queue.cc:260] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.906883  5652 raft_consensus.cc:515] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.907967  5654 raft_consensus.cc:359] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.908746  5654 raft_consensus.cc:385] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.909039  5654 raft_consensus.cc:740] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.909781  5654 consensus_queue.cc:260] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.910084  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:06.910657  5528 raft_consensus.cc:3060] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.912056  5654 ts_tablet_manager.cc:1434] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:06.913147  5654 tablet_bootstrap.cc:492] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:06.913880  5651 ts_tablet_manager.cc:1434] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:22:06.915175  5651 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:06.919855  5654 tablet_bootstrap.cc:654] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.943439  5649 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:06.943974  5649 ts_tablet_manager.cc:1403] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.015s
I20260709 12:22:06.944999  5651 tablet_bootstrap.cc:654] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:06.947477  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:06.946868  5649 raft_consensus.cc:359] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.948143  5604 raft_consensus.cc:3060] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.948101  5652 leader_election.cc:290] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:06.949479  5648 tablet_bootstrap.cc:492] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:06.951745  5648 ts_tablet_manager.cc:1403] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.016s
I20260709 12:22:06.956173  5648 raft_consensus.cc:359] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.957257  5648 raft_consensus.cc:385] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.957988  5648 raft_consensus.cc:740] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.950661  5528 raft_consensus.cc:2468] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:06.959093  5649 raft_consensus.cc:385] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:06.959594  5649 raft_consensus.cc:740] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:06.960606  5343 leader_election.cc:304] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:06.960892  5708 raft_consensus.cc:493] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.961619  5708 raft_consensus.cc:515] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.962051  5652 raft_consensus.cc:2804] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:06.963172  5652 raft_consensus.cc:697] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:06.964311  5652 consensus_queue.cc:237] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.965646  5708 leader_election.cc:290] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:06.965530  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75d2cbd8eac4a4aa3b08cecc781b081" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:06.965880  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75d2cbd8eac4a4aa3b08cecc781b081" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:06.966490  5378 raft_consensus.cc:2468] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:06.959113  5648 consensus_queue.cc:260] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
W20260709 12:22:06.967381  5418 leader_election.cc:343] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:06.967988  5419 leader_election.cc:304] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:06.968837  5689 raft_consensus.cc:2804] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:06.969424  5689 raft_consensus.cc:493] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.969851  5689 raft_consensus.cc:3060] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.971820  5683 raft_consensus.cc:493] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.972610  5683 raft_consensus.cc:515] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:06.975368  5683 leader_election.cc:290] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:06.977710  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:06.978200  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:06.978560  5454 raft_consensus.cc:2393] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 1: Already voted for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in this term.
I20260709 12:22:06.980252  5568 leader_election.cc:304] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:06.982888  5648 ts_tablet_manager.cc:1434] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.006s
I20260709 12:22:06.986213  5708 raft_consensus.cc:493] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.986572  5648 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:06.987134  5683 raft_consensus.cc:3060] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:06.987701  5708 raft_consensus.cc:515] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.980291  5689 raft_consensus.cc:515] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:06.980688  5649 consensus_queue.cc:260] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:06.996325  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:06.997134  5378 raft_consensus.cc:2393] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 1: Already voted for candidate fddd18e8ee414562a16b88c1a12413fc in this term.
I20260709 12:22:06.997483  5649 ts_tablet_manager.cc:1434] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.005s
I20260709 12:22:06.998806  5649 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:06.982719  5604 raft_consensus.cc:2468] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:07.000325  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:07.003981  5418 leader_election.cc:304] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:07.004933  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75d2cbd8eac4a4aa3b08cecc781b081" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:07.006562  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75d2cbd8eac4a4aa3b08cecc781b081" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:07.006765  5703 raft_consensus.cc:3060] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.008041  5648 tablet_bootstrap.cc:654] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:07.012881  5418 leader_election.cc:343] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.001442  5708 leader_election.cc:290] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:07.012809  5378 raft_consensus.cc:3060] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.016315  5703 raft_consensus.cc:2749] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.021056  5688 consensus_queue.cc:1048] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.023391  5649 tablet_bootstrap.cc:654] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.006268  5689 leader_election.cc:290] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:07.033514  5654 tablet_bootstrap.cc:492] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:07.034195  5654 ts_tablet_manager.cc:1403] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.059s
I20260709 12:22:07.035046  5378 raft_consensus.cc:2468] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:07.036281  5419 leader_election.cc:304] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:07.037585  5689 raft_consensus.cc:2804] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:07.038239  5689 raft_consensus.cc:697] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:07.038096  5654 raft_consensus.cc:359] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.039209  5654 raft_consensus.cc:385] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.039601  5654 raft_consensus.cc:740] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.039695  5689 consensus_queue.cc:237] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.040721  5654 consensus_queue.cc:260] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.051882  5651 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:07.052652  5651 ts_tablet_manager.cc:1403] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.138s	user 0.046s	sys 0.045s
I20260709 12:22:07.049427  5683 raft_consensus.cc:2749] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.057144  5654 ts_tablet_manager.cc:1434] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 12:22:07.058254  5687 consensus_queue.cc:1048] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.061045  5654 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:07.066947  5738 raft_consensus.cc:493] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.060644  5651 raft_consensus.cc:359] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.069490  5648 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.070374  5648 ts_tablet_manager.cc:1403] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.027s
I20260709 12:22:07.070209  5738 raft_consensus.cc:515] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.073082  5649 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:07.073765  5649 ts_tablet_manager.cc:1403] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.075s	user 0.007s	sys 0.007s
I20260709 12:22:07.073896  5648 raft_consensus.cc:359] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.074721  5648 raft_consensus.cc:385] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.075016  5648 raft_consensus.cc:740] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.075765  5648 consensus_queue.cc:260] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.080654  5648 ts_tablet_manager.cc:1434] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:07.076198  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0acea6bb584b6ca4cdb21390af1cf5" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.076529  5651 raft_consensus.cc:385] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.081233  5651 raft_consensus.cc:740] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
W20260709 12:22:07.082219  5568 leader_election.cc:343] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.082020  5651 consensus_queue.cc:260] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.082801  5687 raft_consensus.cc:493] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.083331  5687 raft_consensus.cc:515] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.084614  5651 ts_tablet_manager.cc:1434] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:22:07.085306  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0acea6bb584b6ca4cdb21390af1cf5" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:07.085503  5687 leader_election.cc:290] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:07.085652  5651 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:07.086860  5738 leader_election.cc:290] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:07.087420  5567 leader_election.cc:343] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.090158  5567 leader_election.cc:304] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:07.088073  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2596641aca47a4b72b31401defeac3" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.092404  5654 tablet_bootstrap.cc:654] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.092751  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2596641aca47a4b72b31401defeac3" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:07.093873  5648 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.094408  5604 raft_consensus.cc:2393] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fddd18e8ee414562a16b88c1a12413fc in current term 1: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
I20260709 12:22:07.095912  5493 leader_election.cc:304] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:07.097463  5681 raft_consensus.cc:3060] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.083606  5271 catalog_manager.cc:5697] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:07.104235  5651 tablet_bootstrap.cc:654] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.105598  5681 raft_consensus.cc:2749] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.093914  5738 raft_consensus.cc:2749] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.107264  5649 raft_consensus.cc:359] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.107925  5649 raft_consensus.cc:385] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.107995  5648 tablet_bootstrap.cc:654] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.108251  5649 raft_consensus.cc:740] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.109122  5649 consensus_queue.cc:260] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.119702  5651 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:07.120379  5651 ts_tablet_manager.cc:1403] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.001s
I20260709 12:22:07.121886  5652 consensus_queue.cc:1048] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:07.124980  5651 raft_consensus.cc:359] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.125931  5651 raft_consensus.cc:385] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.126273  5651 raft_consensus.cc:740] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.129599  5648 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.130263  5648 ts_tablet_manager.cc:1403] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.003s
I20260709 12:22:07.132604  5652 raft_consensus.cc:493] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.133337  5652 raft_consensus.cc:515] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.133986  5648 raft_consensus.cc:359] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.134933  5648 raft_consensus.cc:385] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.135267  5648 raft_consensus.cc:740] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.136703  5651 consensus_queue.cc:260] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.137135  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:07.138350  5703 raft_consensus.cc:493] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.138849  5703 raft_consensus.cc:515] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.139577  5651 ts_tablet_manager.cc:1434] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:22:07.140933  5703 leader_election.cc:290] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
W20260709 12:22:07.141688  5343 leader_election.cc:343] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.141922  5648 consensus_queue.cc:260] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.143680  5681 raft_consensus.cc:493] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.144176  5681 raft_consensus.cc:515] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.145277  5648 ts_tablet_manager.cc:1434] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.005s
I20260709 12:22:07.146370  5681 leader_election.cc:290] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:07.146570  5648 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.146733  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402cf513fa7f4e30917381ee64a96070" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:07.147504  5529 raft_consensus.cc:2468] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:07.148687  5703 consensus_queue.cc:1048] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.148865  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c21b5980204d2a84e53916eab2d0a0" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:07.150184  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c21b5980204d2a84e53916eab2d0a0" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:07.152005  5378 raft_consensus.cc:2468] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:07.140941  5651 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
W20260709 12:22:07.154091  5493 leader_election.cc:343] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.151067  5418 leader_election.cc:304] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:07.155418  5494 leader_election.cc:304] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:07.155752  5703 raft_consensus.cc:2804] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.156142  5703 raft_consensus.cc:493] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.156490  5703 raft_consensus.cc:3060] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.156790  5681 raft_consensus.cc:2804] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.157184  5681 raft_consensus.cc:493] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.157521  5681 raft_consensus.cc:3060] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.151345  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402cf513fa7f4e30917381ee64a96070" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:07.159003  5604 raft_consensus.cc:2468] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:07.160367  5651 tablet_bootstrap.cc:654] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.166410  5648 tablet_bootstrap.cc:654] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.169734  5652 leader_election.cc:290] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:07.171068  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.171813  5454 raft_consensus.cc:2468] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:07.173074  5344 leader_election.cc:304] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:07.174461  5652 raft_consensus.cc:2804] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.174883  5652 raft_consensus.cc:493] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.175302  5652 raft_consensus.cc:3060] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.178113  5649 ts_tablet_manager.cc:1434] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260709 12:22:07.182379  5690 consensus_queue.cc:1048] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.188709  5649 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:07.188607  5271 catalog_manager.cc:5697] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.175954  5703 raft_consensus.cc:515] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.178663  5648 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.201867  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402cf513fa7f4e30917381ee64a96070" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:07.202502  5529 raft_consensus.cc:3060] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.214282  5689 consensus_queue.cc:1048] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:07.216150  5681 raft_consensus.cc:515] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.222652  5648 ts_tablet_manager.cc:1403] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.002s
I20260709 12:22:07.224993  5651 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:07.229720  5651 ts_tablet_manager.cc:1403] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.006s
I20260709 12:22:07.231666  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c21b5980204d2a84e53916eab2d0a0" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
W20260709 12:22:07.233791  5493 leader_election.cc:343] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.237114  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c21b5980204d2a84e53916eab2d0a0" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:07.237401  5651 raft_consensus.cc:359] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.237978  5378 raft_consensus.cc:3060] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.240279  5681 leader_election.cc:290] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:07.248034  5648 raft_consensus.cc:359] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.248724  5648 raft_consensus.cc:385] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.249011  5648 raft_consensus.cc:740] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.249697  5648 consensus_queue.cc:260] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.250548  5703 leader_election.cc:290] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:07.251683  5648 ts_tablet_manager.cc:1434] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:22:07.251051  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402cf513fa7f4e30917381ee64a96070" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:07.252202  5651 raft_consensus.cc:385] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.252267  5602 raft_consensus.cc:3060] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.252615  5651 raft_consensus.cc:740] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.254281  5529 raft_consensus.cc:2468] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:07.258468  5654 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:07.259009  5654 ts_tablet_manager.cc:1403] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.198s	user 0.039s	sys 0.078s
I20260709 12:22:07.226338  5649 tablet_bootstrap.cc:654] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.256726  5651 consensus_queue.cc:260] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.256062  5378 raft_consensus.cc:2468] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:07.257342  5652 raft_consensus.cc:515] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.264838  5651 ts_tablet_manager.cc:1434] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 12:22:07.266094  5652 leader_election.cc:290] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:07.266917  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:07.267122  5602 raft_consensus.cc:2468] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
W20260709 12:22:07.268424  5343 leader_election.cc:343] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.269191  5651 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:07.264317  5648 tablet_bootstrap.cc:492] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.270948  5455 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.281739  5651 tablet_bootstrap.cc:654] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.284456  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:07.284600  5654 raft_consensus.cc:359] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.285115  5454 raft_consensus.cc:3060] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.285326  5654 raft_consensus.cc:385] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.285691  5654 raft_consensus.cc:740] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.286405  5654 consensus_queue.cc:260] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.291182  5654 ts_tablet_manager.cc:1434] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 12:22:07.291945  5654 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:07.293757  5418 leader_election.cc:304] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:07.293907  5494 leader_election.cc:304] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:07.294662  5689 raft_consensus.cc:2804] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:07.295009  5681 raft_consensus.cc:2804] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:07.295156  5689 raft_consensus.cc:697] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:07.295567  5681 raft_consensus.cc:697] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:07.296629  5689 consensus_queue.cc:237] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.297009  5681 consensus_queue.cc:237] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.303983  5648 tablet_bootstrap.cc:654] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.323487  5654 tablet_bootstrap.cc:654] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.328506  5687 raft_consensus.cc:493] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.329073  5687 raft_consensus.cc:515] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.333408  5687 leader_election.cc:290] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:07.336196  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:07.335016  5738 raft_consensus.cc:493] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.337747  5738 raft_consensus.cc:515] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
W20260709 12:22:07.337961  5493 leader_election.cc:343] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.344122  5272 catalog_manager.cc:5697] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.344336  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:07.346066  5379 raft_consensus.cc:2393] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 1: Already voted for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in this term.
I20260709 12:22:07.347719  5738 leader_election.cc:290] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:07.349257  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.349028  5273 catalog_manager.cc:5697] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.338071  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:07.352710  5568 leader_election.cc:304] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:07.354254  5681 raft_consensus.cc:493] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.354986  5681 raft_consensus.cc:515] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
W20260709 12:22:07.356103  5494 leader_election.cc:343] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.337116  5454 raft_consensus.cc:2468] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:07.356619  5494 leader_election.cc:304] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:07.359730  5687 raft_consensus.cc:2749] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.357514  5738 raft_consensus.cc:3060] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.360869  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75d2cbd8eac4a4aa3b08cecc781b081" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.362278  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75d2cbd8eac4a4aa3b08cecc781b081" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:07.363368  5344 leader_election.cc:304] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:07.363736  5378 raft_consensus.cc:2393] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fddd18e8ee414562a16b88c1a12413fc in current term 1: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
I20260709 12:22:07.364513  5690 raft_consensus.cc:2804] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:07.362416  5681 leader_election.cc:290] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:07.365808  5690 raft_consensus.cc:697] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:07.366837  5690 consensus_queue.cc:237] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.368311  5649 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:07.369035  5649 ts_tablet_manager.cc:1403] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.181s	user 0.014s	sys 0.011s
I20260709 12:22:07.369889  5651 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:07.370420  5651 ts_tablet_manager.cc:1403] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.001s
I20260709 12:22:07.372462  5494 leader_election.cc:304] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:07.372308  5649 raft_consensus.cc:359] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.373416  5681 raft_consensus.cc:3060] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.372459  5738 raft_consensus.cc:2749] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.374591  5648 tablet_bootstrap.cc:492] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.375887  5648 ts_tablet_manager.cc:1403] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.112s	user 0.010s	sys 0.014s
I20260709 12:22:07.378458  5648 raft_consensus.cc:359] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.373256  5651 raft_consensus.cc:359] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.379106  5648 raft_consensus.cc:385] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.379125  5654 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:07.379454  5648 raft_consensus.cc:740] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.379793  5654 ts_tablet_manager.cc:1403] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.000s
I20260709 12:22:07.380610  5648 consensus_queue.cc:260] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.379462  5651 raft_consensus.cc:385] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.381989  5651 raft_consensus.cc:740] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.382741  5651 consensus_queue.cc:260] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.383191  5648 ts_tablet_manager.cc:1434] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:07.383121  5654 raft_consensus.cc:359] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.383982  5654 raft_consensus.cc:385] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.384268  5654 raft_consensus.cc:740] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.384456  5648 tablet_bootstrap.cc:492] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.385223  5651 ts_tablet_manager.cc:1434] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:22:07.385015  5654 consensus_queue.cc:260] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.373238  5649 raft_consensus.cc:385] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.385872  5649 raft_consensus.cc:740] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.386639  5649 consensus_queue.cc:260] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.389191  5651 tablet_bootstrap.cc:492] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:07.390705  5654 ts_tablet_manager.cc:1434] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 12:22:07.391184  5681 raft_consensus.cc:2749] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.391566  5648 tablet_bootstrap.cc:654] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.391696  5654 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:07.394028  5649 ts_tablet_manager.cc:1434] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:22:07.395267  5649 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:07.398201  5652 raft_consensus.cc:493] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.398875  5652 raft_consensus.cc:515] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.400619  5654 tablet_bootstrap.cc:654] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.402894  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:07.405122  5343 leader_election.cc:343] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.407631  5652 leader_election.cc:290] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:07.410926  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.411609  5454 raft_consensus.cc:2468] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:07.412739  5344 leader_election.cc:304] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:07.413542  5690 raft_consensus.cc:2804] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.413932  5690 raft_consensus.cc:493] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.414281  5690 raft_consensus.cc:3060] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.415376  5648 tablet_bootstrap.cc:492] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.415930  5648 ts_tablet_manager.cc:1403] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.032s	user 0.025s	sys 0.003s
I20260709 12:22:07.418823  5648 raft_consensus.cc:359] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.419512  5648 raft_consensus.cc:385] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.419826  5648 raft_consensus.cc:740] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.420677  5648 consensus_queue.cc:260] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.420722  5276 catalog_manager.cc:5697] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.423194  5648 ts_tablet_manager.cc:1434] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:07.429685  5651 tablet_bootstrap.cc:654] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.428298  5649 tablet_bootstrap.cc:654] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.434165  5648 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.455400  5648 tablet_bootstrap.cc:654] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.468053  5654 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:07.468513  5681 raft_consensus.cc:493] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.468820  5654 ts_tablet_manager.cc:1403] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.017s
I20260709 12:22:07.469034  5681 raft_consensus.cc:515] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.469249  5691 consensus_queue.cc:1048] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:07.471199  5681 leader_election.cc:290] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:07.471824  5654 raft_consensus.cc:359] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.472532  5654 raft_consensus.cc:385] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.472817  5654 raft_consensus.cc:740] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.473418  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dcd080cf4b413583707e93ec56d4b9" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.473423  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dcd080cf4b413583707e93ec56d4b9" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:07.474527  5690 raft_consensus.cc:515] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
W20260709 12:22:07.476125  5494 leader_election.cc:343] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:07.476853  5494 leader_election.cc:343] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.477279  5494 leader_election.cc:304] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:07.477399  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:07.478302  5687 raft_consensus.cc:2749] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:07.478839  5343 leader_election.cc:343] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.478705  5654 consensus_queue.cc:260] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.480906  5690 leader_election.cc:290] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:07.482615  5648 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.483027  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:07.484596  5454 raft_consensus.cc:3060] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.484822  5648 ts_tablet_manager.cc:1403] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.014s
I20260709 12:22:07.488999  5648 raft_consensus.cc:359] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.489656  5648 raft_consensus.cc:385] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.489926  5648 raft_consensus.cc:740] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.490618  5648 consensus_queue.cc:260] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.491715  5454 raft_consensus.cc:2468] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:07.492373  5738 raft_consensus.cc:493] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.492974  5738 raft_consensus.cc:515] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.493755  5654 ts_tablet_manager.cc:1434] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:22:07.494802  5654 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:07.497223  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:07.497882  5378 raft_consensus.cc:2468] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:07.498540  5344 leader_election.cc:304] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:07.499403  5648 ts_tablet_manager.cc:1434] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:22:07.500360  5648 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.500208  5568 leader_election.cc:304] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:07.501358  5739 raft_consensus.cc:2804] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.501482  5652 raft_consensus.cc:2804] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:07.501785  5739 raft_consensus.cc:493] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.502235  5739 raft_consensus.cc:3060] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.502521  5652 raft_consensus.cc:697] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:07.503961  5654 tablet_bootstrap.cc:654] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.503605  5652 consensus_queue.cc:237] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.505790  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:07.506429  5529 raft_consensus.cc:2468] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:07.508626  5648 tablet_bootstrap.cc:654] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.495043  5738 leader_election.cc:290] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:07.524385  5689 consensus_queue.cc:1048] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:07.548738  5690 consensus_queue.cc:1048] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.557528  5689 raft_consensus.cc:493] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.558238  5689 raft_consensus.cc:515] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.563308  5689 leader_election.cc:290] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:07.564026  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:07.564246  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:07.565656  5418 leader_election.cc:343] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.566007  5648 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
W20260709 12:22:07.566365  5418 leader_election.cc:343] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.566679  5648 ts_tablet_manager.cc:1403] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.002s
I20260709 12:22:07.566852  5418 leader_election.cc:304] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:07.567840  5739 raft_consensus.cc:515] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.573604  5649 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:07.574108  5649 ts_tablet_manager.cc:1403] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.179s	user 0.027s	sys 0.028s
I20260709 12:22:07.574465  5648 raft_consensus.cc:359] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.575182  5648 raft_consensus.cc:385] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.575438  5648 raft_consensus.cc:740] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.577009  5649 raft_consensus.cc:359] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.577754  5649 raft_consensus.cc:385] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.578039  5649 raft_consensus.cc:740] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.578750  5649 consensus_queue.cc:260] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.568913  5651 tablet_bootstrap.cc:492] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:07.568912  5689 raft_consensus.cc:2749] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.570883  5708 consensus_queue.cc:1048] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:07.580806  5651 ts_tablet_manager.cc:1403] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.192s	user 0.017s	sys 0.000s
I20260709 12:22:07.583709  5651 raft_consensus.cc:359] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.584362  5651 raft_consensus.cc:385] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.584656  5651 raft_consensus.cc:740] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.585363  5651 consensus_queue.cc:260] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.585407  5648 consensus_queue.cc:260] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.589957  5648 ts_tablet_manager.cc:1434] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 12:22:07.590946  5648 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.594208  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:07.594636  5651 ts_tablet_manager.cc:1434] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:22:07.595098  5529 raft_consensus.cc:3060] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.595765  5651 tablet_bootstrap.cc:492] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:07.598665  5649 ts_tablet_manager.cc:1434] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:22:07.599310  5648 tablet_bootstrap.cc:654] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.599717  5649 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:07.607338  5739 leader_election.cc:290] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:07.607656  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:07.608651  5379 raft_consensus.cc:3060] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.610700  5654 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:07.610774  5529 raft_consensus.cc:2468] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:07.611384  5654 ts_tablet_manager.cc:1403] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.117s	user 0.062s	sys 0.041s
I20260709 12:22:07.612110  5567 leader_election.cc:304] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:07.613067  5739 raft_consensus.cc:2804] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:07.613732  5739 raft_consensus.cc:697] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:07.614279  5654 raft_consensus.cc:359] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.614995  5654 raft_consensus.cc:385] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.614704  5739 consensus_queue.cc:237] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.615275  5654 raft_consensus.cc:740] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.616129  5654 consensus_queue.cc:260] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.618544  5654 ts_tablet_manager.cc:1434] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:07.619493  5654 tablet_bootstrap.cc:492] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:07.625900  5651 tablet_bootstrap.cc:654] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.626924  5654 tablet_bootstrap.cc:654] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.621726  5379 raft_consensus.cc:2468] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:07.627530  5649 tablet_bootstrap.cc:654] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.655418  5648 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.656246  5648 ts_tablet_manager.cc:1403] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.024s
I20260709 12:22:07.659163  5648 raft_consensus.cc:359] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.659548  5654 tablet_bootstrap.cc:492] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:07.659852  5648 raft_consensus.cc:385] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.660197  5648 raft_consensus.cc:740] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.660282  5654 ts_tablet_manager.cc:1403] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.012s
I20260709 12:22:07.661051  5648 consensus_queue.cc:260] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.665197  5708 raft_consensus.cc:493] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.664240  5654 raft_consensus.cc:359] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.666901  5708 raft_consensus.cc:515] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.667397  5654 raft_consensus.cc:385] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.667737  5654 raft_consensus.cc:740] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.668607  5654 consensus_queue.cc:260] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.669620  5708 leader_election.cc:290] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:07.670238  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dcd080cf4b413583707e93ec56d4b9" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:07.670869  5529 raft_consensus.cc:2468] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:07.670995  5654 ts_tablet_manager.cc:1434] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:07.671361  5648 ts_tablet_manager.cc:1434] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:22:07.672039  5654 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:07.672340  5648 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.672173  5418 leader_election.cc:304] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:07.673630  5708 raft_consensus.cc:2804] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.673977  5708 raft_consensus.cc:493] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.674299  5708 raft_consensus.cc:3060] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.681092  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dcd080cf4b413583707e93ec56d4b9" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:07.681983  5379 raft_consensus.cc:2468] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:07.665947  5273 catalog_manager.cc:5697] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.683952  5651 tablet_bootstrap.cc:492] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:07.690380  5651 ts_tablet_manager.cc:1403] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.000s
I20260709 12:22:07.691018  5708 raft_consensus.cc:515] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.684466  5750 raft_consensus.cc:493] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.692687  5750 raft_consensus.cc:515] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.693527  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dcd080cf4b413583707e93ec56d4b9" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:07.693894  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dcd080cf4b413583707e93ec56d4b9" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:07.694176  5378 raft_consensus.cc:3060] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.694535  5529 raft_consensus.cc:3060] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.695027  5750 leader_election.cc:290] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:07.695701  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:07.697171  5418 leader_election.cc:343] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.696993  5651 raft_consensus.cc:359] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.697805  5651 raft_consensus.cc:385] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.697983  5649 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:07.698536  5649 ts_tablet_manager.cc:1403] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.099s	user 0.024s	sys 0.008s
I20260709 12:22:07.700045  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:07.701351  5419 leader_election.cc:343] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.701848  5419 leader_election.cc:304] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:07.698173  5651 raft_consensus.cc:740] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.702958  5750 raft_consensus.cc:2749] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.703758  5708 leader_election.cc:290] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:07.703387  5651 consensus_queue.cc:260] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.701329  5649 raft_consensus.cc:359] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.704919  5649 raft_consensus.cc:385] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.705206  5649 raft_consensus.cc:740] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.705602  5529 raft_consensus.cc:2468] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:07.686229  5648 tablet_bootstrap.cc:654] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.706110  5649 consensus_queue.cc:260] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.706938  5418 leader_election.cc:304] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:07.708388  5750 raft_consensus.cc:2804] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:07.708684  5649 ts_tablet_manager.cc:1434] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:07.708884  5750 raft_consensus.cc:697] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:07.709627  5649 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:07.709728  5750 consensus_queue.cc:237] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.715976  5271 catalog_manager.cc:5697] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.716991  5708 consensus_queue.cc:1048] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:22:07.705818  5651 ts_tablet_manager.cc:1434] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:22:07.684751  5654 tablet_bootstrap.cc:654] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.726526  5651 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:07.737695  5681 raft_consensus.cc:493] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.738468  5681 raft_consensus.cc:515] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.742213  5681 leader_election.cc:290] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:07.744453  5649 tablet_bootstrap.cc:654] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.744560  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0acea6bb584b6ca4cdb21390af1cf5" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:07.745301  5603 raft_consensus.cc:2468] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:07.746398  5493 leader_election.cc:304] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:07.748617  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0acea6bb584b6ca4cdb21390af1cf5" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.749536  5454 raft_consensus.cc:2468] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:07.749182  5378 raft_consensus.cc:2468] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:07.752125  5681 raft_consensus.cc:2804] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.752684  5681 raft_consensus.cc:493] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.753129  5681 raft_consensus.cc:3060] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.786293  5648 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.786778  5648 ts_tablet_manager.cc:1403] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.049s
I20260709 12:22:07.795378  5648 raft_consensus.cc:359] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.796115  5648 raft_consensus.cc:385] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.796376  5648 raft_consensus.cc:740] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.797091  5648 consensus_queue.cc:260] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.798564  5648 ts_tablet_manager.cc:1434] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:22:07.799453  5648 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.792833  5651 tablet_bootstrap.cc:654] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.804507  5703 consensus_queue.cc:1048] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:07.810117  5648 tablet_bootstrap.cc:654] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.816303  5603 raft_consensus.cc:3060] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.825911  5681 raft_consensus.cc:515] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.826841  5651 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:07.836218  5651 ts_tablet_manager.cc:1403] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.005s
I20260709 12:22:07.837929  5681 leader_election.cc:290] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:07.827055  5654 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:07.839030  5654 ts_tablet_manager.cc:1403] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.167s	user 0.016s	sys 0.010s
I20260709 12:22:07.839808  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0acea6bb584b6ca4cdb21390af1cf5" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:07.832551  5687 consensus_queue.cc:1048] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.833312  5688 raft_consensus.cc:493] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.847230  5688 raft_consensus.cc:515] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
W20260709 12:22:07.833561  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:07.831944  5276 catalog_manager.cc:5697] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.849357  5688 leader_election.cc:290] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:07.849845  5688 consensus_queue.cc:1048] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.850386  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.850862  5455 raft_consensus.cc:2468] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:07.851989  5494 leader_election.cc:304] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:07.852152  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:07.852824  5601 raft_consensus.cc:2468] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:07.838189  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0acea6bb584b6ca4cdb21390af1cf5" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:07.840540  5768 consensus_queue.cc:1048] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:07.859323  5687 raft_consensus.cc:2804] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.860157  5687 raft_consensus.cc:493] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.860517  5687 raft_consensus.cc:3060] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.841228  5651 raft_consensus.cc:359] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.863034  5454 raft_consensus.cc:3060] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.863269  5651 raft_consensus.cc:385] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.863663  5651 raft_consensus.cc:740] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.842191  5649 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:07.842728  5739 raft_consensus.cc:493] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.864387  5651 consensus_queue.cc:260] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.864810  5739 raft_consensus.cc:515] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:07.867058  5739 leader_election.cc:290] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:07.845360  5654 raft_consensus.cc:359] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.858140  5648 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.868721  5648 ts_tablet_manager.cc:1403] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.002s
I20260709 12:22:07.868600  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c21b5980204d2a84e53916eab2d0a0" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:07.868506  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39c21b5980204d2a84e53916eab2d0a0" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:07.870434  5567 leader_election.cc:304] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:07.871857  5648 raft_consensus.cc:359] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.872627  5648 raft_consensus.cc:385] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.872896  5648 raft_consensus.cc:740] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.873615  5648 consensus_queue.cc:260] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.874608  5651 ts_tablet_manager.cc:1434] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:22:07.875622  5651 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:07.875767  5648 ts_tablet_manager.cc:1434] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:07.876570  5654 raft_consensus.cc:385] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.876888  5654 raft_consensus.cc:740] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.877588  5654 consensus_queue.cc:260] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.879758  5654 ts_tablet_manager.cc:1434] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.000s
I20260709 12:22:07.880739  5649 ts_tablet_manager.cc:1403] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.171s	user 0.036s	sys 0.033s
I20260709 12:22:07.883308  5768 consensus_queue.cc:1048] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.883529  5649 raft_consensus.cc:359] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.884207  5649 raft_consensus.cc:385] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.884766  5739 raft_consensus.cc:2749] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.888649  5603 raft_consensus.cc:3060] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.889422  5648 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:07.889910  5654 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:07.899971  5454 raft_consensus.cc:2468] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:07.902729  5651 tablet_bootstrap.cc:654] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.902678  5494 leader_election.cc:304] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:07.900568  5649 raft_consensus.cc:740] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.903882  5688 raft_consensus.cc:2804] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:07.904672  5688 raft_consensus.cc:697] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:07.905871  5688 consensus_queue.cc:237] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.904675  5649 consensus_queue.cc:260] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:07.918668  5768 raft_consensus.cc:493] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.919305  5768 raft_consensus.cc:515] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.922766  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:07.923365  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:07.923501  5768 leader_election.cc:290] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:07.923405  5454 raft_consensus.cc:2468] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:07.903854  5687 raft_consensus.cc:515] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:07.924237  5529 raft_consensus.cc:2468] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:07.925952  5343 leader_election.cc:304] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:07.927382  5687 leader_election.cc:290] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:07.927385  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:07.928192  5454 raft_consensus.cc:3060] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.928496  5768 raft_consensus.cc:2804] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:07.928997  5768 raft_consensus.cc:493] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.929418  5768 raft_consensus.cc:3060] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.929859  5649 ts_tablet_manager.cc:1434] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:22:07.930900  5649 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:07.933983  5601 raft_consensus.cc:3060] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.935000  5603 raft_consensus.cc:2468] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:07.936705  5454 raft_consensus.cc:2468] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:07.938498  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:07.944269  5648 tablet_bootstrap.cc:654] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.948246  5691 consensus_queue.cc:1048] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.950407  5654 tablet_bootstrap.cc:654] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.951282  5649 tablet_bootstrap.cc:654] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.971369  5690 consensus_queue.cc:1048] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:07.953526  5604 raft_consensus.cc:3060] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:07.986310  5276 catalog_manager.cc:5697] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:07.991052  5651 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:07.992034  5768 raft_consensus.cc:515] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:07.993479  5651 ts_tablet_manager.cc:1403] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.118s	user 0.025s	sys 0.005s
I20260709 12:22:07.993896  5648 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:07.994388  5648 ts_tablet_manager.cc:1403] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.105s	user 0.020s	sys 0.006s
I20260709 12:22:07.997068  5654 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:08.003330  5654 ts_tablet_manager.cc:1403] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.014s
I20260709 12:22:08.003490  5651 raft_consensus.cc:359] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.004222  5651 raft_consensus.cc:385] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.004492  5651 raft_consensus.cc:740] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.005169  5651 consensus_queue.cc:260] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.006811  5651 ts_tablet_manager.cc:1434] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:22:08.006661  5654 raft_consensus.cc:359] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.007421  5654 raft_consensus.cc:385] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.007790  5651 tablet_bootstrap.cc:492] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:07.980547  5494 leader_election.cc:304] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:08.008460  5768 leader_election.cc:290] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:08.009059  5604 raft_consensus.cc:2468] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:07.997027  5648 raft_consensus.cc:359] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.009718  5687 raft_consensus.cc:2804] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.009936  5648 raft_consensus.cc:385] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.010298  5687 raft_consensus.cc:697] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:08.011298  5687 consensus_queue.cc:237] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.007740  5654 raft_consensus.cc:740] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.012501  5649 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.013005  5649 ts_tablet_manager.cc:1403] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.020s
I20260709 12:22:08.013010  5654 consensus_queue.cc:260] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.015108  5654 ts_tablet_manager.cc:1434] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.003s
I20260709 12:22:08.016017  5654 tablet_bootstrap.cc:492] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:08.015888  5649 raft_consensus.cc:359] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.016292  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:08.016623  5649 raft_consensus.cc:385] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.016870  5529 raft_consensus.cc:3060] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.016911  5649 raft_consensus.cc:740] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.018148  5649 consensus_queue.cc:260] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.002559  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:08.020334  5649 ts_tablet_manager.cc:1434] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:08.020697  5454 raft_consensus.cc:3060] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.021301  5649 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:08.022258  5654 tablet_bootstrap.cc:654] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.026960  5651 tablet_bootstrap.cc:654] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.035283  5649 tablet_bootstrap.cc:654] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.039557  5529 raft_consensus.cc:2468] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:08.041982  5654 tablet_bootstrap.cc:492] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:08.042497  5654 ts_tablet_manager.cc:1403] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.003s
I20260709 12:22:08.042310  5343 leader_election.cc:304] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:08.043273  5691 raft_consensus.cc:2804] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.043756  5691 raft_consensus.cc:697] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:08.044574  5691 consensus_queue.cc:237] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.050341  5739 raft_consensus.cc:493] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.040561  5454 raft_consensus.cc:2468] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:08.010313  5648 raft_consensus.cc:740] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.050899  5739 raft_consensus.cc:515] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.053661  5648 consensus_queue.cc:260] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.056030  5648 ts_tablet_manager.cc:1434] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.000s
I20260709 12:22:08.056949  5648 tablet_bootstrap.cc:492] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:08.058293  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d84f9d6d8dd4f7e96a52cf86006235c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.058969  5378 raft_consensus.cc:2468] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:08.059971  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d84f9d6d8dd4f7e96a52cf86006235c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:08.055975  5739 leader_election.cc:290] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:08.060885  5454 raft_consensus.cc:2468] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:08.060257  5568 leader_election.cc:304] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:08.071889  5739 raft_consensus.cc:2804] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.072299  5739 raft_consensus.cc:493] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.072650  5739 raft_consensus.cc:3060] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.081120  5276 catalog_manager.cc:5697] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.084611  5651 tablet_bootstrap.cc:492] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:08.085161  5651 ts_tablet_manager.cc:1403] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.017s
I20260709 12:22:08.088165  5649 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.087880  5651 raft_consensus.cc:359] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.088706  5651 raft_consensus.cc:385] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.088847  5649 ts_tablet_manager.cc:1403] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.008s
I20260709 12:22:08.089160  5651 raft_consensus.cc:740] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.088617  5272 catalog_manager.cc:5697] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.089912  5651 consensus_queue.cc:260] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.093114  5651 ts_tablet_manager.cc:1434] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:08.090613  5739 raft_consensus.cc:515] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.094130  5651 tablet_bootstrap.cc:492] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:08.096797  5648 tablet_bootstrap.cc:654] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.098683  5739 leader_election.cc:290] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:08.090853  5654 raft_consensus.cc:359] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.099339  5654 raft_consensus.cc:385] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.099656  5654 raft_consensus.cc:740] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.100392  5654 consensus_queue.cc:260] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.100809  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d84f9d6d8dd4f7e96a52cf86006235c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:08.101460  5378 raft_consensus.cc:3060] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.102614  5654 ts_tablet_manager.cc:1434] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:22:08.103654  5654 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:08.105316  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d84f9d6d8dd4f7e96a52cf86006235c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:08.105937  5454 raft_consensus.cc:3060] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.107477  5649 raft_consensus.cc:359] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.108335  5649 raft_consensus.cc:385] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.108698  5649 raft_consensus.cc:740] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.109640  5649 consensus_queue.cc:260] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.110857  5654 tablet_bootstrap.cc:654] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.120185  5649 ts_tablet_manager.cc:1434] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:22:08.121122  5651 tablet_bootstrap.cc:654] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.121518  5649 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:08.133649  5651 tablet_bootstrap.cc:492] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:08.134454  5651 ts_tablet_manager.cc:1403] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.001s
I20260709 12:22:08.140807  5649 tablet_bootstrap.cc:654] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.141059  5378 raft_consensus.cc:2468] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:08.142349  5568 leader_election.cc:304] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:08.142733  5651 raft_consensus.cc:359] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.143436  5739 raft_consensus.cc:2804] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.143775  5651 raft_consensus.cc:385] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.144129  5651 raft_consensus.cc:740] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.144021  5739 raft_consensus.cc:697] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:08.145586  5739 consensus_queue.cc:237] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.149628  5651 consensus_queue.cc:260] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.140144  5454 raft_consensus.cc:2468] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:08.156059  5649 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.156703  5649 ts_tablet_manager.cc:1403] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.007s
I20260709 12:22:08.159576  5649 raft_consensus.cc:359] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.160401  5649 raft_consensus.cc:385] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.160790  5649 raft_consensus.cc:740] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.161139  5651 ts_tablet_manager.cc:1434] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 12:22:08.161815  5654 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:08.162181  5651 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:08.161706  5649 consensus_queue.cc:260] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.162396  5654 ts_tablet_manager.cc:1403] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.059s	user 0.037s	sys 0.007s
I20260709 12:22:08.165547  5654 raft_consensus.cc:359] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.166256  5654 raft_consensus.cc:385] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.166549  5654 raft_consensus.cc:740] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.161947  5275 catalog_manager.cc:5697] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.167253  5654 consensus_queue.cc:260] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.170722  5649 ts_tablet_manager.cc:1434] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260709 12:22:08.171823  5649 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:08.171891  5739 consensus_queue.cc:1048] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.178494  5649 tablet_bootstrap.cc:654] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.181933  5654 ts_tablet_manager.cc:1434] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:22:08.182996  5654 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:08.184872  5651 tablet_bootstrap.cc:654] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.184615  5739 consensus_queue.cc:1048] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.191994  5739 raft_consensus.cc:493] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.192359  5768 raft_consensus.cc:493] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.192512  5739 raft_consensus.cc:515] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.192915  5768 raft_consensus.cc:515] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.193708  5654 tablet_bootstrap.cc:654] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.194831  5739 leader_election.cc:290] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:08.195919  5648 tablet_bootstrap.cc:492] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:08.195955  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79dc98f9fe994e9488ec27c89efce84d" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:08.196621  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79dc98f9fe994e9488ec27c89efce84d" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:08.196834  5528 raft_consensus.cc:2468] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:08.197371  5768 leader_election.cc:290] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:08.198278  5567 leader_election.cc:304] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:08.196653  5648 ts_tablet_manager.cc:1403] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.140s	user 0.005s	sys 0.022s
I20260709 12:22:08.199837  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c9acfac3f7442eb0892615a08fe453" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:08.200124  5568 leader_election.cc:343] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:08.201715  5343 leader_election.cc:343] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.202229  5738 raft_consensus.cc:2804] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.202634  5738 raft_consensus.cc:493] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.202811  5739 raft_consensus.cc:493] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.202991  5738 raft_consensus.cc:3060] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.203351  5739 raft_consensus.cc:515] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.206408  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a56a6374454cf6b3c48e13d1daf5d9" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:08.206796  5739 leader_election.cc:290] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.208087  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a56a6374454cf6b3c48e13d1daf5d9" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.208282  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c9acfac3f7442eb0892615a08fe453" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:08.208804  5379 raft_consensus.cc:2468] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
W20260709 12:22:08.211184  5344 leader_election.cc:343] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:08.211443  5567 leader_election.cc:343] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.211685  5344 leader_election.cc:304] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:08.213284  5568 leader_election.cc:304] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:08.214097  5648 raft_consensus.cc:359] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.214669  5739 raft_consensus.cc:2804] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.214994  5648 raft_consensus.cc:385] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.215142  5739 raft_consensus.cc:493] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.215322  5648 raft_consensus.cc:740] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.215585  5739 raft_consensus.cc:3060] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.216802  5703 consensus_queue.cc:1048] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.217501  5750 consensus_queue.cc:1048] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.217937  5768 raft_consensus.cc:2749] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:08.219669  5738 raft_consensus.cc:515] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.216104  5648 consensus_queue.cc:260] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.223107  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79dc98f9fe994e9488ec27c89efce84d" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:08.225348  5648 ts_tablet_manager.cc:1434] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:22:08.230626  5738 leader_election.cc:290] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:08.230561  5568 leader_election.cc:343] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.231788  5687 raft_consensus.cc:493] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.235069  5648 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:08.236887  5681 raft_consensus.cc:493] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.241899  5681 raft_consensus.cc:515] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.243978  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79dc98f9fe994e9488ec27c89efce84d" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:08.244769  5527 raft_consensus.cc:3060] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.251288  5681 leader_election.cc:290] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.251754  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3420ee8c43745c5af1bb3648726e7d0" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:08.252766  5602 raft_consensus.cc:2468] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:08.254453  5493 leader_election.cc:304] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:08.255611  5681 raft_consensus.cc:2804] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.256108  5681 raft_consensus.cc:493] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.237331  5687 raft_consensus.cc:515] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.256567  5681 raft_consensus.cc:3060] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.246534  5703 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.269223  5651 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:08.270885  5651 ts_tablet_manager.cc:1403] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.000s
I20260709 12:22:08.274165  5651 raft_consensus.cc:359] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.275152  5651 raft_consensus.cc:385] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.275506  5651 raft_consensus.cc:740] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.276315  5651 consensus_queue.cc:260] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.276497  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3420ee8c43745c5af1bb3648726e7d0" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.278828  5651 ts_tablet_manager.cc:1434] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:22:08.278095  5739 raft_consensus.cc:515] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.278895  5703 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.285899  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:08.278828  5377 raft_consensus.cc:2468] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
W20260709 12:22:08.287734  5418 leader_election.cc:343] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.293059  5651 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:08.297994  5703 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.298964  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a56a6374454cf6b3c48e13d1daf5d9" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:08.299232  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:08.300547  5567 leader_election.cc:343] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:08.300698  5419 leader_election.cc:343] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.301214  5419 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:08.302404  5687 leader_election.cc:290] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:08.302512  5739 leader_election.cc:290] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.303500  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:08.305604  5493 leader_election.cc:343] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.305598  5649 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.306607  5649 ts_tablet_manager.cc:1403] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.135s	user 0.006s	sys 0.014s
I20260709 12:22:08.309023  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a56a6374454cf6b3c48e13d1daf5d9" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:08.303535  5703 raft_consensus.cc:2749] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:08.313607  5649 raft_consensus.cc:359] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.315770  5649 raft_consensus.cc:385] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.316119  5649 raft_consensus.cc:740] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.316562  5654 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:08.312768  5377 raft_consensus.cc:3060] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.317147  5654 ts_tablet_manager.cc:1403] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.134s	user 0.019s	sys 0.036s
I20260709 12:22:08.320529  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:08.311695  5648 tablet_bootstrap.cc:654] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.321190  5454 raft_consensus.cc:2468] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:08.321839  5649 consensus_queue.cc:260] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.316928  5527 raft_consensus.cc:2468] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:08.319911  5654 raft_consensus.cc:359] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.310829  5651 tablet_bootstrap.cc:654] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.327483  5654 raft_consensus.cc:385] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.327831  5654 raft_consensus.cc:740] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.331955  5494 leader_election.cc:304] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:08.333647  5649 ts_tablet_manager.cc:1434] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:22:08.336315  5649 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:08.339802  5654 consensus_queue.cc:260] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.321712  5681 raft_consensus.cc:515] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.337595  5687 raft_consensus.cc:2804] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.344569  5567 leader_election.cc:304] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:08.349228  5791 raft_consensus.cc:493] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.349751  5791 raft_consensus.cc:515] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.352495  5791 leader_election.cc:290] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.355176  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fad4ce0c2a44c8b885dcbca5bfde87" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.356173  5654 ts_tablet_manager.cc:1434] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
W20260709 12:22:08.356812  5494 leader_election.cc:343] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.358937  5649 tablet_bootstrap.cc:654] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.359181  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fad4ce0c2a44c8b885dcbca5bfde87" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:08.359550  5816 raft_consensus.cc:2804] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.344048  5687 raft_consensus.cc:493] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:08.364630  5493 leader_election.cc:343] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.364818  5687 raft_consensus.cc:3060] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.365163  5493 leader_election.cc:304] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:08.365932  5688 consensus_queue.cc:1048] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.367270  5791 raft_consensus.cc:2749] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:08.368105  5654 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:08.382948  5377 raft_consensus.cc:2468] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:08.384305  5568 leader_election.cc:304] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:08.385124  5654 tablet_bootstrap.cc:654] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.385912  5738 raft_consensus.cc:2804] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.386672  5738 raft_consensus.cc:697] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:08.387552  5738 consensus_queue.cc:237] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.392637  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3420ee8c43745c5af1bb3648726e7d0" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:08.393419  5377 raft_consensus.cc:3060] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.394054  5648 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:08.394181  5681 leader_election.cc:290] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.394572  5648 ts_tablet_manager.cc:1403] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.160s	user 0.005s	sys 0.008s
I20260709 12:22:08.396986  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3420ee8c43745c5af1bb3648726e7d0" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:08.397822  5604 raft_consensus.cc:3060] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.405602  5648 raft_consensus.cc:359] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.406358  5648 raft_consensus.cc:385] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.406630  5648 raft_consensus.cc:740] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.407354  5648 consensus_queue.cc:260] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.408639  5687 raft_consensus.cc:515] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.410782  5687 leader_election.cc:290] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:08.413311  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:08.413951  5455 raft_consensus.cc:3060] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.417812  5648 ts_tablet_manager.cc:1434] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 12:22:08.425551  5651 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:08.426082  5651 ts_tablet_manager.cc:1403] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.023s
I20260709 12:22:08.426740  5791 consensus_queue.cc:1048] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.427548  5604 raft_consensus.cc:2468] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:08.428784  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:08.430315  5649 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.430783  5649 ts_tablet_manager.cc:1403] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.095s	user 0.005s	sys 0.013s
I20260709 12:22:08.432138  5493 leader_election.cc:304] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:08.432596  5648 tablet_bootstrap.cc:492] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
W20260709 12:22:08.433106  5493 leader_election.cc:343] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.434638  5688 raft_consensus.cc:2804] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.435134  5688 raft_consensus.cc:697] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:08.436542  5816 raft_consensus.cc:697] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:08.437888  5816 consensus_queue.cc:237] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.435946  5688 consensus_queue.cc:237] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.442536  5703 raft_consensus.cc:493] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.445287  5703 raft_consensus.cc:515] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.450928  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64afdc610b42868a6cd77183a441d7" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:08.451719  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64afdc610b42868a6cd77183a441d7" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.451936  5703 leader_election.cc:290] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:08.452392  5378 raft_consensus.cc:2468] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
W20260709 12:22:08.452973  5418 leader_election.cc:343] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.454123  5419 leader_election.cc:304] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:08.454321  5649 raft_consensus.cc:359] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.455040  5649 raft_consensus.cc:385] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.455328  5649 raft_consensus.cc:740] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.463267  5651 raft_consensus.cc:359] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.466603  5651 raft_consensus.cc:385] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.466950  5651 raft_consensus.cc:740] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.455265  5703 raft_consensus.cc:2804] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.467022  5649 consensus_queue.cc:260] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.467798  5651 consensus_queue.cc:260] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.471769  5649 ts_tablet_manager.cc:1434] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.006s
I20260709 12:22:08.472939  5649 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:08.471837  5651 ts_tablet_manager.cc:1434] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:22:08.474155  5377 raft_consensus.cc:2468] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:08.457741  5820 raft_consensus.cc:493] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.474206  5455 raft_consensus.cc:2468] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:08.475165  5820 raft_consensus.cc:515] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.477286  5651 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:08.478837  5703 raft_consensus.cc:493] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.478696  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.479856  5276 catalog_manager.cc:5697] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.494621  5651 tablet_bootstrap.cc:654] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.479278  5703 raft_consensus.cc:3060] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.507133  5750 raft_consensus.cc:493] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:08.506733  5568 leader_election.cc:343] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.510411  5750 raft_consensus.cc:515] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.517928  5820 leader_election.cc:290] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:08.519152  5750 leader_election.cc:290] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:08.519687  5494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:34515, user_credentials={real_user=slave}} blocked reactor thread for 62876.3us
I20260709 12:22:08.526914  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c9acfac3f7442eb0892615a08fe453" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.528254  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c9acfac3f7442eb0892615a08fe453" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:08.529284  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:08.534669  5654 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:08.535024  5649 tablet_bootstrap.cc:654] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.540109  5654 ts_tablet_manager.cc:1403] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.172s	user 0.030s	sys 0.039s
I20260709 12:22:08.531711  5275 catalog_manager.cc:5697] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:08.539923  5527 raft_consensus.cc:2468] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:08.538703  5648 tablet_bootstrap.cc:654] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.541759  5377 raft_consensus.cc:2468] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:08.539983  5455 raft_consensus.cc:2468] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:08.549046  5419 leader_election.cc:304] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:08.550913  5568 leader_election.cc:304] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:08.551745  5820 raft_consensus.cc:2804] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.552109  5820 raft_consensus.cc:493] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.552740  5750 raft_consensus.cc:2804] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.552466  5820 raft_consensus.cc:3060] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.553400  5750 raft_consensus.cc:493] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.557077  5750 raft_consensus.cc:3060] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.557812  5654 raft_consensus.cc:359] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.558205  5651 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:08.558758  5651 ts_tablet_manager.cc:1403] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.010s
I20260709 12:22:08.561446  5651 raft_consensus.cc:359] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.562106  5651 raft_consensus.cc:385] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.562376  5651 raft_consensus.cc:740] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.562953  5651 consensus_queue.cc:260] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.565171  5651 ts_tablet_manager.cc:1434] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:08.566131  5651 tablet_bootstrap.cc:492] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:08.566754  5654 raft_consensus.cc:385] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.567118  5654 raft_consensus.cc:740] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.569109  5654 consensus_queue.cc:260] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.571305  5654 ts_tablet_manager.cc:1434] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:22:08.572184  5654 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:08.572054  5820 raft_consensus.cc:515] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.574194  5820 leader_election.cc:290] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:08.564863  5750 raft_consensus.cc:515] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.577129  5494 leader_election.cc:304] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:08.577674  5691 consensus_queue.cc:1048] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.577976  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:08.578349  5649 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.578570  5455 raft_consensus.cc:3060] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.578809  5649 ts_tablet_manager.cc:1403] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.009s
I20260709 12:22:08.579062  5687 raft_consensus.cc:2804] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.579603  5687 raft_consensus.cc:697] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:08.580925  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:08.581511  5750 leader_election.cc:290] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:08.582281  5649 raft_consensus.cc:359] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.582523  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c9acfac3f7442eb0892615a08fe453" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:08.583125  5378 raft_consensus.cc:3060] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.583941  5649 raft_consensus.cc:385] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.584343  5649 raft_consensus.cc:740] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.587815  5649 consensus_queue.cc:260] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.590224  5649 ts_tablet_manager.cc:1434] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:22:08.591176  5649 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:08.577258  5272 catalog_manager.cc:5697] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.600086  5455 raft_consensus.cc:2468] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
W20260709 12:22:08.596190  5568 leader_election.cc:343] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.566682  5703 raft_consensus.cc:515] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.601598  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c9acfac3f7442eb0892615a08fe453" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:08.602221  5528 raft_consensus.cc:3060] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.602981  5703 leader_election.cc:290] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:08.604753  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64afdc610b42868a6cd77183a441d7" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:08.580422  5687 consensus_queue.cc:237] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.607636  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64afdc610b42868a6cd77183a441d7" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:08.608281  5377 raft_consensus.cc:3060] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.609215  5651 tablet_bootstrap.cc:654] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.615154  5827 consensus_queue.cc:1048] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:08.614676  5418 leader_election.cc:343] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.617238  5568 leader_election.cc:304] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:08.618288  5820 raft_consensus.cc:2804] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.621541  5691 consensus_queue.cc:1048] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.630540  5528 raft_consensus.cc:2468] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:08.632226  5820 raft_consensus.cc:697] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:08.634275  5820 consensus_queue.cc:237] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.637034  5378 raft_consensus.cc:2468] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:08.637436  5827 consensus_queue.cc:1048] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.639187  5419 leader_election.cc:304] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:08.640403  5750 raft_consensus.cc:2804] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.641044  5750 raft_consensus.cc:697] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:08.641913  5750 consensus_queue.cc:237] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.643975  5649 tablet_bootstrap.cc:654] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.652505  5654 tablet_bootstrap.cc:654] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.667651  5648 tablet_bootstrap.cc:492] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:08.668306  5648 ts_tablet_manager.cc:1403] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.245s	user 0.015s	sys 0.011s
I20260709 12:22:08.666034  5377 raft_consensus.cc:2468] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:08.679958  5648 raft_consensus.cc:359] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.680718  5648 raft_consensus.cc:385] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.680994  5648 raft_consensus.cc:740] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.681679  5648 consensus_queue.cc:260] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.682770  5272 catalog_manager.cc:5697] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.691607  5648 ts_tablet_manager.cc:1434] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:22:08.693183  5648 tablet_bootstrap.cc:492] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:08.680619  5419 leader_election.cc:304] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:08.702008  5703 raft_consensus.cc:2804] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.709640  5703 raft_consensus.cc:697] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:08.710507  5703 consensus_queue.cc:237] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.719003  5649 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.719547  5649 ts_tablet_manager.cc:1403] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.129s	user 0.021s	sys 0.011s
I20260709 12:22:08.722110  5681 raft_consensus.cc:493] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.722637  5681 raft_consensus.cc:515] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.728785  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a56a6374454cf6b3c48e13d1daf5d9" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:08.729671  5649 raft_consensus.cc:359] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.730397  5649 raft_consensus.cc:385] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.730659  5649 raft_consensus.cc:740] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.730517  5738 consensus_queue.cc:1048] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:22:08.737841  5768 raft_consensus.cc:493] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.738406  5768 raft_consensus.cc:515] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.732368  5649 consensus_queue.cc:260] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.741499  5768 leader_election.cc:290] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:08.741454  5651 tablet_bootstrap.cc:492] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:08.743669  5651 ts_tablet_manager.cc:1403] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.178s	user 0.023s	sys 0.012s
I20260709 12:22:08.740365  5681 leader_election.cc:290] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.752996  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a56a6374454cf6b3c48e13d1daf5d9" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.753822  5377 raft_consensus.cc:2393] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fddd18e8ee414562a16b88c1a12413fc in current term 1: Already voted for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in this term.
I20260709 12:22:08.753736  5651 raft_consensus.cc:359] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.754534  5651 raft_consensus.cc:385] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.754850  5651 raft_consensus.cc:740] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.756335  5494 leader_election.cc:304] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:08.757251  5681 raft_consensus.cc:3060] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.760737  5651 consensus_queue.cc:260] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.739650  5816 consensus_queue.cc:1048] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:22:08.765645  5649 ts_tablet_manager.cc:1434] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:22:08.766659  5649 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:08.766906  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324177360e04468a9795c4da53cdbd1c" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:08.769335  5343 leader_election.cc:343] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.769496  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324177360e04468a9795c4da53cdbd1c" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:08.772377  5344 leader_election.cc:343] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.772884  5344 leader_election.cc:304] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:08.773660  5768 raft_consensus.cc:2749] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:08.784726  5649 tablet_bootstrap.cc:654] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.786175  5651 ts_tablet_manager.cc:1434] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:22:08.787560  5651 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:08.793334  5816 raft_consensus.cc:493] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.795929  5816 raft_consensus.cc:515] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.798256  5816 leader_election.cc:290] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.797828  5271 catalog_manager.cc:5697] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.800803  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fad4ce0c2a44c8b885dcbca5bfde87" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:08.802167  5768 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.802657  5768 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.803352  5648 tablet_bootstrap.cc:654] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.805102  5681 raft_consensus.cc:2749] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:08.807315  5568 leader_election.cc:343] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.808845  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fad4ce0c2a44c8b885dcbca5bfde87" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:08.799925  5271 catalog_manager.cc:5697] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.808272  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:08.811475  5343 leader_election.cc:343] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.809520  5527 raft_consensus.cc:2468] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:08.813112  5567 leader_election.cc:304] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:08.814515  5768 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:08.817673  5816 raft_consensus.cc:2804] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.822043  5654 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:08.822530  5654 ts_tablet_manager.cc:1403] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.251s	user 0.023s	sys 0.035s
I20260709 12:22:08.821122  5816 raft_consensus.cc:493] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.824604  5816 raft_consensus.cc:3060] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.825034  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:08.825706  5454 raft_consensus.cc:2468] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:08.834161  5654 raft_consensus.cc:359] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.835145  5654 raft_consensus.cc:385] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.835486  5654 raft_consensus.cc:740] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.832850  5344 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:08.837302  5768 raft_consensus.cc:2804] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.837424  5648 tablet_bootstrap.cc:492] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:08.837935  5648 ts_tablet_manager.cc:1403] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.006s
I20260709 12:22:08.837702  5768 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.839911  5768 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.846560  5654 consensus_queue.cc:260] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.850783  5649 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.851261  5649 ts_tablet_manager.cc:1403] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.009s
I20260709 12:22:08.851052  5768 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.853376  5768 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:08.853964  5649 raft_consensus.cc:359] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.854592  5649 raft_consensus.cc:385] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.854444  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:08.855154  5454 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.854967  5649 raft_consensus.cc:740] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.856284  5649 consensus_queue.cc:260] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.858867  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:08.865079  5604 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.859335  5654 ts_tablet_manager.cc:1434] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:22:08.868983  5654 tablet_bootstrap.cc:492] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:08.870253  5651 tablet_bootstrap.cc:654] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.849238  5816 raft_consensus.cc:515] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.874148  5649 ts_tablet_manager.cc:1434] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:22:08.875100  5649 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:08.873531  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fad4ce0c2a44c8b885dcbca5bfde87" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:08.877529  5528 raft_consensus.cc:3060] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.877676  5816 leader_election.cc:290] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:08.877903  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fad4ce0c2a44c8b885dcbca5bfde87" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
W20260709 12:22:08.879375  5568 leader_election.cc:343] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.880309  5648 raft_consensus.cc:359] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.880965  5648 raft_consensus.cc:385] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.881232  5648 raft_consensus.cc:740] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.884693  5648 consensus_queue.cc:260] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.886111  5528 raft_consensus.cc:2468] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:08.886438  5648 ts_tablet_manager.cc:1434] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:22:08.887409  5648 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:08.887302  5567 leader_election.cc:304] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:08.888187  5604 raft_consensus.cc:2468] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:08.888450  5816 raft_consensus.cc:2804] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.892606  5816 raft_consensus.cc:697] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:08.897054  5816 consensus_queue.cc:237] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.901005  5275 catalog_manager.cc:5697] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.903045  5652 raft_consensus.cc:493] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.903534  5652 raft_consensus.cc:515] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.907189  5343 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:08.908378  5768 raft_consensus.cc:2804] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.909055  5768 raft_consensus.cc:697] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:08.910108  5768 consensus_queue.cc:237] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.911576  5649 tablet_bootstrap.cc:654] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.916769  5454 raft_consensus.cc:2468] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:08.920042  5652 leader_election.cc:290] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:08.921808  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5a0e2e4c2a4f8c9a8bfa8ea813be51" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:08.929982  5654 tablet_bootstrap.cc:654] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:08.924590  5343 leader_election.cc:343] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.929804  5652 raft_consensus.cc:493] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.936949  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5a0e2e4c2a4f8c9a8bfa8ea813be51" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:08.942973  5648 tablet_bootstrap.cc:654] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.937244  5652 raft_consensus.cc:515] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:08.948719  5651 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:08.949337  5651 ts_tablet_manager.cc:1403] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.005s
I20260709 12:22:08.952502  5649 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:08.953047  5649 ts_tablet_manager.cc:1403] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.078s	user 0.004s	sys 0.010s
I20260709 12:22:08.952981  5651 raft_consensus.cc:359] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.953712  5654 tablet_bootstrap.cc:492] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:08.953843  5651 raft_consensus.cc:385] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.954262  5654 ts_tablet_manager.cc:1403] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.003s
I20260709 12:22:08.954921  5652 leader_election.cc:290] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:08.954258  5651 raft_consensus.cc:740] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.955996  5651 consensus_queue.cc:260] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:08.957017  5649 raft_consensus.cc:359] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.957844  5649 raft_consensus.cc:385] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.957662  5654 raft_consensus.cc:359] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.958329  5649 raft_consensus.cc:740] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.958529  5654 raft_consensus.cc:385] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.959108  5654 raft_consensus.cc:740] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.959571  5649 consensus_queue.cc:260] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:08.960028  5654 consensus_queue.cc:260] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:08.999830  5648 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:09.001710  5648 ts_tablet_manager.cc:1403] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.002s
I20260709 12:22:09.009214  5651 ts_tablet_manager.cc:1434] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:22:09.010550  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:09.008962  5343 leader_election.cc:343] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.012140  5651 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:09.016201  5689 raft_consensus.cc:493] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.017452  5689 raft_consensus.cc:515] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.017710  5816 consensus_queue.cc:1048] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.021757  5689 leader_election.cc:290] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:09.013722  5687 consensus_queue.cc:1048] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:22:09.012609  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:09.037382  5820 consensus_queue.cc:1048] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.038648  5454 raft_consensus.cc:2393] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in current term 1: Already voted for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in this term.
I20260709 12:22:09.015259  5343 leader_election.cc:304] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:09.044994  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7777356542417f8aa0e1ca2a9955ec" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:09.045692  5768 raft_consensus.cc:2749] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.044564  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7777356542417f8aa0e1ca2a9955ec" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:09.051510  5527 raft_consensus.cc:2468] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:09.051435  5820 consensus_queue.cc:1048] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.053952  5649 ts_tablet_manager.cc:1434] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 12:22:09.057523  5654 ts_tablet_manager.cc:1434] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.003s
I20260709 12:22:09.060722  5454 raft_consensus.cc:3060] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:09.076906  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:09.048012  5343 leader_election.cc:304] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:09.091789  5649 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:09.054011  5648 raft_consensus.cc:359] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.093401  5648 raft_consensus.cc:385] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.093739  5648 raft_consensus.cc:740] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.094522  5648 consensus_queue.cc:260] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.099574  5654 tablet_bootstrap.cc:492] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:09.101394  5649 tablet_bootstrap.cc:654] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:09.105086  5418 leader_election.cc:343] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:09.114212  5343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:38145, user_credentials={real_user=slave}} blocked reactor thread for 66424.1us
I20260709 12:22:09.119088  5648 ts_tablet_manager.cc:1434] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.005s
I20260709 12:22:09.120556  5652 raft_consensus.cc:3060] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.155759  5272 catalog_manager.cc:5697] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.172794  5418 leader_election.cc:304] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:09.173908  5689 consensus_queue.cc:1048] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:09.175992  5689 raft_consensus.cc:2804] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:09.178475  5689 raft_consensus.cc:493] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.179139  5689 raft_consensus.cc:3060] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.182981  5791 consensus_queue.cc:1048] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.215430  5648 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
W20260709 12:22:09.220649  5418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.131:41985, user_credentials={real_user=slave}} blocked reactor thread for 47974.7us
I20260709 12:22:09.223078  5687 consensus_queue.cc:1048] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:09.227015  5651 tablet_bootstrap.cc:700] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc: Time spent opening tablet: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:22:09.227950  5651 tablet_bootstrap.cc:654] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.245551  5750 raft_consensus.cc:493] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.246002  5703 consensus_queue.cc:1048] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.246361  5750 raft_consensus.cc:515] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.254020  5649 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:09.254676  5649 ts_tablet_manager.cc:1403] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.178s	user 0.038s	sys 0.059s
I20260709 12:22:09.232983  5689 raft_consensus.cc:515] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.265748  5689 leader_election.cc:290] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:09.262617  5750 leader_election.cc:290] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:09.263633  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324177360e04468a9795c4da53cdbd1c" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:09.271155  5375 raft_consensus.cc:2468] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:09.273408  5419 leader_election.cc:304] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:09.273236  5649 raft_consensus.cc:359] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.274299  5649 raft_consensus.cc:385] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.274358  5768 raft_consensus.cc:493] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.274857  5649 raft_consensus.cc:740] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.275226  5768 raft_consensus.cc:515] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:09.275923  5649 consensus_queue.cc:260] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.281950  5768 leader_election.cc:290] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:09.283727  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324177360e04468a9795c4da53cdbd1c" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:09.283921  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7777356542417f8aa0e1ca2a9955ec" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:09.284706  5529 raft_consensus.cc:3060] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.285041  5861 raft_consensus.cc:2804] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:09.285712  5861 raft_consensus.cc:493] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.286190  5861 raft_consensus.cc:3060] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.285034  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7777356542417f8aa0e1ca2a9955ec" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:09.290079  5654 tablet_bootstrap.cc:654] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.293174  5708 raft_consensus.cc:493] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.293933  5708 raft_consensus.cc:515] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.300709  5601 raft_consensus.cc:3060] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.302058  5738 consensus_queue.cc:1048] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.303200  5708 leader_election.cc:290] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
W20260709 12:22:09.311406  5418 leader_election.cc:343] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.311657  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79dc98f9fe994e9488ec27c89efce84d" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:09.267136  5689 consensus_queue.cc:1048] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:22:09.314309  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79dc98f9fe994e9488ec27c89efce84d" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:09.328974  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fad4ce0c2a44c8b885dcbca5bfde87" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:09.325071  5652 raft_consensus.cc:2749] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:09.326891  5418 leader_election.cc:343] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.337090  5687 raft_consensus.cc:493] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.348948  5816 consensus_queue.cc:1048] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:09.352753  5687 raft_consensus.cc:515] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.358335  5687 leader_election.cc:290] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:09.359054  5648 tablet_bootstrap.cc:654] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.353058  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fad4ce0c2a44c8b885dcbca5bfde87" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:09.360383  5527 raft_consensus.cc:2393] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in current term 1: Already voted for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in this term.
I20260709 12:22:09.363723  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64afdc610b42868a6cd77183a441d7" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:09.392797  5649 ts_tablet_manager.cc:1434] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.138s	user 0.011s	sys 0.002s
I20260709 12:22:09.394747  5649 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:09.417275  5651 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:09.417781  5651 ts_tablet_manager.cc:1403] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.406s	user 0.013s	sys 0.028s
I20260709 12:22:09.419945  5654 tablet_bootstrap.cc:492] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:09.420506  5654 ts_tablet_manager.cc:1403] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.328s	user 0.015s	sys 0.013s
I20260709 12:22:09.422075  5529 raft_consensus.cc:2468] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
W20260709 12:22:09.424147  5864 log.cc:927] Time spent T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:22:09.425804  5820 raft_consensus.cc:493] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.426371  5820 raft_consensus.cc:515] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.423523  5654 raft_consensus.cc:359] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.434614  5654 raft_consensus.cc:385] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.435060  5654 raft_consensus.cc:740] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.438009  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b64afdc610b42868a6cd77183a441d7" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:09.438974  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:41985, user_credentials={real_user=slave}} blocked reactor thread for 75042.4us
I20260709 12:22:09.440415  5494 leader_election.cc:304] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:09.442027  5828 consensus_queue.cc:1048] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.440019  5654 consensus_queue.cc:260] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.443574  5681 raft_consensus.cc:2749] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.445000  5271 catalog_manager.cc:5697] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.444072  5651 raft_consensus.cc:359] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.468557  5651 raft_consensus.cc:385] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.468987  5651 raft_consensus.cc:740] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.481541  5343 leader_election.cc:304] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:09.482702  5871 raft_consensus.cc:3060] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.484362  5649 tablet_bootstrap.cc:654] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.485206  5418 leader_election.cc:304] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:09.519459  5654 ts_tablet_manager.cc:1434] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.003s
I20260709 12:22:09.520525  5739 consensus_queue.cc:1048] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:22:09.520385  5651 consensus_queue.cc:260] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.523561  5651 ts_tablet_manager.cc:1434] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.106s	user 0.009s	sys 0.000s
I20260709 12:22:09.525223  5651 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:09.484576  5861 raft_consensus.cc:515] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.531005  5820 leader_election.cc:290] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:09.516568  5494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:39599, user_credentials={real_user=slave}} blocked reactor thread for 76369.8us
I20260709 12:22:09.531620  5862 raft_consensus.cc:2749] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.532930  5861 leader_election.cc:290] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:09.533994  5648 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:09.535409  5648 ts_tablet_manager.cc:1403] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.320s	user 0.018s	sys 0.005s
I20260709 12:22:09.516662  5529 raft_consensus.cc:3060] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.551735  5649 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:09.552237  5649 ts_tablet_manager.cc:1403] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.158s	user 0.005s	sys 0.013s
I20260709 12:22:09.533968  5866 consensus_queue.cc:1048] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:22:09.565564  5654 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:09.566381  5768 raft_consensus.cc:493] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.566891  5768 raft_consensus.cc:515] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.567442  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:09.545066  5418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:38145, user_credentials={real_user=slave}} blocked reactor thread for 59961.7us
I20260709 12:22:09.570140  5768 leader_election.cc:290] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:09.577962  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:09.585991  5648 raft_consensus.cc:359] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
W20260709 12:22:09.580785  5419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:39599, user_credentials={real_user=slave}} blocked reactor thread for 59129.3us
I20260709 12:22:09.591135  5648 raft_consensus.cc:385] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.591405  5648 raft_consensus.cc:740] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.592103  5648 consensus_queue.cc:260] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.589597  5568 leader_election.cc:304] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:09.594676  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41986298fd9435e9b41fe9ad22ccdc1" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:09.596202  5343 leader_election.cc:343] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.573994  5871 raft_consensus.cc:2749] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.608404  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324177360e04468a9795c4da53cdbd1c" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:09.609170  5379 raft_consensus.cc:3060] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.610601  5865 raft_consensus.cc:493] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.611217  5865 raft_consensus.cc:515] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.613641  5865 leader_election.cc:290] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:09.614473  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41986298fd9435e9b41fe9ad22ccdc1" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:09.618592  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa51550cc1e48779233015cd4d9e0c9" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:09.602149  5768 consensus_queue.cc:1048] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:22:09.621287  5654 tablet_bootstrap.cc:654] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.623282  5651 tablet_bootstrap.cc:654] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.625362  5648 ts_tablet_manager.cc:1434] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 12:22:09.626959  5648 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:09.635474  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa51550cc1e48779233015cd4d9e0c9" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:09.635756  5691 consensus_queue.cc:1048] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.637575  5649 raft_consensus.cc:359] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.637872  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "324177360e04468a9795c4da53cdbd1c" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:09.638350  5649 raft_consensus.cc:385] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.638686  5526 raft_consensus.cc:3060] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.640419  5820 raft_consensus.cc:2749] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.641826  5418 leader_election.cc:304] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:09.639173  5866 consensus_queue.cc:1048] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:09.635965  5419 leader_election.cc:343] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.638688  5649 raft_consensus.cc:740] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.644788  5649 consensus_queue.cc:260] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.646073  5865 raft_consensus.cc:2804] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:09.648525  5865 raft_consensus.cc:697] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:09.650233  5379 raft_consensus.cc:2468] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:09.649868  5865 consensus_queue.cc:237] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.698328  5708 consensus_queue.cc:1048] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:09.699719  5649 ts_tablet_manager.cc:1434] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.147s	user 0.007s	sys 0.001s
I20260709 12:22:09.701395  5526 raft_consensus.cc:2468] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:09.702559  5649 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:09.694756  5419 leader_election.cc:304] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:09.707579  5750 raft_consensus.cc:2804] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:09.708071  5750 raft_consensus.cc:697] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:09.708896  5750 consensus_queue.cc:237] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
W20260709 12:22:09.710091  5344 leader_election.cc:343] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.710608  5344 leader_election.cc:304] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
W20260709 12:22:09.710954  5418 leader_election.cc:343] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.711441  5418 leader_election.cc:304] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:09.713521  5871 raft_consensus.cc:2749] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.729925  5648 tablet_bootstrap.cc:654] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.730136  5689 raft_consensus.cc:2749] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.734730  5649 tablet_bootstrap.cc:654] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.784595  5654 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:09.785248  5654 ts_tablet_manager.cc:1403] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.220s	user 0.027s	sys 0.006s
I20260709 12:22:09.789175  5651 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:09.789722  5651 ts_tablet_manager.cc:1403] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.265s	user 0.018s	sys 0.026s
I20260709 12:22:09.792706  5651 raft_consensus.cc:359] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:09.793367  5651 raft_consensus.cc:385] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.793624  5651 raft_consensus.cc:740] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.794518  5651 consensus_queue.cc:260] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:09.798663  5651 ts_tablet_manager.cc:1434] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:22:09.800810  5275 catalog_manager.cc:5697] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.802956  5654 raft_consensus.cc:359] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.800384  5649 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:09.803705  5654 raft_consensus.cc:385] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.804078  5654 raft_consensus.cc:740] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.804113  5649 ts_tablet_manager.cc:1403] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.102s	user 0.023s	sys 0.020s
I20260709 12:22:09.813264  5651 tablet_bootstrap.cc:492] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:09.807680  5649 raft_consensus.cc:359] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.820567  5649 raft_consensus.cc:385] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.820874  5649 raft_consensus.cc:740] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.821597  5649 consensus_queue.cc:260] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.819362  5648 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:09.823004  5648 ts_tablet_manager.cc:1403] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.196s	user 0.015s	sys 0.000s
I20260709 12:22:09.823164  5649 ts_tablet_manager.cc:1434] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.008s
I20260709 12:22:09.805615  5654 consensus_queue.cc:260] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.821938  5691 raft_consensus.cc:493] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.826340  5691 raft_consensus.cc:515] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.826421  5648 raft_consensus.cc:359] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.827288  5651 tablet_bootstrap.cc:654] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.827288  5648 raft_consensus.cc:385] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.827844  5648 raft_consensus.cc:740] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.828624  5691 leader_election.cc:290] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:09.828766  5648 consensus_queue.cc:260] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.831665  5649 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:09.831405  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc39fb0872d49eda4aaa7170e421978" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:09.833496  5344 leader_election.cc:343] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.836468  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc39fb0872d49eda4aaa7170e421978" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:09.837901  5343 leader_election.cc:343] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.838367  5343 leader_election.cc:304] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:09.842393  5649 tablet_bootstrap.cc:654] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.845798  5652 raft_consensus.cc:2749] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.859061  5648 ts_tablet_manager.cc:1434] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 12:22:09.860688  5648 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:09.826808  5654 ts_tablet_manager.cc:1434] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.004s
I20260709 12:22:09.881800  5654 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:09.882187  5648 tablet_bootstrap.cc:654] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.883616  5651 tablet_bootstrap.cc:492] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:09.884217  5651 ts_tablet_manager.cc:1403] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.037s
I20260709 12:22:09.888047  5651 raft_consensus.cc:359] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.889495  5651 raft_consensus.cc:385] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.891672  5651 raft_consensus.cc:740] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.892711  5651 consensus_queue.cc:260] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.895449  5651 ts_tablet_manager.cc:1434] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:09.903467  5750 raft_consensus.cc:493] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.904018  5750 raft_consensus.cc:515] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.913614  5750 leader_election.cc:290] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:09.914979  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcb0fbb15b4f14949afe776218f367" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:09.916213  5651 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
W20260709 12:22:09.919293  5418 leader_election.cc:343] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.920182  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcb0fbb15b4f14949afe776218f367" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:09.920872  5377 raft_consensus.cc:2468] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:09.921394  5651 tablet_bootstrap.cc:654] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.922132  5419 leader_election.cc:304] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:09.922542  5648 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:09.923003  5648 ts_tablet_manager.cc:1403] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.007s
I20260709 12:22:09.924353  5689 raft_consensus.cc:2804] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:09.924773  5689 raft_consensus.cc:493] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.925107  5689 raft_consensus.cc:3060] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.925523  5869 raft_consensus.cc:493] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.930233  5869 raft_consensus.cc:515] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:09.930377  5275 catalog_manager.cc:5697] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.925969  5648 raft_consensus.cc:359] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.932497  5648 raft_consensus.cc:385] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.932806  5648 raft_consensus.cc:740] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.929623  5654 tablet_bootstrap.cc:654] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.934393  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7777356542417f8aa0e1ca2a9955ec" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:09.935846  5689 raft_consensus.cc:515] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:09.933481  5648 consensus_queue.cc:260] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:09.938941  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcb0fbb15b4f14949afe776218f367" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:09.939352  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a7777356542417f8aa0e1ca2a9955ec" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:09.940421  5529 raft_consensus.cc:2393] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 1: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
W20260709 12:22:09.940692  5418 leader_election.cc:343] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.940738  5648 ts_tablet_manager.cc:1434] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:22:09.942306  5567 leader_election.cc:304] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:09.942669  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedcb0fbb15b4f14949afe776218f367" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:09.943295  5377 raft_consensus.cc:3060] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.943601  5869 leader_election.cc:290] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:09.944767  5869 raft_consensus.cc:3060] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:09.942847  5648 tablet_bootstrap.cc:492] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:09.946699  5689 leader_election.cc:290] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:09.954680  5649 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:09.955199  5649 ts_tablet_manager.cc:1403] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.124s	user 0.020s	sys 0.012s
I20260709 12:22:09.959007  5649 raft_consensus.cc:359] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:09.959609  5649 raft_consensus.cc:385] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.959852  5649 raft_consensus.cc:740] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.960459  5649 consensus_queue.cc:260] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:09.962476  5649 ts_tablet_manager.cc:1434] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:09.963197  5791 raft_consensus.cc:493] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.963604  5649 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:09.963919  5791 raft_consensus.cc:515] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:09.970468  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5a0e2e4c2a4f8c9a8bfa8ea813be51" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:09.973832  5493 leader_election.cc:343] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.978073  5377 raft_consensus.cc:2468] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:09.979884  5691 raft_consensus.cc:493] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.978942  5791 leader_election.cc:290] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:09.981225  5691 raft_consensus.cc:515] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:09.982101  5419 leader_election.cc:304] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:09.983413  5689 raft_consensus.cc:2804] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:09.984120  5689 raft_consensus.cc:697] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:09.985203  5649 tablet_bootstrap.cc:654] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:09.985536  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:09.987555  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:09.988030  5343 leader_election.cc:343] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.985014  5689 consensus_queue.cc:237] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
W20260709 12:22:09.988813  5343 leader_election.cc:343] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:09.975811  5869 raft_consensus.cc:2749] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.989322  5343 leader_election.cc:304] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:09.990090  5652 raft_consensus.cc:2749] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:09.990446  5691 leader_election.cc:290] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:09.994024  5651 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:09.994526  5651 ts_tablet_manager.cc:1403] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.026s
I20260709 12:22:09.997292  5651 raft_consensus.cc:359] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:09.997925  5651 raft_consensus.cc:385] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:09.998219  5651 raft_consensus.cc:740] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:09.998881  5651 consensus_queue.cc:260] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.001362  5648 tablet_bootstrap.cc:654] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.001632  5651 ts_tablet_manager.cc:1434] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:10.002571  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5a0e2e4c2a4f8c9a8bfa8ea813be51" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:10.003257  5377 raft_consensus.cc:2468] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:10.003786  5654 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:10.003834  5651 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:10.004307  5654 ts_tablet_manager.cc:1403] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.028s
I20260709 12:22:10.004462  5494 leader_election.cc:304] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:10.005810  5791 raft_consensus.cc:2804] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.006219  5791 raft_consensus.cc:493] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.006562  5791 raft_consensus.cc:3060] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.007301  5654 raft_consensus.cc:359] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.008055  5654 raft_consensus.cc:385] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.008311  5654 raft_consensus.cc:740] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.009107  5654 consensus_queue.cc:260] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.011612  5654 ts_tablet_manager.cc:1434] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:10.013108  5654 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:10.019888  5649 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:10.020649  5649 ts_tablet_manager.cc:1403] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.008s
I20260709 12:22:10.023198  5651 tablet_bootstrap.cc:654] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.023698  5649 raft_consensus.cc:359] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.024552  5649 raft_consensus.cc:385] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.024886  5649 raft_consensus.cc:740] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.025730  5649 consensus_queue.cc:260] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.026131  5688 raft_consensus.cc:493] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.027590  5688 raft_consensus.cc:515] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.020296  5654 tablet_bootstrap.cc:654] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.036381  5649 ts_tablet_manager.cc:1434] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:22:10.037811  5649 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:10.039191  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0174a8220da546bba7e2ccf232f59244" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:10.039855  5377 raft_consensus.cc:2468] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:10.031102  5688 leader_election.cc:290] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:10.047353  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0174a8220da546bba7e2ccf232f59244" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:10.059878  5494 leader_election.cc:304] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
W20260709 12:22:10.060496  5493 leader_election.cc:343] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.061323  5688 raft_consensus.cc:2804] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.061759  5688 raft_consensus.cc:493] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.062330  5688 raft_consensus.cc:3060] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.061633  5791 raft_consensus.cc:515] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.067538  5791 leader_election.cc:290] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:10.069476  5276 catalog_manager.cc:5697] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:10.071277  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5a0e2e4c2a4f8c9a8bfa8ea813be51" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:10.071888  5604 raft_consensus.cc:3060] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.072460  5649 tablet_bootstrap.cc:654] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.074838  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5a0e2e4c2a4f8c9a8bfa8ea813be51" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:10.075484  5377 raft_consensus.cc:3060] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.088501  5604 raft_consensus.cc:2468] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:10.090032  5493 leader_election.cc:304] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:10.090889  5791 raft_consensus.cc:2804] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.091979  5791 raft_consensus.cc:697] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:10.092484  5648 tablet_bootstrap.cc:492] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:10.092974  5648 ts_tablet_manager.cc:1403] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.150s	user 0.031s	sys 0.004s
I20260709 12:22:10.092794  5791 consensus_queue.cc:237] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.093995  5688 raft_consensus.cc:515] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.095835  5648 raft_consensus.cc:359] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.096529  5648 raft_consensus.cc:385] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.096776  5648 raft_consensus.cc:740] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.097481  5648 consensus_queue.cc:260] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.098343  5651 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:10.098609  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0174a8220da546bba7e2ccf232f59244" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:10.098834  5651 ts_tablet_manager.cc:1403] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.003s
W20260709 12:22:10.100117  5493 leader_election.cc:343] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.102617  5651 raft_consensus.cc:359] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.103317  5651 raft_consensus.cc:385] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.103574  5651 raft_consensus.cc:740] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.101984  5377 raft_consensus.cc:2468] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:10.108533  5688 leader_election.cc:290] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:10.108103  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0174a8220da546bba7e2ccf232f59244" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:10.109306  5377 raft_consensus.cc:3060] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.104615  5651 consensus_queue.cc:260] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.112701  5649 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:10.113255  5649 ts_tablet_manager.cc:1403] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.008s
I20260709 12:22:10.114753  5654 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:10.115260  5654 ts_tablet_manager.cc:1403] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.102s	user 0.029s	sys 0.027s
I20260709 12:22:10.115865  5651 ts_tablet_manager.cc:1434] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:22:10.116982  5651 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:10.117034  5648 ts_tablet_manager.cc:1434] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:22:10.118255  5654 raft_consensus.cc:359] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.118942  5654 raft_consensus.cc:385] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.119206  5654 raft_consensus.cc:740] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.120410  5377 raft_consensus.cc:2468] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:10.121536  5494 leader_election.cc:304] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:10.122874  5688 raft_consensus.cc:2804] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.123610  5688 raft_consensus.cc:697] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:10.123421  5649 raft_consensus.cc:359] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.124197  5649 raft_consensus.cc:385] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.124506  5649 raft_consensus.cc:740] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.124562  5688 consensus_queue.cc:237] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.125362  5649 consensus_queue.cc:260] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.127636  5649 ts_tablet_manager.cc:1434] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:22:10.127640  5648 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:10.128152  5654 consensus_queue.cc:260] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.130673  5654 ts_tablet_manager.cc:1434] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:22:10.131697  5649 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:10.138502  5654 tablet_bootstrap.cc:492] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:10.146153  5654 tablet_bootstrap.cc:654] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.147972  5272 catalog_manager.cc:5697] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.149716  5689 consensus_queue.cc:1048] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.150295  5649 tablet_bootstrap.cc:654] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.152927  5750 raft_consensus.cc:493] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.153489  5750 raft_consensus.cc:515] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.155386  5654 tablet_bootstrap.cc:492] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:10.155689  5750 leader_election.cc:290] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.155892  5654 ts_tablet_manager.cc:1403] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:22:10.158804  5654 raft_consensus.cc:359] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.159407  5654 raft_consensus.cc:385] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.159670  5654 raft_consensus.cc:740] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.159924  5651 tablet_bootstrap.cc:654] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.164378  5649 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:10.164880  5649 ts_tablet_manager.cc:1403] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.002s
I20260709 12:22:10.170493  5649 raft_consensus.cc:359] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.171171  5649 raft_consensus.cc:385] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.171437  5649 raft_consensus.cc:740] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.172364  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:10.172628  5654 consensus_queue.cc:260] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.172363  5649 consensus_queue.cc:260] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
W20260709 12:22:10.175621  5418 leader_election.cc:343] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.177268  5654 ts_tablet_manager.cc:1434] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:22:10.175650  5649 ts_tablet_manager.cc:1434] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:22:10.179123  5649 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
W20260709 12:22:10.180390  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:10.181186  5654 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:10.182961  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:10.187692  5654 tablet_bootstrap.cc:654] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.193393  5272 catalog_manager.cc:5697] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:10.207286  5419 leader_election.cc:343] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.207978  5419 leader_election.cc:304] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:10.209534  5750 raft_consensus.cc:2749] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.210095  5651 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:10.211225  5649 tablet_bootstrap.cc:654] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.213611  5708 consensus_queue.cc:1048] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.213196  5689 consensus_queue.cc:1048] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.217232  5654 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:10.217784  5654 ts_tablet_manager.cc:1403] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.005s
I20260709 12:22:10.218493  5651 ts_tablet_manager.cc:1403] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.009s
I20260709 12:22:10.221318  5651 raft_consensus.cc:359] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.222004  5651 raft_consensus.cc:385] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.225471  5651 raft_consensus.cc:740] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.226219  5651 consensus_queue.cc:260] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.228039  5649 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:10.228482  5651 ts_tablet_manager.cc:1434] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:10.228658  5649 ts_tablet_manager.cc:1403] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.001s
I20260709 12:22:10.229748  5651 tablet_bootstrap.cc:492] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:10.231736  5649 raft_consensus.cc:359] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.232393  5649 raft_consensus.cc:385] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.232672  5649 raft_consensus.cc:740] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.220757  5654 raft_consensus.cc:359] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.233366  5654 raft_consensus.cc:385] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.233665  5654 raft_consensus.cc:740] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.234375  5654 consensus_queue.cc:260] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.237253  5654 ts_tablet_manager.cc:1434] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:22:10.237382  5651 tablet_bootstrap.cc:654] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.238591  5649 consensus_queue.cc:260] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.240737  5654 tablet_bootstrap.cc:492] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:10.243593  5652 raft_consensus.cc:493] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.244088  5652 raft_consensus.cc:515] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.248147  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fedcb24a7843748efb4e0db04fd967" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:10.249677  5652 leader_election.cc:290] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:10.250402  5343 leader_election.cc:343] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.256654  5654 tablet_bootstrap.cc:654] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.259732  5649 ts_tablet_manager.cc:1434] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:22:10.260944  5649 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:10.263836  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fedcb24a7843748efb4e0db04fd967" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:10.267179  5344 leader_election.cc:343] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.267825  5344 leader_election.cc:304] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:10.269316  5652 raft_consensus.cc:2749] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.271430  5649 tablet_bootstrap.cc:654] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.278961  5654 tablet_bootstrap.cc:492] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:10.279338  5866 raft_consensus.cc:493] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.279887  5866 raft_consensus.cc:515] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.283165  5651 tablet_bootstrap.cc:492] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:10.279887  5654 ts_tablet_manager.cc:1403] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.004s
I20260709 12:22:10.283659  5651 ts_tablet_manager.cc:1403] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.026s
I20260709 12:22:10.283960  5866 leader_election.cc:290] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:10.285120  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa51550cc1e48779233015cd4d9e0c9" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:10.285799  5454 raft_consensus.cc:2468] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:10.283391  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa51550cc1e48779233015cd4d9e0c9" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:10.286793  5651 raft_consensus.cc:359] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.287164  5379 raft_consensus.cc:2468] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:10.287495  5651 raft_consensus.cc:385] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.287776  5651 raft_consensus.cc:740] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.284003  5750 raft_consensus.cc:493] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.288300  5649 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:10.289557  5649 ts_tablet_manager.cc:1403] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 12:22:10.288904  5651 consensus_queue.cc:260] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.289659  5568 leader_election.cc:304] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:10.289598  5750 raft_consensus.cc:515] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.292050  5654 raft_consensus.cc:359] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.292714  5654 raft_consensus.cc:385] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.292963  5654 raft_consensus.cc:740] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.293695  5654 consensus_queue.cc:260] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.294976  5750 leader_election.cc:290] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:10.296023  5654 ts_tablet_manager.cc:1434] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 12:22:10.293592  5866 raft_consensus.cc:2804] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.296167  5649 raft_consensus.cc:359] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.298372  5649 raft_consensus.cc:385] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.297187  5689 consensus_queue.cc:1048] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:10.298797  5649 raft_consensus.cc:740] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.299038  5651 ts_tablet_manager.cc:1434] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.006s
I20260709 12:22:10.300083  5651 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:10.300554  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f641edcab549deae1aa846ded8f15c" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:10.301692  5648 tablet_bootstrap.cc:654] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:10.301869  5418 leader_election.cc:343] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.303440  5649 consensus_queue.cc:260] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.302933  5866 raft_consensus.cc:493] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.304781  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f641edcab549deae1aa846ded8f15c" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:10.305101  5866 raft_consensus.cc:3060] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.304793  5654 tablet_bootstrap.cc:492] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
W20260709 12:22:10.311785  5418 leader_election.cc:343] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.312266  5418 leader_election.cc:304] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:10.313009  5861 raft_consensus.cc:2749] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.313205  5654 tablet_bootstrap.cc:654] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.315600  5651 tablet_bootstrap.cc:654] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.317060  5649 ts_tablet_manager.cc:1434] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:22:10.324956  5649 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:10.336588  5791 raft_consensus.cc:493] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.339125  5791 raft_consensus.cc:515] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.341429  5791 leader_election.cc:290] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:10.342434  5866 raft_consensus.cc:515] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.343048  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41986298fd9435e9b41fe9ad22ccdc1" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:10.344575  5866 leader_election.cc:290] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:10.346393  5494 leader_election.cc:343] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.346962  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa51550cc1e48779233015cd4d9e0c9" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:10.347654  5379 raft_consensus.cc:3060] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.348338  5649 tablet_bootstrap.cc:654] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.352294  5651 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:10.352785  5651 ts_tablet_manager.cc:1403] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.005s
I20260709 12:22:10.353569  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41986298fd9435e9b41fe9ad22ccdc1" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:10.354230  5377 raft_consensus.cc:2468] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:10.354970  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa51550cc1e48779233015cd4d9e0c9" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:10.355180  5687 raft_consensus.cc:493] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.355609  5453 raft_consensus.cc:3060] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.355731  5687 raft_consensus.cc:515] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.358188  5687 leader_election.cc:290] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:10.358785  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:10.360373  5493 leader_election.cc:343] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.361910  5494 leader_election.cc:304] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:10.363336  5651 raft_consensus.cc:359] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.363704  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:10.364076  5651 raft_consensus.cc:385] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.364320  5377 raft_consensus.cc:2468] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:10.364391  5651 raft_consensus.cc:740] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.365949  5691 raft_consensus.cc:493] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.366111  5687 raft_consensus.cc:2804] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.366503  5687 raft_consensus.cc:493] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.366441  5691 raft_consensus.cc:515] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.367563  5494 leader_election.cc:304] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:10.368584  5691 leader_election.cc:290] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.368686  5648 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:10.368690  5688 raft_consensus.cc:493] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.369369  5648 ts_tablet_manager.cc:1403] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.244s	user 0.014s	sys 0.001s
I20260709 12:22:10.369526  5688 raft_consensus.cc:515] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.370599  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:10.371016  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:10.371668  5454 raft_consensus.cc:2468] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:10.372061  5648 raft_consensus.cc:359] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.372421  5379 raft_consensus.cc:2468] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:10.372767  5344 leader_election.cc:304] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:10.372771  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887ea6f2292649de80a0e337800fd7cb" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:10.373708  5691 raft_consensus.cc:2804] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.373857  5453 raft_consensus.cc:2468] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:10.372897  5687 raft_consensus.cc:3060] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:10.374399  5493 leader_election.cc:343] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.374389  5691 raft_consensus.cc:493] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.375348  5568 leader_election.cc:304] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:10.375440  5691 raft_consensus.cc:3060] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.379535  5866 raft_consensus.cc:2804] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.380024  5750 consensus_queue.cc:1048] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.380537  5688 leader_election.cc:290] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:10.380729  5866 raft_consensus.cc:697] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:10.368829  5791 raft_consensus.cc:2804] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.382236  5791 raft_consensus.cc:493] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.382067  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887ea6f2292649de80a0e337800fd7cb" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:10.381685  5866 consensus_queue.cc:237] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.382902  5791 raft_consensus.cc:3060] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:10.384055  5494 leader_election.cc:343] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.384557  5494 leader_election.cc:304] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:10.385434  5688 raft_consensus.cc:2749] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.396462  5691 raft_consensus.cc:515] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.402015  5791 raft_consensus.cc:515] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.405995  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:10.406649  5454 raft_consensus.cc:3060] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.372807  5648 raft_consensus.cc:385] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.408793  5648 raft_consensus.cc:740] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.409655  5648 consensus_queue.cc:260] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.411931  5648 ts_tablet_manager.cc:1434] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:22:10.414948  5454 raft_consensus.cc:2468] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:10.365294  5651 consensus_queue.cc:260] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.417163  5526 raft_consensus.cc:2468] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:10.420920  5651 ts_tablet_manager.cc:1434] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
I20260709 12:22:10.425014  5750 raft_consensus.cc:493] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.425665  5750 raft_consensus.cc:515] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.422008  5651 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:10.428566  5750 leader_election.cc:290] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.430028  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:10.431618  5419 leader_election.cc:343] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.431497  5691 leader_election.cc:290] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.436687  5872 raft_consensus.cc:493] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.437340  5872 raft_consensus.cc:515] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.439530  5872 leader_election.cc:290] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.442584  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a654b632744c53946820d8bb4c5fb8" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:10.443284  5526 raft_consensus.cc:2468] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:10.444051  5604 raft_consensus.cc:3060] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.444231  5344 leader_election.cc:304] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:10.446301  5567 leader_election.cc:304] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:10.447238  5869 raft_consensus.cc:2804] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.447604  5869 raft_consensus.cc:493] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.447906  5869 raft_consensus.cc:3060] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.446327  5652 raft_consensus.cc:2804] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.452745  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:10.460465  5649 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:10.461018  5649 ts_tablet_manager.cc:1403] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.136s	user 0.017s	sys 0.000s
I20260709 12:22:10.461267  5869 raft_consensus.cc:515] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.467319  5654 tablet_bootstrap.cc:492] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:10.467875  5654 ts_tablet_manager.cc:1403] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.004s
I20260709 12:22:10.471450  5654 raft_consensus.cc:359] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.475436  5687 raft_consensus.cc:515] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.478675  5750 consensus_queue.cc:1048] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:10.481314  5418 leader_election.cc:343] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.481757  5418 leader_election.cc:304] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:10.482487  5750 raft_consensus.cc:2749] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.488863  5651 tablet_bootstrap.cc:654] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.490052  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a654b632744c53946820d8bb4c5fb8" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:10.490828  5648 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:10.491698  5652 raft_consensus.cc:697] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
W20260709 12:22:10.492990  5568 leader_election.cc:343] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.493461  5869 leader_election.cc:290] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.494217  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a654b632744c53946820d8bb4c5fb8" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:10.463860  5649 raft_consensus.cc:359] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.494920  5649 raft_consensus.cc:385] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.494941  5529 raft_consensus.cc:3060] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.495329  5649 raft_consensus.cc:740] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.498648  5452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a654b632744c53946820d8bb4c5fb8" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:10.499858  5791 leader_election.cc:290] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:10.500355  5568 leader_election.cc:343] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.492650  5652 consensus_queue.cc:237] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.500851  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:10.501688  5687 leader_election.cc:290] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:10.510946  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
W20260709 12:22:10.502221  5493 leader_election.cc:343] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.514343  5526 raft_consensus.cc:3060] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.472303  5654 raft_consensus.cc:385] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.510466  5649 consensus_queue.cc:260] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.503590  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41986298fd9435e9b41fe9ad22ccdc1" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:10.519181  5654 raft_consensus.cc:740] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.521046  5654 consensus_queue.cc:260] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.522470  5379 raft_consensus.cc:3060] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.526981  5649 ts_tablet_manager.cc:1434] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 12:22:10.529031  5654 ts_tablet_manager.cc:1434] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.002s
I20260709 12:22:10.501730  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:10.535655  5452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41986298fd9435e9b41fe9ad22ccdc1" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:10.544510  5526 raft_consensus.cc:2468] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:10.545774  5648 tablet_bootstrap.cc:654] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.534960  5377 raft_consensus.cc:3060] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.546448  5649 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
W20260709 12:22:10.556208  5494 leader_election.cc:343] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.556600  5529 raft_consensus.cc:2468] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:10.557885  5931 raft_consensus.cc:493] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.557840  5567 leader_election.cc:304] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:10.558501  5931 raft_consensus.cc:515] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.559656  5654 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:10.561846  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:10.563129  5343 leader_election.cc:343] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.562011  5866 raft_consensus.cc:2804] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.565068  5866 raft_consensus.cc:697] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:10.568214  5866 consensus_queue.cc:237] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.563817  5931 leader_election.cc:290] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.564114  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:10.569224  5276 catalog_manager.cc:5697] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.570096  5453 raft_consensus.cc:2468] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:10.570367  5379 raft_consensus.cc:2468] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:10.563017  5791 consensus_queue.cc:1048] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:10.572247  5344 leader_election.cc:304] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:10.572824  5649 tablet_bootstrap.cc:654] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.573136  5494 leader_election.cc:304] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:10.574156  5691 raft_consensus.cc:2804] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.574553  5691 raft_consensus.cc:493] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.574916  5691 raft_consensus.cc:3060] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.574946  5687 raft_consensus.cc:2804] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.575618  5687 raft_consensus.cc:697] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:10.577849  5654 tablet_bootstrap.cc:654] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.578776  5687 consensus_queue.cc:237] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.564051  5651 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:10.583848  5651 ts_tablet_manager.cc:1403] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.162s	user 0.017s	sys 0.000s
I20260709 12:22:10.585171  5931 raft_consensus.cc:493] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.610335  5869 raft_consensus.cc:493] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.613744  5869 raft_consensus.cc:515] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.615864  5869 leader_election.cc:290] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.601528  5931 raft_consensus.cc:515] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.619997  5928 consensus_queue.cc:1048] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:22:10.629784  5276 catalog_manager.cc:5697] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.623234  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fd276ebc024672a5c9eafb8f805442" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:10.636801  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fd276ebc024672a5c9eafb8f805442" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:10.645146  5567 leader_election.cc:343] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.650425  5649 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:10.650959  5649 ts_tablet_manager.cc:1403] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.013s
I20260709 12:22:10.646231  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c71518e1df4ec39ce7f29b4be4a21c" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:10.660108  5343 leader_election.cc:343] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.662389  5931 leader_election.cc:290] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:10.653874  5649 raft_consensus.cc:359] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.666822  5649 raft_consensus.cc:385] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.667207  5649 raft_consensus.cc:740] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
W20260709 12:22:10.671936  5568 leader_election.cc:343] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.673630  5651 raft_consensus.cc:359] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.674396  5651 raft_consensus.cc:385] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.672479  5568 leader_election.cc:304] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:10.674718  5651 raft_consensus.cc:740] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.675414  5651 consensus_queue.cc:260] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.676275  5872 raft_consensus.cc:2749] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.678315  5649 consensus_queue.cc:260] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.678810  5272 catalog_manager.cc:5697] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:10.682016  5649 ts_tablet_manager.cc:1434] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 12:22:10.693112  5649 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:10.693257  5651 ts_tablet_manager.cc:1434] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 12:22:10.694180  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c71518e1df4ec39ce7f29b4be4a21c" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:10.695609  5344 leader_election.cc:343] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.696051  5344 leader_election.cc:304] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:10.697222  5377 raft_consensus.cc:2468] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:10.697786  5931 raft_consensus.cc:2749] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.694501  5651 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:10.707489  5494 leader_election.cc:304] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:10.707322  5688 consensus_queue.cc:1048] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:10.708367  5791 raft_consensus.cc:2804] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.708878  5791 raft_consensus.cc:697] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:10.709689  5791 consensus_queue.cc:237] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.704401  5936 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.716776  5936 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.719394  5936 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:10.700879  5691 raft_consensus.cc:515] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.724080  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:10.724874  5455 raft_consensus.cc:3060] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.724961  5691 leader_election.cc:290] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.729938  5872 raft_consensus.cc:493] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.730588  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:10.730480  5872 raft_consensus.cc:515] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.746949  5648 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:10.747715  5648 ts_tablet_manager.cc:1403] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.257s	user 0.008s	sys 0.010s
I20260709 12:22:10.755702  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:10.759822  5872 leader_election.cc:290] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:10.763504  5493 consensus_peers.cc:597] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc -> Peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Couldn't send request to peer 2df71e80861d4ef18c58ce9ed40ed9ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:10.764349  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
W20260709 12:22:10.767725  5343 leader_election.cc:343] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:10.768790  5343 leader_election.cc:343] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.779193  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc39fb0872d49eda4aaa7170e421978" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:10.782104  5343 leader_election.cc:343] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.782615  5343 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:10.782765  5376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc39fb0872d49eda4aaa7170e421978" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:10.783383  5691 raft_consensus.cc:2749] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:10.776683  5276 catalog_manager.cc:5697] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:10.784243  5376 raft_consensus.cc:2468] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:10.789813  5648 raft_consensus.cc:359] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.790777  5648 raft_consensus.cc:385] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.791123  5648 raft_consensus.cc:740] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.794288  5649 tablet_bootstrap.cc:654] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.781517  5272 catalog_manager.cc:5697] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.807376  5654 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:10.807870  5654 ts_tablet_manager.cc:1403] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.248s	user 0.033s	sys 0.009s
I20260709 12:22:10.808751  5648 consensus_queue.cc:260] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.811879  5651 tablet_bootstrap.cc:654] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.832231  5648 ts_tablet_manager.cc:1434] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.001s
I20260709 12:22:10.839538  5455 raft_consensus.cc:2468] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:10.844482  5344 leader_election.cc:304] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:10.846058  5691 raft_consensus.cc:2804] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.846678  5691 raft_consensus.cc:697] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:10.847777  5691 consensus_queue.cc:237] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:10.850410  5654 raft_consensus.cc:359] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.851114  5654 raft_consensus.cc:385] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:10.851365  5654 raft_consensus.cc:740] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:10.820147  5568 leader_election.cc:304] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:10.853004  5944 raft_consensus.cc:2804] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.853358  5944 raft_consensus.cc:493] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.853709  5944 raft_consensus.cc:3060] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.852035  5654 consensus_queue.cc:260] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:10.864158  5648 tablet_bootstrap.cc:492] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:10.868621  5654 ts_tablet_manager.cc:1434] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:22:10.869784  5654 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:10.880811  5944 raft_consensus.cc:515] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.881564  5648 tablet_bootstrap.cc:654] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.882993  5944 leader_election.cc:290] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:10.858472  5568 leader_election.cc:343] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.892364  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc39fb0872d49eda4aaa7170e421978" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
W20260709 12:22:10.894110  5568 leader_election.cc:343] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.894574  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc39fb0872d49eda4aaa7170e421978" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:10.895176  5377 raft_consensus.cc:3060] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.895480  5654 tablet_bootstrap.cc:654] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:10.900038  5691 consensus_queue.cc:1048] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.900678  5872 consensus_queue.cc:1048] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.902258  5652 consensus_queue.cc:1048] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:10.906924  5941 consensus_queue.cc:1048] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:10.934373  5941 raft_consensus.cc:493] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.934701  5377 raft_consensus.cc:2468] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:10.934980  5941 raft_consensus.cc:515] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:10.967589  5941 leader_election.cc:290] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:10.975445  5568 leader_election.cc:304] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:10.979619  5452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f641edcab549deae1aa846ded8f15c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:10.980329  5452 raft_consensus.cc:2468] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:10.981621  5872 raft_consensus.cc:2804] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:10.982317  5568 leader_election.cc:304] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:10.983983  5872 raft_consensus.cc:697] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:10.986770  5872 consensus_queue.cc:237] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:10.989334  5651 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:10.984118  5945 raft_consensus.cc:2804] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:10.989948  5651 ts_tablet_manager.cc:1403] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.296s	user 0.023s	sys 0.002s
I20260709 12:22:10.990319  5945 raft_consensus.cc:493] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:10.990779  5945 raft_consensus.cc:3060] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:10.996869  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f641edcab549deae1aa846ded8f15c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:10.999671  5945 raft_consensus.cc:515] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
W20260709 12:22:11.000335  5567 leader_election.cc:343] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:10.984182  5649 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:11.004212  5649 ts_tablet_manager.cc:1403] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.311s	user 0.023s	sys 0.032s
I20260709 12:22:11.010730  5945 leader_election.cc:290] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:11.018898  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f641edcab549deae1aa846ded8f15c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:11.019694  5451 raft_consensus.cc:3060] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:11.021028  5568 consensus_peers.cc:597] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:11.039549  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f641edcab549deae1aa846ded8f15c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
W20260709 12:22:11.041114  5567 leader_election.cc:343] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.049311  5654 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:11.049806  5654 ts_tablet_manager.cc:1403] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.180s	user 0.010s	sys 0.011s
I20260709 12:22:11.052407  5451 raft_consensus.cc:2468] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:11.054057  5651 raft_consensus.cc:359] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.054615  5568 leader_election.cc:304] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.054850  5651 raft_consensus.cc:385] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.055333  5651 raft_consensus.cc:740] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.055490  5941 raft_consensus.cc:2804] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:11.056237  5651 consensus_queue.cc:260] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.057308  5941 raft_consensus.cc:697] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:11.058693  5651 ts_tablet_manager.cc:1434] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:22:11.059932  5651 tablet_bootstrap.cc:492] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:11.058666  5941 consensus_queue.cc:237] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.063902  5648 tablet_bootstrap.cc:492] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:11.064405  5648 ts_tablet_manager.cc:1403] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.204s	user 0.010s	sys 0.039s
I20260709 12:22:11.082326  5648 raft_consensus.cc:359] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.083001  5648 raft_consensus.cc:385] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.083276  5648 raft_consensus.cc:740] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.083813  5648 consensus_queue.cc:260] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.085192  5648 ts_tablet_manager.cc:1434] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:22:11.086216  5648 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:11.094599  5601 raft_consensus.cc:3060] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.071089  5654 raft_consensus.cc:359] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.096413  5654 raft_consensus.cc:385] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.096716  5654 raft_consensus.cc:740] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.097414  5654 consensus_queue.cc:260] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.098784  5791 raft_consensus.cc:493] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.099498  5654 ts_tablet_manager.cc:1434] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.049s	user 0.001s	sys 0.003s
I20260709 12:22:11.077032  5866 consensus_queue.cc:1048] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:22:11.100775  5654 tablet_bootstrap.cc:492] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
W20260709 12:22:11.077464  5957 log.cc:927] Time spent T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:22:11.073364  5649 raft_consensus.cc:359] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.102567  5649 raft_consensus.cc:385] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.102854  5649 raft_consensus.cc:740] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.103523  5649 consensus_queue.cc:260] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.073467  5271 catalog_manager.cc:5697] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:11.105615  5649 ts_tablet_manager.cc:1434] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.000s
I20260709 12:22:11.106621  5649 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:11.067010  5651 tablet_bootstrap.cc:654] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.099535  5791 raft_consensus.cc:515] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.121006  5654 tablet_bootstrap.cc:654] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.121465  5688 consensus_queue.cc:1048] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:11.121838  5791 leader_election.cc:290] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:11.125073  5376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fedcb24a7843748efb4e0db04fd967" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:11.125746  5376 raft_consensus.cc:2468] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:11.126096  5648 tablet_bootstrap.cc:654] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.128408  5494 leader_election.cc:304] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:11.117045  5276 catalog_manager.cc:5697] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:11.131937  5688 raft_consensus.cc:2804] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:11.132387  5688 raft_consensus.cc:493] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.132740  5688 raft_consensus.cc:3060] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.136518  5791 consensus_queue.cc:1048] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:11.145169  5455 raft_consensus.cc:3060] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.145840  5649 tablet_bootstrap.cc:654] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.150405  5688 raft_consensus.cc:515] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.152488  5945 raft_consensus.cc:493] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.152702  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fedcb24a7843748efb4e0db04fd967" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:11.152944  5688 leader_election.cc:290] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:11.153055  5945 raft_consensus.cc:515] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.155417  5945 leader_election.cc:290] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:11.158636  5494 leader_election.cc:343] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.158161  5271 catalog_manager.cc:5697] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:11.160225  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fedcb24a7843748efb4e0db04fd967" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:11.160887  5374 raft_consensus.cc:3060] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.160813  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0174a8220da546bba7e2ccf232f59244" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:11.172580  5862 raft_consensus.cc:493] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.173086  5862 raft_consensus.cc:515] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.188843  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fedcb24a7843748efb4e0db04fd967" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
W20260709 12:22:11.192143  5494 leader_election.cc:343] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.183403  5941 raft_consensus.cc:493] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:11.193223  5941 raft_consensus.cc:515] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.206187  5691 raft_consensus.cc:493] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.206944  5691 raft_consensus.cc:515] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.210872  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:11.212373  5343 leader_election.cc:343] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.213541  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:11.202253  5376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0174a8220da546bba7e2ccf232f59244" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:11.215607  5568 leader_election.cc:304] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.217191  5872 raft_consensus.cc:2749] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:11.221150  5649 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:11.221438  5376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:11.221685  5649 ts_tablet_manager.cc:1403] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.115s	user 0.008s	sys 0.004s
I20260709 12:22:11.222090  5376 raft_consensus.cc:2468] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:11.223971  5568 leader_election.cc:304] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:11.225914  5866 raft_consensus.cc:2804] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.226320  5866 raft_consensus.cc:493] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:11.226656  5866 raft_consensus.cc:3060] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.227800  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:11.228879  5862 leader_election.cc:290] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
W20260709 12:22:11.230590  5344 leader_election.cc:343] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.231279  5344 leader_election.cc:304] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.233958  5936 raft_consensus.cc:2749] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:11.238027  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887ea6f2292649de80a0e337800fd7cb" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:11.239665  5708 raft_consensus.cc:493] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.240175  5708 raft_consensus.cc:515] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.242152  5529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887ea6f2292649de80a0e337800fd7cb" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:11.243012  5708 leader_election.cc:290] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:11.244841  5343 consensus_peers.cc:597] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:11.247262  5688 consensus_queue.cc:1048] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:11.247287  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41986298fd9435e9b41fe9ad22ccdc1" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:11.225098  5649 raft_consensus.cc:359] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.251819  5649 raft_consensus.cc:385] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.252190  5649 raft_consensus.cc:740] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.209818  5691 leader_election.cc:290] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:11.249104  5941 leader_election.cc:290] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:11.259421  5649 consensus_queue.cc:260] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.243026  5529 raft_consensus.cc:2468] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
W20260709 12:22:11.263628  5418 leader_election.cc:343] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.266000  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f41986298fd9435e9b41fe9ad22ccdc1" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:11.267601  5418 leader_election.cc:304] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:11.269167  5750 raft_consensus.cc:2804] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:11.269541  5750 raft_consensus.cc:493] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.269883  5750 raft_consensus.cc:3060] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.275578  5374 raft_consensus.cc:2468] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:11.276638  5494 leader_election.cc:304] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:11.277218  5648 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:11.277704  5648 ts_tablet_manager.cc:1403] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.192s	user 0.022s	sys 0.035s
I20260709 12:22:11.277766  5791 raft_consensus.cc:2804] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:11.278542  5791 raft_consensus.cc:697] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:11.279662  5654 tablet_bootstrap.cc:492] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:11.279433  5791 consensus_queue.cc:237] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.280159  5654 ts_tablet_manager.cc:1403] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.180s	user 0.017s	sys 0.009s
I20260709 12:22:11.280521  5648 raft_consensus.cc:359] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.281201  5648 raft_consensus.cc:385] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.281459  5648 raft_consensus.cc:740] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.282889  5654 raft_consensus.cc:359] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.283551  5654 raft_consensus.cc:385] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.283797  5654 raft_consensus.cc:740] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.284795  5654 consensus_queue.cc:260] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.284795  5648 consensus_queue.cc:260] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.287833  5418 leader_election.cc:304] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.288472  5649 ts_tablet_manager.cc:1434] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:22:11.291327  5654 ts_tablet_manager.cc:1434] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
W20260709 12:22:11.291525  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:11.292500  5750 raft_consensus.cc:515] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.293040  5648 ts_tablet_manager.cc:1434] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:22:11.294117  5648 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:11.295259  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887ea6f2292649de80a0e337800fd7cb" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:11.295372  5872 raft_consensus.cc:493] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.295825  5526 raft_consensus.cc:3060] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.296038  5872 raft_consensus.cc:515] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.302912  5648 tablet_bootstrap.cc:654] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.304898  5866 raft_consensus.cc:515] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.305918  5526 raft_consensus.cc:2468] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:11.309456  5418 leader_election.cc:304] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:11.306233  5654 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:11.310236  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887ea6f2292649de80a0e337800fd7cb" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:11.311496  5708 raft_consensus.cc:2804] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:11.313169  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:11.313946  5708 raft_consensus.cc:697] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:11.314860  5708 consensus_queue.cc:237] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.315634  5872 leader_election.cc:290] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:11.316915  5649 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:11.310935  5600 raft_consensus.cc:3060] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.317677  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887ea6f2292649de80a0e337800fd7cb" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:11.318156  5866 leader_election.cc:290] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:11.318490  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5fd56f4297c4405b24eaad2e3f296fa" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:11.335389  5654 tablet_bootstrap.cc:654] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.350390  5604 raft_consensus.cc:3060] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.310724  5750 leader_election.cc:290] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:11.340704  5374 raft_consensus.cc:3060] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.359007  5687 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.360550  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "887ea6f2292649de80a0e337800fd7cb" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:11.381366  5651 tablet_bootstrap.cc:492] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:11.381925  5651 ts_tablet_manager.cc:1403] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.322s	user 0.012s	sys 0.026s
I20260709 12:22:11.390161  5649 tablet_bootstrap.cc:654] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.392446  5648 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:11.393332  5651 raft_consensus.cc:359] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.394428  5861 raft_consensus.cc:2749] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.398689  5651 raft_consensus.cc:385] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.400492  5651 raft_consensus.cc:740] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.398241  5648 ts_tablet_manager.cc:1403] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.019s
I20260709 12:22:11.401837  5602 raft_consensus.cc:1240] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Rejecting Update request from peer fddd18e8ee414562a16b88c1a12413fc for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.402130  5651 consensus_queue.cc:260] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.406667  5648 raft_consensus.cc:359] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.407431  5648 raft_consensus.cc:385] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.407692  5648 raft_consensus.cc:740] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.372694  5687 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.409075  5651 ts_tablet_manager.cc:1434] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:22:11.410319  5651 tablet_bootstrap.cc:492] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:11.410777  5687 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:11.412971  5648 consensus_queue.cc:260] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.415256  5648 ts_tablet_manager.cc:1434] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:22:11.416504  5648 tablet_bootstrap.cc:492] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:11.422045  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:11.422060  5600 raft_consensus.cc:2468] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:11.423442  5688 consensus_queue.cc:1059] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:11.424327  5688 raft_consensus.cc:3055] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.424655  5688 raft_consensus.cc:740] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:11.425364  5526 raft_consensus.cc:2393] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 1: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
I20260709 12:22:11.425498  5688 consensus_queue.cc:260] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.426839  5688 raft_consensus.cc:3060] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.427136  5567 leader_election.cc:304] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.428947  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:11.429711  5872 raft_consensus.cc:2749] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:11.430295  5493 leader_election.cc:343] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.429752  5379 raft_consensus.cc:2468] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:11.441202  5494 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:11.442098  5975 raft_consensus.cc:2804] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:11.442488  5975 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.442883  5975 raft_consensus.cc:3060] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.450316  5651 tablet_bootstrap.cc:654] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.427160  5271 catalog_manager.cc:5697] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:11.452749  5418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:38145, user_credentials={real_user=slave}} blocked reactor thread for 62370.7us
I20260709 12:22:11.463833  5648 tablet_bootstrap.cc:654] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.472811  5374 raft_consensus.cc:2468] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 2.
I20260709 12:22:11.474298  5568 leader_election.cc:304] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.476625  5866 raft_consensus.cc:2804] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:11.477133  5866 raft_consensus.cc:697] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:11.478039  5866 consensus_queue.cc:237] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.480885  5376 raft_consensus.cc:1240] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Rejecting Update request from peer fddd18e8ee414562a16b88c1a12413fc for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.497962  5691 consensus_queue.cc:1048] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:11.527160  5567 consensus_peers.cc:597] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:11.531316  5649 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:11.531900  5649 ts_tablet_manager.cc:1403] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.215s	user 0.017s	sys 0.014s
I20260709 12:22:11.533463  5654 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:11.535666  5649 raft_consensus.cc:359] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.544064  5649 raft_consensus.cc:385] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.540541  5648 tablet_bootstrap.cc:492] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:11.544345  5654 ts_tablet_manager.cc:1403] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.005s
I20260709 12:22:11.542215  5273 catalog_manager.cc:5697] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 2 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:11.544720  5648 ts_tablet_manager.cc:1403] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.129s	user 0.030s	sys 0.012s
I20260709 12:22:11.544373  5649 raft_consensus.cc:740] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.548641  5649 consensus_queue.cc:260] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.549285  5648 raft_consensus.cc:359] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.550736  5648 raft_consensus.cc:385] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.551110  5648 raft_consensus.cc:740] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.556176  5872 consensus_queue.cc:1048] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:11.558897  5648 consensus_queue.cc:260] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.562489  5651 tablet_bootstrap.cc:492] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:11.564642  5651 ts_tablet_manager.cc:1403] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.155s	user 0.010s	sys 0.003s
I20260709 12:22:11.570299  5872 consensus_queue.cc:1048] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:11.566323  5271 catalog_manager.cc:5697] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:11.574525  5651 raft_consensus.cc:359] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.575248  5651 raft_consensus.cc:385] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.575527  5651 raft_consensus.cc:740] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.576223  5651 consensus_queue.cc:260] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.577343  5453 raft_consensus.cc:3060] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.579169  5651 ts_tablet_manager.cc:1434] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:22:11.577962  5649 ts_tablet_manager.cc:1434] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 12:22:11.580360  5651 tablet_bootstrap.cc:492] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:11.581480  5649 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:11.584333  5652 raft_consensus.cc:493] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.562857  5975 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.584841  5652 raft_consensus.cc:515] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.591120  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:11.591434  5652 leader_election.cc:290] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:11.591806  5374 raft_consensus.cc:3060] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.594524  5649 tablet_bootstrap.cc:654] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.595412  5975 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:11.596638  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:11.596838  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:11.598198  5343 leader_election.cc:343] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:11.598207  5493 leader_election.cc:343] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.599337  5374 raft_consensus.cc:2468] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:11.599529  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:11.600910  5494 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
W20260709 12:22:11.601348  5343 leader_election.cc:343] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.601837  5343 leader_election.cc:304] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.602895  5652 raft_consensus.cc:2749] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:11.603694  5872 consensus_queue.cc:1048] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:11.582208  5648 ts_tablet_manager.cc:1434] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:22:11.601899  5975 raft_consensus.cc:2804] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:11.615707  5975 raft_consensus.cc:697] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:11.586261  5651 tablet_bootstrap.cc:654] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.617241  5648 tablet_bootstrap.cc:492] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:11.617091  5975 consensus_queue.cc:237] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.621170  5654 raft_consensus.cc:359] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.622088  5654 raft_consensus.cc:385] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.622424  5654 raft_consensus.cc:740] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.640631  5651 tablet_bootstrap.cc:492] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:11.641225  5651 ts_tablet_manager.cc:1403] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.004s
I20260709 12:22:11.644752  5654 consensus_queue.cc:260] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.645944  5931 raft_consensus.cc:493] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.646495  5931 raft_consensus.cc:515] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.647459  5654 ts_tablet_manager.cc:1434] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.000s
I20260709 12:22:11.655416  5931 leader_election.cc:290] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:11.657795  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7de8fac5809466d88f4b46fcee34489" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:11.659650  5343 leader_election.cc:343] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.660916  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7de8fac5809466d88f4b46fcee34489" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:11.663178  5343 leader_election.cc:343] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.663600  5343 leader_election.cc:304] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.664450  5652 raft_consensus.cc:2749] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:11.672158  5654 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:11.643996  5651 raft_consensus.cc:359] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.676787  5651 raft_consensus.cc:385] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.677122  5651 raft_consensus.cc:740] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.679559  5648 tablet_bootstrap.cc:654] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.688131  5651 consensus_queue.cc:260] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.693851  5651 ts_tablet_manager.cc:1434] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:22:11.694943  5651 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:11.702116  5654 tablet_bootstrap.cc:654] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.706280  5651 tablet_bootstrap.cc:654] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.707023  5649 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:11.707535  5649 ts_tablet_manager.cc:1403] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.126s	user 0.043s	sys 0.050s
I20260709 12:22:11.710263  5649 raft_consensus.cc:359] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.710882  5649 raft_consensus.cc:385] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.711146  5649 raft_consensus.cc:740] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.712040  5649 consensus_queue.cc:260] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.714279  5649 ts_tablet_manager.cc:1434] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:11.715296  5649 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:11.715874  5648 tablet_bootstrap.cc:492] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:11.716379  5648 ts_tablet_manager.cc:1403] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.011s
I20260709 12:22:11.717144  5654 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:11.717628  5654 ts_tablet_manager.cc:1403] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.001s
I20260709 12:22:11.718984  5648 raft_consensus.cc:359] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.719650  5648 raft_consensus.cc:385] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.720134  5648 raft_consensus.cc:740] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.720211  5654 raft_consensus.cc:359] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.721251  5649 tablet_bootstrap.cc:654] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.721021  5648 consensus_queue.cc:260] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.721021  5654 raft_consensus.cc:385] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.724400  5654 raft_consensus.cc:740] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.725807  5648 ts_tablet_manager.cc:1434] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:11.727219  5648 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:11.732975  5654 consensus_queue.cc:260] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.736567  5654 ts_tablet_manager.cc:1434] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:22:11.755878  5708 consensus_queue.cc:1048] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:11.732784  5271 catalog_manager.cc:5697] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:11.765069  5791 raft_consensus.cc:493] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.765710  5791 raft_consensus.cc:515] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.750829  5654 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:11.767964  5791 leader_election.cc:290] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:11.769984  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fd276ebc024672a5c9eafb8f805442" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:11.770699  5454 raft_consensus.cc:2468] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:11.773766  5654 tablet_bootstrap.cc:654] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.774753  5651 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:11.775427  5651 ts_tablet_manager.cc:1403] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.030s
I20260709 12:22:11.776602  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fd276ebc024672a5c9eafb8f805442" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:11.777227  5604 raft_consensus.cc:2468] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:11.777731  5648 tablet_bootstrap.cc:654] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.779309  5651 raft_consensus.cc:359] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.788726  5654 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:11.789254  5654 ts_tablet_manager.cc:1403] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 12:22:11.780247  5651 raft_consensus.cc:385] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.795058  5651 raft_consensus.cc:740] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.796126  5651 consensus_queue.cc:260] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.775331  5494 leader_election.cc:304] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:11.797689  5651 ts_tablet_manager.cc:1434] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:22:11.798813  5651 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:11.798890  5649 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:11.798904  5932 raft_consensus.cc:2804] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:11.799592  5932 raft_consensus.cc:493] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.799610  5649 ts_tablet_manager.cc:1403] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.048s
I20260709 12:22:11.800041  5932 raft_consensus.cc:3060] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.802781  5649 raft_consensus.cc:359] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.803476  5649 raft_consensus.cc:385] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.803776  5649 raft_consensus.cc:740] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.804697  5648 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:11.804476  5649 consensus_queue.cc:260] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.805240  5648 ts_tablet_manager.cc:1403] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.004s
I20260709 12:22:11.805811  5651 tablet_bootstrap.cc:654] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.806318  5649 ts_tablet_manager.cc:1434] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:11.807451  5649 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:11.808014  5648 raft_consensus.cc:359] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.808717  5648 raft_consensus.cc:385] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.808992  5648 raft_consensus.cc:740] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.809851  5648 consensus_queue.cc:260] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.810400  5931 raft_consensus.cc:493] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.812080  5931 raft_consensus.cc:515] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.814185  5931 leader_election.cc:290] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:11.816278  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:11.816313  5649 tablet_bootstrap.cc:654] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:11.817632  5343 leader_election.cc:343] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.792071  5654 raft_consensus.cc:359] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.818310  5654 raft_consensus.cc:385] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.818931  5976 consensus_queue.cc:1048] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:11.820421  5654 raft_consensus.cc:740] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.821382  5654 consensus_queue.cc:260] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.826606  5651 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:11.827183  5651 ts_tablet_manager.cc:1403] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.007s
I20260709 12:22:11.829136  5649 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:11.829628  5649 ts_tablet_manager.cc:1403] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:22:11.829337  5687 consensus_queue.cc:1048] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:11.830060  5651 raft_consensus.cc:359] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.830753  5651 raft_consensus.cc:385] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.831037  5651 raft_consensus.cc:740] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.831707  5651 consensus_queue.cc:260] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.820027  5648 ts_tablet_manager.cc:1434] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 12:22:11.832597  5455 raft_consensus.cc:3060] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.833724  5648 tablet_bootstrap.cc:492] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:11.833356  5649 raft_consensus.cc:359] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.834146  5649 raft_consensus.cc:385] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:11.834416  5649 raft_consensus.cc:740] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.835198  5649 consensus_queue.cc:260] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:11.836879  5862 raft_consensus.cc:493] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.837422  5862 raft_consensus.cc:515] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.840369  5648 tablet_bootstrap.cc:654] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.840845  5945 raft_consensus.cc:493] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.841364  5945 raft_consensus.cc:515] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.842577  5649 ts_tablet_manager.cc:1434] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:22:11.843379  5651 ts_tablet_manager.cc:1434] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:22:11.843647  5649 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:11.844491  5651 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:11.845446  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3cc33a5e1c49a79a13e57852104de3" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:11.843443  5945 leader_election.cc:290] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:11.847659  5376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3cc33a5e1c49a79a13e57852104de3" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:11.847782  5568 leader_election.cc:343] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.850284  5649 tablet_bootstrap.cc:654] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.850751  5651 tablet_bootstrap.cc:654] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:11.850980  5568 leader_election.cc:343] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.851444  5568 leader_election.cc:304] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:11.826635  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:11.854743  5872 raft_consensus.cc:2749] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:11.863749  5654 ts_tablet_manager.cc:1434] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
W20260709 12:22:11.865106  5344 leader_election.cc:343] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.865411  5654 tablet_bootstrap.cc:492] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:11.865653  5344 leader_election.cc:304] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:11.866474  5652 raft_consensus.cc:2749] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:11.866521  5525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48cbeaeff384cbd8556c14de06a2c41" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:11.867398  5525 raft_consensus.cc:2468] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:11.869828  5418 leader_election.cc:304] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:11.874343  5941 raft_consensus.cc:493] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.874903  5941 raft_consensus.cc:515] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:11.884783  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c71518e1df4ec39ce7f29b4be4a21c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:11.885464  5454 raft_consensus.cc:2468] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:11.884198  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c71518e1df4ec39ce7f29b4be4a21c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:11.880609  5708 raft_consensus.cc:2804] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:11.882031  5941 leader_election.cc:290] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:11.889578  5375 raft_consensus.cc:2468] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:11.886062  5862 leader_election.cc:290] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:11.892027  5568 leader_election.cc:304] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:11.896171  5648 tablet_bootstrap.cc:492] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:11.896713  5648 ts_tablet_manager.cc:1403] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.005s
I20260709 12:22:11.897563  5872 raft_consensus.cc:2804] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:11.898150  5872 raft_consensus.cc:493] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.898554  5872 raft_consensus.cc:3060] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.884342  5528 raft_consensus.cc:3060] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.890079  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48cbeaeff384cbd8556c14de06a2c41" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:11.901311  5648 raft_consensus.cc:359] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.902637  5648 raft_consensus.cc:385] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:11.902215  5418 leader_election.cc:343] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:11.903491  5648 raft_consensus.cc:740] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:11.905331  5932 raft_consensus.cc:515] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.893748  5708 raft_consensus.cc:493] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.905691  5648 consensus_queue.cc:260] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.906564  5708 raft_consensus.cc:3060] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.907480  5932 leader_election.cc:290] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:11.913303  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fd276ebc024672a5c9eafb8f805442" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:11.913910  5604 raft_consensus.cc:3060] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.917985  5648 ts_tablet_manager.cc:1434] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:22:11.919301  5648 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:11.929677  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fd276ebc024672a5c9eafb8f805442" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:11.930339  5454 raft_consensus.cc:3060] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:11.954485  5979 raft_consensus.cc:493] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.955082  5979 raft_consensus.cc:515] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.957108  5654 tablet_bootstrap.cc:654] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:11.958840  5604 raft_consensus.cc:2468] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:11.966476  5976 raft_consensus.cc:493] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.967023  5976 raft_consensus.cc:515] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:11.968796  5975 raft_consensus.cc:493] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.969334  5975 raft_consensus.cc:515] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.971272  5975 leader_election.cc:290] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:11.973405  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f641edcab549deae1aa846ded8f15c" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:11.973585  5688 consensus_queue.cc:1048] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:11.981165  5976 leader_election.cc:290] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:11.998724  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a654b632744c53946820d8bb4c5fb8" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:12.009377  5526 raft_consensus.cc:1275] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:11.987540  5979 leader_election.cc:290] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:11.988348  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fedcb24a7843748efb4e0db04fd967" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:11.989123  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78a654b632744c53946820d8bb4c5fb8" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:11.989135  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57f641edcab549deae1aa846ded8f15c" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:11.993203  5525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fedcb24a7843748efb4e0db04fd967" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:11.995342  5454 raft_consensus.cc:2468] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:12.011471  5708 raft_consensus.cc:515] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:11.979730  5872 raft_consensus.cc:515] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.019281  5494 leader_election.cc:304] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:12.021832  5975 raft_consensus.cc:2804] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:12.022330  5975 raft_consensus.cc:697] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:12.023110  5975 consensus_queue.cc:237] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:12.024284  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c71518e1df4ec39ce7f29b4be4a21c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:12.024919  5375 raft_consensus.cc:3060] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.026664  5418 leader_election.cc:304] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.031395  5649 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:12.031927  5649 ts_tablet_manager.cc:1403] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.013s
I20260709 12:22:12.033996  5648 tablet_bootstrap.cc:654] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.036953  5976 raft_consensus.cc:2749] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.051244  5651 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:12.051950  5651 ts_tablet_manager.cc:1403] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.208s	user 0.014s	sys 0.015s
I20260709 12:22:12.053617  5419 leader_election.cc:304] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.054744  5862 raft_consensus.cc:2749] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.042315  5941 consensus_queue.cc:1048] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:22:12.058247  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0c71518e1df4ec39ce7f29b4be4a21c" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:12.058907  5454 raft_consensus.cc:3060] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.059514  5455 raft_consensus.cc:3060] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.060590  5493 leader_election.cc:304] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:12.061950  5791 raft_consensus.cc:2749] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.063546  5375 raft_consensus.cc:2468] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:12.064700  5568 leader_election.cc:304] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:12.064834  5379 raft_consensus.cc:1275] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:12.068737  5941 consensus_queue.cc:1048] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:12.070363  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48cbeaeff384cbd8556c14de06a2c41" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:12.070978  5524 raft_consensus.cc:3060] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.067896  5649 raft_consensus.cc:359] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.073452  5649 raft_consensus.cc:385] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.073776  5649 raft_consensus.cc:740] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.075446  5649 consensus_queue.cc:260] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.078212  5454 raft_consensus.cc:2468] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:12.081777  5649 ts_tablet_manager.cc:1434] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.006s
I20260709 12:22:12.058277  5708 leader_election.cc:290] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:12.049293  5872 leader_election.cc:290] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:12.074581  5945 raft_consensus.cc:2804] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:12.089491  5651 raft_consensus.cc:359] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.091311  5651 raft_consensus.cc:385] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.091562  5651 raft_consensus.cc:740] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.092108  5651 consensus_queue.cc:260] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.087656  5936 raft_consensus.cc:493] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.094077  5936 raft_consensus.cc:515] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.094334  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48cbeaeff384cbd8556c14de06a2c41" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:12.084322  5866 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.097005  5866 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.098155  5601 raft_consensus.cc:3060] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.099138  5866 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:12.101254  5418 leader_election.cc:343] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.104779  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:12.105435  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:12.106575  5375 raft_consensus.cc:2393] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 1: Already voted for candidate fddd18e8ee414562a16b88c1a12413fc in this term.
I20260709 12:22:12.108598  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:12.096256  5936 leader_election.cc:290] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:12.111534  5343 leader_election.cc:343] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.113152  5527 raft_consensus.cc:3060] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:12.116776  6002 log.cc:927] Time spent T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:22:12.120543  5654 tablet_bootstrap.cc:492] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:12.121078  5654 ts_tablet_manager.cc:1403] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.256s	user 0.021s	sys 0.010s
I20260709 12:22:12.121829  5568 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.123832  5654 raft_consensus.cc:359] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:12.124806  5654 raft_consensus.cc:385] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.125080  5654 raft_consensus.cc:740] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.125763  5654 consensus_queue.cc:260] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:12.128790  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:12.138334  5654 ts_tablet_manager.cc:1434] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:22:12.138787  5649 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:12.139062  5651 ts_tablet_manager.cc:1434] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.000s
I20260709 12:22:12.143628  5651 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
W20260709 12:22:12.156960  5344 leader_election.cc:343] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.157661  5344 leader_election.cc:304] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:12.159425  5936 raft_consensus.cc:2749] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:12.190201  6009 log.cc:927] Time spent T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:12.194010  5941 raft_consensus.cc:2749] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.197296  5651 tablet_bootstrap.cc:654] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.198930  5652 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.199380  5652 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.199801  5649 tablet_bootstrap.cc:654] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.159749  5945 raft_consensus.cc:697] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:12.200774  5932 raft_consensus.cc:493] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:12.201308  5932 raft_consensus.cc:515] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.201459  5945 consensus_queue.cc:237] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.203023  5652 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:12.203923  5932 leader_election.cc:290] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:12.204768  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:12.205883  5526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:12.206306  5343 leader_election.cc:343] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.206471  5654 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
W20260709 12:22:12.208590  5343 leader_election.cc:343] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.209012  5343 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.212813  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:12.213564  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:12.215597  5931 raft_consensus.cc:2749] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.216988  5932 consensus_queue.cc:1048] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:12.222272  5494 leader_election.cc:304] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:12.243948  5687 raft_consensus.cc:2749] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.244089  5932 raft_consensus.cc:493] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.291718  5687 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.324246  5276 catalog_manager.cc:5697] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.329103  5652 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.329686  5652 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.278024  5932 raft_consensus.cc:515] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.353298  5652 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:12.310952  5687 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.340837  5688 consensus_queue.cc:1048] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:22:12.399350  5528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:12.402019  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:12.411909  5687 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:12.414356  5648 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:12.414932  5648 ts_tablet_manager.cc:1403] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.496s	user 0.028s	sys 0.054s
I20260709 12:22:12.379926  5654 tablet_bootstrap.cc:654] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.378963  5524 raft_consensus.cc:2468] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:12.420506  5271 catalog_manager.cc:5697] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.416916  5528 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:12.451047  5648 raft_consensus.cc:359] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.452054  5648 raft_consensus.cc:385] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.457616  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:12.458350  5374 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:12.437964  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:12.464636  6018 log.cc:927] Time spent T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:22:12.465517  5344 leader_election.cc:343] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.452380  5648 raft_consensus.cc:740] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.467034  5648 consensus_queue.cc:260] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.486864  5494 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:12.498562  5932 leader_election.cc:290] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:12.500901  5343 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:12.499992  5418 leader_election.cc:304] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:12.501775  5648 ts_tablet_manager.cc:1434] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.000s
I20260709 12:22:12.505519  5652 raft_consensus.cc:2804] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:12.506052  5652 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.506454  5652 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.512154  5977 raft_consensus.cc:2804] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:12.520001  5649 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:12.524109  5649 ts_tablet_manager.cc:1403] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.431s	user 0.015s	sys 0.006s
I20260709 12:22:12.514665  5977 raft_consensus.cc:697] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:12.534791  5652 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.536991  6015 raft_consensus.cc:493] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.537520  6015 raft_consensus.cc:515] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:12.539631  6015 leader_election.cc:290] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:12.540928  5648 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:12.545087  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:12.545846  5374 raft_consensus.cc:2468] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:12.548599  6030 raft_consensus.cc:2804] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:12.549017  6030 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.549355  6030 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.550401  5525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42967958ae64becbb47efba2703dc6a" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:12.555128  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:12.555871  5567 leader_election.cc:343] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.556409  5977 consensus_queue.cc:237] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:12.548172  5649 raft_consensus.cc:359] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.560804  5649 raft_consensus.cc:385] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.561091  5649 raft_consensus.cc:740] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.562703  5649 consensus_queue.cc:260] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
W20260709 12:22:12.565239  5494 leader_election.cc:343] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.566288  5494 leader_election.cc:304] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:12.568311  5652 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:12.569557  5649 ts_tablet_manager.cc:1434] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:22:12.570403  5791 raft_consensus.cc:2804] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:12.574251  5791 raft_consensus.cc:493] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.574589  5791 raft_consensus.cc:3060] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.576630  5654 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:12.577136  5654 ts_tablet_manager.cc:1403] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.371s	user 0.014s	sys 0.003s
W20260709 12:22:12.531965  5493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:38145, user_credentials={real_user=slave}} blocked reactor thread for 55218.3us
I20260709 12:22:12.582615  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:12.585485  5651 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:12.586045  5651 ts_tablet_manager.cc:1403] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.446s	user 0.024s	sys 0.001s
W20260709 12:22:12.589986  5344 leader_election.cc:343] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.593129  6031 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.596124  6031 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.600806  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:12.598320  5654 raft_consensus.cc:359] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.609365  5654 raft_consensus.cc:385] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.609637  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:12.609923  5654 raft_consensus.cc:740] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.611200  5654 consensus_queue.cc:260] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.611852  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:12.611202  5418 leader_election.cc:343] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.613765  5654 ts_tablet_manager.cc:1434] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:22:12.615176  5654 tablet_bootstrap.cc:492] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:12.602061  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42967958ae64becbb47efba2703dc6a" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:12.620198  5568 leader_election.cc:343] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.620646  5568 leader_election.cc:304] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.616328  5648 tablet_bootstrap.cc:654] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.625874  6011 raft_consensus.cc:2749] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.627825  6031 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:12.634337  5493 leader_election.cc:343] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.643692  5649 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:12.648221  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:12.644372  5654 tablet_bootstrap.cc:654] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.641465  5651 raft_consensus.cc:359] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.652949  5651 raft_consensus.cc:385] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.653252  5651 raft_consensus.cc:740] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.653988  5651 consensus_queue.cc:260] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
W20260709 12:22:12.658197  5419 leader_election.cc:343] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.658896  5419 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:12.659917  5977 raft_consensus.cc:2749] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.663018  5651 ts_tablet_manager.cc:1434] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:22:12.664068  5651 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:12.672055  5651 tablet_bootstrap.cc:654] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.673890  5975 consensus_queue.cc:1048] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:12.680714  5649 tablet_bootstrap.cc:654] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.652194  6030 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.675985  5791 raft_consensus.cc:515] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.693532  5273 catalog_manager.cc:5697] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.700709  5791 leader_election.cc:290] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:12.706681  5527 raft_consensus.cc:2393] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in current term 1: Already voted for candidate fddd18e8ee414562a16b88c1a12413fc in this term.
I20260709 12:22:12.708274  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:12.708962  5374 raft_consensus.cc:3060] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.738983  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:12.749938  6030 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:12.755336  5493 leader_election.cc:343] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.755774  5654 tablet_bootstrap.cc:492] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:12.755336  5945 consensus_queue.cc:1048] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:12.756491  5654 ts_tablet_manager.cc:1403] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.008s
I20260709 12:22:12.758618  5343 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.759264  5648 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:12.775651  5648 ts_tablet_manager.cc:1403] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.252s	user 0.016s	sys 0.009s
I20260709 12:22:12.759769  5376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:12.761021  5791 consensus_queue.cc:1048] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:22:12.771740  6026 consensus_queue.cc:1048] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:22:12.778668  5931 raft_consensus.cc:493] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.779153  5931 raft_consensus.cc:515] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.780340  5649 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:12.780855  5649 ts_tablet_manager.cc:1403] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.137s	user 0.019s	sys 0.000s
I20260709 12:22:12.781237  5931 leader_election.cc:290] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:12.759855  6033 raft_consensus.cc:2749] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.783399  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b77c24029e4efbbd5c2679556ef30e" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:12.783726  5376 raft_consensus.cc:2393] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fddd18e8ee414562a16b88c1a12413fc in current term 1: Already voted for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in this term.
W20260709 12:22:12.786751  5343 leader_election.cc:343] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.800989  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b77c24029e4efbbd5c2679556ef30e" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:12.802671  5343 leader_election.cc:343] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.803134  5343 leader_election.cc:304] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.803871  6033 raft_consensus.cc:2749] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.794343  5649 raft_consensus.cc:359] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.787575  5648 raft_consensus.cc:359] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.763164  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:12.820892  5649 raft_consensus.cc:385] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.821391  5649 raft_consensus.cc:740] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.821985  5648 raft_consensus.cc:385] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.822393  5648 raft_consensus.cc:740] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.776877  5374 raft_consensus.cc:2468] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:12.786962  5654 raft_consensus.cc:359] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:12.790208  5651 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:12.826099  5651 ts_tablet_manager.cc:1403] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.162s	user 0.034s	sys 0.021s
I20260709 12:22:12.822084  5649 consensus_queue.cc:260] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
W20260709 12:22:12.822587  5494 leader_election.cc:343] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.826613  5648 consensus_queue.cc:260] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.827271  5494 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:12.827968  5649 ts_tablet_manager.cc:1434] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:22:12.829007  5649 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:12.829118  5791 raft_consensus.cc:2749] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.830384  5494 leader_election.cc:304] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:12.830461  5651 raft_consensus.cc:359] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.831364  5651 raft_consensus.cc:385] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.831503  5791 raft_consensus.cc:2804] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:12.831794  5651 raft_consensus.cc:740] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.832547  5791 raft_consensus.cc:697] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:12.833504  5791 consensus_queue.cc:237] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.844821  5649 tablet_bootstrap.cc:654] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.845041  5648 ts_tablet_manager.cc:1434] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.001s
I20260709 12:22:12.860607  5654 raft_consensus.cc:385] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.838783  5651 consensus_queue.cc:260] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.861508  5648 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:12.870414  5654 raft_consensus.cc:740] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.871249  5654 consensus_queue.cc:260] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:12.857589  5791 raft_consensus.cc:493] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.872844  5791 raft_consensus.cc:515] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.876024  5791 leader_election.cc:290] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:12.876281  5648 tablet_bootstrap.cc:654] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.877337  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:12.878378  5688 raft_consensus.cc:493] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:12.878803  5494 leader_election.cc:343] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.878835  5688 raft_consensus.cc:515] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.869560  5276 catalog_manager.cc:5697] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:12.883711  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7de8fac5809466d88f4b46fcee34489" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:12.884965  5654 ts_tablet_manager.cc:1434] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.000s
W20260709 12:22:12.885181  5493 leader_election.cc:343] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.886871  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:12.887552  5374 raft_consensus.cc:2468] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:12.887759  5654 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:12.888645  5494 leader_election.cc:304] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:12.890813  5688 leader_election.cc:290] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:12.891399  5688 raft_consensus.cc:2804] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:12.891726  5688 raft_consensus.cc:493] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.892045  5688 raft_consensus.cc:3060] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.892138  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7de8fac5809466d88f4b46fcee34489" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:12.892824  5378 raft_consensus.cc:2468] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:12.893842  5494 leader_election.cc:304] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:12.894979  6032 raft_consensus.cc:2804] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:12.895313  6032 raft_consensus.cc:493] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.895618  6032 raft_consensus.cc:3060] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.897128  5931 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.898929  5931 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.901043  5931 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:12.902956  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:12.903563  5454 raft_consensus.cc:2468] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 0.
I20260709 12:22:12.903803  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:12.905696  5344 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
W20260709 12:22:12.906261  5343 leader_election.cc:343] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.907019  5649 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:12.907567  5649 ts_tablet_manager.cc:1403] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.011s
I20260709 12:22:12.909168  5931 raft_consensus.cc:2804] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:12.909642  5931 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.910029  5931 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.912341  5649 raft_consensus.cc:359] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.913360  5649 raft_consensus.cc:385] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:12.913638  5649 raft_consensus.cc:740] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:12.920905  5931 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.922551  5651 ts_tablet_manager.cc:1434] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 12:22:12.924093  5654 tablet_bootstrap.cc:654] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.925004  5649 consensus_queue.cc:260] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.928593  5688 raft_consensus.cc:515] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:12.928853  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:12.931058  5649 ts_tablet_manager.cc:1434] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
W20260709 12:22:12.931754  5343 leader_election.cc:343] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.932279  5649 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:12.936352  6026 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.932475  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:12.936996  6026 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.937553  5378 raft_consensus.cc:3060] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.938854  6033 raft_consensus.cc:493] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.939121  6026 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:12.939355  6033 raft_consensus.cc:515] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:12.940809  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:12.942152  5567 leader_election.cc:343] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.943661  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ce82f087341228c390906bb0d6802" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:12.947700  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:12.948598  5374 raft_consensus.cc:2468] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:12.950158  5568 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.951566  6026 raft_consensus.cc:2804] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:12.952073  6026 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:12.952489  6026 raft_consensus.cc:3060] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.958413  5649 tablet_bootstrap.cc:654] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.959864  6011 raft_consensus.cc:493] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.960812  5378 raft_consensus.cc:2468] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
W20260709 12:22:12.960969  5343 leader_election.cc:343] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.964829  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ce82f087341228c390906bb0d6802" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:12.961472  5931 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:12.966037  6033 leader_election.cc:290] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:12.965893  6011 raft_consensus.cc:515] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:12.967604  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
W20260709 12:22:12.968828  5344 leader_election.cc:343] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.969074  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:12.969319  5344 leader_election.cc:304] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:12.963435  6032 raft_consensus.cc:515] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:12.972136  5651 tablet_bootstrap.cc:492] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:12.968168  5454 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:12.973975  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7de8fac5809466d88f4b46fcee34489" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
W20260709 12:22:12.975206  5493 leader_election.cc:343] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.968163  6011 leader_election.cc:290] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:12.976555  5688 leader_election.cc:290] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:12.978273  6033 raft_consensus.cc:2749] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.982517  6032 leader_election.cc:290] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:12.985054  5568 leader_election.cc:343] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.986130  5454 raft_consensus.cc:2468] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:12.986495  5648 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:12.987171  5648 ts_tablet_manager.cc:1403] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.000s
I20260709 12:22:12.987588  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:12.991750  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
W20260709 12:22:12.993417  5567 leader_election.cc:343] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:12.993907  5567 leader_election.cc:304] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:12.995090  5945 raft_consensus.cc:2749] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:12.998824  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7de8fac5809466d88f4b46fcee34489" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:12.999459  5374 raft_consensus.cc:3060] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.000051  5654 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:13.000602  5654 ts_tablet_manager.cc:1403] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.008s
I20260709 12:22:13.002511  5648 raft_consensus.cc:359] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.003690  5654 raft_consensus.cc:359] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.004388  5654 raft_consensus.cc:385] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.003193  5648 raft_consensus.cc:385] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.004757  5654 raft_consensus.cc:740] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.005378  6026 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.005776  5654 consensus_queue.cc:260] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.004869  5648 raft_consensus.cc:740] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.007504  5648 consensus_queue.cc:260] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.008217  5654 ts_tablet_manager.cc:1434] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:13.008317  5455 raft_consensus.cc:3060] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.008764  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:13.009479  5654 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:13.010535  5651 tablet_bootstrap.cc:654] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:12.992336  5494 leader_election.cc:304] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
W20260709 12:22:13.012382  5567 leader_election.cc:343] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:13.012770  5374 raft_consensus.cc:2468] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:13.013533  5975 raft_consensus.cc:2804] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.014017  5975 raft_consensus.cc:697] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:13.014854  5975 consensus_queue.cc:237] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.016353  5654 tablet_bootstrap.cc:654] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.018289  6026 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.019057  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:13.019645  5378 raft_consensus.cc:3060] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.020586  6031 raft_consensus.cc:493] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.021077  6031 raft_consensus.cc:515] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.024149  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3cc33a5e1c49a79a13e57852104de3" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:13.025604  5419 leader_election.cc:343] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:13.029235  5344 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:13.029687  5654 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:13.030162  5654 ts_tablet_manager.cc:1403] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 12:22:13.030059  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3cc33a5e1c49a79a13e57852104de3" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:13.030418  6033 raft_consensus.cc:2804] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.030781  5604 raft_consensus.cc:2468] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:13.030979  6033 raft_consensus.cc:697] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:13.031922  6033 consensus_queue.cc:237] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.032708  6031 leader_election.cc:290] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.034600  5378 raft_consensus.cc:2468] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:13.035717  5654 raft_consensus.cc:359] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.037063  5654 raft_consensus.cc:385] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.037351  5654 raft_consensus.cc:740] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
W20260709 12:22:13.037840  5418 consensus_peers.cc:597] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Couldn't send request to peer 2df71e80861d4ef18c58ce9ed40ed9ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:13.037992  5654 consensus_queue.cc:260] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.037078  5568 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:13.039116  5418 leader_election.cc:304] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:13.040119  6031 raft_consensus.cc:2804] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:13.040683  6031 raft_consensus.cc:493] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.041460  6031 raft_consensus.cc:3060] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.043291  5872 raft_consensus.cc:2804] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.043793  5872 raft_consensus.cc:697] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:13.044657  5872 consensus_queue.cc:237] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.046716  5654 ts_tablet_manager.cc:1434] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:22:13.048234  5654 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:13.049438  5494 leader_election.cc:304] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:13.050869  5975 raft_consensus.cc:2804] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.051640  5975 raft_consensus.cc:697] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:13.052676  5975 consensus_queue.cc:237] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.054982  5654 tablet_bootstrap.cc:654] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.071846  5649 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: No bootstrap required, opened a new log
I20260709 12:22:13.072610  5649 ts_tablet_manager.cc:1403] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.014s
I20260709 12:22:13.082109  5455 raft_consensus.cc:2468] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:13.086884  5273 catalog_manager.cc:5697] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:13.091971  5273 catalog_manager.cc:5697] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.096921  5648 ts_tablet_manager.cc:1434] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.109s	user 0.009s	sys 0.001s
I20260709 12:22:13.098771  5654 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:13.099289  5654 ts_tablet_manager.cc:1403] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.012s
I20260709 12:22:13.102234  5651 tablet_bootstrap.cc:492] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:13.102952  5651 ts_tablet_manager.cc:1403] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.000s
I20260709 12:22:13.108026  5648 tablet_bootstrap.cc:492] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:13.083158  5649 raft_consensus.cc:359] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.116091  5649 raft_consensus.cc:385] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.116493  5649 raft_consensus.cc:740] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.117362  5649 consensus_queue.cc:260] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.119800  6031 raft_consensus.cc:515] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.121670  5648 tablet_bootstrap.cc:654] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.116541  5651 raft_consensus.cc:359] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.122453  5651 raft_consensus.cc:385] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.122779  5651 raft_consensus.cc:740] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.118304  5654 raft_consensus.cc:359] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.123282  5654 raft_consensus.cc:385] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.123558  5654 raft_consensus.cc:740] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.124310  5654 consensus_queue.cc:260] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.123620  5651 consensus_queue.cc:260] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.119707  5272 catalog_manager.cc:5697] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:13.121392  5649 ts_tablet_manager.cc:1434] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:22:13.129760  5654 ts_tablet_manager.cc:1434] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 12:22:13.131556  5654 tablet_bootstrap.cc:492] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:13.131914  6031 leader_election.cc:290] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.133759  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3cc33a5e1c49a79a13e57852104de3" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:13.134411  5378 raft_consensus.cc:3060] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.128038  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3cc33a5e1c49a79a13e57852104de3" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:13.137449  5600 raft_consensus.cc:3060] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.138073  5654 tablet_bootstrap.cc:654] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.141598  5276 catalog_manager.cc:5697] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:13.149799  5651 ts_tablet_manager.cc:1434] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:22:13.144717  5378 raft_consensus.cc:2468] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:13.167341  6031 consensus_queue.cc:1048] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:13.168905  5651 tablet_bootstrap.cc:492] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:13.169633  5419 leader_election.cc:304] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:13.170878  6031 raft_consensus.cc:2804] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.171609  6031 raft_consensus.cc:697] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:13.172670  6031 consensus_queue.cc:237] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.177073  5600 raft_consensus.cc:2468] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:13.181851  5651 tablet_bootstrap.cc:654] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.194248  5654 tablet_bootstrap.cc:492] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:13.194734  5654 ts_tablet_manager.cc:1403] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.016s
I20260709 12:22:13.197387  5654 raft_consensus.cc:359] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.198061  5654 raft_consensus.cc:385] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.198320  5654 raft_consensus.cc:740] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.201606  5654 consensus_queue.cc:260] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.208523  5654 ts_tablet_manager.cc:1434] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:22:13.209645  5654 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:13.211148  5648 tablet_bootstrap.cc:492] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:13.211654  5648 ts_tablet_manager.cc:1403] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.001s
I20260709 12:22:13.214685  5648 raft_consensus.cc:359] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.215603  5648 raft_consensus.cc:385] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.215479  5654 tablet_bootstrap.cc:654] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.215927  5648 raft_consensus.cc:740] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.219483  5648 consensus_queue.cc:260] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.223130  5648 ts_tablet_manager.cc:1434] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:22:13.224191  5648 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:13.230460  5271 catalog_manager.cc:5697] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.242745  5654 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:13.243289  5654 ts_tablet_manager.cc:1403] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.001s
I20260709 12:22:13.244544  5651 tablet_bootstrap.cc:492] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:13.245106  5651 ts_tablet_manager.cc:1403] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.004s
I20260709 12:22:13.246073  5654 raft_consensus.cc:359] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.246784  5654 raft_consensus.cc:385] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.246869  5648 tablet_bootstrap.cc:654] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:13.251930  5493 consensus_peers.cc:597] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc -> Peer 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145): Couldn't send request to peer 2df71e80861d4ef18c58ce9ed40ed9ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:13.256543  5654 raft_consensus.cc:740] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.249502  5651 raft_consensus.cc:359] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.257603  5651 raft_consensus.cc:385] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.257964  5651 raft_consensus.cc:740] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.257685  5654 consensus_queue.cc:260] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.258728  5651 consensus_queue.cc:260] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.261222  5651 ts_tablet_manager.cc:1434] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:22:13.262754  5651 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:13.267227  5654 ts_tablet_manager.cc:1434] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 12:22:13.267771  5872 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.268519  5654 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:13.268296  5872 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.270470  5872 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:13.272580  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.273072  5651 tablet_bootstrap.cc:654] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.273849  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:13.274585  5454 raft_consensus.cc:2393] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 1: Already voted for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in this term.
I20260709 12:22:13.278331  5568 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:13.283419  5654 tablet_bootstrap.cc:654] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.285116  5872 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.287056  5648 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:13.287559  5648 ts_tablet_manager.cc:1403] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.008s
I20260709 12:22:13.288810  5651 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:13.289244  5651 ts_tablet_manager.cc:1403] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 12:22:13.290210  5648 raft_consensus.cc:359] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.290899  5648 raft_consensus.cc:385] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.291174  5648 raft_consensus.cc:740] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.291829  5648 consensus_queue.cc:260] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.294029  5648 ts_tablet_manager.cc:1434] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:13.296857  5651 raft_consensus.cc:359] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.297569  5651 raft_consensus.cc:385] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.297840  5651 raft_consensus.cc:740] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.298636  5651 consensus_queue.cc:260] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.300601  5651 ts_tablet_manager.cc:1434] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:13.301600  5651 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:13.305239  5648 tablet_bootstrap.cc:492] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:13.306803  5654 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:13.307317  5654 ts_tablet_manager.cc:1403] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.005s
I20260709 12:22:13.308033  5872 raft_consensus.cc:2749] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:13.310356  5651 tablet_bootstrap.cc:654] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.312880  5648 tablet_bootstrap.cc:654] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.312505  5654 raft_consensus.cc:359] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.313393  5654 raft_consensus.cc:385] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.317041  5654 raft_consensus.cc:740] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.317802  5654 consensus_queue.cc:260] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.327435  5872 raft_consensus.cc:493] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.327908  5872 raft_consensus.cc:515] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.330087  5872 leader_election.cc:290] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:13.330130  5648 tablet_bootstrap.cc:492] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:13.330838  5648 ts_tablet_manager.cc:1403] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.016s
I20260709 12:22:13.332331  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48cbeaeff384cbd8556c14de06a2c41" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:13.333623  5648 raft_consensus.cc:359] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.334364  5648 raft_consensus.cc:385] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.334683  5648 raft_consensus.cc:740] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.335466  5648 consensus_queue.cc:260] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.337930  5654 ts_tablet_manager.cc:1434] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:22:13.338542  5648 ts_tablet_manager.cc:1434] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:22:13.338986  5654 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba: Bootstrap starting.
I20260709 12:22:13.346259  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48cbeaeff384cbd8556c14de06a2c41" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:13.346920  5654 tablet_bootstrap.cc:654] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.347018  5648 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:13.350872  6032 consensus_queue.cc:1048] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:13.358911  5654 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba: No bootstrap required, opened a new log
I20260709 12:22:13.359483  5654 ts_tablet_manager.cc:1403] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 12:22:13.362317  5654 raft_consensus.cc:359] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.363018  5654 raft_consensus.cc:385] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.363296  5654 raft_consensus.cc:740] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.363783  5568 leader_election.cc:304] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:13.363931  5654 consensus_queue.cc:260] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.365479  5979 raft_consensus.cc:493] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.366007  5979 raft_consensus.cc:515] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.366420  5654 ts_tablet_manager.cc:1434] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:13.367888  5979 leader_election.cc:290] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:13.370198  5648 tablet_bootstrap.cc:654] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.372836  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42967958ae64becbb47efba2703dc6a" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:13.373559  5601 raft_consensus.cc:2468] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:13.374804  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42967958ae64becbb47efba2703dc6a" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:13.375656  5527 raft_consensus.cc:2468] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:13.374874  5418 leader_election.cc:304] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:13.378582  5979 raft_consensus.cc:2804] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:13.379015  5979 raft_consensus.cc:493] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.379408  5979 raft_consensus.cc:3060] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.387387  5979 raft_consensus.cc:515] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.389389  5979 leader_election.cc:290] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:13.389461  5601 raft_consensus.cc:3060] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.391450  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42967958ae64becbb47efba2703dc6a" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:13.392099  5600 raft_consensus.cc:3060] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.393328  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42967958ae64becbb47efba2703dc6a" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:13.393959  5523 raft_consensus.cc:3060] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:13.397024  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:34515, user_credentials={real_user=slave}} blocked reactor thread for 49135.3us
I20260709 12:22:13.399380  5600 raft_consensus.cc:2468] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:13.400771  5418 leader_election.cc:304] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:13.402532  6031 raft_consensus.cc:2804] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.403424  6031 raft_consensus.cc:697] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:13.404347  6031 consensus_queue.cc:237] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.411612  5791 consensus_queue.cc:1048] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:13.424647  5651 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:13.425177  5651 ts_tablet_manager.cc:1403] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.124s	user 0.007s	sys 0.011s
I20260709 12:22:13.428378  5651 raft_consensus.cc:359] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.435456  5651 raft_consensus.cc:385] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.436812  5651 raft_consensus.cc:740] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.437417  5651 consensus_queue.cc:260] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.438863  5651 ts_tablet_manager.cc:1434] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:22:13.442469  5651 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc: Bootstrap starting.
I20260709 12:22:13.448943  5975 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.449491  5975 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.452788  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:13.454573  5975 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.458829  5931 consensus_queue.cc:1048] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:13.461243  5945 raft_consensus.cc:2749] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:13.467444  5648 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:13.480360  5648 ts_tablet_manager.cc:1403] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.134s	user 0.033s	sys 0.037s
I20260709 12:22:13.482811  5648 raft_consensus.cc:359] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.483421  5648 raft_consensus.cc:385] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.483701  5648 raft_consensus.cc:740] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.468014  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.467262  5687 consensus_queue.cc:1048] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:13.469964  5651 tablet_bootstrap.cc:654] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.484339  5648 consensus_queue.cc:260] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.489137  5648 ts_tablet_manager.cc:1434] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:22:13.490074  5648 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:13.490206  5945 raft_consensus.cc:493] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.490669  5945 raft_consensus.cc:515] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.493000  5945 leader_election.cc:290] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.494694  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7de8fac5809466d88f4b46fcee34489" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:13.495816  5648 tablet_bootstrap.cc:654] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.510782  5872 raft_consensus.cc:493] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.511361  5872 raft_consensus.cc:515] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.420614  5523 raft_consensus.cc:2468] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:13.514381  5379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7de8fac5809466d88f4b46fcee34489" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.515331  5379 raft_consensus.cc:2393] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 1: Already voted for candidate fddd18e8ee414562a16b88c1a12413fc in this term.
I20260709 12:22:13.514056  5945 raft_consensus.cc:493] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.516747  5945 raft_consensus.cc:515] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.519946  5374 raft_consensus.cc:2393] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fddd18e8ee414562a16b88c1a12413fc in current term 1: Already voted for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in this term.
I20260709 12:22:13.518921  5945 leader_election.cc:290] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.521690  5872 leader_election.cc:290] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:13.521540  5494 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:13.523401  6032 raft_consensus.cc:3060] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.523456  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:13.528558  5651 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc: No bootstrap required, opened a new log
I20260709 12:22:13.529089  5651 ts_tablet_manager.cc:1403] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.006s
I20260709 12:22:13.530123  5454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ce82f087341228c390906bb0d6802" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
W20260709 12:22:13.534929  5568 leader_election.cc:343] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:13.536351  5975 consensus_queue.cc:1048] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:22:13.547099  5979 raft_consensus.cc:493] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.547207  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.547775  5979 raft_consensus.cc:515] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.552733  5979 leader_election.cc:290] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.554548  5936 consensus_queue.cc:1048] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:13.555833  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.556054  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ce82f087341228c390906bb0d6802" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.556507  5378 raft_consensus.cc:2468] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:13.556727  5377 raft_consensus.cc:2468] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 0.
I20260709 12:22:13.557767  5419 leader_election.cc:304] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:13.559900  5976 raft_consensus.cc:2804] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:13.560292  5976 raft_consensus.cc:493] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.560720  5791 raft_consensus.cc:493] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.560820  5976 raft_consensus.cc:3060] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.561267  5791 raft_consensus.cc:515] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.563194  5791 leader_election.cc:290] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:13.564556  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:13.565505  5450 raft_consensus.cc:2468] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:13.565609  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:13.566282  5601 raft_consensus.cc:2468] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 0.
I20260709 12:22:13.566943  5494 leader_election.cc:304] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:13.567663  5568 leader_election.cc:304] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:13.568403  5791 raft_consensus.cc:2804] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:13.568800  5791 raft_consensus.cc:493] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.569121  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:13.569298  6011 raft_consensus.cc:3060] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.569751  5604 raft_consensus.cc:2468] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:13.569123  5791 raft_consensus.cc:3060] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.577874  5568 leader_election.cc:304] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:13.591650  5979 raft_consensus.cc:493] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.592248  5979 raft_consensus.cc:515] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.594252  5651 raft_consensus.cc:359] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.598500  6026 raft_consensus.cc:2749] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:13.594391  5979 leader_election.cc:290] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:13.584061  5976 raft_consensus.cc:515] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.604578  5651 raft_consensus.cc:385] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.605010  5651 raft_consensus.cc:740] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.597148  6032 raft_consensus.cc:2749] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:13.609438  6011 raft_consensus.cc:2749] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:13.611188  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:13.612105  5377 raft_consensus.cc:3060] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.623832  5272 catalog_manager.cc:5697] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:13.641728  5651 consensus_queue.cc:260] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.595880  5791 raft_consensus.cc:515] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.645184  5377 raft_consensus.cc:2468] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:13.649636  5419 leader_election.cc:304] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:13.645733  5976 leader_election.cc:290] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.646394  5975 consensus_queue.cc:1048] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:13.647516  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:13.651625  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:13.652144  5455 raft_consensus.cc:3060] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.652207  5601 raft_consensus.cc:3060] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.656826  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:13.657439  5602 raft_consensus.cc:3060] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.659092  5601 raft_consensus.cc:2468] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:13.660673  5791 leader_election.cc:290] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:13.661727  5648 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:13.661931  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:13.662231  5648 ts_tablet_manager.cc:1403] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.172s	user 0.030s	sys 0.022s
I20260709 12:22:13.662684  5527 raft_consensus.cc:2393] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 1: Already voted for candidate fddd18e8ee414562a16b88c1a12413fc in this term.
I20260709 12:22:13.664333  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:13.665056  5604 raft_consensus.cc:2393] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 1: Already voted for candidate fddd18e8ee414562a16b88c1a12413fc in this term.
I20260709 12:22:13.666946  5455 raft_consensus.cc:2468] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:13.668179  5494 leader_election.cc:304] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:13.668308  6026 consensus_queue.cc:1048] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:13.669474  5791 raft_consensus.cc:2804] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.670596  5791 raft_consensus.cc:697] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:13.672724  6031 raft_consensus.cc:2804] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.673197  5418 leader_election.cc:304] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:13.673242  6031 raft_consensus.cc:697] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:13.674386  6031 consensus_queue.cc:237] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.675711  5979 raft_consensus.cc:2749] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:13.676637  5975 raft_consensus.cc:493] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.677124  5975 raft_consensus.cc:515] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.679121  5975 leader_election.cc:290] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:13.679229  5324 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:13.681509  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.682403  5377 raft_consensus.cc:2468] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:13.684113  5494 leader_election.cc:304] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:13.686146  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:13.685137  5975 raft_consensus.cc:2804] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:13.686764  5975 raft_consensus.cc:493] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.687131  5975 raft_consensus.cc:3060] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.688712  5568 leader_election.cc:304] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:13.690318  5872 raft_consensus.cc:2804] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:13.690713  5872 raft_consensus.cc:493] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.691035  5872 raft_consensus.cc:3060] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.694777  6032 raft_consensus.cc:493] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:13.694922  5494 leader_election.cc:343] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:13.695299  6032 raft_consensus.cc:515] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.697443  6032 leader_election.cc:290] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.699059  5602 raft_consensus.cc:2468] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:13.699990  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b77c24029e4efbbd5c2679556ef30e" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:13.700709  5600 raft_consensus.cc:2468] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:13.701637  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b77c24029e4efbbd5c2679556ef30e" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.648567  5651 ts_tablet_manager.cc:1434] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 12:22:13.705084  5648 raft_consensus.cc:359] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.705762  5648 raft_consensus.cc:385] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.706007  5648 raft_consensus.cc:740] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.706866  5791 consensus_queue.cc:237] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:13.708597  5375 raft_consensus.cc:2468] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 0.
I20260709 12:22:13.715909  6083 consensus_queue.cc:1048] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:13.745954  5648 consensus_queue.cc:260] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.747470  5493 leader_election.cc:304] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:13.748648  5648 ts_tablet_manager.cc:1434] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.001s
I20260709 12:22:13.763255  5272 catalog_manager.cc:5697] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.765496  5687 raft_consensus.cc:2804] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:13.765935  5687 raft_consensus.cc:493] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.766315  5687 raft_consensus.cc:3060] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.771014  5648 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7: Bootstrap starting.
I20260709 12:22:13.774972  5872 raft_consensus.cc:515] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
W20260709 12:22:13.776304  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:39599, user_credentials={real_user=slave}} blocked reactor thread for 86155.7us
I20260709 12:22:13.807359  5872 leader_election.cc:290] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:13.779564  5418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.132:38145, user_credentials={real_user=slave}} blocked reactor thread for 106426us
I20260709 12:22:13.818985  5977 consensus_queue.cc:1048] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:13.779870  6087 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.820919  6087 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.823113  6087 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:13.780509  5648 tablet_bootstrap.cc:654] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:13.787424  5687 raft_consensus.cc:515] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:13.788275  5604 raft_consensus.cc:3060] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.827790  5687 leader_election.cc:290] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:13.833868  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b77c24029e4efbbd5c2679556ef30e" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:13.837131  5375 raft_consensus.cc:3060] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.838739  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:13.839774  5523 raft_consensus.cc:2393] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 1: Already voted for candidate fddd18e8ee414562a16b88c1a12413fc in this term.
I20260709 12:22:13.833765  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:13.845129  5377 raft_consensus.cc:2393] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 1: Already voted for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in this term.
I20260709 12:22:13.853526  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ce82f087341228c390906bb0d6802" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:13.794921  5975 raft_consensus.cc:515] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.860945  5378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ce82f087341228c390906bb0d6802" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:13.861512  5378 raft_consensus.cc:3060] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.872968  5418 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:13.876299  5975 leader_election.cc:290] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:13.879343  5376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:13.880028  5376 raft_consensus.cc:3060] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.884720  5378 raft_consensus.cc:2468] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:13.886418  6087 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.887326  5945 consensus_queue.cc:1048] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:13.889228  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:13.889853  5455 raft_consensus.cc:3060] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.890980  5568 leader_election.cc:304] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:13.887715  5376 raft_consensus.cc:2468] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:13.893040  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b77c24029e4efbbd5c2679556ef30e" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:13.893397  5945 raft_consensus.cc:2804] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.893745  5603 raft_consensus.cc:3060] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:13.893989  5945 raft_consensus.cc:697] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:13.898797  6083 consensus_queue.cc:1048] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:13.900560  5945 consensus_queue.cc:237] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.905746  5603 raft_consensus.cc:2468] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:13.906029  5455 raft_consensus.cc:2468] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:13.905769  6087 raft_consensus.cc:2749] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:13.908368  5648 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7: No bootstrap required, opened a new log
I20260709 12:22:13.908886  5648 ts_tablet_manager.cc:1403] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.012s
I20260709 12:22:13.910312  5375 raft_consensus.cc:2468] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:13.911518  5493 leader_election.cc:304] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:13.912379  5975 raft_consensus.cc:2804] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.912973  5975 raft_consensus.cc:697] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:13.913934  5975 consensus_queue.cc:237] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
W20260709 12:22:13.915685  5568 leader_election.cc:343] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:13.912318  5494 leader_election.cc:304] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:13.919904  5791 raft_consensus.cc:2804] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:13.920406  5791 raft_consensus.cc:697] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:13.921073  5791 consensus_queue.cc:237] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:13.925797  5648 raft_consensus.cc:359] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.926806  5648 raft_consensus.cc:385] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:13.927177  5648 raft_consensus.cc:740] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Initialized, Role: FOLLOWER
I20260709 12:22:13.929543  5648 consensus_queue.cc:260] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:13.876225  5272 catalog_manager.cc:5697] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:13.954048  5648 ts_tablet_manager.cc:1434] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 12:22:13.952749  5977 consensus_queue.cc:1048] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:22:14.010692  5271 catalog_manager.cc:5697] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 1 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:14.034866  5272 catalog_manager.cc:5697] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:14.037155  5272 catalog_manager.cc:5697] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 0 to 1, leader changed from <none> to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 1 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:14.084489  6087 consensus_queue.cc:1048] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:14.104673  6087 consensus_queue.cc:1048] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:14.155933  6087 raft_consensus.cc:493] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.156399  6087 raft_consensus.cc:515] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:14.158213  6087 leader_election.cc:290] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:14.158869  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ce82f087341228c390906bb0d6802" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:14.159183  5377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7ce82f087341228c390906bb0d6802" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:14.159991  5377 raft_consensus.cc:2393] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 1: Already voted for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in this term.
I20260709 12:22:14.160948  5419 leader_election.cc:304] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:14.161602  6087 raft_consensus.cc:3060] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:14.166541  6087 raft_consensus.cc:2749] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:14.284848  6091 consensus_queue.cc:1048] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:14.299549  5975 consensus_queue.cc:1048] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:14.302557  5872 consensus_queue.cc:1048] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:14.330691  5872 consensus_queue.cc:1048] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:14.386126  6091 consensus_queue.cc:1048] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:14.392112  6033 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.392643  6033 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:14.394801  6033 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:14.397994  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:14.398720  5527 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:14.400414  5343 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:14.401192  6033 raft_consensus.cc:2804] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:14.401577  6033 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.402690  6033 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.403313  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:14.404003  5451 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 1.
I20260709 12:22:14.404569  5791 consensus_queue.cc:1048] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:14.411537  6033 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:14.415015  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:14.415656  5527 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.420385  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:14.421038  5455 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.425257  6033 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:14.427665  5527 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:14.428699  5343 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:14.429715  6033 raft_consensus.cc:2804] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:14.432560  6033 raft_consensus.cc:697] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:14.433362  6033 consensus_queue.cc:237] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:14.435396  5455 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:14.449117  5271 catalog_manager.cc:5697] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 0 to 2, leader changed from <none> to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:14.477025 27446 tablet_server.cc:179] TabletServer@127.26.205.129:0 shutting down...
W20260709 12:22:14.492167  5494 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:22:14.496246  5494 consensus_peers.cc:597] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.518960 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:22:14.519992  5494 consensus_peers.cc:597] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.521678 27446 tablet_replica.cc:333] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.522439 27446 raft_consensus.cc:2243] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.522961 27446 raft_consensus.cc:2272] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.526926 27446 tablet_replica.cc:333] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.527685 27446 raft_consensus.cc:2243] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.528205 27446 raft_consensus.cc:2272] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.529443  5791 consensus_queue.cc:1048] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:14.531119 27446 tablet_replica.cc:333] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.531876 27446 raft_consensus.cc:2243] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.532372 27446 raft_consensus.cc:2272] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.535188 27446 tablet_replica.cc:333] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.535998 27446 raft_consensus.cc:2243] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.536466 27446 raft_consensus.cc:2272] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.538830 27446 tablet_replica.cc:333] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.539593 27446 raft_consensus.cc:2243] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.540061 27446 raft_consensus.cc:2272] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:14.541442  5494 consensus_peers.cc:597] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.543077 27446 tablet_replica.cc:333] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.543933 27446 raft_consensus.cc:2243] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.544450 27446 raft_consensus.cc:2272] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.546926 27446 tablet_replica.cc:333] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.547751 27446 raft_consensus.cc:2243] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.548746 27446 raft_consensus.cc:2272] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.551158 27446 tablet_replica.cc:333] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.551981 27446 raft_consensus.cc:2243] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.552536 27446 raft_consensus.cc:2272] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.554888 27446 tablet_replica.cc:333] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
W20260709 12:22:14.555452  5568 consensus_peers.cc:597] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.555635 27446 raft_consensus.cc:2243] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.556214 27446 raft_consensus.cc:2272] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.558560 27446 tablet_replica.cc:333] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.559347 27446 raft_consensus.cc:2243] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.559849 27446 raft_consensus.cc:2272] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.562623 27446 tablet_replica.cc:333] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.563684 27446 raft_consensus.cc:2243] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.564332 27446 raft_consensus.cc:2272] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.566339 27446 tablet_replica.cc:333] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
W20260709 12:22:14.566531  5419 consensus_peers.cc:597] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.567124 27446 raft_consensus.cc:2243] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.567631 27446 raft_consensus.cc:2272] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.569803 27446 tablet_replica.cc:333] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.570632 27446 raft_consensus.cc:2243] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.571110 27446 raft_consensus.cc:2272] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:14.572860  5419 consensus_peers.cc:597] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.573346 27446 tablet_replica.cc:333] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.574194 27446 raft_consensus.cc:2243] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:22:14.574266  5494 consensus_peers.cc:597] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.575215 27446 raft_consensus.cc:2272] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.577908 27446 tablet_replica.cc:333] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.578727 27446 raft_consensus.cc:2243] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:14.578981  5419 consensus_peers.cc:597] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.579202 27446 raft_consensus.cc:2272] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.582015 27446 tablet_replica.cc:333] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.582787 27446 raft_consensus.cc:2243] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.583298 27446 raft_consensus.cc:2272] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.585487 27446 tablet_replica.cc:333] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.586020 27446 raft_consensus.cc:2243] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.586813 27446 raft_consensus.cc:2272] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.588754 27446 tablet_replica.cc:333] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.589215 27446 raft_consensus.cc:2243] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.589564 27446 raft_consensus.cc:2272] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.591213 27446 tablet_replica.cc:333] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.591725 27446 raft_consensus.cc:2243] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.592494 27446 pending_rounds.cc:70] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Trying to abort 1 pending ops.
I20260709 12:22:14.592742 27446 pending_rounds.cc:77] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7305624512248512512 op_type: NO_OP noop_request { }
I20260709 12:22:14.593031 27446 raft_consensus.cc:2889] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:14.593255 27446 raft_consensus.cc:2272] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.595275 27446 tablet_replica.cc:333] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.595769 27446 raft_consensus.cc:2243] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.596110 27446 raft_consensus.cc:2272] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.597829 27446 tablet_replica.cc:333] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.598439 27446 raft_consensus.cc:2243] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.598786 27446 raft_consensus.cc:2272] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.601243 27446 tablet_replica.cc:333] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.601953 27446 raft_consensus.cc:2243] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.602489 27446 raft_consensus.cc:2272] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:14.603317  5494 consensus_peers.cc:597] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.604636 27446 tablet_replica.cc:333] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.605229 27446 raft_consensus.cc:2243] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.605690 27446 raft_consensus.cc:2272] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.607431 27446 tablet_replica.cc:333] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.607996 27446 raft_consensus.cc:2243] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.608340 27446 raft_consensus.cc:2272] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.610287 27446 tablet_replica.cc:333] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.610803 27446 raft_consensus.cc:2243] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.611505 27446 raft_consensus.cc:2272] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.613420 27446 tablet_replica.cc:333] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.613989 27446 raft_consensus.cc:2243] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.614404 27446 raft_consensus.cc:2272] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.616240 27446 tablet_replica.cc:333] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.616815 27446 raft_consensus.cc:2243] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.617215 27446 raft_consensus.cc:2272] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.619251 27446 tablet_replica.cc:333] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.619933 27446 raft_consensus.cc:2243] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.620388 27446 raft_consensus.cc:2272] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.622897 27446 tablet_replica.cc:333] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.623672 27446 raft_consensus.cc:2243] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.624178 27446 raft_consensus.cc:2272] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:14.624472  5568 consensus_peers.cc:597] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.626678 27446 tablet_replica.cc:333] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.627552 27446 raft_consensus.cc:2243] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.628036 27446 raft_consensus.cc:2272] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.630348 27446 tablet_replica.cc:333] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
W20260709 12:22:14.630677  5568 consensus_peers.cc:597] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.630911 27446 raft_consensus.cc:2243] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.631963 27446 raft_consensus.cc:2272] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.634474 27446 tablet_replica.cc:333] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.635181 27446 raft_consensus.cc:2243] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.635716 27446 raft_consensus.cc:2272] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:14.636852  5494 consensus_peers.cc:597] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.637917 27446 tablet_replica.cc:333] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.638513 27446 raft_consensus.cc:2243] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.638917 27446 raft_consensus.cc:2272] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.640844 27446 tablet_replica.cc:333] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.641374 27446 raft_consensus.cc:2243] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.641834 27446 raft_consensus.cc:2272] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.643622 27446 tablet_replica.cc:333] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.644196 27446 raft_consensus.cc:2243] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.644637 27446 raft_consensus.cc:2272] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.646998 27446 tablet_replica.cc:333] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.647733 27446 raft_consensus.cc:2243] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.648702 27446 raft_consensus.cc:2272] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.651263 27446 tablet_replica.cc:333] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.651940 27446 raft_consensus.cc:2243] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.652904 27446 raft_consensus.cc:2272] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.655508 27446 tablet_replica.cc:333] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.656191 27446 raft_consensus.cc:2243] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.657137 27446 raft_consensus.cc:2272] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.659363 27446 tablet_replica.cc:333] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.659991 27446 raft_consensus.cc:2243] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.660527 27446 raft_consensus.cc:2272] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.663094 27446 tablet_replica.cc:333] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.663781 27446 raft_consensus.cc:2243] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.665975 27446 raft_consensus.cc:2272] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.668839 27446 tablet_replica.cc:333] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.669651 27446 raft_consensus.cc:2243] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.670790 27446 raft_consensus.cc:2272] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:14.671820  5494 consensus_peers.cc:597] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.673296  5568 consensus_peers.cc:597] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.673630 27446 tablet_replica.cc:333] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.674523 27446 raft_consensus.cc:2243] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.675043 27446 raft_consensus.cc:2272] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.678033 27446 tablet_replica.cc:333] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.678817 27446 raft_consensus.cc:2243] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.679420 27446 raft_consensus.cc:2272] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.682183 27446 tablet_replica.cc:333] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
I20260709 12:22:14.682823 27446 raft_consensus.cc:2243] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:14.683316  5568 consensus_peers.cc:597] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.683451 27446 raft_consensus.cc:2272] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.686196 27446 tablet_replica.cc:333] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: stopping tablet replica
W20260709 12:22:14.686336  5419 consensus_peers.cc:597] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.687638 27446 raft_consensus.cc:2243] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.688241 27446 raft_consensus.cc:2272] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:14.729425  5568 consensus_peers.cc:597] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.766165  5494 consensus_peers.cc:597] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.767336 27446 tablet_server.cc:196] TabletServer@127.26.205.129:0 shutdown complete.
W20260709 12:22:14.793980  5419 consensus_peers.cc:597] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.824898  5568 consensus_peers.cc:597] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.833118  5568 consensus_peers.cc:597] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.840685  5568 consensus_peers.cc:597] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.843899  5419 consensus_peers.cc:597] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.847152  5419 consensus_peers.cc:597] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.851248 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:14.859337  6120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:14.859797  6122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:14.860453  6119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:14.866706  5419 consensus_peers.cc:597] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.867833 27446 server_base.cc:1061] running on GCE node
W20260709 12:22:14.868602  5568 consensus_peers.cc:597] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.870527  5494 consensus_peers.cc:597] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.872149 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:14.872430 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:14.872655 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599734872617 us; error 0 us; skew 500 ppm
W20260709 12:22:14.872891  5494 consensus_peers.cc:597] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.873376 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:22:14.875422  5494 consensus_peers.cc:597] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.877349 27446 webserver.cc:533] Webserver started at http://127.26.205.129:40953/ using document root <none> and password file <none>
I20260709 12:22:14.877899 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:14.878129 27446 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:22:14.882202 27446 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:22:14.893146  6128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:14.895210 27446 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:14.895586 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
format_stamp: "Formatted at 2026-07-09 12:22:03 on dist-test-slave-673s"
I20260709 12:22:14.896082 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:22:14.902758  5568 consensus_peers.cc:597] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.905440  5494 consensus_peers.cc:597] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.934163 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:14.935969 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:14.937779 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:14.942948  6135 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:22:14.956202  5494 consensus_peers.cc:597] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.969625  5494 consensus_peers.cc:597] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:15.045744  5494 consensus_peers.cc:597] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:15.214028 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:22:15.214457 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.272s	user 0.010s	sys 0.000s
I20260709 12:22:15.214864 27446 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:22:15.228992  6135 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.244180  6135 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.244961  6135 tablet_bootstrap.cc:492] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.245553  6135 ts_tablet_manager.cc:1403] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:22:15.248064  6135 raft_consensus.cc:359] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.248762  6135 raft_consensus.cc:740] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.249490  6135 consensus_queue.cc:260] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.256966  6135 ts_tablet_manager.cc:1434] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 12:22:15.257823  6135 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.270840  6135 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.271752  6135 tablet_bootstrap.cc:492] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.272382  6135 ts_tablet_manager.cc:1403] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:22:15.274873  6135 raft_consensus.cc:359] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.275527  6135 raft_consensus.cc:740] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.276372  6135 consensus_queue.cc:260] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.278445  6135 ts_tablet_manager.cc:1434] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:15.279196  6135 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.300027  6135 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.300947  6135 tablet_bootstrap.cc:492] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.301563  6135 ts_tablet_manager.cc:1403] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 12:22:15.303599  6135 raft_consensus.cc:359] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.304128  6135 raft_consensus.cc:740] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.304708  6135 consensus_queue.cc:260] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.306052  6135 ts_tablet_manager.cc:1434] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:15.306712  6135 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.327737  6135 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.328758  6135 tablet_bootstrap.cc:492] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.329457  6135 ts_tablet_manager.cc:1403] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:22:15.331915  6135 raft_consensus.cc:359] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.332696  6135 raft_consensus.cc:740] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.333351  6135 consensus_queue.cc:260] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.335242  6135 ts_tablet_manager.cc:1434] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:15.336024  6135 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.356818  6135 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.357743  6135 tablet_bootstrap.cc:492] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.358398  6135 ts_tablet_manager.cc:1403] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:22:15.360845  6135 raft_consensus.cc:359] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.361526  6135 raft_consensus.cc:740] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.362386  6135 consensus_queue.cc:260] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.364421  6135 ts_tablet_manager.cc:1434] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:15.365203  6135 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.424202  6135 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.425127  6135 tablet_bootstrap.cc:492] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.425761  6135 ts_tablet_manager.cc:1403] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.061s	user 0.032s	sys 0.025s
I20260709 12:22:15.428153  6135 raft_consensus.cc:359] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.428828  6135 raft_consensus.cc:740] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.429595  6135 consensus_queue.cc:260] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.431638  6135 ts_tablet_manager.cc:1434] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:15.432422  6135 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.500283  6135 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.501611  6135 tablet_bootstrap.cc:492] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.502236  6135 ts_tablet_manager.cc:1403] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.038s
I20260709 12:22:15.504645  6135 raft_consensus.cc:359] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.505316  6135 raft_consensus.cc:740] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.506096  6135 consensus_queue.cc:260] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.507997  6135 ts_tablet_manager.cc:1434] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:22:15.508724  6135 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.510175 27446 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:22:15.510547 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.296s	user 0.251s	sys 0.005s
I20260709 12:22:15.521075  6135 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.521792  6135 tablet_bootstrap.cc:492] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.522420  6135 ts_tablet_manager.cc:1403] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:22:15.524775  6135 raft_consensus.cc:359] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.525293  6135 raft_consensus.cc:740] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.526043  6135 consensus_queue.cc:260] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.527619  6135 ts_tablet_manager.cc:1434] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:15.528374  6135 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.544184  6135 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.545405  6135 tablet_bootstrap.cc:492] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.546255  6135 ts_tablet_manager.cc:1403] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:22:15.549471  6135 raft_consensus.cc:359] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.550379  6135 raft_consensus.cc:740] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.551190  6135 consensus_queue.cc:260] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.553351  6135 ts_tablet_manager.cc:1434] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:15.554189  6135 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.556017  5977 raft_consensus.cc:493] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.557397  5977 raft_consensus.cc:515] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.560078  5977 leader_election.cc:290] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:15.562778  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:15.565459  5419 leader_election.cc:336] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:15.566586  5418 leader_election.cc:304] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:15.568053  5976 raft_consensus.cc:2749] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.571543  6135 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:15.572817  6135 tablet_bootstrap.cc:492] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.573578  6135 ts_tablet_manager.cc:1403] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:22:15.576586  6135 raft_consensus.cc:359] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.577556  6135 raft_consensus.cc:740] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.578100 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:39599
I20260709 12:22:15.578238  6207 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:39599 every 8 connection(s)
I20260709 12:22:15.578706  6135 consensus_queue.cc:260] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.580889  6135 ts_tablet_manager.cc:1434] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:15.581805  6135 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.611790  6135 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.613133  6135 tablet_bootstrap.cc:492] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.613987  6135 ts_tablet_manager.cc:1403] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.008s
I20260709 12:22:15.616636  6135 raft_consensus.cc:359] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.617400  6135 raft_consensus.cc:740] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.618065  6135 consensus_queue.cc:260] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.619670  6135 ts_tablet_manager.cc:1434] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:22:15.620491  6135 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.642737  6209 heartbeater.cc:344] Connected to a master server at 127.26.205.190:40179
I20260709 12:22:15.643316  6209 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:15.644240  6209 heartbeater.cc:507] Master 127.26.205.190:40179 requested a full tablet report, sending...
I20260709 12:22:15.647006  6135 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.648005  6135 tablet_bootstrap.cc:492] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.648631  6135 ts_tablet_manager.cc:1403] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.007s
I20260709 12:22:15.651206  6135 raft_consensus.cc:359] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.651844  6135 raft_consensus.cc:740] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.652496  6135 consensus_queue.cc:260] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.654420  6135 ts_tablet_manager.cc:1434] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:15.655177  6135 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.655731  5976 raft_consensus.cc:493] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.656276  5976 raft_consensus.cc:515] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.659502  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:15.661031  5419 leader_election.cc:343] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:15.665021  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:15.666767  5418 leader_election.cc:304] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:15.667722  5976 leader_election.cc:290] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:15.668708  5979 raft_consensus.cc:2749] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.670579  5979 raft_consensus.cc:493] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.671212  5979 raft_consensus.cc:515] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.699064  5271 ts_manager.cc:194] Re-registered known tserver with Master: 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:15.700075  6135 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.701128  6135 tablet_bootstrap.cc:492] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.701790  6135 ts_tablet_manager.cc:1403] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.021s
I20260709 12:22:15.704859  6135 raft_consensus.cc:359] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.705554  6135 raft_consensus.cc:740] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.706264  6135 consensus_queue.cc:260] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.707180  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:15.708462  6135 ts_tablet_manager.cc:1434] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 12:22:15.708725  5419 leader_election.cc:343] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:15.709319  6135 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.720330  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:15.727108  6138 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.727885  6138 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.730720  6138 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:15.731950  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:15.732486  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:15.732887  6179 raft_consensus.cc:2468] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:15.734225  5568 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:15.706349  5979 leader_election.cc:290] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:15.737709  5418 leader_election.cc:304] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:15.739336  5979 raft_consensus.cc:2749] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.740128  6138 raft_consensus.cc:2804] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.740599  6138 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.741101  6138 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.745934  5271 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57620
I20260709 12:22:15.750837  6209 heartbeater.cc:499] Master 127.26.205.190:40179 was elected leader, sending a full tablet report...
I20260709 12:22:15.780572  6218 raft_consensus.cc:493] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.781234  6218 raft_consensus.cc:515] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
W20260709 12:22:15.783367  5418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:38145, user_credentials={real_user=slave}} blocked reactor thread for 44435.5us
I20260709 12:22:15.784018  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:15.785347  5419 leader_election.cc:343] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:15.786779  6218 leader_election.cc:290] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:15.789072  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:15.790760  6138 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.791211  5418 leader_election.cc:304] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:15.792830  6218 raft_consensus.cc:2749] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.793426  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:15.794047  6179 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.804713  6138 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:15.805856  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:15.806092  6135 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.807178  6135 tablet_bootstrap.cc:492] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.807845  6135 ts_tablet_manager.cc:1403] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.099s	user 0.037s	sys 0.056s
I20260709 12:22:15.810438  6135 raft_consensus.cc:359] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.811102  6135 raft_consensus.cc:740] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.811569  6179 raft_consensus.cc:2468] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 2.
I20260709 12:22:15.811858  6135 consensus_queue.cc:260] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.812891  5568 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:15.814255  6135 ts_tablet_manager.cc:1434] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:15.815143  6135 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.817545  6138 raft_consensus.cc:2804] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:15.818207  6138 raft_consensus.cc:697] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:15.819139  6138 consensus_queue.cc:237] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.842504  5276 catalog_manager.cc:5697] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 2 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:15.845132  6138 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.845732  6138 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.849164  6138 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:15.850586  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:15.850768  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
W20260709 12:22:15.853875  5568 leader_election.cc:343] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:15.855322  5568 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:15.856374  6138 raft_consensus.cc:2749] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.857360  6135 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.859129  6135 tablet_bootstrap.cc:492] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.859850  6135 ts_tablet_manager.cc:1403] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.012s
I20260709 12:22:15.862237  6135 raft_consensus.cc:359] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.862939  6135 raft_consensus.cc:740] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.863811  6135 consensus_queue.cc:260] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.865828  6135 ts_tablet_manager.cc:1434] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:22:15.872032  6135 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.895601  6135 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.896639  6135 tablet_bootstrap.cc:492] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.897177  6135 ts_tablet_manager.cc:1403] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 12:22:15.899391  6135 raft_consensus.cc:359] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.899905  6135 raft_consensus.cc:740] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.900528  6135 consensus_queue.cc:260] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.902240  6135 ts_tablet_manager.cc:1434] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:15.903201  5977 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.903437  6135 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.903800  5977 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.905910  5977 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:15.907047  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:15.907397  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:15.908042  6179 raft_consensus.cc:2468] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:15.909437  5419 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:15.910349  5977 raft_consensus.cc:2804] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.910802  5977 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.919020  5977 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.919121  6135 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.921501  6216 raft_consensus.cc:493] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.929097  6216 raft_consensus.cc:515] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.932262  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:15.932466  6216 leader_election.cc:290] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:15.933527  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:15.934648  6135 tablet_bootstrap.cc:492] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
W20260709 12:22:15.934564  5419 leader_election.cc:343] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:15.935529  6135 ts_tablet_manager.cc:1403] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.000s
I20260709 12:22:15.937606  5418 leader_election.cc:304] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:15.938360  6135 raft_consensus.cc:359] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.939067  6135 raft_consensus.cc:740] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.939797  6135 consensus_queue.cc:260] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.940060  5976 raft_consensus.cc:2749] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.941924  6135 ts_tablet_manager.cc:1434] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:15.942726  6135 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.946228  5977 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.948372  6138 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.948944  6138 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.954545  6181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:15.954900  6138 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:15.955277  6181 raft_consensus.cc:2468] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:15.955767  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:15.956115  6145 raft_consensus.cc:493] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.956950  5451 raft_consensus.cc:2393] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 2: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
I20260709 12:22:15.956732  6145 raft_consensus.cc:515] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.957800  5977 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:15.958945  6145 leader_election.cc:290] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:15.959867  6138 raft_consensus.cc:493] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.960012  5568 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:15.960476  6138 raft_consensus.cc:515] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:15.961320  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:15.961956  5451 raft_consensus.cc:2468] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:15.962563  6138 leader_election.cc:290] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:15.963249  6135 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.963176  5494 leader_election.cc:304] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:15.964506  6135 tablet_bootstrap.cc:492] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.963157  6138 raft_consensus.cc:2804] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.964880  5975 raft_consensus.cc:2804] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.965138  6138 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.965317  5975 raft_consensus.cc:493] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.965391  6135 ts_tablet_manager.cc:1403] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.005s
I20260709 12:22:15.965577  6138 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.965720  5975 raft_consensus.cc:3060] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.968000  6135 raft_consensus.cc:359] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.968556  6135 raft_consensus.cc:740] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.964321  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:15.969215  6180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:15.969233  6135 consensus_queue.cc:260] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.971761  6135 ts_tablet_manager.cc:1434] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:22:15.972452  5568 leader_election.cc:343] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:15.972620  6135 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:15.973707  5567 leader_election.cc:304] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:15.962484  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:15.974503  5945 raft_consensus.cc:2749] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:15.975466  5494 leader_election.cc:343] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:15.973707  6138 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.977891  6138 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:15.979064  5975 raft_consensus.cc:515] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.974050  6181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:15.981068  6181 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.981655  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:15.982378  5455 raft_consensus.cc:2393] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 2: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
I20260709 12:22:15.983928  5977 raft_consensus.cc:493] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.984467  5977 raft_consensus.cc:515] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:15.986575  5977 leader_election.cc:290] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:15.987248  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:15.988176  6180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:15.988870  6180 raft_consensus.cc:2468] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:15.990121  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:15.991258  6135 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:15.991994  6135 tablet_bootstrap.cc:492] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:15.991794  5419 leader_election.cc:304] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:15.992491  6181 raft_consensus.cc:2468] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 2.
I20260709 12:22:15.992746  6135 ts_tablet_manager.cc:1403] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:22:15.993310  5977 raft_consensus.cc:2804] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.993736  5977 raft_consensus.cc:493] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.994097  5977 raft_consensus.cc:3060] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.994783  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:15.995030  6135 raft_consensus.cc:359] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.995591  5599 raft_consensus.cc:2393] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 2: Already voted for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in this term.
I20260709 12:22:15.995741  6135 raft_consensus.cc:740] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.996559  6135 consensus_queue.cc:260] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:15.997143  5419 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:15.997354  5568 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:15.998008  5945 raft_consensus.cc:493] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:15.998422  6137 raft_consensus.cc:2749] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.998543  5945 raft_consensus.cc:515] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:15.999150  6135 ts_tablet_manager.cc:1434] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:16.000052  6135 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:16.000895  5945 leader_election.cc:290] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:16.008358  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:16.009057  5451 raft_consensus.cc:2468] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:16.009534  6181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.009581  5976 raft_consensus.cc:2804] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.010977  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:16.011907  5976 raft_consensus.cc:697] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:16.011969  6145 raft_consensus.cc:493] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.013837  6145 raft_consensus.cc:515] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.014406  5976 consensus_queue.cc:237] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.016031  6145 leader_election.cc:290] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:16.012694  5568 leader_election.cc:343] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.012815  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a31cf131ed6430ea825e8d57e6433cb" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:16.017138  5451 raft_consensus.cc:3060] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.017477  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:16.019186  6137 raft_consensus.cc:493] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
W20260709 12:22:16.019196  5494 leader_election.cc:343] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.019732  6137 raft_consensus.cc:515] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.020603  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:16.021229  5455 raft_consensus.cc:2468] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:16.021461  6135 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.021826  6137 leader_election.cc:290] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:16.022416  6135 tablet_bootstrap.cc:492] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.022360  5494 leader_election.cc:304] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:16.023260  6135 ts_tablet_manager.cc:1403] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:22:16.023258  6091 raft_consensus.cc:493] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.023952  6091 raft_consensus.cc:515] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.024358  6145 raft_consensus.cc:2804] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.024820  6145 raft_consensus.cc:493] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.025151  6145 raft_consensus.cc:3060] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.025918  6091 leader_election.cc:290] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:16.026607  6216 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.027133  6216 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.028904  6216 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:16.023204  5568 leader_election.cc:304] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:16.013267  5975 leader_election.cc:290] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:16.029675  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:16.030139  6180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:16.030555  5455 raft_consensus.cc:2468] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
I20260709 12:22:16.031476  6178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:16.031786  6138 raft_consensus.cc:2804] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.031901  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:16.032348  6178 raft_consensus.cc:2393] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 2: Already voted for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in this term.
I20260709 12:22:16.033346  6180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:16.032250  6138 raft_consensus.cc:493] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.033928  6180 raft_consensus.cc:2468] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:16.034233  6138 raft_consensus.cc:3060] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.036661  6135 raft_consensus.cc:359] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.037617  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:16.037549  6135 raft_consensus.cc:740] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.036687  5494 leader_election.cc:304] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:16.038882  6135 consensus_queue.cc:260] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.041301  5418 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:16.042393  6216 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.038049  5568 leader_election.cc:304] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:16.004127  5977 raft_consensus.cc:515] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.043005  5975 raft_consensus.cc:2804] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.043396  5975 raft_consensus.cc:493] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.043674  5455 raft_consensus.cc:2393] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 2: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
I20260709 12:22:16.043706  5975 raft_consensus.cc:3060] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.010146  6181 raft_consensus.cc:3060] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.046604  6137 raft_consensus.cc:2804] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.047017  6137 raft_consensus.cc:493] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.047412  6137 raft_consensus.cc:3060] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.053349  6218 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.053900  6218 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.055889  6218 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:16.056739  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:16.057211  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:16.057636  6180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:16.057857  5603 raft_consensus.cc:2468] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 1.
I20260709 12:22:16.058154  5977 leader_election.cc:290] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:16.059017  5419 leader_election.cc:343] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.059810  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.060421  6179 raft_consensus.cc:3060] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.061403  6137 raft_consensus.cc:515] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.062024  6216 raft_consensus.cc:2749] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.062654  5604 raft_consensus.cc:2393] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7eb36fa55fb24fc6a0531b58835695d7 in current term 2: Already voted for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in this term.
I20260709 12:22:16.061471  5418 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:16.065963  6138 raft_consensus.cc:515] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:16.066322  6216 raft_consensus.cc:2804] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.066998  6216 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.068038  6179 raft_consensus.cc:2468] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 2.
I20260709 12:22:16.068205  6216 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.070749  6135 ts_tablet_manager.cc:1434] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 12:22:16.029600  5451 raft_consensus.cc:2468] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 2.
I20260709 12:22:16.068866  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
W20260709 12:22:16.068771  5494 leader_election.cc:343] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.098367  5455 raft_consensus.cc:3060] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.093598  5975 raft_consensus.cc:515] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.097800  6145 raft_consensus.cc:515] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.101606  5945 raft_consensus.cc:493] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.102149  6135 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:16.102185  5945 raft_consensus.cc:515] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.103251  6145 leader_election.cc:290] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:16.104563  5945 leader_election.cc:290] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:16.106374  6137 leader_election.cc:290] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:16.104267  6138 leader_election.cc:290] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:16.114583  6232 raft_consensus.cc:493] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.115170  6232 raft_consensus.cc:515] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:16.115896  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:16.117807  5494 leader_election.cc:304] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:16.116588  5451 raft_consensus.cc:3060] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.121358  6180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521044053aaa4980a83c1d2f14d14524" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.126291  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:16.126859  6181 raft_consensus.cc:2468] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 2.
I20260709 12:22:16.126992  5599 raft_consensus.cc:2468] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 1.
W20260709 12:22:16.129772  5494 leader_election.cc:343] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.128523  5493 leader_election.cc:304] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:16.138913  5455 raft_consensus.cc:2468] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 2.
I20260709 12:22:16.142251  5419 leader_election.cc:304] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:16.144090  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:16.144997  5455 raft_consensus.cc:2468] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 1.
I20260709 12:22:16.147583  5975 leader_election.cc:290] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:16.142243  5568 leader_election.cc:304] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:16.149772  6138 raft_consensus.cc:2804] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.150507  6138 raft_consensus.cc:697] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:16.151646  6138 consensus_queue.cc:237] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:16.131366  6145 raft_consensus.cc:2804] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.156195  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:16.157138  5455 raft_consensus.cc:2393] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 2: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
I20260709 12:22:16.154958  5568 leader_election.cc:304] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:16.149370  6216 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.161897  6145 raft_consensus.cc:697] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 2 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:16.162757  6137 raft_consensus.cc:2804] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.172245  5276 catalog_manager.cc:5697] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.164376  6230 raft_consensus.cc:2804] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:16.181077  6178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81434dfcd51a4772a9f3c8b182f6a9f6" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.182202  6177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf71ad7e2ac54415ab73c6499883c3b4" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.185755  6179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:16.166150  6232 leader_election.cc:290] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:16.210770  5494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.130:34515, user_credentials={real_user=slave}} blocked reactor thread for 78903.4us
W20260709 12:22:16.225598  5418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.132:38145, user_credentials={real_user=slave}} blocked reactor thread for 51346.7us
I20260709 12:22:16.177146  6235 raft_consensus.cc:2804] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.203979  6216 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:16.203743  6180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.210489  6137 raft_consensus.cc:493] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.192346  5451 raft_consensus.cc:2468] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 2.
I20260709 12:22:16.236334  6137 raft_consensus.cc:3060] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.238816  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:16.243007  5604 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.248368  6176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.249101  6176 raft_consensus.cc:3060] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.255146  6174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" is_pre_election: true
I20260709 12:22:16.255901  5604 raft_consensus.cc:2468] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 2.
W20260709 12:22:16.257206  5419 leader_election.cc:343] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.258806  5452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12167beadba54b97bfef03d91a5725aa" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
W20260709 12:22:16.258981  5494 leader_election.cc:343] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.259452  5452 raft_consensus.cc:3060] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.219889  6230 raft_consensus.cc:493] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:16.247521  6177 raft_consensus.cc:2393] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2df71e80861d4ef18c58ce9ed40ed9ba in current term 2: Already voted for candidate 7eb36fa55fb24fc6a0531b58835695d7 in this term.
I20260709 12:22:16.268637  6235 raft_consensus.cc:697] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:16.269588  5418 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:16.272967  6235 consensus_queue.cc:237] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.274466  6218 raft_consensus.cc:2804] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.275049  6218 raft_consensus.cc:697] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:16.275835  6218 consensus_queue.cc:237] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.265383  6230 raft_consensus.cc:3060] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.294989  6135 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.303158  5452 raft_consensus.cc:2468] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 2.
I20260709 12:22:16.308070  6176 raft_consensus.cc:2468] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 2.
I20260709 12:22:16.309043  6137 raft_consensus.cc:515] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.314824  5494 leader_election.cc:304] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:16.297498  6145 consensus_queue.cc:237] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.317093  6137 leader_election.cc:290] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Requested vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:16.322495  5494 leader_election.cc:304] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:16.323089  6237 raft_consensus.cc:2804] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.327234  6237 raft_consensus.cc:697] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 2 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:16.328938  6230 raft_consensus.cc:515] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:16.328095  6237 consensus_queue.cc:237] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.358111  6135 tablet_bootstrap.cc:492] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.359166  6135 ts_tablet_manager.cc:1403] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.257s	user 0.020s	sys 0.017s
I20260709 12:22:16.331212  6230 leader_election.cc:290] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:16.384390  6181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.374455  6236 raft_consensus.cc:2804] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.391361  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d726792b00846af91fe7eaee674790a" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:16.410218  5599 raft_consensus.cc:3060] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.409390  6236 raft_consensus.cc:697] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 2 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:16.414815  6236 consensus_queue.cc:237] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.408946  5276 catalog_manager.cc:5697] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:16.417920  5494 leader_election.cc:343] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.417304  5271 catalog_manager.cc:5697] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 2 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.419288  5272 catalog_manager.cc:5697] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 2 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.429232  5599 raft_consensus.cc:2468] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 2.
I20260709 12:22:16.430045  6135 raft_consensus.cc:359] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.430505  5493 leader_election.cc:304] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:16.430804  6135 raft_consensus.cc:740] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.431422  6240 raft_consensus.cc:2804] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:22:16.408797  5568 leader_election.cc:343] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:16.461481  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.129:39599, user_credentials={real_user=slave}} blocked reactor thread for 52721.5us
W20260709 12:22:16.462381  5568 leader_election.cc:343] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.459578  6135 consensus_queue.cc:260] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.465958  6135 ts_tablet_manager.cc:1434] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.106s	user 0.011s	sys 0.004s
I20260709 12:22:16.466814  6135 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:16.461489  6240 raft_consensus.cc:697] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 2 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:16.469398  6240 consensus_queue.cc:237] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:16.467249  5568 leader_election.cc:304] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:16.476302  6247 raft_consensus.cc:2749] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.481310  6175 raft_consensus.cc:1275] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.481539  6181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
I20260709 12:22:16.482847  5452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ab26a4132c42e7b6a9ed53a0d4d98b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:16.483484  5452 raft_consensus.cc:3060] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.506480  6175 raft_consensus.cc:1275] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Refusing update from remote peer 7eb36fa55fb24fc6a0531b58835695d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.509970  5451 raft_consensus.cc:1275] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.514281  5945 consensus_queue.cc:1048] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:16.515916  5568 leader_election.cc:343] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.516680  6235 consensus_queue.cc:1048] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.522804  5603 raft_consensus.cc:1275] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 7eb36fa55fb24fc6a0531b58835695d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.528091  5945 consensus_queue.cc:1048] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:16.535012  6218 consensus_queue.cc:1048] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.516192  5452 raft_consensus.cc:2468] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 2.
I20260709 12:22:16.547226  5568 leader_election.cc:304] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:16.550701  5945 raft_consensus.cc:2804] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.551594  5945 raft_consensus.cc:697] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:16.552534  5945 consensus_queue.cc:237] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.568557  5276 catalog_manager.cc:5697] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.603521  5271 catalog_manager.cc:5697] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 2 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.605928  5271 catalog_manager.cc:5697] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 2 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.607820  5271 catalog_manager.cc:5697] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to fddd18e8ee414562a16b88c1a12413fc (127.26.205.131). New cstate: current_term: 2 leader_uuid: "fddd18e8ee414562a16b88c1a12413fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.621763  5452 raft_consensus.cc:1275] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.623183  6243 consensus_queue.cc:1048] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.624929  6135 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.625948  6135 tablet_bootstrap.cc:492] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.626473  6135 ts_tablet_manager.cc:1403] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.160s	user 0.018s	sys 0.016s
I20260709 12:22:16.635597  6135 raft_consensus.cc:359] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:16.636343  6135 raft_consensus.cc:740] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.637347  6135 consensus_queue.cc:260] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:16.639571  6135 ts_tablet_manager.cc:1434] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:22:16.640501  6135 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
W20260709 12:22:16.640746  5568 consensus_peers.cc:597] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:16.673025  6175 raft_consensus.cc:1275] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Refusing update from remote peer 7eb36fa55fb24fc6a0531b58835695d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.675693  6235 consensus_queue.cc:1048] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.679250  6135 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.680408  6135 tablet_bootstrap.cc:492] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.681082  6135 ts_tablet_manager.cc:1403] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.007s
I20260709 12:22:16.690207  6135 raft_consensus.cc:359] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.690914  6135 raft_consensus.cc:740] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.691563  6135 consensus_queue.cc:260] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.693655  6135 ts_tablet_manager.cc:1434] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:22:16.694363  6135 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:16.701766  5603 raft_consensus.cc:1275] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 7eb36fa55fb24fc6a0531b58835695d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.703430  6235 consensus_queue.cc:1048] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.720077  6135 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.720975  6135 tablet_bootstrap.cc:492] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.721436  6135 ts_tablet_manager.cc:1403] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 12:22:16.723196  6135 raft_consensus.cc:359] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:16.723726  6135 raft_consensus.cc:740] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.724351  6135 consensus_queue.cc:260] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
W20260709 12:22:16.725587  5568 consensus_peers.cc:597] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:16.728564  6178 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.733136  5603 raft_consensus.cc:1275] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 7eb36fa55fb24fc6a0531b58835695d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.734736  5977 consensus_queue.cc:1048] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.741910  5276 catalog_manager.cc:5697] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 1 to 2, leader changed from 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129) to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 2 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.743162  6178 raft_consensus.cc:1275] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Refusing update from remote peer 7eb36fa55fb24fc6a0531b58835695d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.745299  6135 ts_tablet_manager.cc:1434] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:22:16.746215  6135 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:16.746558  6235 consensus_queue.cc:1048] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.779501  5452 raft_consensus.cc:1275] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer fddd18e8ee414562a16b88c1a12413fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.781215  6091 consensus_queue.cc:1048] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.812148  6135 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.812809  6178 raft_consensus.cc:1275] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Refusing update from remote peer fddd18e8ee414562a16b88c1a12413fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.813285  6135 tablet_bootstrap.cc:492] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.814021  6135 ts_tablet_manager.cc:1403] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.022s
I20260709 12:22:16.814539  6237 consensus_queue.cc:1048] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.816664  6135 raft_consensus.cc:359] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.819309  6135 raft_consensus.cc:740] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.820079  6135 consensus_queue.cc:260] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.824007  6135 ts_tablet_manager.cc:1434] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:16.824823  6135 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:16.839673  6135 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.840667  6135 tablet_bootstrap.cc:492] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.841327  6135 ts_tablet_manager.cc:1403] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 12:22:16.843676  6135 raft_consensus.cc:359] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.844332  6135 raft_consensus.cc:740] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.844982  6135 consensus_queue.cc:260] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.846983  6135 ts_tablet_manager.cc:1434] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:22:16.847786  6135 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:16.868737  5603 raft_consensus.cc:1275] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer fddd18e8ee414562a16b88c1a12413fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.870261  6135 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.870170  6091 consensus_queue.cc:1048] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.871245  6135 tablet_bootstrap.cc:492] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.871918  6135 ts_tablet_manager.cc:1403] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 12:22:16.874385  6135 raft_consensus.cc:359] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.874917  6135 raft_consensus.cc:740] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.875674  6135 consensus_queue.cc:260] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.877807  6135 ts_tablet_manager.cc:1434] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:22:16.881386  6135 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
W20260709 12:22:16.884114  5494 consensus_peers.cc:597] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:16.903872  6135 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.904930  6135 tablet_bootstrap.cc:492] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.905609  6135 ts_tablet_manager.cc:1403] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:22:16.908092  6135 raft_consensus.cc:359] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:16.908777  6135 raft_consensus.cc:740] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.909442  6135 consensus_queue.cc:260] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:16.911528  6135 ts_tablet_manager.cc:1434] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:16.912914  6135 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
W20260709 12:22:16.916667  5494 consensus_peers.cc:597] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:16.952373  5494 consensus_peers.cc:597] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:16.954704  6135 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.955790  6135 tablet_bootstrap.cc:492] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.955801  5452 raft_consensus.cc:1275] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer fddd18e8ee414562a16b88c1a12413fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:16.956001  5568 consensus_peers.cc:597] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:16.956593  6135 ts_tablet_manager.cc:1403] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.017s
I20260709 12:22:16.957187  6091 consensus_queue.cc:1048] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.959287  6135 raft_consensus.cc:359] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.959830  6135 raft_consensus.cc:740] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.960538  6135 consensus_queue.cc:260] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:16.962611  6135 ts_tablet_manager.cc:1434] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:16.964969  6135 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
W20260709 12:22:16.977734  5494 consensus_peers.cc:597] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:16.995704  6135 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:16.996642  6135 tablet_bootstrap.cc:492] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:16.997265  6135 ts_tablet_manager.cc:1403] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.008s
I20260709 12:22:16.999558  6135 raft_consensus.cc:359] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:16.999883  5452 raft_consensus.cc:1275] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer fddd18e8ee414562a16b88c1a12413fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.000276  6135 raft_consensus.cc:740] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.001159  6135 consensus_queue.cc:260] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.001700  6236 consensus_queue.cc:1048] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.005182  6135 ts_tablet_manager.cc:1434] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:17.005990  6135 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.030308  6135 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.031180  6135 tablet_bootstrap.cc:492] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.031813  6135 ts_tablet_manager.cc:1403] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.000s
I20260709 12:22:17.034128  6135 raft_consensus.cc:359] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:17.034797  6135 raft_consensus.cc:740] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.035486  6135 consensus_queue.cc:260] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:17.035981  6178 raft_consensus.cc:1275] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Refusing update from remote peer fddd18e8ee414562a16b88c1a12413fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.037762  6135 ts_tablet_manager.cc:1434] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 12:22:17.039222  6091 consensus_queue.cc:1048] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.045408  6135 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.070585  6135 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.071565  6135 tablet_bootstrap.cc:492] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.072202  6135 ts_tablet_manager.cc:1403] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.003s
I20260709 12:22:17.074568  6135 raft_consensus.cc:359] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:17.075168  6135 raft_consensus.cc:740] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.075882  6135 consensus_queue.cc:260] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:17.077919  6135 ts_tablet_manager.cc:1434] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:17.078676  6135 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.091631  6135 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.092523  6135 tablet_bootstrap.cc:492] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.092904  5452 raft_consensus.cc:1275] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.093315  6135 ts_tablet_manager.cc:1403] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:22:17.094928  6244 consensus_queue.cc:1048] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.095986  6135 raft_consensus.cc:359] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.096764  6135 raft_consensus.cc:740] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.097416  6135 consensus_queue.cc:260] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.099498  6135 ts_tablet_manager.cc:1434] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:17.100996  6135 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.116003  6135 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.116982  6135 tablet_bootstrap.cc:492] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.118254  6135 ts_tablet_manager.cc:1403] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 12:22:17.121357  6135 raft_consensus.cc:359] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:17.121999  6135 raft_consensus.cc:740] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.122656  6135 consensus_queue.cc:260] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:17.124521  6135 ts_tablet_manager.cc:1434] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:17.125355  6135 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.139505  6135 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.140497  6135 tablet_bootstrap.cc:492] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.141579  6135 ts_tablet_manager.cc:1403] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:22:17.143512  6135 raft_consensus.cc:359] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.144001  6135 raft_consensus.cc:740] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.144670  6135 consensus_queue.cc:260] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.146220  6135 ts_tablet_manager.cc:1434] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:22:17.146854  6135 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.157619  6135 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.158442  6135 tablet_bootstrap.cc:492] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.159091  6135 ts_tablet_manager.cc:1403] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:22:17.161000  6135 raft_consensus.cc:359] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:17.161497  6135 raft_consensus.cc:740] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.161994  6135 consensus_queue.cc:260] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:17.163400  6135 ts_tablet_manager.cc:1434] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:17.164294  6135 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
W20260709 12:22:17.175103  5568 consensus_peers.cc:597] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:17.177245  6135 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.178213  6135 tablet_bootstrap.cc:492] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.178838  6135 ts_tablet_manager.cc:1403] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
W20260709 12:22:17.179149  5494 consensus_peers.cc:597] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:17.180747  6135 raft_consensus.cc:359] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.181296  6135 raft_consensus.cc:740] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.181818  6135 consensus_queue.cc:260] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.183671  6135 ts_tablet_manager.cc:1434] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:17.184643  6135 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.196864  6135 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.197767  6135 tablet_bootstrap.cc:492] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.198398  6135 ts_tablet_manager.cc:1403] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:22:17.200615  6135 raft_consensus.cc:359] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.201256  6135 raft_consensus.cc:740] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.201879  6135 consensus_queue.cc:260] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.203871  6135 ts_tablet_manager.cc:1434] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:17.205003  6135 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.218889  6135 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.219868  6135 tablet_bootstrap.cc:492] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.220513  6135 ts_tablet_manager.cc:1403] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:22:17.222738  6135 raft_consensus.cc:359] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:17.223456  6135 raft_consensus.cc:740] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.224114  6135 consensus_queue.cc:260] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:17.226032  6135 ts_tablet_manager.cc:1434] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:17.226986  6135 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.243672  6135 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.244590  6135 tablet_bootstrap.cc:492] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.245271  6135 ts_tablet_manager.cc:1403] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.005s
I20260709 12:22:17.247712  6135 raft_consensus.cc:359] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:17.248369  6135 raft_consensus.cc:740] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.249074  6135 consensus_queue.cc:260] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:17.251216  6135 ts_tablet_manager.cc:1434] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:22:17.252000  6135 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.264825  6135 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.265651  6135 tablet_bootstrap.cc:492] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.266256  6135 ts_tablet_manager.cc:1403] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:22:17.267967  6135 raft_consensus.cc:359] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:17.268446  6135 raft_consensus.cc:740] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.269007  6135 consensus_queue.cc:260] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:17.270453  6135 ts_tablet_manager.cc:1434] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:17.272300  6135 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.292239  6175 raft_consensus.cc:3060] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.317894  6135 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.318962  6135 tablet_bootstrap.cc:492] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.319591  6135 ts_tablet_manager.cc:1403] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.019s
I20260709 12:22:17.322132  6135 raft_consensus.cc:359] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:17.322793  6135 raft_consensus.cc:740] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.323539  6135 consensus_queue.cc:260] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:17.325590  6135 ts_tablet_manager.cc:1434] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:22:17.326404  6135 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.346419  6135 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.347381  6135 tablet_bootstrap.cc:492] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.348057  6135 ts_tablet_manager.cc:1403] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:22:17.350382  6135 raft_consensus.cc:359] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:17.351023  6135 raft_consensus.cc:740] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.351689  6135 consensus_queue.cc:260] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:17.354383  6135 ts_tablet_manager.cc:1434] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:17.355739  6135 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.362702  6299 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.363277  6299 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.370724  6299 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:17.380256  6135 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.381233  6135 tablet_bootstrap.cc:492] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.381950  6135 ts_tablet_manager.cc:1403] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.007s
I20260709 12:22:17.384636  5452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7" is_pre_election: true
I20260709 12:22:17.385351  5452 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:17.386654  6131 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:17.386756  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
I20260709 12:22:17.387516  5523 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:17.387605  6299 raft_consensus.cc:2804] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:17.388047  6299 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.388371  6299 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.386391  6135 raft_consensus.cc:359] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.388810  6135 raft_consensus.cc:740] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.389541  6135 consensus_queue.cc:260] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.391496  6135 ts_tablet_manager.cc:1434] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:17.392309  6135 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap starting.
I20260709 12:22:17.395818  6299 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.399024  5525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:17.399600  5525 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.399852  5452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f004b323a1d24685bf59c122a46fec9f" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:17.400475  5452 raft_consensus.cc:3060] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.401460  6299 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:17.409364  5525 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 3.
I20260709 12:22:17.410992  6130 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:17.413581  6175 raft_consensus.cc:3060] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.417215  5452 raft_consensus.cc:2468] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 3.
I20260709 12:22:17.423148  6135 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:17.423557  6140 raft_consensus.cc:2804] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.424152  6135 tablet_bootstrap.cc:492] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Bootstrap complete.
I20260709 12:22:17.425122  6135 ts_tablet_manager.cc:1403] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.011s
I20260709 12:22:17.429862  6135 raft_consensus.cc:359] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.430544  6135 raft_consensus.cc:740] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Initialized, Role: FOLLOWER
I20260709 12:22:17.431294  6135 consensus_queue.cc:260] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.442651  6140 raft_consensus.cc:697] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:17.443132  6135 ts_tablet_manager.cc:1434] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 12:22:17.443677  6140 consensus_queue.cc:237] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:17.458915  5272 catalog_manager.cc:5697] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.529938  6175 raft_consensus.cc:3060] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.692152  6175 raft_consensus.cc:3060] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.842228  5525 raft_consensus.cc:1275] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:17.843461  6140 consensus_queue.cc:1048] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.861953  5453 raft_consensus.cc:1275] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:17.864014  6310 consensus_queue.cc:1048] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:25.606431 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:25.661641  5451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce"
dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:45214
I20260709 12:22:25.662312  5451 raft_consensus.cc:606] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:25.673887  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:25.674463  5523 raft_consensus.cc:606] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:25.685943  5600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03"
dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:59166
I20260709 12:22:25.686533  5600 raft_consensus.cc:606] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:25.689218  5451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875"
dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:45214
I20260709 12:22:25.689733  5451 raft_consensus.cc:606] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:25.692368  5600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f267030285b54db4bfe6e2293754df95"
dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:59166
I20260709 12:22:25.692941  5600 raft_consensus.cc:606] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:25.694062 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:25.695772 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:25.696640 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:25.697373  6344 raft_consensus.cc:993] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 2df71e80861d4ef18c58ce9ed40ed9ba to start an election
I20260709 12:22:25.698093  6346 raft_consensus.cc:1081] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 2df71e80861d4ef18c58ce9ed40ed9ba to start an election
I20260709 12:22:25.700176  5599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211"
dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
 from {username='slave'} at 127.0.0.1:46158
I20260709 12:22:25.700783  5599 raft_consensus.cc:493] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.701202  5599 raft_consensus.cc:3060] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.709996  5599 raft_consensus.cc:515] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:25.712814  5599 leader_election.cc:290] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:25.713464  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:25.714306  5451 raft_consensus.cc:3060] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.714928  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69e86de2926d4f3eafdf9f57553e3211" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:25.715502  5523 raft_consensus.cc:3055] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.715757  5523 raft_consensus.cc:740] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:25.716620  5523 consensus_queue.cc:260] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:25.717918  5523 raft_consensus.cc:3060] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.719928  5451 raft_consensus.cc:2468] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 2.
I20260709 12:22:25.721272  5568 leader_election.cc:304] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:25.722131  6138 raft_consensus.cc:2804] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.722565  6138 raft_consensus.cc:697] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:25.723501  6138 consensus_queue.cc:237] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:25.724598  5523 raft_consensus.cc:2468] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 2.
I20260709 12:22:25.748857  5272 catalog_manager.cc:5697] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 2 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:25.800981  6353 raft_consensus.cc:993] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:25.801594  6338 raft_consensus.cc:1081] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:25.803185  6181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38580
I20260709 12:22:25.803710  6181 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.804014  6181 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.811947  6353 raft_consensus.cc:993] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:25.811740  6181 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:25.812462  6338 raft_consensus.cc:1081] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:25.813863  6181 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:25.814525  6175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f267030285b54db4bfe6e2293754df95"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38580
I20260709 12:22:25.815565  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:25.815766  6175 raft_consensus.cc:493] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.816159  5451 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.816226  6175 raft_consensus.cc:3060] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.822257  5451 raft_consensus.cc:2468] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 3.
I20260709 12:22:25.823117  6175 raft_consensus.cc:515] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:25.823843  6131 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:25.824987  6341 raft_consensus.cc:2804] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:25.825654  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:25.826210  5523 raft_consensus.cc:3060] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.826226  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e076c07c0947d5a199139898ffba03" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:25.826982  5599 raft_consensus.cc:3055] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:25.827325  5599 raft_consensus.cc:740] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:25.827476  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:25.828346  6341 raft_consensus.cc:697] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:25.828708  5600 raft_consensus.cc:3055] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:25.829088  5600 raft_consensus.cc:740] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:25.828055  5599 consensus_queue.cc:260] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:25.829429  6341 consensus_queue.cc:237] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:25.829902  5600 consensus_queue.cc:260] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:25.830624  5599 raft_consensus.cc:3060] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.831131  5600 raft_consensus.cc:3060] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.834012  5523 raft_consensus.cc:2468] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:25.835618  6130 leader_election.cc:304] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:25.836453  6175 leader_election.cc:290] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:25.837154  6359 raft_consensus.cc:2804] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.839713  5599 raft_consensus.cc:2468] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 3.
I20260709 12:22:25.844281  5600 raft_consensus.cc:2468] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:25.846036  6359 raft_consensus.cc:697] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:25.847138  6359 consensus_queue.cc:237] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:25.849171  5272 catalog_manager.cc:5697] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 2 to 3, leader changed from 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 3 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:25.871519  5272 catalog_manager.cc:5697] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:25.953256  6363 raft_consensus.cc:993] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:25.953806  6345 raft_consensus.cc:1081] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:25.955088  6175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38564
I20260709 12:22:25.955575  6175 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:25.955869  6175 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.961549  6175 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:25.963320  6175 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:25.963872  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:25.964535  5599 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.965276  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4058efce24824bdab7ff7d90f5c1c9ce" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:25.965894  5453 raft_consensus.cc:3055] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:25.966156  5453 raft_consensus.cc:740] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:25.966885  5453 consensus_queue.cc:260] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:25.967794  5453 raft_consensus.cc:3060] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.969581  5599 raft_consensus.cc:2468] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 3.
I20260709 12:22:25.970592  6130 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:25.971379  6361 raft_consensus.cc:2804] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:25.971858  6361 raft_consensus.cc:697] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:25.972771  6361 consensus_queue.cc:237] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:25.974040  5453 raft_consensus.cc:2468] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 3.
I20260709 12:22:25.983286  5272 catalog_manager.cc:5697] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 2 to 3, leader changed from 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 3 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.005733  6363 raft_consensus.cc:993] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:26.006217  6345 raft_consensus.cc:1081] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:26.007589  6175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38564
I20260709 12:22:26.008126  6175 raft_consensus.cc:493] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:26.008495  6175 raft_consensus.cc:3060] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.013742  6175 raft_consensus.cc:515] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:26.015369  6175 leader_election.cc:290] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:26.016103  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:26.016750  5599 raft_consensus.cc:3060] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.021416  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d541fc6b63b5452aa4505d8f4275b875" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:26.022034  5453 raft_consensus.cc:3055] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.022375  5453 raft_consensus.cc:740] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:26.023348  5453 consensus_queue.cc:260] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:26.024716  5453 raft_consensus.cc:3060] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.025135  5599 raft_consensus.cc:2468] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:26.026971  6130 leader_election.cc:304] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:26.027732  6361 raft_consensus.cc:2804] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:26.028234  6361 raft_consensus.cc:697] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:26.029160  6361 consensus_queue.cc:237] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:26.032804  5453 raft_consensus.cc:2468] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:26.039837  5272 catalog_manager.cc:5697] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.114054  5523 raft_consensus.cc:1275] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.115272  6338 consensus_queue.cc:1048] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.127187  5453 raft_consensus.cc:1275] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.128602  6338 consensus_queue.cc:1048] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.245090  5599 raft_consensus.cc:1275] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:26.246217  6361 consensus_queue.cc:1048] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:26.258368  5451 raft_consensus.cc:1275] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:26.259814  6359 consensus_queue.cc:1048] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:26.263137  5600 raft_consensus.cc:1275] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.268240  6359 consensus_queue.cc:1048] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:22:26.295953  5523 raft_consensus.cc:1275] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.297483  6361 consensus_queue.cc:1048] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.442087  5600 raft_consensus.cc:1275] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:26.443279  6361 consensus_queue.cc:1048] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:26.453071  5451 raft_consensus.cc:1275] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:26.454445  6341 consensus_queue.cc:1048] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:26.560127  5453 raft_consensus.cc:1275] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.561367  6359 consensus_queue.cc:1048] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.571039  5599 raft_consensus.cc:1275] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:26.572554  6359 consensus_queue.cc:1048] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.775432 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.823086  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af71d02653944509494d122128ee567"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:26.823704  5523 raft_consensus.cc:606] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:26.826516  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20bc52dfebc342d381e8f38949578038"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:26.826975  5523 raft_consensus.cc:606] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:26.829131  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:26.829577  5523 raft_consensus.cc:606] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:26.831627  5599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2"
dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:59166
I20260709 12:22:26.832194  5599 raft_consensus.cc:606] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:26.834710  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:26.835148  5523 raft_consensus.cc:606] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:26.836155 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:26.837872 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:26.838543 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.855984  6338 raft_consensus.cc:993] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:26.856581  6353 raft_consensus.cc:1081] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:26.858350  6178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38580
I20260709 12:22:26.858928  6178 raft_consensus.cc:493] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:26.859470  6178 raft_consensus.cc:3060] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.861883  6346 raft_consensus.cc:993] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:26.862421  6346 raft_consensus.cc:1081] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:26.864846  6175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38566
I20260709 12:22:26.865365  6175 raft_consensus.cc:493] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:26.865733  6175 raft_consensus.cc:3060] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.873183  6175 raft_consensus.cc:515] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:26.873996  6178 raft_consensus.cc:515] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:26.876111  6178 leader_election.cc:290] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:26.876267  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:26.876879  5453 raft_consensus.cc:3060] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.877709  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b79772c58ae14912b3ac47484ae94bbd" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:26.879537  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:26.880110  5451 raft_consensus.cc:3060] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.880379  5523 raft_consensus.cc:3055] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.880779  5523 raft_consensus.cc:740] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:26.881484  5523 consensus_queue.cc:260] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:26.882545  5523 raft_consensus.cc:3060] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.884744  5453 raft_consensus.cc:2468] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:26.885881  6131 leader_election.cc:304] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:26.886796  6341 raft_consensus.cc:2804] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:26.887341  6341 raft_consensus.cc:697] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:26.888505  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4116669c74d4417d993b6fe905fab3c2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:26.889079  5600 raft_consensus.cc:3055] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.889351  5600 raft_consensus.cc:740] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:26.889832  6175 leader_election.cc:290] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:26.890097  5600 consensus_queue.cc:260] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:26.886746  5451 raft_consensus.cc:2468] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:26.891341  5600 raft_consensus.cc:3060] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.891769  6131 leader_election.cc:304] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:26.892683  6359 raft_consensus.cc:2804] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:26.893141  6359 raft_consensus.cc:697] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:26.894009  6359 consensus_queue.cc:237] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:26.888197  6341 consensus_queue.cc:237] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:26.896796  5523 raft_consensus.cc:2468] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:26.900969  5600 raft_consensus.cc:2468] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:26.909907  5276 catalog_manager.cc:5697] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:26.911266  5276 catalog_manager.cc:5697] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.239311  6346 raft_consensus.cc:993] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:27.239794  6344 raft_consensus.cc:1081] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:27.241387  6175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1af71d02653944509494d122128ee567"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38566
I20260709 12:22:27.241863  6175 raft_consensus.cc:493] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:27.242218  6175 raft_consensus.cc:3060] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.248495  6175 raft_consensus.cc:515] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:27.250339  6175 leader_election.cc:290] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:27.251183  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:27.251271  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af71d02653944509494d122128ee567" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:27.251823  5527 raft_consensus.cc:3055] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:27.251940  5599 raft_consensus.cc:3060] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.252074  5527 raft_consensus.cc:740] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:27.253147  5527 consensus_queue.cc:260] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:27.254312  5527 raft_consensus.cc:3060] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.259173  5599 raft_consensus.cc:2468] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:27.260360  6130 leader_election.cc:304] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:27.261225  6341 raft_consensus.cc:2804] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:27.261127  5527 raft_consensus.cc:2468] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:27.261883  6341 raft_consensus.cc:697] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:27.262835  6341 consensus_queue.cc:237] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:27.272444  5276 catalog_manager.cc:5697] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:27.274325  6346 raft_consensus.cc:993] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:27.274868  6344 raft_consensus.cc:1081] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:27.276338  6175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38566
I20260709 12:22:27.276889  6175 raft_consensus.cc:493] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:27.277225  6175 raft_consensus.cc:3060] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.283711  6175 raft_consensus.cc:515] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:27.286065  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:27.286623  5453 raft_consensus.cc:3060] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.286705  6175 leader_election.cc:290] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:27.286871  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30b377cee535487cadb7a1c9c5cbbf02" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:27.287492  5527 raft_consensus.cc:3055] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:27.287810  5527 raft_consensus.cc:740] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:27.288645  5527 consensus_queue.cc:260] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:27.289588  5527 raft_consensus.cc:3060] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.292806  5453 raft_consensus.cc:2468] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:27.294090  6131 leader_election.cc:304] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:27.294885  6341 raft_consensus.cc:2804] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:27.295344  6341 raft_consensus.cc:697] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:27.296054  5527 raft_consensus.cc:2468] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:27.296253  6341 consensus_queue.cc:237] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:27.309154  5276 catalog_manager.cc:5697] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.337838  5599 raft_consensus.cc:1275] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.339151  6341 consensus_queue.cc:1048] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.341559  6346 raft_consensus.cc:993] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:27.342087  6344 raft_consensus.cc:1081] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:27.343580  6178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20bc52dfebc342d381e8f38949578038"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38566
I20260709 12:22:27.344223  6178 raft_consensus.cc:493] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:27.344614  6178 raft_consensus.cc:3060] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.354230  6178 raft_consensus.cc:515] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:27.356629  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:27.357198  5527 raft_consensus.cc:3055] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:27.357506  5527 raft_consensus.cc:740] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:27.358235  5527 consensus_queue.cc:260] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:27.359303  5527 raft_consensus.cc:3060] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.360150  6178 leader_election.cc:290] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:27.364501  5453 raft_consensus.cc:1275] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.366196  5527 raft_consensus.cc:2468] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:27.367501  6130 leader_election.cc:304] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:27.367578  6359 consensus_queue.cc:1048] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.369342  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:27.369941  5599 raft_consensus.cc:3060] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:27.369606  6361 raft_consensus.cc:2804] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:27.389916  5599 raft_consensus.cc:2468] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:27.398046  6361 raft_consensus.cc:697] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:27.399438  6361 consensus_queue.cc:237] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:27.410080  5271 catalog_manager.cc:5697] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:27.421388  5527 raft_consensus.cc:1275] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.422526  6361 consensus_queue.cc:1048] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.432471  5453 raft_consensus.cc:1275] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.433846  6393 consensus_queue.cc:1048] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.723307  5599 raft_consensus.cc:1275] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.724593  6393 consensus_queue.cc:1048] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.734030  5527 raft_consensus.cc:1275] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.736239  6359 consensus_queue.cc:1048] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.768177  5451 raft_consensus.cc:1275] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.769546  6359 consensus_queue.cc:1048] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.773594  5527 raft_consensus.cc:1275] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.775398  6359 consensus_queue.cc:1048] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.802877  5527 raft_consensus.cc:1275] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.804359  6391 consensus_queue.cc:1048] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.813503  5599 raft_consensus.cc:1275] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:27.816095  6391 consensus_queue.cc:1048] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:27.900840 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:27.940204  5527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:27.940846  5527 raft_consensus.cc:606] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:27.943360  5527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:27.943769  5527 raft_consensus.cc:606] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:27.945778  5527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:27.946161  5527 raft_consensus.cc:606] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:27.948167  5527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a"
dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
mode: GRACEFUL
new_leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
 from {username='slave'} at 127.0.0.1:33462
I20260709 12:22:27.948652  5527 raft_consensus.cc:606] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Received request to transfer leadership to TS 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:27.949882 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:27.952078 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:27.952966 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:28.007347  6333 raft_consensus.cc:993] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:28.007942  6346 raft_consensus.cc:1081] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:28.009625  6178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38566
I20260709 12:22:28.010078  6178 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.010355  6178 raft_consensus.cc:3060] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.015684  6178 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:28.017079  6178 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:28.017798  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:28.018388  5527 raft_consensus.cc:3055] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:28.018050  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:28.018745  5527 raft_consensus.cc:740] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:28.019151  5599 raft_consensus.cc:3060] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.019821  5527 consensus_queue.cc:260] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:28.021399  5527 raft_consensus.cc:3060] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.028749  5527 raft_consensus.cc:2468] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:28.030004  6130 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:28.030813  6391 raft_consensus.cc:2804] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:28.031279  6391 raft_consensus.cc:697] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:28.032107  6391 consensus_queue.cc:237] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:28.033092  5599 raft_consensus.cc:2468] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:28.043601  5276 catalog_manager.cc:5697] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:28.184968  6333 raft_consensus.cc:993] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 2df71e80861d4ef18c58ce9ed40ed9ba to start an election
I20260709 12:22:28.185449  6346 raft_consensus.cc:1081] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 2df71e80861d4ef18c58ce9ed40ed9ba to start an election
I20260709 12:22:28.186991  5600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b"
dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
 from {username='slave'} at 127.0.0.1:46158
I20260709 12:22:28.187494  5600 raft_consensus.cc:493] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.187774  5600 raft_consensus.cc:3060] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.193599  5600 raft_consensus.cc:515] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:28.195254  5600 leader_election.cc:290] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:28.195856  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:28.196257  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12444cef6727421b9d5186006a5dda8b" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:28.196548  5453 raft_consensus.cc:3060] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.196928  5527 raft_consensus.cc:3055] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:28.197268  5527 raft_consensus.cc:740] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:28.197964  5527 consensus_queue.cc:260] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:28.198969  5527 raft_consensus.cc:3060] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.201934  5453 raft_consensus.cc:2468] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 2.
I20260709 12:22:28.203047  5568 leader_election.cc:304] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:28.203740  6138 raft_consensus.cc:2804] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:28.203850  5527 raft_consensus.cc:2468] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df71e80861d4ef18c58ce9ed40ed9ba in term 2.
I20260709 12:22:28.204205  6138 raft_consensus.cc:697] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Becoming Leader. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:28.205000  6138 consensus_queue.cc:237] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:28.214699  5276 catalog_manager.cc:5697] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132). New cstate: current_term: 2 leader_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:28.304533  6346 raft_consensus.cc:993] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:28.305009  6344 raft_consensus.cc:1081] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:28.307029  6178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38566
I20260709 12:22:28.307583  6178 raft_consensus.cc:493] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.307917  6178 raft_consensus.cc:3060] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.314797  6178 raft_consensus.cc:515] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:28.316306  6178 leader_election.cc:290] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:28.317230  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:28.317246  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b59df10e4c4aa38e5dbd6cc3b2ed67" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:28.317818  5527 raft_consensus.cc:3055] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:28.317950  5453 raft_consensus.cc:3060] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.318095  5527 raft_consensus.cc:740] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:28.318770  5527 consensus_queue.cc:260] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:28.319675  5527 raft_consensus.cc:3060] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.322808  5453 raft_consensus.cc:2468] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:28.323803  6131 leader_election.cc:304] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:28.324512  5527 raft_consensus.cc:2468] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:28.324582  6391 raft_consensus.cc:2804] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:28.327392  6391 raft_consensus.cc:697] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:28.328253  6391 consensus_queue.cc:237] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:28.339648  5276 catalog_manager.cc:5697] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.381273  6344 raft_consensus.cc:993] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc: : Instructing follower 7eb36fa55fb24fc6a0531b58835695d7 to start an election
I20260709 12:22:28.381850  6333 raft_consensus.cc:1081] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Signalling peer 7eb36fa55fb24fc6a0531b58835695d7 to start an election
I20260709 12:22:28.383270  5453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a"
dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
 from {username='slave'} at 127.0.0.1:34972
I20260709 12:22:28.383718  5453 raft_consensus.cc:493] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:28.383981  5453 raft_consensus.cc:3060] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.388604  5453 raft_consensus.cc:515] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:28.390332  5453 leader_election.cc:290] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:28.391062  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:28.391278  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5495488e26d44d3be7dd371d31e169a" candidate_uuid: "7eb36fa55fb24fc6a0531b58835695d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:28.391708  5527 raft_consensus.cc:3055] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:28.391808  5599 raft_consensus.cc:3060] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.392076  5527 raft_consensus.cc:740] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:28.392925  5527 consensus_queue.cc:260] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:28.394127  5527 raft_consensus.cc:3060] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:28.398406  5599 raft_consensus.cc:2468] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 2.
I20260709 12:22:28.399638  5418 leader_election.cc:304] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, 7eb36fa55fb24fc6a0531b58835695d7; no voters: 
I20260709 12:22:28.400450  6405 raft_consensus.cc:2804] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:28.400629  5527 raft_consensus.cc:2468] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb36fa55fb24fc6a0531b58835695d7 in term 2.
I20260709 12:22:28.401464  6405 raft_consensus.cc:697] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:28.402392  6405 consensus_queue.cc:237] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:28.411113  5276 catalog_manager.cc:5697] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 reported cstate change: term changed from 1 to 2, leader changed from fddd18e8ee414562a16b88c1a12413fc (127.26.205.131) to 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "7eb36fa55fb24fc6a0531b58835695d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:28.446878  5527 raft_consensus.cc:1275] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.448042  6361 consensus_queue.cc:1048] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.461843  5599 raft_consensus.cc:1275] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.464679  6361 consensus_queue.cc:1048] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:28.745417  5527 raft_consensus.cc:1275] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.746591  6361 consensus_queue.cc:1048] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.753552  5451 raft_consensus.cc:1275] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.755508  6361 consensus_queue.cc:1048] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.798797  5527 raft_consensus.cc:1275] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.800150  6420 consensus_queue.cc:1048] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.837085  5451 raft_consensus.cc:1275] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Refusing update from remote peer 2df71e80861d4ef18c58ce9ed40ed9ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.840881  6426 consensus_queue.cc:1048] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.881935  5599 raft_consensus.cc:1275] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 7eb36fa55fb24fc6a0531b58835695d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.883258  6405 consensus_queue.cc:1048] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.895304  5527 raft_consensus.cc:1275] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 7eb36fa55fb24fc6a0531b58835695d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:28.897400  6363 consensus_queue.cc:1048] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:28.990903 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.027817  5599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e"
dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:59166
I20260709 12:22:29.028350  5599 raft_consensus.cc:606] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:29.030771  5451 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2"
dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
mode: GRACEFUL
new_leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:45214
I20260709 12:22:29.031230  5451 raft_consensus.cc:606] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Received request to transfer leadership to TS 1ad33b9e1a5644d0afb8822d3b3ac926
I20260709 12:22:29.032325 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:29.033500 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.034093 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.109261  6425 raft_consensus.cc:993] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:29.109839  6426 raft_consensus.cc:1081] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:29.111267  6175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38580
I20260709 12:22:29.111753  6175 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:29.112108  6175 raft_consensus.cc:3060] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.118891  6175 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:29.120728  6175 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Requested vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145)
I20260709 12:22:29.122761  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fddd18e8ee414562a16b88c1a12413fc"
I20260709 12:22:29.123365  5527 raft_consensus.cc:3060] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.125227  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:29.125972  5599 raft_consensus.cc:3055] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:29.126340  5599 raft_consensus.cc:740] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2df71e80861d4ef18c58ce9ed40ed9ba, State: Running, Role: LEADER
I20260709 12:22:29.127519  5599 consensus_queue.cc:260] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:29.129432  5599 raft_consensus.cc:3060] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.130472  5527 raft_consensus.cc:2468] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
I20260709 12:22:29.131636  6130 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:29.132506  6359 raft_consensus.cc:2804] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:29.132965  6359 raft_consensus.cc:697] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:29.133823  6359 consensus_queue.cc:237] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:29.139022  5599 raft_consensus.cc:2468] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 2.
W20260709 12:22:29.199467  5494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:39599, user_credentials={real_user=slave}} blocked reactor thread for 54839.9us
I20260709 12:22:29.182492  5272 catalog_manager.cc:5697] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 1 to 2, leader changed from 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.418139  6405 raft_consensus.cc:993] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7: : Instructing follower 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:29.418885  6363 raft_consensus.cc:1081] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Signalling peer 1ad33b9e1a5644d0afb8822d3b3ac926 to start an election
I20260709 12:22:29.420812  6181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2"
dest_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926"
 from {username='slave'} at 127.0.0.1:38564
I20260709 12:22:29.421554  6181 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:29.421974  6181 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.429523  6181 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:29.430968  6181 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:29.432469  5451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7eb36fa55fb24fc6a0531b58835695d7"
I20260709 12:22:29.431993  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bebc67e8ff7b4d9484156a204358eef2" candidate_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:29.433077  5451 raft_consensus.cc:3055] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:29.433260  5599 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.433454  5451 raft_consensus.cc:740] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7eb36fa55fb24fc6a0531b58835695d7, State: Running, Role: LEADER
I20260709 12:22:29.434635  5451 consensus_queue.cc:260] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:29.436266  5451 raft_consensus.cc:3060] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.442210  5599 raft_consensus.cc:2468] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 3.
I20260709 12:22:29.443956  6130 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 
I20260709 12:22:29.444900  6359 raft_consensus.cc:2804] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:29.445829  5451 raft_consensus.cc:2468] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad33b9e1a5644d0afb8822d3b3ac926 in term 3.
I20260709 12:22:29.448647  6359 raft_consensus.cc:697] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 LEADER]: Becoming Leader. State: Replica: 1ad33b9e1a5644d0afb8822d3b3ac926, State: Running, Role: LEADER
I20260709 12:22:29.449759  6359 consensus_queue.cc:237] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:29.462594  5272 catalog_manager.cc:5697] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 reported cstate change: term changed from 2 to 3, leader changed from 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130) to 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129). New cstate: current_term: 3 leader_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.538285  5527 raft_consensus.cc:1275] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:29.539846  6359 consensus_queue.cc:1048] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:29.563207  5599 raft_consensus.cc:1275] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:29.564738  6391 consensus_queue.cc:1048] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:30.059762  5599 raft_consensus.cc:1275] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:30.061256  5451 raft_consensus.cc:1275] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Refusing update from remote peer 1ad33b9e1a5644d0afb8822d3b3ac926: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:30.061684  6361 consensus_queue.cc:1048] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:30.062927  6359 consensus_queue.cc:1048] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:30.080608 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.175474 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:30.176668 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:30.177297 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.213765 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.247570 27446 tablet_server.cc:179] TabletServer@127.26.205.129:39599 shutting down...
I20260709 12:22:30.281687 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:30.282755 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.283918 27446 raft_consensus.cc:2243] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.285219 27446 raft_consensus.cc:2272] T b79772c58ae14912b3ac47484ae94bbd P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.285892  5494 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 72 similar messages]
I20260709 12:22:30.288517 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.289930 27446 raft_consensus.cc:2243] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.290618 27446 raft_consensus.cc:2272] T aedcb0fbb15b4f14949afe776218f367 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.292227  5494 consensus_peers.cc:597] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.293745 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.294520 27446 raft_consensus.cc:2243] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.295370 27446 raft_consensus.cc:2272] T f267030285b54db4bfe6e2293754df95 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.297966 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.298661 27446 raft_consensus.cc:2243] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.299079 27446 raft_consensus.cc:2272] T 82fedcb24a7843748efb4e0db04fd967 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.301694 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.302496 27446 raft_consensus.cc:2243] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.302932 27446 raft_consensus.cc:2272] T 39c21b5980204d2a84e53916eab2d0a0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.306098 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.307112 27446 raft_consensus.cc:2243] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.307637 27446 raft_consensus.cc:2272] T f41986298fd9435e9b41fe9ad22ccdc1 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.310920 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.311688 27446 raft_consensus.cc:2243] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.312242 27446 raft_consensus.cc:2272] T 9fc00f3869334c9785c100fd236007c5 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.315586 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.316396 27446 raft_consensus.cc:2243] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.316905 27446 raft_consensus.cc:2272] T 3cc39fb0872d49eda4aaa7170e421978 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.318367  5419 consensus_peers.cc:597] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.319379 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.320113 27446 raft_consensus.cc:2243] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.320685 27446 raft_consensus.cc:2272] T 60dcd080cf4b413583707e93ec56d4b9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.324185 27446 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:30.324594  5419 consensus_peers.cc:597] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.325176 27446 raft_consensus.cc:2243] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.325969 27446 raft_consensus.cc:2272] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.329741 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.330722 27446 raft_consensus.cc:2243] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.332005 27446 raft_consensus.cc:2272] T 30b377cee535487cadb7a1c9c5cbbf02 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.334021  5568 consensus_peers.cc:597] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.334750  5494 consensus_peers.cc:597] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.335333 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.336273 27446 raft_consensus.cc:2243] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:30.336649  5568 consensus_peers.cc:597] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.336894 27446 raft_consensus.cc:2272] T afa51550cc1e48779233015cd4d9e0c9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.337283  5568 consensus_peers.cc:597] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.339968 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.340890 27446 raft_consensus.cc:2243] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.341437 27446 raft_consensus.cc:2272] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.344377 27446 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:30.345131  5419 consensus_peers.cc:597] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.345289 27446 raft_consensus.cc:2243] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.345876 27446 raft_consensus.cc:2272] T 0174a8220da546bba7e2ccf232f59244 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.348484 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.349238 27446 raft_consensus.cc:2243] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.350410 27446 raft_consensus.cc:2272] T 4058efce24824bdab7ff7d90f5c1c9ce P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.353570 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.354156 27446 raft_consensus.cc:2243] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.354542 27446 raft_consensus.cc:2272] T 324177360e04468a9795c4da53cdbd1c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.357131 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.357864 27446 raft_consensus.cc:2243] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.358397 27446 raft_consensus.cc:2272] T 7a31cf131ed6430ea825e8d57e6433cb P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.361239 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.361867 27446 raft_consensus.cc:2243] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.362385 27446 raft_consensus.cc:2272] T e3420ee8c43745c5af1bb3648726e7d0 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.364975 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.365660 27446 raft_consensus.cc:2243] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.366832 27446 raft_consensus.cc:2272] T d541fc6b63b5452aa4505d8f4275b875 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.368988  5568 consensus_peers.cc:597] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.370102 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.370878 27446 raft_consensus.cc:2243] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.371740 27446 raft_consensus.cc:2272] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.374084 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.374668 27446 raft_consensus.cc:2243] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.375077 27446 raft_consensus.cc:2272] T d5fd56f4297c4405b24eaad2e3f296fa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.377298 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.377962 27446 raft_consensus.cc:2243] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.378465 27446 raft_consensus.cc:2272] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.380731 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.381371 27446 raft_consensus.cc:2243] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.381927 27446 raft_consensus.cc:2272] T 8b64afdc610b42868a6cd77183a441d7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.384305 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.385143 27446 raft_consensus.cc:2243] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.386212 27446 raft_consensus.cc:2272] T 1af71d02653944509494d122128ee567 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.388837 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.389474 27446 raft_consensus.cc:2243] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.390249 27446 raft_consensus.cc:2272] T 0db9822ea4574d15bd17a42e91fb030e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.393049 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.393821 27446 raft_consensus.cc:2243] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.394342 27446 raft_consensus.cc:2272] T 9f3cc33a5e1c49a79a13e57852104de3 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.396683  5494 consensus_peers.cc:597] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.397392 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.398043 27446 raft_consensus.cc:2243] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.398517 27446 raft_consensus.cc:2272] T a3b77c24029e4efbbd5c2679556ef30e P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.401050 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.401973 27446 raft_consensus.cc:2243] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.402618 27446 raft_consensus.cc:2272] T bf71ad7e2ac54415ab73c6499883c3b4 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.405987 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.406828 27446 raft_consensus.cc:2243] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.407434 27446 raft_consensus.cc:2272] T 4d84f9d6d8dd4f7e96a52cf86006235c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.409327  5494 consensus_peers.cc:597] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.410902 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.411667 27446 raft_consensus.cc:2243] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.412735 27446 raft_consensus.cc:2272] T 4116669c74d4417d993b6fe905fab3c2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.415416 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.416179 27446 raft_consensus.cc:2243] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.416647 27446 raft_consensus.cc:2272] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.419523 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.420333 27446 raft_consensus.cc:2243] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.421388 27446 raft_consensus.cc:2272] T bebc67e8ff7b4d9484156a204358eef2 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.424782 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.425632 27446 raft_consensus.cc:2243] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.426199 27446 raft_consensus.cc:2272] T 18a56a6374454cf6b3c48e13d1daf5d9 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.428371  5568 consensus_peers.cc:597] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.428984 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.429628 27446 raft_consensus.cc:2243] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.430680 27446 raft_consensus.cc:2272] T f004b323a1d24685bf59c122a46fec9f P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.433755 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.434544 27446 raft_consensus.cc:2243] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.435654 27446 raft_consensus.cc:2272] T 793b2585318747d0b1c32b60839d07e7 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.436896  5494 consensus_peers.cc:597] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.437659  5494 consensus_peers.cc:597] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.438796 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.439416 27446 raft_consensus.cc:2243] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.440565 27446 raft_consensus.cc:2272] T 20bc52dfebc342d381e8f38949578038 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.443136 27446 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:30.443493  5568 consensus_peers.cc:597] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.443709 27446 raft_consensus.cc:2243] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.444240 27446 raft_consensus.cc:2272] T ff7ce82f087341228c390906bb0d6802 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.446462 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.447050 27446 raft_consensus.cc:2243] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.447623 27446 raft_consensus.cc:2272] T 521044053aaa4980a83c1d2f14d14524 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.450748 27446 tablet_replica.cc:333] stopping tablet replica
W20260709 12:22:30.451049  5494 consensus_peers.cc:597] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:30.451524 27446 raft_consensus.cc:2243] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.451987 27446 raft_consensus.cc:2272] T d75d2cbd8eac4a4aa3b08cecc781b081 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.454161 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.454648 27446 raft_consensus.cc:2243] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.455062 27446 raft_consensus.cc:2272] T 9d726792b00846af91fe7eaee674790a P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.457353 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.457840 27446 raft_consensus.cc:2243] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:30.458624 27446 raft_consensus.cc:2272] T d4e076c07c0947d5a199139898ffba03 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.460840 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.461298 27446 raft_consensus.cc:2243] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.461651 27446 raft_consensus.cc:2272] T c7de8fac5809466d88f4b46fcee34489 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.463752 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.464255 27446 raft_consensus.cc:2243] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.464702 27446 raft_consensus.cc:2272] T 12167beadba54b97bfef03d91a5725aa P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.466796 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.467450 27446 raft_consensus.cc:2243] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.467864 27446 raft_consensus.cc:2272] T a0c71518e1df4ec39ce7f29b4be4a21c P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:30.470398 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:30.470979 27446 raft_consensus.cc:2243] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:30.471400 27446 raft_consensus.cc:2272] T d3c9acfac3f7442eb0892615a08fe453 P 1ad33b9e1a5644d0afb8822d3b3ac926 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:30.490276  5494 consensus_peers.cc:597] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.499378  5568 consensus_peers.cc:597] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.502341  5494 consensus_peers.cc:597] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.512848  5419 consensus_peers.cc:597] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.753615  5568 consensus_peers.cc:597] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.754364  5568 consensus_peers.cc:597] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.754974  5568 consensus_peers.cc:597] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.885987  5568 connection.cc:573] client connection to 127.26.205.129:39599 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:22:30.973771 27446 tablet_server.cc:196] TabletServer@127.26.205.129:39599 shutdown complete.
W20260709 12:22:30.986352  5494 connection.cc:769] client connection to 127.26.205.129:39599 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:22:30.978446  5419 connection.cc:769] client connection to 127.26.205.129:39599 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:22:30.989812  5419 consensus_peers.cc:597] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:30.990252  5419 consensus_peers.cc:597] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.045922  5494 consensus_peers.cc:597] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.046617  5494 consensus_peers.cc:597] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.054452  5494 consensus_peers.cc:597] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.055050  5494 consensus_peers.cc:597] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.066241  5419 consensus_peers.cc:597] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.067081  5419 consensus_peers.cc:597] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.156528 27446 tablet_server.cc:179] TabletServer@127.26.205.130:0 shutting down...
W20260709 12:22:31.183440  5568 consensus_peers.cc:597] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.190943  5568 consensus_peers.cc:597] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.217186 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:31.218508 27446 tablet_replica.cc:333] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.219996 27446 raft_consensus.cc:2243] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.220772 27446 raft_consensus.cc:2272] T ff7ce82f087341228c390906bb0d6802 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.224195 27446 tablet_replica.cc:333] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.224922 27446 raft_consensus.cc:2243] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.225428 27446 raft_consensus.cc:2272] T b79772c58ae14912b3ac47484ae94bbd P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.227792 27446 tablet_replica.cc:333] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.228411 27446 raft_consensus.cc:2243] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.228914 27446 raft_consensus.cc:2272] T f004b323a1d24685bf59c122a46fec9f P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.230762 27446 tablet_replica.cc:333] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.231272 27446 raft_consensus.cc:2243] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.231712 27446 raft_consensus.cc:2272] T d541fc6b63b5452aa4505d8f4275b875 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.233888 27446 tablet_replica.cc:333] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.234527 27446 raft_consensus.cc:2243] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.235042 27446 raft_consensus.cc:2272] T 30b377cee535487cadb7a1c9c5cbbf02 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.237038 27446 tablet_replica.cc:333] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.237627 27446 raft_consensus.cc:2243] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.238592 27446 raft_consensus.cc:2272] T e5495488e26d44d3be7dd371d31e169a P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.240851 27446 tablet_replica.cc:333] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
W20260709 12:22:31.241708  5494 consensus_peers.cc:597] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.241808 27446 raft_consensus.cc:2243] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.243161 27446 raft_consensus.cc:2272] T 9f3cc33a5e1c49a79a13e57852104de3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.245890 27446 tablet_replica.cc:333] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.246876 27446 raft_consensus.cc:2243] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.247292 27446 raft_consensus.cc:2272] T 78a654b632744c53946820d8bb4c5fb8 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.249377 27446 tablet_replica.cc:333] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.249939 27446 raft_consensus.cc:2243] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.250352 27446 raft_consensus.cc:2272] T 44fd276ebc024672a5c9eafb8f805442 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.252365 27446 tablet_replica.cc:333] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.253041 27446 raft_consensus.cc:2243] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.253476 27446 raft_consensus.cc:2272] T 82fedcb24a7843748efb4e0db04fd967 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.256340 27446 tablet_replica.cc:333] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.257282 27446 raft_consensus.cc:2243] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.257931 27446 raft_consensus.cc:2272] T 3cc39fb0872d49eda4aaa7170e421978 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.260258 27446 tablet_replica.cc:333] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.260835 27446 raft_consensus.cc:2243] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.261422 27446 raft_consensus.cc:2272] T 12167beadba54b97bfef03d91a5725aa P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.263908 27446 tablet_replica.cc:333] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.264762 27446 raft_consensus.cc:2243] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.265902 27446 raft_consensus.cc:2272] T aedcb0fbb15b4f14949afe776218f367 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.268848 27446 tablet_replica.cc:333] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.269806 27446 raft_consensus.cc:2243] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.270357 27446 raft_consensus.cc:2272] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.273402 27446 tablet_replica.cc:333] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.274191 27446 raft_consensus.cc:2243] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.275305 27446 raft_consensus.cc:2272] T 4a7777356542417f8aa0e1ca2a9955ec P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.276727  5568 consensus_peers.cc:597] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.278254 27446 tablet_replica.cc:333] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.279173 27446 raft_consensus.cc:2243] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.280155 27446 raft_consensus.cc:2272] T a0c71518e1df4ec39ce7f29b4be4a21c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.282997 27446 tablet_replica.cc:333] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.284017 27446 raft_consensus.cc:2243] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.285148 27446 raft_consensus.cc:2272] T d3c9acfac3f7442eb0892615a08fe453 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.288081 27446 tablet_replica.cc:333] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.288856 27446 raft_consensus.cc:2243] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.289748 27446 raft_consensus.cc:2272] T f42967958ae64becbb47efba2703dc6a P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.291857 27446 tablet_replica.cc:333] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.292486 27446 raft_consensus.cc:2243] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.293004 27446 raft_consensus.cc:2272] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.295682 27446 tablet_replica.cc:333] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.296480 27446 raft_consensus.cc:2243] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.297492 27446 raft_consensus.cc:2272] T 8b64afdc610b42868a6cd77183a441d7 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.300119 27446 tablet_replica.cc:333] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.300849 27446 raft_consensus.cc:2243] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.301239 27446 raft_consensus.cc:2272] T afa51550cc1e48779233015cd4d9e0c9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.303447 27446 tablet_replica.cc:333] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.303961 27446 raft_consensus.cc:2243] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.304391 27446 raft_consensus.cc:2272] T bebc67e8ff7b4d9484156a204358eef2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.306264 27446 tablet_replica.cc:333] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.306886 27446 raft_consensus.cc:2243] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.307451 27446 raft_consensus.cc:2272] T 57f641edcab549deae1aa846ded8f15c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.310135 27446 tablet_replica.cc:333] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.310781 27446 raft_consensus.cc:2243] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.311278 27446 raft_consensus.cc:2272] T 7a31cf131ed6430ea825e8d57e6433cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.313494 27446 tablet_replica.cc:333] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.314034 27446 raft_consensus.cc:2243] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.314807 27446 raft_consensus.cc:2272] T 324177360e04468a9795c4da53cdbd1c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.316691 27446 tablet_replica.cc:333] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.317198 27446 raft_consensus.cc:2243] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.317628 27446 raft_consensus.cc:2272] T 4116669c74d4417d993b6fe905fab3c2 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.319667 27446 tablet_replica.cc:333] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.320250 27446 raft_consensus.cc:2243] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.320839 27446 raft_consensus.cc:2272] T 4d84f9d6d8dd4f7e96a52cf86006235c P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.323361 27446 tablet_replica.cc:333] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.324033 27446 raft_consensus.cc:2243] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.324888 27446 raft_consensus.cc:2272] T ca2596641aca47a4b72b31401defeac3 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.327191 27446 tablet_replica.cc:333] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.327890 27446 raft_consensus.cc:2243] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.328488 27446 raft_consensus.cc:2272] T 12444cef6727421b9d5186006a5dda8b P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.329312  5568 consensus_peers.cc:597] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.330957 27446 tablet_replica.cc:333] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.331741 27446 raft_consensus.cc:2243] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.332723 27446 raft_consensus.cc:2272] T 887ea6f2292649de80a0e337800fd7cb P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.333698  5494 consensus_peers.cc:597] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.334998 27446 tablet_replica.cc:333] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.335668 27446 raft_consensus.cc:2243] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.336189 27446 raft_consensus.cc:2272] T 69e86de2926d4f3eafdf9f57553e3211 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.338477 27446 tablet_replica.cc:333] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.339066 27446 raft_consensus.cc:2243] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.340095 27446 raft_consensus.cc:2272] T bf71ad7e2ac54415ab73c6499883c3b4 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.341817  5568 consensus_peers.cc:597] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.342788 27446 tablet_replica.cc:333] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.343408 27446 raft_consensus.cc:2243] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.343860 27446 raft_consensus.cc:2272] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.345949 27446 tablet_replica.cc:333] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.346525 27446 raft_consensus.cc:2243] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.346969 27446 raft_consensus.cc:2272] T 4058efce24824bdab7ff7d90f5c1c9ce P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.349041 27446 tablet_replica.cc:333] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.349625 27446 raft_consensus.cc:2243] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.350189 27446 raft_consensus.cc:2272] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.352963 27446 tablet_replica.cc:333] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.353571 27446 raft_consensus.cc:2243] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.354550 27446 raft_consensus.cc:2272] T 402cf513fa7f4e30917381ee64a96070 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.355540  5568 consensus_peers.cc:597] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.357048 27446 tablet_replica.cc:333] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.357616 27446 raft_consensus.cc:2243] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.358346 27446 raft_consensus.cc:2272] T 60dcd080cf4b413583707e93ec56d4b9 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.360226 27446 tablet_replica.cc:333] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.360764 27446 raft_consensus.cc:2243] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.361143 27446 raft_consensus.cc:2272] T d4e076c07c0947d5a199139898ffba03 P 7eb36fa55fb24fc6a0531b58835695d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.363534 27446 tablet_replica.cc:333] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.364338 27446 raft_consensus.cc:2243] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.364916 27446 raft_consensus.cc:2272] T 521044053aaa4980a83c1d2f14d14524 P 7eb36fa55fb24fc6a0531b58835695d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.367834 27446 tablet_replica.cc:333] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.368604 27446 raft_consensus.cc:2243] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.369736 27446 raft_consensus.cc:2272] T d75d2cbd8eac4a4aa3b08cecc781b081 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.372534 27446 tablet_replica.cc:333] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.373255 27446 raft_consensus.cc:2243] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:22:31.373519  5494 consensus_peers.cc:597] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.373785  5417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.374148 27446 raft_consensus.cc:2272] T c48cbeaeff384cbd8556c14de06a2c41 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.376365 27446 tablet_replica.cc:333] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.376986 27446 raft_consensus.cc:2243] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.377537 27446 raft_consensus.cc:2272] T f41986298fd9435e9b41fe9ad22ccdc1 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.380139 27446 tablet_replica.cc:333] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.380669 27446 raft_consensus.cc:2243] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.381101 27446 raft_consensus.cc:2272] T 79dc98f9fe994e9488ec27c89efce84d P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.383038 27446 tablet_replica.cc:333] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7: stopping tablet replica
I20260709 12:22:31.383512 27446 raft_consensus.cc:2243] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.383957 27446 raft_consensus.cc:2272] T 9fc00f3869334c9785c100fd236007c5 P 7eb36fa55fb24fc6a0531b58835695d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.396667  6464 raft_consensus.cc:493] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.397250  6464 raft_consensus.cc:515] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:31.399520  6464 leader_election.cc:290] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:31.403054  5494 leader_election.cc:336] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:31.403533  5494 leader_election.cc:336] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.403887  5494 leader_election.cc:304] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:31.404541  6464 raft_consensus.cc:2749] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.408560  6346 raft_consensus.cc:493] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
W20260709 12:22:31.409235  5494 consensus_peers.cc:597] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.409049  6346 raft_consensus.cc:515] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:31.411087  6346 leader_election.cc:290] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:31.415258  5568 consensus_peers.cc:597] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.415871  5494 leader_election.cc:336] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:31.416661  5494 leader_election.cc:336] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.417006  5494 leader_election.cc:304] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:31.417567  6346 raft_consensus.cc:2749] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.453311  6346 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.453737  6346 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.455588  6346 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.456353  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b2585318747d0b1c32b60839d07e7" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:31.460908  5494 leader_election.cc:336] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.461324  5494 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:31.462692  6464 raft_consensus.cc:2749] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.467697 27446 tablet_server.cc:196] TabletServer@127.26.205.130:0 shutdown complete.
W20260709 12:22:31.495272  5568 consensus_peers.cc:597] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.497715  6464 raft_consensus.cc:493] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.498334  6464 raft_consensus.cc:515] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.500788  6464 leader_election.cc:290] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.502571  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f267030285b54db4bfe6e2293754df95" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:31.506356  5494 leader_election.cc:336] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.506711  5494 leader_election.cc:304] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
I20260709 12:22:31.507373  6464 raft_consensus.cc:2749] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.510983  6466 raft_consensus.cc:493] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.512526  6466 raft_consensus.cc:515] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:31.514607  6466 leader_election.cc:290] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:31.519922  5568 leader_election.cc:336] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:31.520680  5568 leader_election.cc:336] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:31.521092  5568 leader_election.cc:304] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:31.521806  6466 raft_consensus.cc:2749] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:31.525625  5568 consensus_peers.cc:597] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.541290  6466 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.541927  6466 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.544008  6466 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.544994  5527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fddd18e8ee414562a16b88c1a12413fc" is_pre_election: true
W20260709 12:22:31.549746  5568 leader_election.cc:336] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.550045  5568 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:31.551995  6346 raft_consensus.cc:493] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.552585  6346 raft_consensus.cc:515] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } }
I20260709 12:22:31.554263  6466 raft_consensus.cc:2749] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.556726  6346 leader_election.cc:290] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:31.562512 27446 tablet_server.cc:179] TabletServer@127.26.205.131:0 shutting down...
W20260709 12:22:31.573045  5494 leader_election.cc:336] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:31.578992  5494 leader_election.cc:336] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:31.579389  6458 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
W20260709 12:22:31.580550  5567 consensus_peers.cc:597] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.580693  6458 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:31.580154  5494 leader_election.cc:304] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
W20260709 12:22:31.582278  5494 consensus_peers.cc:597] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.582726  5494 consensus_peers.cc:597] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.582906  6346 raft_consensus.cc:2749] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.583323  6458 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:31.588887  5568 consensus_peers.cc:597] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.592020  5568 leader_election.cc:336] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:31.592756  5568 leader_election.cc:336] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:31.593097  5568 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:31.595168  6458 raft_consensus.cc:2749] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.605675  6464 raft_consensus.cc:493] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.606312  6464 raft_consensus.cc:515] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.608661  6464 leader_election.cc:290] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.609308  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bc52dfebc342d381e8f38949578038" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
W20260709 12:22:31.613463  5494 leader_election.cc:336] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.613914  5494 leader_election.cc:304] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd18e8ee414562a16b88c1a12413fc; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 2df71e80861d4ef18c58ce9ed40ed9ba
W20260709 12:22:31.614337  5567 consensus_peers.cc:597] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.616223  6464 raft_consensus.cc:2749] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.617503 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:31.618443 27446 tablet_replica.cc:333] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.619326 27446 raft_consensus.cc:2243] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.620052 27446 raft_consensus.cc:2272] T b79772c58ae14912b3ac47484ae94bbd P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.622706 27446 tablet_replica.cc:333] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.623275 27446 raft_consensus.cc:2243] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.624042 27446 raft_consensus.cc:2272] T a3b77c24029e4efbbd5c2679556ef30e P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.625281  6464 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.625851  6464 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.626672 27446 tablet_replica.cc:333] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.627710 27446 raft_consensus.cc:2243] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.627974  6464 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.628302 27446 raft_consensus.cc:2272] T e5495488e26d44d3be7dd371d31e169a P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.629520  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" is_pre_election: true
I20260709 12:22:31.630249  5602 raft_consensus.cc:2468] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 2.
I20260709 12:22:31.631299 27446 tablet_replica.cc:333] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.631516  5493 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:31.632210 27446 raft_consensus.cc:2243] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:31.632232  5494 leader_election.cc:336] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.633052 27446 raft_consensus.cc:2272] T 30b377cee535487cadb7a1c9c5cbbf02 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.633167  6346 raft_consensus.cc:2804] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:31.634014  6346 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.634392  6346 raft_consensus.cc:3060] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:31.635995 27446 tablet_replica.cc:333] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.636953 27446 raft_consensus.cc:2243] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.637954 27446 raft_consensus.cc:2272] T c7de8fac5809466d88f4b46fcee34489 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.638202  6458 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.638618  6458 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.640513  6458 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.640820 27446 tablet_replica.cc:333] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.642197 27446 raft_consensus.cc:2243] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.643268 27446 raft_consensus.cc:2272] T 12167beadba54b97bfef03d91a5725aa P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.644328  5567 leader_election.cc:336] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:31.644930  6346 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.646209 27446 tablet_replica.cc:333] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
W20260709 12:22:31.646209  5494 consensus_peers.cc:597] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.647324 27446 raft_consensus.cc:2243] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.647413  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db9822ea4574d15bd17a42e91fb030e" candidate_uuid: "fddd18e8ee414562a16b88c1a12413fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba"
I20260709 12:22:31.647991  5602 raft_consensus.cc:3060] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:31.648411 27446 raft_consensus.cc:2272] T 44fd276ebc024672a5c9eafb8f805442 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.649125  5568 leader_election.cc:336] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.649559  5568 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:31.650168  6458 raft_consensus.cc:2749] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.651348 27446 tablet_replica.cc:333] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.652271 27446 raft_consensus.cc:2243] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.653277 27446 raft_consensus.cc:2272] T 82fedcb24a7843748efb4e0db04fd967 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.655570  5602 raft_consensus.cc:2468] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd18e8ee414562a16b88c1a12413fc in term 3.
I20260709 12:22:31.656286 27446 tablet_replica.cc:333] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.656706  5493 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba, fddd18e8ee414562a16b88c1a12413fc; no voters: 
I20260709 12:22:31.657200 27446 raft_consensus.cc:2243] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.657517  6464 raft_consensus.cc:2804] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:31.657861 27446 raft_consensus.cc:2272] T d5fd56f4297c4405b24eaad2e3f296fa P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.658010  6464 raft_consensus.cc:697] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 3 LEADER]: Becoming Leader. State: Replica: fddd18e8ee414562a16b88c1a12413fc, State: Running, Role: LEADER
I20260709 12:22:31.658941  6464 consensus_queue.cc:237] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.660790 27446 tablet_replica.cc:333] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.661651 27446 raft_consensus.cc:2243] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.662624 27446 raft_consensus.cc:2272] T 0174a8220da546bba7e2ccf232f59244 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.665457 27446 tablet_replica.cc:333] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.667596  6346 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 election: Requested vote from peers 2df71e80861d4ef18c58ce9ed40ed9ba (127.26.205.132:38145), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.668542 27446 raft_consensus.cc:2243] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:22:31.669554  5568 consensus_peers.cc:597] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.670585 27446 pending_rounds.cc:70] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc: Trying to abort 1 pending ops.
I20260709 12:22:31.670841 27446 pending_rounds.cc:77] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305624582804353024 op_type: NO_OP noop_request { }
I20260709 12:22:31.671149 27446 raft_consensus.cc:2889] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:31.671458 27446 raft_consensus.cc:2272] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.673405  5494 leader_election.cc:336] T 0db9822ea4574d15bd17a42e91fb030e P fddd18e8ee414562a16b88c1a12413fc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.674574 27446 tablet_replica.cc:333] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.675192 27446 raft_consensus.cc:2243] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.675622 27446 raft_consensus.cc:2272] T f42967958ae64becbb47efba2703dc6a P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.677588 27446 tablet_replica.cc:333] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.678141 27446 raft_consensus.cc:2243] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.678576 27446 raft_consensus.cc:2272] T 1af71d02653944509494d122128ee567 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.680480 27446 tablet_replica.cc:333] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.681077 27446 raft_consensus.cc:2243] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.681499 27446 raft_consensus.cc:2272] T 8b64afdc610b42868a6cd77183a441d7 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.683542 27446 tablet_replica.cc:333] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.684077 27446 raft_consensus.cc:2243] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.684569 27446 raft_consensus.cc:2272] T b6b59df10e4c4aa38e5dbd6cc3b2ed67 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.686508 27446 tablet_replica.cc:333] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.687078 27446 raft_consensus.cc:2243] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.687463 27446 raft_consensus.cc:2272] T 4a7777356542417f8aa0e1ca2a9955ec P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.689390 27446 tablet_replica.cc:333] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.689898 27446 raft_consensus.cc:2243] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.690258 27446 raft_consensus.cc:2272] T d3c9acfac3f7442eb0892615a08fe453 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.692073 27446 tablet_replica.cc:333] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.692641 27446 raft_consensus.cc:2243] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.693343 27446 raft_consensus.cc:2272] T e3420ee8c43745c5af1bb3648726e7d0 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.695640 27446 tablet_replica.cc:333] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.696223 27446 raft_consensus.cc:2243] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.696734 27446 raft_consensus.cc:2272] T 57f641edcab549deae1aa846ded8f15c P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.699272 27446 tablet_replica.cc:333] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.699935 27446 raft_consensus.cc:2243] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.700511 27446 raft_consensus.cc:2272] T 324177360e04468a9795c4da53cdbd1c P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.703228 27446 tablet_replica.cc:333] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.704080 27446 raft_consensus.cc:2243] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.704910 27446 raft_consensus.cc:2272] T 7a31cf131ed6430ea825e8d57e6433cb P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.707079 27446 tablet_replica.cc:333] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.707660 27446 raft_consensus.cc:2243] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.708606 27446 raft_consensus.cc:2272] T 9a0acea6bb584b6ca4cdb21390af1cf5 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.710500 27446 tablet_replica.cc:333] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.711028 27446 raft_consensus.cc:2243] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.711519 27446 raft_consensus.cc:2272] T f004b323a1d24685bf59c122a46fec9f P fddd18e8ee414562a16b88c1a12413fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.713897 27446 tablet_replica.cc:333] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.714627 27446 raft_consensus.cc:2243] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.715099 27446 raft_consensus.cc:2272] T 18a56a6374454cf6b3c48e13d1daf5d9 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.715613  5568 consensus_peers.cc:597] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.717300 27446 tablet_replica.cc:333] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.717891 27446 raft_consensus.cc:2243] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.718259 27446 raft_consensus.cc:2272] T ca2596641aca47a4b72b31401defeac3 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.720186 27446 tablet_replica.cc:333] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.720748  6466 raft_consensus.cc:493] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.720799 27446 raft_consensus.cc:2243] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.721545 27446 raft_consensus.cc:2272] T 12444cef6727421b9d5186006a5dda8b P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.721321  6466 raft_consensus.cc:515] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:31.723256  6466 leader_election.cc:290] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.724009 27446 tablet_replica.cc:333] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.724890 27446 raft_consensus.cc:2243] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.725405 27446 raft_consensus.cc:2272] T 887ea6f2292649de80a0e337800fd7cb P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.725994  6466 raft_consensus.cc:493] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
W20260709 12:22:31.726189  5567 leader_election.cc:336] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:31.726545  6466 raft_consensus.cc:515] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
W20260709 12:22:31.727859  5568 leader_election.cc:336] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.728268 27446 tablet_replica.cc:333] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.728580  6466 leader_election.cc:290] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:31.728384  5568 leader_election.cc:304] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:31.729234 27446 raft_consensus.cc:2243] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.729837 27446 raft_consensus.cc:2272] T 69e86de2926d4f3eafdf9f57553e3211 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.729389  6466 raft_consensus.cc:2749] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:31.731187  5567 leader_election.cc:336] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:22:31.732576 27446 tablet_replica.cc:333] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.733217 27446 raft_consensus.cc:2243] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:22:31.733517  5568 leader_election.cc:336] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.733950  5568 leader_election.cc:304] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:31.734069 27446 raft_consensus.cc:2272] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.734534  6466 raft_consensus.cc:2749] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.736641 27446 tablet_replica.cc:333] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.737465 27446 raft_consensus.cc:2243] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.737901 27446 raft_consensus.cc:2272] T 08fad4ce0c2a44c8b885dcbca5bfde87 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.739914 27446 tablet_replica.cc:333] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.740535 27446 raft_consensus.cc:2243] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.741027 27446 raft_consensus.cc:2272] T 60dcd080cf4b413583707e93ec56d4b9 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.743767 27446 tablet_replica.cc:333] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.744271 27446 raft_consensus.cc:2243] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.745266 27446 raft_consensus.cc:2272] T 39c21b5980204d2a84e53916eab2d0a0 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.746822  6466 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.747665 27446 tablet_replica.cc:333] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.747375  6466 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:31.748209  6420 raft_consensus.cc:493] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.748574 27446 raft_consensus.cc:2243] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.748831  6420 raft_consensus.cc:515] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:31.749142 27446 raft_consensus.cc:2272] T c48cbeaeff384cbd8556c14de06a2c41 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.749640  6466 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:31.750890  6420 leader_election.cc:290] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:31.751893 27446 tablet_replica.cc:333] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.752717 27446 raft_consensus.cc:2243] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.753605 27446 raft_consensus.cc:2272] T f41986298fd9435e9b41fe9ad22ccdc1 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.755682  5568 leader_election.cc:336] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:31.756155  5568 leader_election.cc:336] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:31.756460 27446 tablet_replica.cc:333] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.757247 27446 raft_consensus.cc:2243] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.757805 27446 raft_consensus.cc:2272] T 79dc98f9fe994e9488ec27c89efce84d P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.758075  5568 leader_election.cc:336] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.758468  5568 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:31.759172  6420 raft_consensus.cc:2749] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:31.759258  5568 leader_election.cc:336] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.759738  5568 leader_election.cc:304] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:31.760489 27446 tablet_replica.cc:333] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.760383  6420 raft_consensus.cc:2749] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.761395 27446 raft_consensus.cc:2243] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.761932 27446 raft_consensus.cc:2272] T 78a654b632744c53946820d8bb4c5fb8 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.763813 27446 tablet_replica.cc:333] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.764358 27446 raft_consensus.cc:2243] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.764837 27446 raft_consensus.cc:2272] T f267030285b54db4bfe6e2293754df95 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.766724 27446 tablet_replica.cc:333] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.767261 27446 raft_consensus.cc:2243] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.767673 27446 raft_consensus.cc:2272] T 402cf513fa7f4e30917381ee64a96070 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.768887  6420 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.769367  6420 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:31.769891 27446 tablet_replica.cc:333] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.770494 27446 raft_consensus.cc:2243] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.771267  6420 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:31.771365 27446 raft_consensus.cc:2272] T 521044053aaa4980a83c1d2f14d14524 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.774374 27446 tablet_replica.cc:333] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.775101 27446 raft_consensus.cc:2243] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:31.775202  5568 leader_election.cc:336] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.775688 27446 raft_consensus.cc:2272] T d75d2cbd8eac4a4aa3b08cecc781b081 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.776554  5568 leader_election.cc:336] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:31.776978  5568 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:31.777673  6458 raft_consensus.cc:2749] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.778252 27446 tablet_replica.cc:333] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.779070 27446 raft_consensus.cc:2243] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.780030 27446 raft_consensus.cc:2272] T 9d726792b00846af91fe7eaee674790a P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:31.782635 27446 tablet_replica.cc:333] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
W20260709 12:22:31.782707  5567 consensus_peers.cc:597] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.783236 27446 raft_consensus.cc:2243] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:31.783783  5550 debug-util.cc:398] Leaking SignalData structure 0x7b08002732a0 after lost signal to thread 27449
I20260709 12:22:31.783772 27446 raft_consensus.cc:2272] T 793b2585318747d0b1c32b60839d07e7 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.784873  5550 debug-util.cc:398] Leaking SignalData structure 0x7b080026ff80 after lost signal to thread 5310
I20260709 12:22:31.786595 27446 tablet_replica.cc:333] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
W20260709 12:22:31.786847  5550 debug-util.cc:398] Leaking SignalData structure 0x7b080003c8e0 after lost signal to thread 5553
I20260709 12:22:31.787292 27446 raft_consensus.cc:2243] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:31.787782 27446 raft_consensus.cc:2272] T 20bc52dfebc342d381e8f38949578038 P fddd18e8ee414562a16b88c1a12413fc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.787923  5550 debug-util.cc:398] Leaking SignalData structure 0x7b080013f220 after lost signal to thread 5628
I20260709 12:22:31.789919 27446 tablet_replica.cc:333] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc: stopping tablet replica
I20260709 12:22:31.790454 27446 raft_consensus.cc:2243] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:31.791237 27446 raft_consensus.cc:2272] T 9fc00f3869334c9785c100fd236007c5 P fddd18e8ee414562a16b88c1a12413fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:31.814556  5567 consensus_peers.cc:597] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.860036  6458 raft_consensus.cc:493] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:31.860649  6458 raft_consensus.cc:515] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
W20260709 12:22:31.863341  5567 consensus_peers.cc:597] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:31.863659  6458 leader_election.cc:290] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:31.865937  5567 leader_election.cc:336] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:31.867497  5568 leader_election.cc:336] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:31.867945  5568 leader_election.cc:304] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:31.868782  6420 raft_consensus.cc:2749] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:31.916540  5567 consensus_peers.cc:597] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.950443  5567 consensus_peers.cc:597] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:31.965749  5567 consensus_peers.cc:597] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:32.407900  6458 raft_consensus.cc:493] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.408541  6458 raft_consensus.cc:515] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:32.409427  6420 raft_consensus.cc:493] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.409979  6466 raft_consensus.cc:493] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.410211  6420 raft_consensus.cc:515] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:32.410578  6466 raft_consensus.cc:515] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:32.410921  6458 leader_election.cc:290] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:32.411533  6458 raft_consensus.cc:493] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.412015  6458 raft_consensus.cc:515] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:32.412688  6420 leader_election.cc:290] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:32.412859  6466 leader_election.cc:290] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
I20260709 12:22:32.417915  6458 leader_election.cc:290] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:32.422227  5567 leader_election.cc:336] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:32.423084  5567 leader_election.cc:336] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:32.423928  5568 leader_election.cc:336] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:32.424366  5568 leader_election.cc:304] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.425163  6458 raft_consensus.cc:2749] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:32.425359  5568 leader_election.cc:336] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:32.425873  5568 leader_election.cc:304] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
W20260709 12:22:32.425910  5567 leader_election.cc:336] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:32.426584  6458 raft_consensus.cc:2749] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:32.426789  5568 leader_election.cc:336] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:32.427300  5568 leader_election.cc:304] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.427949  6458 raft_consensus.cc:2749] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:32.430284  5568 leader_election.cc:336] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:32.430985  5568 leader_election.cc:336] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:32.431310  5568 leader_election.cc:304] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:32.432058  6458 raft_consensus.cc:2749] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:32.498106  6420 raft_consensus.cc:493] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.498678  6420 raft_consensus.cc:515] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:32.500741  6420 leader_election.cc:290] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:32.505898  5568 leader_election.cc:336] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:32.506433  5567 leader_election.cc:336] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:32.506832  5567 leader_election.cc:304] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.507400  6420 raft_consensus.cc:2749] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.663259  6475 raft_consensus.cc:493] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:32.663724  6475 raft_consensus.cc:515] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:32.665509  6475 leader_election.cc:290] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:32.669466  5567 leader_election.cc:336] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:32.669947  5568 leader_election.cc:336] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:32.670316  5568 leader_election.cc:304] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.670926  6475 raft_consensus.cc:2749] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:32.699383  6475 raft_consensus.cc:493] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:32.699963  6475 raft_consensus.cc:515] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:32.702246  6475 leader_election.cc:290] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:32.705719  5568 leader_election.cc:336] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:32.706552  5567 leader_election.cc:336] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:32.706899  5567 leader_election.cc:304] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.707451  6475 raft_consensus.cc:2749] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.714923  6420 raft_consensus.cc:493] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.715319  6420 raft_consensus.cc:515] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:32.717077  6420 leader_election.cc:290] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:32.720484  5568 leader_election.cc:336] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:32.721350  5567 leader_election.cc:336] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:32.721726  5567 leader_election.cc:304] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.722381  6420 raft_consensus.cc:2749] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:32.722916  6475 raft_consensus.cc:493] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.723395  6475 raft_consensus.cc:515] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:32.725333  6475 leader_election.cc:290] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:32.729074  5568 leader_election.cc:336] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:32.730329  5567 leader_election.cc:336] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:32.730720  5567 leader_election.cc:304] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.731305  6475 raft_consensus.cc:2749] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:32.732766  5568 consensus_peers.cc:597] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:32.743211  6475 raft_consensus.cc:493] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.743662  6475 raft_consensus.cc:515] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:32.745378  6475 leader_election.cc:290] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:32.746855  6475 raft_consensus.cc:493] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.748207  6475 raft_consensus.cc:515] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
W20260709 12:22:32.750028  5568 leader_election.cc:336] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:32.750303  6475 leader_election.cc:290] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:32.750635  5568 leader_election.cc:336] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:32.751071  5568 leader_election.cc:304] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:32.751778  6475 raft_consensus.cc:2749] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:32.754298  5567 leader_election.cc:336] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:32.755636  5568 leader_election.cc:336] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:32.755971  5568 leader_election.cc:304] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.756515  6475 raft_consensus.cc:2749] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:32.781930  6475 raft_consensus.cc:493] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:32.782368  6475 raft_consensus.cc:515] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:32.784215  6475 leader_election.cc:290] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:32.786590  6475 raft_consensus.cc:493] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:32.787045  6475 raft_consensus.cc:515] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
W20260709 12:22:32.788645  5568 leader_election.cc:336] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:32.789541  5568 leader_election.cc:336] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:32.789933  6475 leader_election.cc:290] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:32.789997  5568 leader_election.cc:304] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:32.791054  6475 raft_consensus.cc:2749] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:32.792886  5567 leader_election.cc:336] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:32.794826  5568 leader_election.cc:336] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:32.795250  5568 leader_election.cc:304] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.795949  6475 raft_consensus.cc:2749] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:32.859258 27446 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5550)
W20260709 12:22:32.884295  5568 consensus_peers.cc:597] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:32.927729  6420 raft_consensus.cc:493] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:32.928479  6420 raft_consensus.cc:515] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:32.930820  6420 leader_election.cc:290] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:32.933053  5568 consensus_peers.cc:597] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:32.934937  5567 leader_election.cc:336] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:32.936427  5568 leader_election.cc:336] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:32.936898  5568 leader_election.cc:304] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.937500  6420 raft_consensus.cc:2749] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:32.952785  5568 consensus_peers.cc:597] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:32.953290  5568 consensus_peers.cc:597] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:32.960414  6475 raft_consensus.cc:493] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:32.961100  6475 raft_consensus.cc:515] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:32.964282  6475 leader_election.cc:290] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:32.966741  5568 leader_election.cc:336] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:32.967931  5567 leader_election.cc:336] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:32.968268  5567 leader_election.cc:304] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:32.968897  6475 raft_consensus.cc:2749] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:32.998235  6475 raft_consensus.cc:493] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:32.998832  6475 raft_consensus.cc:515] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:33.001194  6475 leader_election.cc:290] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:33.004849  5568 leader_election.cc:336] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:33.005359  5567 leader_election.cc:336] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:33.005760  5567 leader_election.cc:304] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.006328  6475 raft_consensus.cc:2749] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:33.042572  5568 consensus_peers.cc:597] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:33.044548  5568 consensus_peers.cc:597] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:33.058697  6475 raft_consensus.cc:493] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:33.059263  6475 raft_consensus.cc:515] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:33.061043  6475 leader_election.cc:290] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:33.065153  5567 leader_election.cc:336] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:33.065677  5568 leader_election.cc:336] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:33.066062  5568 leader_election.cc:304] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.066828  6475 raft_consensus.cc:2749] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:33.081036  5568 consensus_peers.cc:597] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:33.089251  6420 raft_consensus.cc:493] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:33.089793  6420 raft_consensus.cc:515] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
W20260709 12:22:33.091467  5568 consensus_peers.cc:597] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:33.091962  6420 leader_election.cc:290] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:33.096915  5568 leader_election.cc:336] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:33.099380  5567 leader_election.cc:336] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:33.099749  5567 leader_election.cc:304] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.100368  6476 raft_consensus.cc:2749] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:33.103461  6476 raft_consensus.cc:493] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:33.103968  6476 raft_consensus.cc:515] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:33.106287  6476 leader_election.cc:290] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:33.110715  5567 leader_election.cc:336] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:33.112185  5568 leader_election.cc:336] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:33.112565  5568 leader_election.cc:304] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.114320  6476 raft_consensus.cc:2749] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:33.262488  5568 consensus_peers.cc:597] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:33.312877  6476 raft_consensus.cc:493] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.313403  6476 raft_consensus.cc:515] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:33.315101  6476 leader_election.cc:290] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:33.318871  5568 leader_election.cc:336] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:33.319566  5568 leader_election.cc:336] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:33.319947  5568 leader_election.cc:304] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:33.320683  6476 raft_consensus.cc:2749] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:33.356856  6476 raft_consensus.cc:493] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.357321  6476 raft_consensus.cc:515] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:33.359159  6476 leader_election.cc:290] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:33.362039  6476 raft_consensus.cc:493] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.362530  6476 raft_consensus.cc:515] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:33.364529  6476 leader_election.cc:290] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:33.365386  5567 leader_election.cc:336] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:33.365866  5568 leader_election.cc:336] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:33.366315  5568 leader_election.cc:304] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.367079  6476 raft_consensus.cc:2749] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:33.370828  5568 leader_election.cc:336] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:33.371788  5568 leader_election.cc:336] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:33.372164  5568 leader_election.cc:304] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:33.372862  6475 raft_consensus.cc:2749] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:33.413918  6475 raft_consensus.cc:493] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.414521  6475 raft_consensus.cc:515] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:33.416843  6475 leader_election.cc:290] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:33.421089  5568 leader_election.cc:336] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:33.421726  5568 leader_election.cc:336] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:33.422030  5568 leader_election.cc:304] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:33.422626  6475 raft_consensus.cc:2749] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.520720  6475 raft_consensus.cc:493] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.521214  6475 raft_consensus.cc:515] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:33.523123  6475 leader_election.cc:290] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:33.527652  5568 leader_election.cc:336] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:33.528203  5567 leader_election.cc:336] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:33.528647  5567 leader_election.cc:304] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.529381  6475 raft_consensus.cc:2749] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:33.614789  5568 consensus_peers.cc:597] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:33.647351  6476 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.647923  6476 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:33.650283  6476 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:33.656015  6475 raft_consensus.cc:493] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.656527  6475 raft_consensus.cc:515] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
W20260709 12:22:33.657334  5567 leader_election.cc:336] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:33.658483  6475 leader_election.cc:290] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:33.662701  5567 leader_election.cc:336] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:33.663400  5568 leader_election.cc:336] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:33.663829  5568 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.664651  6475 raft_consensus.cc:2749] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:33.665069  5568 consensus_peers.cc:597] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:33.667308  5568 leader_election.cc:336] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:33.667740  5568 leader_election.cc:304] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.668473  6475 raft_consensus.cc:2749] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:33.688700  6475 raft_consensus.cc:493] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.689143  6475 raft_consensus.cc:515] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:33.690795  6475 leader_election.cc:290] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:33.694451  5567 leader_election.cc:336] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:33.694921  5568 leader_election.cc:336] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:33.695268  5568 leader_election.cc:304] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:33.695852  6475 raft_consensus.cc:2749] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:33.697651  6475 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.698036  6475 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:33.699595  6475 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:33.703604  5568 leader_election.cc:336] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:33.705582  5568 leader_election.cc:336] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:33.705912  5568 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:33.706490  6475 raft_consensus.cc:2749] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.777938  6475 raft_consensus.cc:493] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:33.778420  6475 raft_consensus.cc:515] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:33.780050  6475 leader_election.cc:290] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:33.783630  5568 leader_election.cc:336] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:33.784338  5568 leader_election.cc:336] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:33.784759  5568 leader_election.cc:304] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:33.785524  6475 raft_consensus.cc:2749] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:33.817889  5568 consensus_peers.cc:597] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:33.859802 27446 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5550)
W20260709 12:22:33.878965  5568 consensus_peers.cc:597] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:33.890144  5568 consensus_peers.cc:597] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:33.921578  5568 consensus_peers.cc:597] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:33.935990  5568 consensus_peers.cc:597] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:33.987918  5568 consensus_peers.cc:597] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:34.020355  5568 consensus_peers.cc:597] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:34.027534  6475 raft_consensus.cc:493] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.028082  6475 raft_consensus.cc:515] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:34.030560  6475 leader_election.cc:290] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:34.034179  5568 leader_election.cc:336] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:34.034616  5567 leader_election.cc:336] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:34.035002  5567 leader_election.cc:304] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.035558  6475 raft_consensus.cc:2749] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:34.035774  5567 consensus_peers.cc:597] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:34.073994  5568 consensus_peers.cc:597] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:34.078006  5567 consensus_peers.cc:597] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:34.088148  6475 raft_consensus.cc:493] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.088881  6475 raft_consensus.cc:515] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:34.092267  6475 leader_election.cc:290] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:34.094805  5568 leader_election.cc:336] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:34.096029  5567 leader_election.cc:336] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:34.096390  5567 leader_election.cc:304] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.096999  6475 raft_consensus.cc:2749] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:34.168040  5567 consensus_peers.cc:597] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:34.178398  5567 consensus_peers.cc:597] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:34.303450  6476 raft_consensus.cc:493] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.304072  6476 raft_consensus.cc:515] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:34.306375  6476 leader_election.cc:290] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:34.309742  5568 leader_election.cc:336] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:34.311342  5568 leader_election.cc:336] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:34.311722  5568 leader_election.cc:304] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:34.312328  6476 raft_consensus.cc:2749] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:34.328812  5568 consensus_peers.cc:597] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:34.335624  5567 consensus_peers.cc:597] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:34.377722  6476 raft_consensus.cc:493] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.378433  6476 raft_consensus.cc:515] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:34.380839  6476 leader_election.cc:290] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:34.384477  5568 leader_election.cc:336] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:34.384965  5567 leader_election.cc:336] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:34.385370  5567 leader_election.cc:304] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.386009  6475 raft_consensus.cc:2749] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:34.389689  6475 raft_consensus.cc:493] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.390215  6475 raft_consensus.cc:515] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:34.392496  6475 leader_election.cc:290] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:34.396579  5568 leader_election.cc:336] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:34.397514  5568 leader_election.cc:336] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:34.397877  5568 leader_election.cc:304] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
W20260709 12:22:34.398453  5567 consensus_peers.cc:597] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:34.398473  6476 raft_consensus.cc:2749] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:34.421619  5568 consensus_peers.cc:597] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Couldn't send request to peer 7eb36fa55fb24fc6a0531b58835695d7. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:34.431535  6476 raft_consensus.cc:493] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.432164  6476 raft_consensus.cc:515] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:34.433899  6476 leader_election.cc:290] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:34.437716  5568 leader_election.cc:336] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:34.438431  5568 leader_election.cc:336] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:34.438814  5568 leader_election.cc:304] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:34.439571  6476 raft_consensus.cc:2749] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.442556  6476 raft_consensus.cc:493] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.443037  6476 raft_consensus.cc:515] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:34.447762  6476 leader_election.cc:290] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:34.450471  5568 leader_election.cc:336] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:34.451090  5567 leader_election.cc:336] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:34.451503  5567 leader_election.cc:304] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.452198  6476 raft_consensus.cc:2749] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:34.453445  6476 raft_consensus.cc:493] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:34.453897  6476 raft_consensus.cc:515] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:34.455650  6476 leader_election.cc:290] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:34.456720  6476 raft_consensus.cc:493] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.457237  6476 raft_consensus.cc:515] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
W20260709 12:22:34.459136  5567 leader_election.cc:336] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:34.459483  6476 leader_election.cc:290] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:34.460860  5568 leader_election.cc:336] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:34.461337  5568 leader_election.cc:304] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.462211  6476 raft_consensus.cc:2749] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:34.463519  5567 leader_election.cc:336] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:34.464563  5568 leader_election.cc:336] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:34.464888  5568 leader_election.cc:304] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.465430  6476 raft_consensus.cc:2749] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.583726  6475 raft_consensus.cc:493] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.584216  6475 raft_consensus.cc:515] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:34.586120  6475 leader_election.cc:290] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:34.589746  5568 leader_election.cc:336] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:34.590240  5567 leader_election.cc:336] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:34.590622  5567 leader_election.cc:304] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.591192  6475 raft_consensus.cc:2749] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:34.699404  5567 consensus_peers.cc:597] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:34.726214  6475 raft_consensus.cc:493] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:34.726694  6475 raft_consensus.cc:515] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:34.728566  6475 leader_election.cc:290] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:34.731952  5567 leader_election.cc:336] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:34.733621  5568 leader_election.cc:336] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:34.734119  5568 leader_election.cc:304] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.734956  6475 raft_consensus.cc:2749] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:34.759363  5567 consensus_peers.cc:597] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Couldn't send request to peer fddd18e8ee414562a16b88c1a12413fc. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:22:34.813215  6476 raft_consensus.cc:493] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:34.813676  6476 raft_consensus.cc:515] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:34.815460  6476 leader_election.cc:290] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:34.819860  5567 leader_election.cc:336] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:34.820361  5568 leader_election.cc:336] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:34.821528  5568 leader_election.cc:304] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.822114  6476 raft_consensus.cc:2749] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:34.846223  6476 raft_consensus.cc:493] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:34.846665  6476 raft_consensus.cc:515] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:34.848316  6476 leader_election.cc:290] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:34.853142  5567 leader_election.cc:336] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:34.853600  5568 leader_election.cc:336] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:34.854048  5568 leader_election.cc:304] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.854758  6476 raft_consensus.cc:2749] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:34.860337 27446 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5550)
I20260709 12:22:34.894119  6476 raft_consensus.cc:493] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7eb36fa55fb24fc6a0531b58835695d7)
I20260709 12:22:34.894688  6476 raft_consensus.cc:515] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:34.896380  6476 leader_election.cc:290] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:34.900149  5568 leader_election.cc:336] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:34.900655  5567 leader_election.cc:336] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:34.901116  5567 leader_election.cc:304] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.901991  6475 raft_consensus.cc:2749] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:34.914956  6475 raft_consensus.cc:493] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:34.915436  6475 raft_consensus.cc:515] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:34.917271  6475 leader_election.cc:290] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:34.920905  5568 leader_election.cc:336] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:34.921574  5568 leader_election.cc:336] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:34.921972  5568 leader_election.cc:304] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:34.922703  6475 raft_consensus.cc:2749] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.968098  6476 raft_consensus.cc:493] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:34.968760  6476 raft_consensus.cc:515] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:34.972775  6476 leader_election.cc:290] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:34.977373  5568 leader_election.cc:336] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:34.979270  5567 leader_election.cc:336] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:34.979640  5567 leader_election.cc:304] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:34.980604  6475 raft_consensus.cc:2749] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:34.996743  6476 raft_consensus.cc:493] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:34.997342  6476 raft_consensus.cc:515] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:34.999661  6476 leader_election.cc:290] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:35.003005  5567 leader_election.cc:336] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:35.003461  5568 leader_election.cc:336] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:35.003885  5568 leader_election.cc:304] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:35.004503  6476 raft_consensus.cc:2749] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:35.078368  6476 raft_consensus.cc:493] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:35.078840  6476 raft_consensus.cc:515] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } } peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } }
I20260709 12:22:35.080607  6476 leader_election.cc:290] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515), fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985)
W20260709 12:22:35.084060  5568 leader_election.cc:336] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
W20260709 12:22:35.085142  5567 leader_election.cc:336] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
I20260709 12:22:35.085593  5567 leader_election.cc:304] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 7eb36fa55fb24fc6a0531b58835695d7, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:35.086349  6476 raft_consensus.cc:2749] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:35.110400  6476 raft_consensus.cc:493] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:35.110893  6476 raft_consensus.cc:515] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:35.111291  6475 raft_consensus.cc:493] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fddd18e8ee414562a16b88c1a12413fc)
I20260709 12:22:35.111853  6475 raft_consensus.cc:515] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:35.113158  6476 leader_election.cc:290] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
I20260709 12:22:35.113911  6475 leader_election.cc:290] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:35.117069  5567 leader_election.cc:336] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:35.117597  5567 leader_election.cc:336] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:35.118213  5568 leader_election.cc:336] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:35.118665  5568 leader_election.cc:304] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:35.119367  6476 raft_consensus.cc:2749] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:35.119477  5568 leader_election.cc:336] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:35.119982  5568 leader_election.cc:304] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:35.120607  6476 raft_consensus.cc:2749] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:35.172418  6476 raft_consensus.cc:493] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:35.172940  6476 raft_consensus.cc:515] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fddd18e8ee414562a16b88c1a12413fc" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41985 } } peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } }
I20260709 12:22:35.174728  6476 leader_election.cc:290] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985), 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599)
W20260709 12:22:35.177763  5567 leader_election.cc:336] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fddd18e8ee414562a16b88c1a12413fc (127.26.205.131:41985): Network error: Client connection negotiation failed: client connection to 127.26.205.131:41985: connect: Connection refused (error 111)
W20260709 12:22:35.178817  5568 leader_election.cc:336] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
I20260709 12:22:35.179147  5568 leader_election.cc:304] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, fddd18e8ee414562a16b88c1a12413fc
I20260709 12:22:35.179701  6476 raft_consensus.cc:2749] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:35.243252  5568 consensus_peers.cc:597] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:35.287745  5568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111) [suppressed 447 similar messages]
W20260709 12:22:35.351548  5568 consensus_peers.cc:597] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:35.377779  5568 consensus_peers.cc:597] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:35.383134  5568 consensus_peers.cc:597] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:35.429570  5568 consensus_peers.cc:597] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:35.455189  5568 consensus_peers.cc:597] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:35.562070  6476 raft_consensus.cc:493] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:35.562819  6476 raft_consensus.cc:515] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
W20260709 12:22:35.563439  5568 consensus_peers.cc:597] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:35.565265  6476 leader_election.cc:290] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
W20260709 12:22:35.570147  5568 leader_election.cc:336] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:35.570936  5568 leader_election.cc:336] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:35.571332  5568 leader_election.cc:304] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:35.571988  6476 raft_consensus.cc:2749] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:35.592350  6476 raft_consensus.cc:493] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1ad33b9e1a5644d0afb8822d3b3ac926)
I20260709 12:22:35.592885  6476 raft_consensus.cc:515] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df71e80861d4ef18c58ce9ed40ed9ba" member_type: VOTER last_known_addr { host: "127.26.205.132" port: 38145 } } peers { permanent_uuid: "1ad33b9e1a5644d0afb8822d3b3ac926" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39599 } } peers { permanent_uuid: "7eb36fa55fb24fc6a0531b58835695d7" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34515 } }
I20260709 12:22:35.594904  6476 leader_election.cc:290] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599), 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515)
I20260709 12:22:35.597361 27446 tablet_server.cc:196] TabletServer@127.26.205.131:0 shutdown complete.
W20260709 12:22:35.598481  5568 leader_election.cc:336] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111)
W20260709 12:22:35.599282  5568 leader_election.cc:336] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7eb36fa55fb24fc6a0531b58835695d7 (127.26.205.130:34515): Network error: Client connection negotiation failed: client connection to 127.26.205.130:34515: connect: Connection refused (error 111)
I20260709 12:22:35.599664  5568 leader_election.cc:304] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2df71e80861d4ef18c58ce9ed40ed9ba; no voters: 1ad33b9e1a5644d0afb8822d3b3ac926, 7eb36fa55fb24fc6a0531b58835695d7
I20260709 12:22:35.600394  6476 raft_consensus.cc:2749] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:35.607261  5568 consensus_peers.cc:597] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba -> Peer 1ad33b9e1a5644d0afb8822d3b3ac926 (127.26.205.129:39599): Couldn't send request to peer 1ad33b9e1a5644d0afb8822d3b3ac926. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:39599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:35.668771 27446 tablet_server.cc:179] TabletServer@127.26.205.132:0 shutting down...
I20260709 12:22:35.708109 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:35.709062 27446 tablet_replica.cc:333] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.710104 27446 raft_consensus.cc:2243] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.710903 27446 raft_consensus.cc:2272] T ff7ce82f087341228c390906bb0d6802 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.713122 27446 tablet_replica.cc:333] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.713661 27446 raft_consensus.cc:2243] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.714041 27446 raft_consensus.cc:2272] T c7de8fac5809466d88f4b46fcee34489 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.715858 27446 tablet_replica.cc:333] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.716398 27446 raft_consensus.cc:2243] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.716794 27446 raft_consensus.cc:2272] T a3b77c24029e4efbbd5c2679556ef30e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.718596 27446 tablet_replica.cc:333] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.719135 27446 raft_consensus.cc:2243] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.719583 27446 raft_consensus.cc:2272] T e5495488e26d44d3be7dd371d31e169a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.721459 27446 tablet_replica.cc:333] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.722013 27446 raft_consensus.cc:2243] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.722447 27446 raft_consensus.cc:2272] T 9f3cc33a5e1c49a79a13e57852104de3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.725054 27446 tablet_replica.cc:333] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.725690 27446 raft_consensus.cc:2243] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.726601 27446 raft_consensus.cc:2272] T a0c71518e1df4ec39ce7f29b4be4a21c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.728807 27446 tablet_replica.cc:333] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.729321 27446 raft_consensus.cc:2243] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.730011 27446 raft_consensus.cc:2272] T d5fd56f4297c4405b24eaad2e3f296fa P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.731786 27446 tablet_replica.cc:333] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.732278 27446 raft_consensus.cc:2243] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.733049 27446 raft_consensus.cc:2272] T 57f641edcab549deae1aa846ded8f15c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.735059 27446 tablet_replica.cc:333] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.735603 27446 raft_consensus.cc:2243] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.736410 27446 raft_consensus.cc:2272] T 3cc39fb0872d49eda4aaa7170e421978 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.738379 27446 tablet_replica.cc:333] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.738919 27446 raft_consensus.cc:2243] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.739317 27446 raft_consensus.cc:2272] T 44fd276ebc024672a5c9eafb8f805442 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.741225 27446 tablet_replica.cc:333] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.741746 27446 raft_consensus.cc:2243] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.742141 27446 raft_consensus.cc:2272] T aedcb0fbb15b4f14949afe776218f367 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.744011 27446 tablet_replica.cc:333] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.744596 27446 raft_consensus.cc:2243] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.745010 27446 raft_consensus.cc:2272] T 4a7777356542417f8aa0e1ca2a9955ec P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.746764 27446 tablet_replica.cc:333] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.747344 27446 raft_consensus.cc:2243] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.748111 27446 raft_consensus.cc:2272] T afa51550cc1e48779233015cd4d9e0c9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.749980 27446 tablet_replica.cc:333] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.750504 27446 raft_consensus.cc:2243] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.751040 27446 raft_consensus.cc:2272] T bebc67e8ff7b4d9484156a204358eef2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.753304 27446 tablet_replica.cc:333] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.754055 27446 raft_consensus.cc:2243] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.754607 27446 raft_consensus.cc:2272] T d541fc6b63b5452aa4505d8f4275b875 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.756621 27446 tablet_replica.cc:333] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.757094 27446 raft_consensus.cc:2243] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.757512 27446 raft_consensus.cc:2272] T e3420ee8c43745c5af1bb3648726e7d0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.759274 27446 tablet_replica.cc:333] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.759796 27446 raft_consensus.cc:2243] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.760207 27446 raft_consensus.cc:2272] T ca2596641aca47a4b72b31401defeac3 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.762126 27446 tablet_replica.cc:333] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.762641 27446 raft_consensus.cc:2243] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.763386 27446 raft_consensus.cc:2272] T 12444cef6727421b9d5186006a5dda8b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.765254 27446 tablet_replica.cc:333] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.765758 27446 raft_consensus.cc:2243] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.766471 27446 raft_consensus.cc:2272] T 18a56a6374454cf6b3c48e13d1daf5d9 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.768314 27446 tablet_replica.cc:333] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.768925 27446 raft_consensus.cc:2243] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.769327 27446 raft_consensus.cc:2272] T 887ea6f2292649de80a0e337800fd7cb P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.771160 27446 tablet_replica.cc:333] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.771703 27446 raft_consensus.cc:2243] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.772518 27446 raft_consensus.cc:2272] T 69e86de2926d4f3eafdf9f57553e3211 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.774398 27446 tablet_replica.cc:333] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.774935 27446 raft_consensus.cc:2243] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.775341 27446 raft_consensus.cc:2272] T 4b5a0e2e4c2a4f8c9a8bfa8ea813be51 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.777120 27446 tablet_replica.cc:333] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.777652 27446 raft_consensus.cc:2243] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.778384 27446 raft_consensus.cc:2272] T 08fad4ce0c2a44c8b885dcbca5bfde87 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.780162 27446 tablet_replica.cc:333] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.780699 27446 raft_consensus.cc:2243] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.781476 27446 raft_consensus.cc:2272] T 4d84f9d6d8dd4f7e96a52cf86006235c P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.783277 27446 tablet_replica.cc:333] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.783779 27446 raft_consensus.cc:2243] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.784200 27446 raft_consensus.cc:2272] T 4116669c74d4417d993b6fe905fab3c2 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.786044 27446 tablet_replica.cc:333] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.786572 27446 raft_consensus.cc:2243] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.786978 27446 raft_consensus.cc:2272] T 9a0acea6bb584b6ca4cdb21390af1cf5 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.788870 27446 tablet_replica.cc:333] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.789383 27446 raft_consensus.cc:2243] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.789803 27446 raft_consensus.cc:2272] T bf71ad7e2ac54415ab73c6499883c3b4 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.791630 27446 tablet_replica.cc:333] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.792165 27446 raft_consensus.cc:2243] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.792599 27446 raft_consensus.cc:2272] T d4e076c07c0947d5a199139898ffba03 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.794351 27446 tablet_replica.cc:333] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.794860 27446 raft_consensus.cc:2243] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.795286 27446 raft_consensus.cc:2272] T 9d726792b00846af91fe7eaee674790a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.797088 27446 tablet_replica.cc:333] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.797626 27446 raft_consensus.cc:2243] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.798029 27446 raft_consensus.cc:2272] T 402cf513fa7f4e30917381ee64a96070 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.799798 27446 tablet_replica.cc:333] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.800295 27446 raft_consensus.cc:2243] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.801142 27446 raft_consensus.cc:2272] T 95ab26a4132c42e7b6a9ed53a0d4d98b P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.802853 27446 tablet_replica.cc:333] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.803359 27446 raft_consensus.cc:2243] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.803753 27446 raft_consensus.cc:2272] T 39c21b5980204d2a84e53916eab2d0a0 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.805538 27446 tablet_replica.cc:333] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.806057 27446 raft_consensus.cc:2243] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.806448 27446 raft_consensus.cc:2272] T 1af71d02653944509494d122128ee567 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.808391 27446 tablet_replica.cc:333] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.808933 27446 raft_consensus.cc:2243] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.809351 27446 raft_consensus.cc:2272] T 0db9822ea4574d15bd17a42e91fb030e P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.811106 27446 tablet_replica.cc:333] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.811615 27446 raft_consensus.cc:2243] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.812011 27446 raft_consensus.cc:2272] T f42967958ae64becbb47efba2703dc6a P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.813827 27446 tablet_replica.cc:333] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.814348 27446 raft_consensus.cc:2243] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.815073 27446 raft_consensus.cc:2272] T 81434dfcd51a4772a9f3c8b182f6a9f6 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.816970 27446 tablet_replica.cc:333] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.817683 27446 raft_consensus.cc:2243] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.818608 27446 raft_consensus.cc:2272] T 78a654b632744c53946820d8bb4c5fb8 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.820400 27446 tablet_replica.cc:333] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.820906 27446 raft_consensus.cc:2243] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.821329 27446 raft_consensus.cc:2272] T f267030285b54db4bfe6e2293754df95 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.823047 27446 tablet_replica.cc:333] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.823557 27446 raft_consensus.cc:2243] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.823995 27446 raft_consensus.cc:2272] T 793b2585318747d0b1c32b60839d07e7 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.825780 27446 tablet_replica.cc:333] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.826257 27446 raft_consensus.cc:2243] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.826680 27446 raft_consensus.cc:2272] T 20bc52dfebc342d381e8f38949578038 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.828677 27446 tablet_replica.cc:333] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.829156 27446 raft_consensus.cc:2243] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.829602 27446 raft_consensus.cc:2272] T 0174a8220da546bba7e2ccf232f59244 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.831406 27446 tablet_replica.cc:333] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.831868 27446 raft_consensus.cc:2243] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.832291 27446 raft_consensus.cc:2272] T 4058efce24824bdab7ff7d90f5c1c9ce P 2df71e80861d4ef18c58ce9ed40ed9ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.834123 27446 tablet_replica.cc:333] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.834587 27446 raft_consensus.cc:2243] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:35.834973 27446 raft_consensus.cc:2272] T c48cbeaeff384cbd8556c14de06a2c41 P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.836827 27446 tablet_replica.cc:333] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba: stopping tablet replica
I20260709 12:22:35.837462 27446 raft_consensus.cc:2243] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:35.838284 27446 raft_consensus.cc:2272] T 79dc98f9fe994e9488ec27c89efce84d P 2df71e80861d4ef18c58ce9ed40ed9ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:35.908171 27446 tablet_server.cc:196] TabletServer@127.26.205.132:0 shutdown complete.
I20260709 12:22:35.977109 27446 master.cc:562] Master@127.26.205.190:40179 shutting down...
I20260709 12:22:36.004887 27446 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:36.005414 27446 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:36.005700 27446 tablet_replica.cc:333] T 00000000000000000000000000000000 P 57e4204dd50548b3ba01d7cc1ea259dd: stopping tablet replica
I20260709 12:22:36.027834 27446 master.cc:584] Master@127.26.205.190:40179 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32551 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:22:36.122148 27446 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.205.190:33567
I20260709 12:22:36.123309 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:36.129528  6479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:36.130107  6480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:36.130402  6482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:36.131664 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:36.132714 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:36.132887 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:36.133002 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599756132992 us; error 0 us; skew 500 ppm
I20260709 12:22:36.133468 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:36.135736 27446 webserver.cc:533] Webserver started at http://127.26.205.190:38977/ using document root <none> and password file <none>
I20260709 12:22:36.136164 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:36.136309 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:36.136843 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:36.137943 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/master-0-root/instance:
uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:36.142195 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:22:36.145412  6487 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.146158 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:36.146407 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/master-0-root
uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:36.146644 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:36.159963 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:36.161343 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:36.199831 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.190:33567
I20260709 12:22:36.199952  6538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.190:33567 every 8 connection(s)
I20260709 12:22:36.203733  6539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.214506  6539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab: Bootstrap starting.
I20260709 12:22:36.219420  6539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.223731  6539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab: No bootstrap required, opened a new log
I20260709 12:22:36.225931  6539 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab" member_type: VOTER }
I20260709 12:22:36.226305  6539 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.226504  6539 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.226999  6539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab" member_type: VOTER }
I20260709 12:22:36.227427  6539 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:36.227618  6539 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:36.227818  6539 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:36.232856  6539 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab" member_type: VOTER }
I20260709 12:22:36.233351  6539 leader_election.cc:304] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab; no voters: 
I20260709 12:22:36.234458  6539 leader_election.cc:290] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:36.234895  6542 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:36.236284  6542 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 1 LEADER]: Becoming Leader. State: Replica: 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab, State: Running, Role: LEADER
I20260709 12:22:36.237002  6542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab" member_type: VOTER }
I20260709 12:22:36.237538  6539 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:36.242153  6543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab" member_type: VOTER } }
I20260709 12:22:36.242162  6544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab. Latest consensus state: current_term: 1 leader_uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e99dcfaf5e540d9a7c8f8e7f3a8b0ab" member_type: VOTER } }
I20260709 12:22:36.243117  6543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:36.243206  6544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:36.248000  6549 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:36.253012  6549 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:36.255096 27446 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:36.261683  6549 catalog_manager.cc:1383] Generated new cluster ID: 867a7f5e4efd4ea898c199ca16239a9f
I20260709 12:22:36.261989  6549 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:36.276207  6549 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:36.277520  6549 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:36.290891  6549 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab: Generated new TSK 0
I20260709 12:22:36.291493  6549 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:36.322129 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:36.328336  6560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:36.329455  6561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:36.331538  6563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:36.333945 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:36.334983 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:36.335212 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:36.335341 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599756335329 us; error 0 us; skew 500 ppm
I20260709 12:22:36.335839 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:36.338143 27446 webserver.cc:533] Webserver started at http://127.26.205.129:36593/ using document root <none> and password file <none>
I20260709 12:22:36.338725 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:36.338897 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:36.339105 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:36.340140 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root/instance:
uuid: "c0d2ea2a843343a9843407d627de9d91"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:36.344514 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:22:36.347762  6568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.348693 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:36.349102 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "c0d2ea2a843343a9843407d627de9d91"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:36.349380 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:36.366222 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:36.367466 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:36.368996 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:36.371305 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:36.371520 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.371886 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:36.372138 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.416200 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:43893
I20260709 12:22:36.416278  6630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:43893 every 8 connection(s)
I20260709 12:22:36.421631 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:36.429426  6635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:36.430213  6636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:36.433498  6638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:36.434235 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:36.435269 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:36.435493 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:36.435693 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599756435673 us; error 0 us; skew 500 ppm
I20260709 12:22:36.436285 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:36.439282 27446 webserver.cc:533] Webserver started at http://127.26.205.130:43503/ using document root <none> and password file <none>
I20260709 12:22:36.439787 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:36.439904  6631 heartbeater.cc:344] Connected to a master server at 127.26.205.190:33567
I20260709 12:22:36.440014 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:36.440470  6631 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:36.440562 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:36.441270  6631 heartbeater.cc:507] Master 127.26.205.190:33567 requested a full tablet report, sending...
I20260709 12:22:36.441866 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-1-root/instance:
uuid: "19599a3207e943748b36d4b4505ee334"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:36.443372  6504 ts_manager.cc:194] Registered new tserver with Master: c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893)
I20260709 12:22:36.445189  6504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51254
I20260709 12:22:36.446888 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:22:36.450583  6643 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.451385 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:36.451706 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-1-root
uuid: "19599a3207e943748b36d4b4505ee334"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:36.451972 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:36.467430 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:36.468705 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:36.470141 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:36.472478 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:36.472807 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:36.473152 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:36.473382 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.515143 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.130:44817
I20260709 12:22:36.515255  6705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.130:44817 every 8 connection(s)
I20260709 12:22:36.520169 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:36.526538  6709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:36.528862  6710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:36.530409 27446 server_base.cc:1061] running on GCE node
W20260709 12:22:36.531384  6712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:36.532660 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:36.532908 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:36.533005  6706 heartbeater.cc:344] Connected to a master server at 127.26.205.190:33567
I20260709 12:22:36.533136 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599756533114 us; error 0 us; skew 500 ppm
I20260709 12:22:36.533474  6706 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:36.533931 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:36.534348  6706 heartbeater.cc:507] Master 127.26.205.190:33567 requested a full tablet report, sending...
I20260709 12:22:36.536549 27446 webserver.cc:533] Webserver started at http://127.26.205.131:34355/ using document root <none> and password file <none>
I20260709 12:22:36.536926  6504 ts_manager.cc:194] Registered new tserver with Master: 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:36.537286 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:36.537601 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:36.537916 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:36.538836  6504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51262
I20260709 12:22:36.539510 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-2-root/instance:
uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:36.544601 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:22:36.547834  6717 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.548735 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:36.549083 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-2-root
uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:36.549397 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:36.561868 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:36.562966 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:36.564388 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:36.566644 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:36.566877 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.567113 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:36.567306 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:36.609409 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.131:37607
I20260709 12:22:36.609522  6779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.131:37607 every 8 connection(s)
I20260709 12:22:36.623273  6780 heartbeater.cc:344] Connected to a master server at 127.26.205.190:33567
I20260709 12:22:36.623782  6780 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:36.624761  6780 heartbeater.cc:507] Master 127.26.205.190:33567 requested a full tablet report, sending...
I20260709 12:22:36.626839  6504 ts_manager.cc:194] Registered new tserver with Master: 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:36.627532 27446 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014841555s
I20260709 12:22:36.628285  6504 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51266
I20260709 12:22:36.653234  6504 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51270:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:36.656186  6504 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:36.725914  6671 tablet_service.cc:1511] Processing CreateTablet for tablet f447f8dfed7745d3888f713d4df03c5d (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:36.727480  6671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f447f8dfed7745d3888f713d4df03c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.736891  6670 tablet_service.cc:1511] Processing CreateTablet for tablet dfc6a902d5cf43ac92f8a59a96687008 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:36.738428  6670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc6a902d5cf43ac92f8a59a96687008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.741235  6744 tablet_service.cc:1511] Processing CreateTablet for tablet dfc6a902d5cf43ac92f8a59a96687008 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:36.741632  6669 tablet_service.cc:1511] Processing CreateTablet for tablet 4b79bcf2dba94a7db0382c9521fd8cdb (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:36.742749  6744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc6a902d5cf43ac92f8a59a96687008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.743068  6669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b79bcf2dba94a7db0382c9521fd8cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.747826  6668 tablet_service.cc:1511] Processing CreateTablet for tablet c88ea66150894013ba7d60ef9703f72b (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:36.748629  6742 tablet_service.cc:1511] Processing CreateTablet for tablet c88ea66150894013ba7d60ef9703f72b (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:36.749322  6668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88ea66150894013ba7d60ef9703f72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.749013  6743 tablet_service.cc:1511] Processing CreateTablet for tablet 4b79bcf2dba94a7db0382c9521fd8cdb (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:36.750087  6742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88ea66150894013ba7d60ef9703f72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.750562  6745 tablet_service.cc:1511] Processing CreateTablet for tablet f447f8dfed7745d3888f713d4df03c5d (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:36.751945  6745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f447f8dfed7745d3888f713d4df03c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.761629  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b79bcf2dba94a7db0382c9521fd8cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.771353  6795 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:36.773885  6796 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:36.785653  6795 tablet_bootstrap.cc:654] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.792163  6671 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd1d0a5dea54a12b2a486f051d53e9b (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:36.794579  6671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd1d0a5dea54a12b2a486f051d53e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.794917  6796 tablet_bootstrap.cc:654] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.796065  6670 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa519025a92435d80dfcae39fd33338 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:36.797439  6670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa519025a92435d80dfcae39fd33338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.797187  6743 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd1d0a5dea54a12b2a486f051d53e9b (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:36.798520  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd1d0a5dea54a12b2a486f051d53e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.803821  6596 tablet_service.cc:1511] Processing CreateTablet for tablet f447f8dfed7745d3888f713d4df03c5d (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:36.805488  6596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f447f8dfed7745d3888f713d4df03c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.809515  6595 tablet_service.cc:1511] Processing CreateTablet for tablet dfc6a902d5cf43ac92f8a59a96687008 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:36.810891  6595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc6a902d5cf43ac92f8a59a96687008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.813596  6594 tablet_service.cc:1511] Processing CreateTablet for tablet 4b79bcf2dba94a7db0382c9521fd8cdb (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:36.814966  6594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b79bcf2dba94a7db0382c9521fd8cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.816830  6591 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa519025a92435d80dfcae39fd33338 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:36.818231  6591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa519025a92435d80dfcae39fd33338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.819978  6795 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:36.820626  6795 ts_tablet_manager.cc:1403] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.007s
I20260709 12:22:36.821694  6592 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd1d0a5dea54a12b2a486f051d53e9b (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:36.823076  6592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd1d0a5dea54a12b2a486f051d53e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.823195  6796 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:36.823766  6796 ts_tablet_manager.cc:1403] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.007s
I20260709 12:22:36.824103  6795 raft_consensus.cc:359] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:36.824975  6795 raft_consensus.cc:385] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.825318  6795 raft_consensus.cc:740] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.825624  6593 tablet_service.cc:1511] Processing CreateTablet for tablet c88ea66150894013ba7d60ef9703f72b (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:36.826129  6795 consensus_queue.cc:260] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:36.827062  6593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88ea66150894013ba7d60ef9703f72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.830924  6796 raft_consensus.cc:359] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:36.831939  6796 raft_consensus.cc:385] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.832526  6796 raft_consensus.cc:740] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.833493  6796 consensus_queue.cc:260] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:36.835773  6795 ts_tablet_manager.cc:1434] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 12:22:36.837064  6706 heartbeater.cc:499] Master 127.26.205.190:33567 was elected leader, sending a full tablet report...
I20260709 12:22:36.839985  6795 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:36.854491  6795 tablet_bootstrap.cc:654] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.855778  6780 heartbeater.cc:499] Master 127.26.205.190:33567 was elected leader, sending a full tablet report...
I20260709 12:22:36.862599  6743 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa519025a92435d80dfcae39fd33338 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:36.863969  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa519025a92435d80dfcae39fd33338. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:36.864777  6781 tablet.cc:2406] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:36.866161  6796 ts_tablet_manager.cc:1434] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.009s
I20260709 12:22:36.867306  6796 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:36.883186  6800 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:36.884660  6796 tablet_bootstrap.cc:654] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.893704  6592 tablet_service.cc:1511] Processing CreateTablet for tablet fd54b38b050946e78b2a467d33f9e262 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:36.895115  6592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd54b38b050946e78b2a467d33f9e262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.896727  6669 tablet_service.cc:1511] Processing CreateTablet for tablet fd54b38b050946e78b2a467d33f9e262 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:36.898216  6669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd54b38b050946e78b2a467d33f9e262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.900940  6745 tablet_service.cc:1511] Processing CreateTablet for tablet fd54b38b050946e78b2a467d33f9e262 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:36.902259  6745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd54b38b050946e78b2a467d33f9e262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.904628  6671 tablet_service.cc:1511] Processing CreateTablet for tablet b8c08c3b93c940a0933076cf33c06c1c (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:36.905437  6594 tablet_service.cc:1511] Processing CreateTablet for tablet b8c08c3b93c940a0933076cf33c06c1c (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:36.905951  6671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c08c3b93c940a0933076cf33c06c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.906689  6594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c08c3b93c940a0933076cf33c06c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.910110  6800 tablet_bootstrap.cc:654] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.915832  6796 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:36.916405  6796 ts_tablet_manager.cc:1403] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.005s
I20260709 12:22:36.919502  6796 raft_consensus.cc:359] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:36.920344  6796 raft_consensus.cc:385] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.921803  6591 tablet_service.cc:1511] Processing CreateTablet for tablet 79b2bd0763a046f589c55245b0a97278 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:36.933843  6591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b2bd0763a046f589c55245b0a97278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.932058  6796 raft_consensus.cc:740] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.935241  6796 consensus_queue.cc:260] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:36.935518  6593 tablet_service.cc:1511] Processing CreateTablet for tablet 6081970742dd4ec389b8df32ff80be74 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:36.936866  6593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6081970742dd4ec389b8df32ff80be74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.929890  6670 tablet_service.cc:1511] Processing CreateTablet for tablet 79b2bd0763a046f589c55245b0a97278 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:36.937518  6796 ts_tablet_manager.cc:1434] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 12:22:36.937830  6670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b2bd0763a046f589c55245b0a97278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.939492  6743 tablet_service.cc:1511] Processing CreateTablet for tablet 79b2bd0763a046f589c55245b0a97278 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:36.942404  6796 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:36.920013  6744 tablet_service.cc:1511] Processing CreateTablet for tablet b8c08c3b93c940a0933076cf33c06c1c (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:36.945564  6744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c08c3b93c940a0933076cf33c06c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.949103  6743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b2bd0763a046f589c55245b0a97278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.955142  6795 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:36.955778  6795 ts_tablet_manager.cc:1403] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.116s	user 0.026s	sys 0.008s
I20260709 12:22:36.958917  6795 raft_consensus.cc:359] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:36.959681  6795 raft_consensus.cc:385] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:36.959987  6795 raft_consensus.cc:740] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:36.963551  6671 tablet_service.cc:1511] Processing CreateTablet for tablet 6081970742dd4ec389b8df32ff80be74 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:36.963812  6742 tablet_service.cc:1511] Processing CreateTablet for tablet 6081970742dd4ec389b8df32ff80be74 (DEFAULT_TABLE table=test-workload [id=0a9a4c8cc9304802b3e0bea55694ce1e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:36.964949  6742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6081970742dd4ec389b8df32ff80be74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.964949  6671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6081970742dd4ec389b8df32ff80be74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:36.977487  6796 tablet_bootstrap.cc:654] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:36.981362  6795 consensus_queue.cc:260] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:36.983671  6795 ts_tablet_manager.cc:1434] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 12:22:36.993220  6795 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:37.012575  6800 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.013188  6800 ts_tablet_manager.cc:1403] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.130s	user 0.022s	sys 0.044s
I20260709 12:22:37.013741  6795 tablet_bootstrap.cc:654] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.016314  6800 raft_consensus.cc:359] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.017127  6800 raft_consensus.cc:385] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.017439  6800 raft_consensus.cc:740] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.018199  6800 consensus_queue.cc:260] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.019068  6795 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:37.019556  6795 ts_tablet_manager.cc:1403] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 12:22:37.020845  6796 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:37.021522  6796 ts_tablet_manager.cc:1403] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.079s	user 0.005s	sys 0.007s
I20260709 12:22:37.022083  6631 heartbeater.cc:499] Master 127.26.205.190:33567 was elected leader, sending a full tablet report...
I20260709 12:22:37.022544  6800 ts_tablet_manager.cc:1434] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:22:37.022428  6795 raft_consensus.cc:359] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.023190  6795 raft_consensus.cc:385] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.023536  6795 raft_consensus.cc:740] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.023628  6800 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.024422  6795 consensus_queue.cc:260] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.024581  6796 raft_consensus.cc:359] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.025368  6796 raft_consensus.cc:385] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.025681  6796 raft_consensus.cc:740] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.026643  6796 consensus_queue.cc:260] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.030517  6800 tablet_bootstrap.cc:654] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.032064  6796 ts_tablet_manager.cc:1434] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:22:37.033567  6807 raft_consensus.cc:493] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.034099  6795 ts_tablet_manager.cc:1434] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:22:37.034782  6807 raft_consensus.cc:515] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.035480  6795 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:37.039896  6807 leader_election.cc:290] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.047042  6795 tablet_bootstrap.cc:654] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.034317  6796 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:37.054297  6800 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.054888  6800 ts_tablet_manager.cc:1403] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.021s
I20260709 12:22:37.055598  6796 tablet_bootstrap.cc:654] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.058177  6800 raft_consensus.cc:359] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.058995  6800 raft_consensus.cc:385] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.059305  6800 raft_consensus.cc:740] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.060227  6800 consensus_queue.cc:260] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.062459  6800 ts_tablet_manager.cc:1434] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:37.063467  6800 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.071561  6755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.072398  6755 raft_consensus.cc:2468] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 0.
I20260709 12:22:37.074009  6570 leader_election.cc:304] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.074932  6807 raft_consensus.cc:2804] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.075287  6807 raft_consensus.cc:493] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.075613  6807 raft_consensus.cc:3060] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.075809  6800 tablet_bootstrap.cc:654] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.085614  6807 raft_consensus.cc:515] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.086673  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
W20260709 12:22:37.088989  6572 leader_election.cc:343] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.091208  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:37.092666  6795 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
W20260709 12:22:37.093209  6572 leader_election.cc:343] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.093369  6795 ts_tablet_manager.cc:1403] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.011s
I20260709 12:22:37.098016  6795 raft_consensus.cc:359] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.101130  6755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:37.102609  6755 raft_consensus.cc:3060] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.104903  6799 raft_consensus.cc:493] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.105576  6799 raft_consensus.cc:515] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.113907  6755 raft_consensus.cc:2468] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 1.
I20260709 12:22:37.101809  6807 leader_election.cc:290] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Requested vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.114665  6795 raft_consensus.cc:385] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.114686  6799 leader_election.cc:290] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.117903  6795 raft_consensus.cc:740] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.118952  6800 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.118809  6795 consensus_queue.cc:260] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.119485  6800 ts_tablet_manager.cc:1403] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.018s
I20260709 12:22:37.121315  6795 ts_tablet_manager.cc:1434] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:22:37.122946  6570 leader_election.cc:304] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 19599a3207e943748b36d4b4505ee334
I20260709 12:22:37.124367  6807 raft_consensus.cc:2804] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.124505  6795 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:37.122793  6800 raft_consensus.cc:359] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.127343  6800 raft_consensus.cc:385] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.127676  6800 raft_consensus.cc:740] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.129668  6800 consensus_queue.cc:260] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.134029  6795 tablet_bootstrap.cc:654] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.135459  6807 raft_consensus.cc:697] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: Becoming Leader. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Running, Role: LEADER
I20260709 12:22:37.136526  6807 consensus_queue.cc:237] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.142982  6800 ts_tablet_manager.cc:1434] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 12:22:37.144544  6800 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.147091  6796 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:37.147662  6796 ts_tablet_manager.cc:1403] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.114s	user 0.030s	sys 0.044s
I20260709 12:22:37.147847  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91" is_pre_election: true
W20260709 12:22:37.149739  6644 leader_election.cc:343] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.153677  6755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.154412  6755 raft_consensus.cc:2468] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 0.
I20260709 12:22:37.155349  6645 leader_election.cc:304] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:37.155778  6795 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:37.156355  6799 raft_consensus.cc:2804] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.156514  6795 ts_tablet_manager.cc:1403] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.010s
I20260709 12:22:37.156848  6799 raft_consensus.cc:493] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.157254  6796 raft_consensus.cc:359] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.158027  6796 raft_consensus.cc:385] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.158325  6796 raft_consensus.cc:740] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.158757  6800 tablet_bootstrap.cc:654] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.159528  6796 consensus_queue.cc:260] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.160403  6795 raft_consensus.cc:359] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.161278  6795 raft_consensus.cc:385] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.161662  6795 raft_consensus.cc:740] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.162227  6796 ts_tablet_manager.cc:1434] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:22:37.163319  6796 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:37.163008  6795 consensus_queue.cc:260] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.157261  6799 raft_consensus.cc:3060] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.170989  6796 tablet_bootstrap.cc:654] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.160070  6503 catalog_manager.cc:5697] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0d2ea2a843343a9843407d627de9d91 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c0d2ea2a843343a9843407d627de9d91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.183955  6795 ts_tablet_manager.cc:1434] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.005s
I20260709 12:22:37.201527  6821 raft_consensus.cc:493] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.204489  6821 raft_consensus.cc:515] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.204934  6801 raft_consensus.cc:493] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.206849  6801 raft_consensus.cc:515] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.215677  6801 leader_election.cc:290] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:37.213624  6799 raft_consensus.cc:515] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.220952  6799 leader_election.cc:290] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.221977  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:37.222146  6755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:37.222918  6755 raft_consensus.cc:3060] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:37.223645  6644 leader_election.cc:343] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.226481  6800 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.226589  6796 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:37.227274  6800 ts_tablet_manager.cc:1403] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.083s	user 0.029s	sys 0.041s
I20260709 12:22:37.227397  6796 ts_tablet_manager.cc:1403] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.064s	user 0.032s	sys 0.028s
I20260709 12:22:37.230334  6755 raft_consensus.cc:2468] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 1.
I20260709 12:22:37.230872  6796 raft_consensus.cc:359] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.231736  6796 raft_consensus.cc:385] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.231784  6645 leader_election.cc:304] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:37.231331  6800 raft_consensus.cc:359] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.232455  6796 raft_consensus.cc:740] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.232648  6800 raft_consensus.cc:385] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.233109  6800 raft_consensus.cc:740] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.233166  6799 raft_consensus.cc:2804] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.233879  6799 raft_consensus.cc:697] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:37.233469  6796 consensus_queue.cc:260] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.234258  6800 consensus_queue.cc:260] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.234756  6799 consensus_queue.cc:237] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.236763  6796 ts_tablet_manager.cc:1434] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:37.237913  6796 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:37.239748  6807 raft_consensus.cc:493] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.240257  6807 raft_consensus.cc:515] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.243259  6807 leader_election.cc:290] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.243794  6800 ts_tablet_manager.cc:1434] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 12:22:37.243944  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.244710  6681 raft_consensus.cc:2468] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 0.
I20260709 12:22:37.246039  6572 leader_election.cc:304] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.246290  6796 tablet_bootstrap.cc:654] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.246973  6807 raft_consensus.cc:2804] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.247382  6807 raft_consensus.cc:493] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.247483  6800 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.247798  6807 raft_consensus.cc:3060] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:37.250116  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:37.255024  6800 tablet_bootstrap.cc:654] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.258737  6807 raft_consensus.cc:515] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.262530  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:37.263302  6681 raft_consensus.cc:3060] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.267724  6800 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.268286  6800 ts_tablet_manager.cc:1403] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 12:22:37.271401  6800 raft_consensus.cc:359] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.272051  6800 raft_consensus.cc:385] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.272320  6800 raft_consensus.cc:740] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.273140  6681 raft_consensus.cc:2468] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 1.
I20260709 12:22:37.273315  6800 consensus_queue.cc:260] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.275825  6800 ts_tablet_manager.cc:1434] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:37.276887  6800 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.276772  6572 leader_election.cc:304] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.202996  6795 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:37.278930  6817 raft_consensus.cc:2804] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.279575  6817 raft_consensus.cc:697] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: Becoming Leader. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Running, Role: LEADER
I20260709 12:22:37.280963  6817 consensus_queue.cc:237] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.284212  6800 tablet_bootstrap.cc:654] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.287425  6821 leader_election.cc:290] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.288239  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91" is_pre_election: true
I20260709 12:22:37.289029  6754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
W20260709 12:22:37.289875  6644 leader_election.cc:343] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.289990  6754 raft_consensus.cc:2468] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 0.
I20260709 12:22:37.292979  6645 leader_election.cc:304] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:37.296041  6799 raft_consensus.cc:2804] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.296561  6799 raft_consensus.cc:493] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.297005  6799 raft_consensus.cc:3060] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.299094  6502 catalog_manager.cc:5697] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.306174  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88ea66150894013ba7d60ef9703f72b" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91" is_pre_election: true
I20260709 12:22:37.311024  6606 raft_consensus.cc:2468] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 0.
I20260709 12:22:37.312849  6718 leader_election.cc:304] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.313303  6795 tablet_bootstrap.cc:654] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.314092  6801 raft_consensus.cc:2804] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.314602  6801 raft_consensus.cc:493] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.315008  6801 raft_consensus.cc:3060] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.318809  6807 leader_election.cc:290] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Requested vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.319944  6796 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:37.320087  6800 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.320587  6796 ts_tablet_manager.cc:1403] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.083s	user 0.018s	sys 0.040s
I20260709 12:22:37.320730  6800 ts_tablet_manager.cc:1403] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.014s
I20260709 12:22:37.321314  6754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:37.324579  6800 raft_consensus.cc:359] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.325426  6800 raft_consensus.cc:385] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.325730  6800 raft_consensus.cc:740] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.325459  6796 raft_consensus.cc:359] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.326859  6796 raft_consensus.cc:385] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.326555  6800 consensus_queue.cc:260] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.327318  6796 raft_consensus.cc:740] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.327708  6817 raft_consensus.cc:493] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.328228  6817 raft_consensus.cc:515] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.330396  6817 leader_election.cc:290] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.306797  6755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.331610  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd1d0a5dea54a12b2a486f051d53e9b" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.332417  6800 ts_tablet_manager.cc:1434] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:37.332516  6680 raft_consensus.cc:2468] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 0.
I20260709 12:22:37.332228  6796 consensus_queue.cc:260] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.333011  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd1d0a5dea54a12b2a486f051d53e9b" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.333848  6753 raft_consensus.cc:2468] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 0.
I20260709 12:22:37.333969  6572 leader_election.cc:304] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.322265  6799 raft_consensus.cc:515] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.334013  6800 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.335539  6817 raft_consensus.cc:2804] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.338624  6817 raft_consensus.cc:493] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.335824  6502 catalog_manager.cc:5697] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0d2ea2a843343a9843407d627de9d91 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c0d2ea2a843343a9843407d627de9d91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.339025  6817 raft_consensus.cc:3060] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.334506  6754 raft_consensus.cc:3060] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.345067  6800 tablet_bootstrap.cc:654] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.304656  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88ea66150894013ba7d60ef9703f72b" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.360877  6807 raft_consensus.cc:493] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.361143  6681 raft_consensus.cc:2468] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 0.
I20260709 12:22:37.361500  6807 raft_consensus.cc:515] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.364713  6807 leader_election.cc:290] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.365027  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.365553  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.364073  6801 raft_consensus.cc:515] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.368918  6796 ts_tablet_manager.cc:1434] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.048s	user 0.013s	sys 0.027s
I20260709 12:22:37.369668  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:37.369237  6799 leader_election.cc:290] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.370044  6796 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:37.370357  6795 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:37.370858  6795 ts_tablet_manager.cc:1403] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.168s	user 0.010s	sys 0.011s
W20260709 12:22:37.371111  6644 leader_election.cc:343] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:37.367539  6572 leader_election.cc:343] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:37.373648  6570 leader_election.cc:343] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:37.374081  6570 leader_election.cc:304] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d2ea2a843343a9843407d627de9d91; no voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe
I20260709 12:22:37.374038  6795 raft_consensus.cc:359] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.374990  6795 raft_consensus.cc:385] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.375464  6807 raft_consensus.cc:2749] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.376339  6754 raft_consensus.cc:2468] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 1.
I20260709 12:22:37.377549  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:37.378213  6796 tablet_bootstrap.cc:654] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.378176  6753 raft_consensus.cc:3060] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.378970  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88ea66150894013ba7d60ef9703f72b" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:37.379565  6606 raft_consensus.cc:3060] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.367473  6817 raft_consensus.cc:515] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.384357  6817 leader_election.cc:290] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Requested vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.385079  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd1d0a5dea54a12b2a486f051d53e9b" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:37.385665  6680 raft_consensus.cc:3060] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.386442  6800 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.386994  6800 ts_tablet_manager.cc:1403] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.005s
I20260709 12:22:37.390081  6800 raft_consensus.cc:359] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.390800  6800 raft_consensus.cc:385] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.391119  6800 raft_consensus.cc:740] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.391848  6800 consensus_queue.cc:260] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.394187  6807 raft_consensus.cc:493] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.394730  6807 raft_consensus.cc:515] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.397686  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.397984  6606 raft_consensus.cc:2468] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:37.400485  6807 leader_election.cc:290] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.401901  6680 raft_consensus.cc:2468] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 1.
I20260709 12:22:37.403155  6801 leader_election.cc:290] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:37.375312  6795 raft_consensus.cc:740] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.404088  6754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd1d0a5dea54a12b2a486f051d53e9b" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:37.404771  6754 raft_consensus.cc:3060] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.405359  6718 leader_election.cc:304] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.405010  6795 consensus_queue.cc:260] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.404806  6572 leader_election.cc:304] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.407521  6807 raft_consensus.cc:2804] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.408032  6807 raft_consensus.cc:697] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: Becoming Leader. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Running, Role: LEADER
I20260709 12:22:37.408800  6755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.411037  6753 raft_consensus.cc:2468] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 1.
I20260709 12:22:37.411073  6755 raft_consensus.cc:2393] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0d2ea2a843343a9843407d627de9d91 in current term 1: Already voted for candidate 19599a3207e943748b36d4b4505ee334 in this term.
I20260709 12:22:37.394197  6800 ts_tablet_manager.cc:1434] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:37.420403  6801 raft_consensus.cc:2804] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.419317  6570 leader_election.cc:304] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d2ea2a843343a9843407d627de9d91; no voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe
I20260709 12:22:37.421137  6800 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.409797  6807 consensus_queue.cc:237] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.412479  6645 leader_election.cc:304] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:37.420696  6796 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:37.412041  6754 raft_consensus.cc:2468] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 1.
I20260709 12:22:37.422814  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88ea66150894013ba7d60ef9703f72b" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:37.428265  6796 ts_tablet_manager.cc:1403] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.023s
I20260709 12:22:37.422178  6795 ts_tablet_manager.cc:1434] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:22:37.428344  6680 raft_consensus.cc:3060] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.421903  6817 raft_consensus.cc:3060] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.436597  6795 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:37.431977  6796 raft_consensus.cc:359] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.438321  6796 raft_consensus.cc:385] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.438697  6796 raft_consensus.cc:740] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.439579  6796 consensus_queue.cc:260] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.434862  6800 tablet_bootstrap.cc:654] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.435506  6799 raft_consensus.cc:2804] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.440896  6799 raft_consensus.cc:697] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:37.441764  6799 consensus_queue.cc:237] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.442341  6796 ts_tablet_manager.cc:1434] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:22:37.443492  6796 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:37.444249  6817 raft_consensus.cc:2749] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.421288  6801 raft_consensus.cc:697] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:37.435397  6680 raft_consensus.cc:2468] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:37.449903  6796 tablet_bootstrap.cc:654] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.449580  6801 consensus_queue.cc:237] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.452111  6795 tablet_bootstrap.cc:654] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.459239  6800 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.461846  6796 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:37.462980  6800 ts_tablet_manager.cc:1403] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.004s
I20260709 12:22:37.463059  6796 ts_tablet_manager.cc:1403] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:22:37.475157  6800 raft_consensus.cc:359] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.475400  6796 raft_consensus.cc:359] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.476339  6796 raft_consensus.cc:385] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.476815  6796 raft_consensus.cc:740] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.477782  6796 consensus_queue.cc:260] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.480485  6504 catalog_manager.cc:5697] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.469763  6502 catalog_manager.cc:5697] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0d2ea2a843343a9843407d627de9d91 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c0d2ea2a843343a9843407d627de9d91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.475932  6800 raft_consensus.cc:385] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.484256  6796 ts_tablet_manager.cc:1434] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:22:37.484613  6800 raft_consensus.cc:740] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.485492  6796 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:37.485563  6800 consensus_queue.cc:260] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.486424  6503 catalog_manager.cc:5697] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 0 to 1, leader changed from <none> to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 1 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.488253  6800 ts_tablet_manager.cc:1434] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.007s
I20260709 12:22:37.489377  6800 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.481803  6795 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:37.490020  6795 ts_tablet_manager.cc:1403] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.008s
I20260709 12:22:37.492038  6796 tablet_bootstrap.cc:654] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.493233  6795 raft_consensus.cc:359] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.493990  6795 raft_consensus.cc:385] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.494306  6795 raft_consensus.cc:740] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.495517  6800 tablet_bootstrap.cc:654] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.495163  6795 consensus_queue.cc:260] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.498584  6795 ts_tablet_manager.cc:1434] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:22:37.499998  6795 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:37.504634  6796 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:37.505244  6796 ts_tablet_manager.cc:1403] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 12:22:37.507023  6795 tablet_bootstrap.cc:654] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.508070  6796 raft_consensus.cc:359] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.510123  6796 raft_consensus.cc:385] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.511962  6796 raft_consensus.cc:740] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.513864  6800 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.514591  6796 consensus_queue.cc:260] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.518143  6796 ts_tablet_manager.cc:1434] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:22:37.518486  6795 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:37.519133  6796 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe: Bootstrap starting.
I20260709 12:22:37.521755  6795 ts_tablet_manager.cc:1403] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.001s
I20260709 12:22:37.524611  6800 ts_tablet_manager.cc:1403] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.007s
I20260709 12:22:37.524674  6795 raft_consensus.cc:359] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.526633  6795 raft_consensus.cc:385] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.526953  6795 raft_consensus.cc:740] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.527858  6795 consensus_queue.cc:260] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.527827  6800 raft_consensus.cc:359] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.529151  6800 raft_consensus.cc:385] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.529510  6800 raft_consensus.cc:740] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.530247  6800 consensus_queue.cc:260] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.531694  6796 tablet_bootstrap.cc:654] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.533583  6800 ts_tablet_manager.cc:1434] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:37.533499  6799 raft_consensus.cc:493] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.535261  6799 raft_consensus.cc:515] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.537500  6799 leader_election.cc:290] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.534757  6795 ts_tablet_manager.cc:1434] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:22:37.538832  6795 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:37.540246  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.541487  6753 raft_consensus.cc:2393] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19599a3207e943748b36d4b4505ee334 in current term 1: Already voted for candidate c0d2ea2a843343a9843407d627de9d91 in this term.
I20260709 12:22:37.539157  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91" is_pre_election: true
I20260709 12:22:37.544992  6644 leader_election.cc:304] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19599a3207e943748b36d4b4505ee334; no voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:37.545847  6795 tablet_bootstrap.cc:654] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.546700  6799 raft_consensus.cc:3060] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.550573  6795 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:37.550999  6795 ts_tablet_manager.cc:1403] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.012s	user 0.002s	sys 0.007s
I20260709 12:22:37.553361  6795 raft_consensus.cc:359] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.554199  6795 raft_consensus.cc:385] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.554421  6795 raft_consensus.cc:740] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.555058  6795 consensus_queue.cc:260] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.556888  6795 ts_tablet_manager.cc:1434] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:37.557942  6795 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334: Bootstrap starting.
I20260709 12:22:37.559652  6799 raft_consensus.cc:2749] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.539909  6800 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:37.563800  6795 tablet_bootstrap.cc:654] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.568105  6795 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334: No bootstrap required, opened a new log
I20260709 12:22:37.568568  6795 ts_tablet_manager.cc:1403] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:22:37.569509  6800 tablet_bootstrap.cc:654] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:37.571288  6795 raft_consensus.cc:359] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.572031  6795 raft_consensus.cc:385] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.572358  6795 raft_consensus.cc:740] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.572914  6801 raft_consensus.cc:493] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.573263  6795 consensus_queue.cc:260] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.573665  6801 raft_consensus.cc:515] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.575775  6795 ts_tablet_manager.cc:1434] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:37.577749  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd54b38b050946e78b2a467d33f9e262" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91" is_pre_election: true
I20260709 12:22:37.578516  6606 raft_consensus.cc:2468] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 0.
I20260709 12:22:37.579280  6796 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe: No bootstrap required, opened a new log
I20260709 12:22:37.579823  6796 ts_tablet_manager.cc:1403] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.031s
I20260709 12:22:37.580037  6718 leader_election.cc:304] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.581269  6832 raft_consensus.cc:2804] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.581691  6832 raft_consensus.cc:493] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.582050  6832 raft_consensus.cc:3060] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.582631  6796 raft_consensus.cc:359] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.583330  6796 raft_consensus.cc:385] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.583581  6796 raft_consensus.cc:740] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.584497  6801 leader_election.cc:290] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:37.585621  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd54b38b050946e78b2a467d33f9e262" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.586112  6680 raft_consensus.cc:2468] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 0.
I20260709 12:22:37.584278  6796 consensus_queue.cc:260] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.589056  6796 ts_tablet_manager.cc:1434] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:22:37.591933  6800 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: No bootstrap required, opened a new log
I20260709 12:22:37.592486  6800 ts_tablet_manager.cc:1403] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.005s
I20260709 12:22:37.592698  6832 raft_consensus.cc:515] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.594908  6832 leader_election.cc:290] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:37.595804  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd54b38b050946e78b2a467d33f9e262" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:37.595914  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd54b38b050946e78b2a467d33f9e262" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:37.595954  6800 raft_consensus.cc:359] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.596565  6606 raft_consensus.cc:3060] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.596740  6680 raft_consensus.cc:3060] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.596863  6800 raft_consensus.cc:385] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:37.597348  6800 raft_consensus.cc:740] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:37.598055  6800 consensus_queue.cc:260] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.600358  6800 ts_tablet_manager.cc:1434] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:22:37.604084  6680 raft_consensus.cc:2468] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:37.604739  6606 raft_consensus.cc:2468] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:37.605326  6721 leader_election.cc:304] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: 
I20260709 12:22:37.605706  6832 raft_consensus.cc:493] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.606251  6801 raft_consensus.cc:2804] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.606282  6832 raft_consensus.cc:515] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.607407  6801 raft_consensus.cc:697] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:37.608291  6801 consensus_queue.cc:237] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.608989  6832 leader_election.cc:290] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:37.609875  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91" is_pre_election: true
I20260709 12:22:37.610154  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.610643  6606 raft_consensus.cc:2468] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 0.
I20260709 12:22:37.610802  6680 raft_consensus.cc:2468] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 0.
I20260709 12:22:37.611722  6718 leader_election.cc:304] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.612639  6832 raft_consensus.cc:2804] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.613059  6832 raft_consensus.cc:493] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.613404  6832 raft_consensus.cc:3060] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.616495  6503 catalog_manager.cc:5697] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 0 to 1, leader changed from <none> to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 1 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.618960  6832 raft_consensus.cc:515] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.620616  6832 leader_election.cc:290] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:37.621505  6807 raft_consensus.cc:493] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.621667  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:37.621789  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:37.622146  6807 raft_consensus.cc:515] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.622491  6606 raft_consensus.cc:3060] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.622625  6680 raft_consensus.cc:3060] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.624315  6807 leader_election.cc:290] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.628012  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.628620  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.628718  6753 raft_consensus.cc:2468] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 0.
I20260709 12:22:37.629356  6681 raft_consensus.cc:2468] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 0.
I20260709 12:22:37.629808  6606 raft_consensus.cc:2468] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:37.630131  6570 leader_election.cc:304] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.630957  6807 raft_consensus.cc:2804] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.630939  6718 leader_election.cc:304] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.631512  6807 raft_consensus.cc:493] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.631924  6807 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.632038  6832 raft_consensus.cc:2804] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.632220  6680 raft_consensus.cc:2468] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:37.632692  6832 raft_consensus.cc:697] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:37.633610  6832 consensus_queue.cc:237] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.638651  6807 raft_consensus.cc:515] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.640719  6807 leader_election.cc:290] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Requested vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.641427  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:37.642088  6680 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.643384  6504 catalog_manager.cc:5697] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 0 to 1, leader changed from <none> to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 1 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.645134  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:37.645572  6753 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.649410  6680 raft_consensus.cc:2468] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 1.
I20260709 12:22:37.651130  6572 leader_election.cc:304] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.651906  6817 raft_consensus.cc:2804] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.652446  6817 raft_consensus.cc:697] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: Becoming Leader. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Running, Role: LEADER
I20260709 12:22:37.652576  6753 raft_consensus.cc:2468] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0d2ea2a843343a9843407d627de9d91 in term 1.
I20260709 12:22:37.653333  6817 consensus_queue.cc:237] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.658028  6817 consensus_queue.cc:1048] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.661773  6504 catalog_manager.cc:5697] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0d2ea2a843343a9843407d627de9d91 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c0d2ea2a843343a9843407d627de9d91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:37.677016  6817 consensus_queue.cc:1048] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.696053  6817 raft_consensus.cc:493] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.696537  6817 raft_consensus.cc:515] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.698092  6817 leader_election.cc:290] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:37.698850  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.699124  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d" candidate_uuid: "c0d2ea2a843343a9843407d627de9d91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:37.699921  6753 raft_consensus.cc:2393] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0d2ea2a843343a9843407d627de9d91 in current term 1: Already voted for candidate 19599a3207e943748b36d4b4505ee334 in this term.
I20260709 12:22:37.700866  6570 leader_election.cc:304] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0d2ea2a843343a9843407d627de9d91; no voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe
I20260709 12:22:37.701458  6817 raft_consensus.cc:3060] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.706473  6817 raft_consensus.cc:2749] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:37.716005  6799 consensus_queue.cc:1048] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.726485  6821 consensus_queue.cc:1048] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.738562  6832 raft_consensus.cc:493] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.739018  6832 raft_consensus.cc:515] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.740751  6832 leader_election.cc:290] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:37.741576  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91" is_pre_election: true
I20260709 12:22:37.741859  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:37.742334  6606 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 0.
I20260709 12:22:37.742502  6680 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 0.
I20260709 12:22:37.743407  6718 leader_election.cc:304] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.744056  6832 raft_consensus.cc:2804] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:37.744395  6832 raft_consensus.cc:493] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.744720  6832 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.749795  6832 raft_consensus.cc:515] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.751504  6832 leader_election.cc:290] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:37.752148  6606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:37.752748  6606 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.752782  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:37.753413  6680 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:37.757906  6606 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:37.758543  6680 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:37.759029  6718 leader_election.cc:304] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:37.759850  6832 raft_consensus.cc:2804] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:37.760288  6832 raft_consensus.cc:697] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:37.761047  6832 consensus_queue.cc:237] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:37.768154  6504 catalog_manager.cc:5697] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 0 to 1, leader changed from <none> to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 1 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:37.827544  6817 consensus_queue.cc:1048] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.839392  6807 consensus_queue.cc:1048] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.850075  6807 consensus_queue.cc:1048] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.865151  6816 consensus_queue.cc:1048] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:37.894742 27446 ts_manager.cc:295] Set tserver state for c0d2ea2a843343a9843407d627de9d91 to MAINTENANCE_MODE
I20260709 12:22:37.895650 27446 tablet_server.cc:179] TabletServer@127.26.205.129:0 shutting down...
I20260709 12:22:37.922569 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:37.923475 27446 tablet_replica.cc:333] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.924119 27446 raft_consensus.cc:2243] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.924598 27446 raft_consensus.cc:2272] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.926620 27446 tablet_replica.cc:333] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.927414 27446 raft_consensus.cc:2243] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.927882 27446 raft_consensus.cc:2272] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.928328  6821 consensus_queue.cc:1048] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:37.929873 27446 tablet_replica.cc:333] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.930716 27446 raft_consensus.cc:2243] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.931486 27446 pending_rounds.cc:70] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Trying to abort 1 pending ops.
I20260709 12:22:37.931803 27446 pending_rounds.cc:77] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624607357300736 op_type: NO_OP noop_request { }
I20260709 12:22:37.932219 27446 raft_consensus.cc:2889] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:37.932649 27446 raft_consensus.cc:2272] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.938292 27446 tablet_replica.cc:333] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.939178 27446 raft_consensus.cc:2243] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.939700 27446 raft_consensus.cc:2272] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.942157 27446 tablet_replica.cc:333] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.942945 27446 raft_consensus.cc:2243] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:22:37.943073  6644 consensus_peers.cc:597] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:37.944077 27446 raft_consensus.cc:2272] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.946806 27446 tablet_replica.cc:333] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.947413 27446 raft_consensus.cc:2243] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.947908 27446 raft_consensus.cc:2272] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.950732 27446 tablet_replica.cc:333] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.951468 27446 raft_consensus.cc:2243] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.951881 27446 raft_consensus.cc:2272] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.953796 27446 tablet_replica.cc:333] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.954427 27446 raft_consensus.cc:2243] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.955260 27446 raft_consensus.cc:2272] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.957396 27446 tablet_replica.cc:333] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.957907 27446 raft_consensus.cc:2243] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:37.958289 27446 raft_consensus.cc:2272] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.960110 27446 tablet_replica.cc:333] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: stopping tablet replica
I20260709 12:22:37.960664 27446 raft_consensus.cc:2243] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:37.961467 27446 raft_consensus.cc:2272] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:37.990073 27446 tablet_server.cc:196] TabletServer@127.26.205.129:0 shutdown complete.
W20260709 12:22:38.021868  6718 consensus_peers.cc:597] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:38.037659  6718 consensus_peers.cc:597] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:38.037703  6832 consensus_queue.cc:1048] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:38.128508  6848 consensus_queue.cc:1048] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:38.154258  6801 consensus_queue.cc:1048] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:38.166296  6832 consensus_queue.cc:1048] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:38.166707  6718 consensus_peers.cc:597] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:38.178968  6718 consensus_peers.cc:597] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:38.187295  6644 consensus_peers.cc:597] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:38.251114  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:39.170815  6874 raft_consensus.cc:493] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
I20260709 12:22:39.171398  6874 raft_consensus.cc:515] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.173172  6874 leader_election.cc:290] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:39.174471  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
W20260709 12:22:39.177021  6644 leader_election.cc:336] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.177404  6644 leader_election.cc:304] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19599a3207e943748b36d4b4505ee334; no voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:39.178054  6874 raft_consensus.cc:2749] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:39.180802  6848 raft_consensus.cc:493] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
I20260709 12:22:39.181322  6848 raft_consensus.cc:515] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.182997  6848 leader_election.cc:290] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:39.184016  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
I20260709 12:22:39.184738  6680 raft_consensus.cc:2468] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 1.
I20260709 12:22:39.185917  6721 leader_election.cc:304] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: 
I20260709 12:22:39.186793  6848 raft_consensus.cc:2804] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:39.186811  6718 leader_election.cc:336] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.187215  6848 raft_consensus.cc:493] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
I20260709 12:22:39.187605  6848 raft_consensus.cc:3060] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.192782  6848 raft_consensus.cc:515] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.194309  6848 leader_election.cc:290] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:39.195626  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b79bcf2dba94a7db0382c9521fd8cdb" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:39.196306  6680 raft_consensus.cc:3060] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:39.199044  6718 leader_election.cc:336] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.203250  6680 raft_consensus.cc:2468] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 2.
I20260709 12:22:39.239176  6721 leader_election.cc:304] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:39.240914  6848 raft_consensus.cc:2804] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.241847  6848 raft_consensus.cc:697] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:39.243268  6848 consensus_queue.cc:237] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
W20260709 12:22:39.252902  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:39.255052  6503 catalog_manager.cc:5697] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 1 to 2, leader changed from c0d2ea2a843343a9843407d627de9d91 (127.26.205.129) to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 2 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.306092  6874 raft_consensus.cc:493] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.306840  6874 raft_consensus.cc:515] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.309257  6874 leader_election.cc:290] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:39.310858  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:39.312067  6753 raft_consensus.cc:2468] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 1.
I20260709 12:22:39.313632  6645 leader_election.cc:304] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: 
I20260709 12:22:39.314560  6874 raft_consensus.cc:2804] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:39.314874  6874 raft_consensus.cc:493] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.315212  6874 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:39.315335  6644 leader_election.cc:336] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.323947  6874 raft_consensus.cc:515] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.325786  6874 leader_election.cc:290] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:39.326957  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:39.327560  6753 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:39.329384  6644 leader_election.cc:336] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.335779  6753 raft_consensus.cc:2468] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:39.336898  6645 leader_election.cc:304] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:39.337689  6874 raft_consensus.cc:493] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
I20260709 12:22:39.337940  6882 raft_consensus.cc:2804] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.338492  6874 raft_consensus.cc:515] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.339265  6882 raft_consensus.cc:697] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:39.341048  6882 consensus_queue.cc:237] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.342880  6874 leader_election.cc:290] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:39.342960  6848 raft_consensus.cc:493] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
I20260709 12:22:39.344024  6848 raft_consensus.cc:515] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.346356  6848 leader_election.cc:290] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:39.346941  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:39.347612  6753 raft_consensus.cc:2468] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 1.
I20260709 12:22:39.348740  6645 leader_election.cc:304] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: 
I20260709 12:22:39.349570  6874 raft_consensus.cc:2804] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:39.349941  6874 raft_consensus.cc:493] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
I20260709 12:22:39.350333  6874 raft_consensus.cc:3060] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.350703  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
W20260709 12:22:39.352025  6644 leader_election.cc:336] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
W20260709 12:22:39.352746  6718 leader_election.cc:336] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.358835  6874 raft_consensus.cc:515] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.358606  6503 catalog_manager.cc:5697] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 1 to 2, leader changed from c0d2ea2a843343a9843407d627de9d91 (127.26.205.129) to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.359923  6680 raft_consensus.cc:2393] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20f7b7fec95c4907b8fabc47ea547ffe in current term 2: Already voted for candidate 19599a3207e943748b36d4b4505ee334 in this term.
I20260709 12:22:39.361900  6874 leader_election.cc:290] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:39.362135  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:39.362732  6753 raft_consensus.cc:3060] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.364046  6721 leader_election.cc:304] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe; no voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:39.365273  6848 raft_consensus.cc:493] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
W20260709 12:22:39.365689  6644 leader_election.cc:336] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.365998  6848 raft_consensus.cc:515] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.368265  6848 leader_election.cc:290] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:39.369707  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd1d0a5dea54a12b2a486f051d53e9b" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19599a3207e943748b36d4b4505ee334" is_pre_election: true
W20260709 12:22:39.372491  6718 leader_election.cc:336] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.372800  6874 raft_consensus.cc:493] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
I20260709 12:22:39.372934  6718 leader_election.cc:304] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe; no voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:39.373615  6874 raft_consensus.cc:515] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.373950  6848 raft_consensus.cc:2749] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:39.374423  6753 raft_consensus.cc:2468] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:39.375157  6875 raft_consensus.cc:2749] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:39.375798  6874 leader_election.cc:290] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:39.376030  6645 leader_election.cc:304] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:39.377274  6874 raft_consensus.cc:2804] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.378726  6874 raft_consensus.cc:697] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:39.379148  6754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd1d0a5dea54a12b2a486f051d53e9b" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" is_pre_election: true
I20260709 12:22:39.380194  6754 raft_consensus.cc:2468] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 1.
I20260709 12:22:39.380286  6874 consensus_queue.cc:237] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
W20260709 12:22:39.381215  6644 leader_election.cc:336] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.381825  6645 leader_election.cc:304] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:39.382614  6882 raft_consensus.cc:2804] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:39.382938  6882 raft_consensus.cc:493] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0d2ea2a843343a9843407d627de9d91)
I20260709 12:22:39.383304  6882 raft_consensus.cc:3060] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:39.388903  6503 catalog_manager.cc:5697] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 1 to 2, leader changed from c0d2ea2a843343a9843407d627de9d91 (127.26.205.129) to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.391690  6882 raft_consensus.cc:515] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.393613  6882 leader_election.cc:290] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:39.394733  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd1d0a5dea54a12b2a486f051d53e9b" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:39.395399  6753 raft_consensus.cc:3060] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:39.399344  6644 leader_election.cc:336] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111)
I20260709 12:22:39.403216  6753 raft_consensus.cc:2468] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:39.404637  6645 leader_election.cc:304] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: c0d2ea2a843343a9843407d627de9d91
I20260709 12:22:39.405516  6882 raft_consensus.cc:2804] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:39.406064  6882 raft_consensus.cc:697] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:39.407327  6882 consensus_queue.cc:237] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:39.414542  6503 catalog_manager.cc:5697] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 1 to 2, leader changed from c0d2ea2a843343a9843407d627de9d91 (127.26.205.129) to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:39.751250  6753 raft_consensus.cc:1275] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:39.752684  6882 consensus_queue.cc:1048] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:39.763829  6644 consensus_peers.cc:597] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.797503  6753 raft_consensus.cc:1275] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:39.798844  6874 consensus_queue.cc:1048] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:39.812419  6644 consensus_peers.cc:597] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.821218  6680 raft_consensus.cc:1275] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:39.822585  6875 consensus_queue.cc:1048] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:39.835992  6718 consensus_peers.cc:597] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:39.932979  6753 raft_consensus.cc:1275] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:39.934290  6882 consensus_queue.cc:1048] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:39.946827  6644 consensus_peers.cc:597] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:40.144743  6644 consensus_peers.cc:597] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.254197  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:40.410842  6644 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111) [suppressed 81 similar messages]
W20260709 12:22:40.451458  6718 consensus_peers.cc:597] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.491858  6718 consensus_peers.cc:597] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.668322  6644 consensus_peers.cc:597] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.813577  6718 consensus_peers.cc:597] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:40.823726  6718 consensus_peers.cc:597] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:41.255455  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:42.091601  6718 consensus_peers.cc:597] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.256516  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:22:42.318728  6644 consensus_peers.cc:597] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.511916  6644 consensus_peers.cc:597] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.606613  6644 consensus_peers.cc:597] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:22:42.721596  6644 consensus_peers.cc:597] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:22:42.894155  6718 consensus_peers.cc:597] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:43.009845 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:43.017658  6897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:43.017750  6896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:43.019183  6899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:43.021648 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:43.023861 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:43.024111 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:43.024335 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599763024309 us; error 0 us; skew 500 ppm
I20260709 12:22:43.025009 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:43.027647 27446 webserver.cc:533] Webserver started at http://127.26.205.129:36593/ using document root <none> and password file <none>
I20260709 12:22:43.028196 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:43.028390 27446 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:22:43.032668 27446 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:43.036574  6904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:43.037365 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:22:43.037672 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "c0d2ea2a843343a9843407d627de9d91"
format_stamp: "Formatted at 2026-07-09 12:22:36 on dist-test-slave-673s"
I20260709 12:22:43.038056 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:43.054383 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:43.055680 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:43.057197 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:43.060911  6911 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:22:43.109948 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:22:43.110330 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.050s	user 0.000s	sys 0.003s
I20260709 12:22:43.110646 27446 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:22:43.116040  6911 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:43.127815  6911 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.128700  6911 tablet_bootstrap.cc:492] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.129437  6911 ts_tablet_manager.cc:1403] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.006s
I20260709 12:22:43.132539  6911 raft_consensus.cc:359] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.133095  6911 raft_consensus.cc:740] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.133801  6911 consensus_queue.cc:260] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.136092  6911 ts_tablet_manager.cc:1434] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:22:43.136906  6911 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
W20260709 12:22:43.141614  6644 consensus_peers.cc:597] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:43.149734  6911 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.150688  6911 tablet_bootstrap.cc:492] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.151337  6911 ts_tablet_manager.cc:1403] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:22:43.153999  6911 raft_consensus.cc:359] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.154546  6911 raft_consensus.cc:740] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.155181  6911 consensus_queue.cc:260] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.156562 27446 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:22:43.156813  6911 ts_tablet_manager.cc:1434] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:22:43.156864 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.046s	user 0.038s	sys 0.009s
I20260709 12:22:43.157651  6911 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
W20260709 12:22:43.167275  6718 consensus_peers.cc:597] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:22:43.172142  6911 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.173369  6911 tablet_bootstrap.cc:492] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.174254  6911 ts_tablet_manager.cc:1403] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:22:43.177909  6911 raft_consensus.cc:359] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.178880  6911 raft_consensus.cc:740] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.179838  6911 consensus_queue.cc:260] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.182611  6911 ts_tablet_manager.cc:1434] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:43.183617  6911 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:43.200250  6911 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.201295  6911 tablet_bootstrap.cc:492] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.202013  6911 ts_tablet_manager.cc:1403] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 12:22:43.204636  6911 raft_consensus.cc:359] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.205175  6911 raft_consensus.cc:740] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.205901  6911 consensus_queue.cc:260] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.208153  6911 ts_tablet_manager.cc:1434] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.002s
I20260709 12:22:43.209053  6911 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:43.213670 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:43893
I20260709 12:22:43.213852  6972 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:43893 every 8 connection(s)
I20260709 12:22:43.220772 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.229384  6911 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:22:43.230405  6911 tablet_bootstrap.cc:492] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.231012  6911 ts_tablet_manager.cc:1403] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:22:43.234102  6911 raft_consensus.cc:359] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.235045  6911 raft_consensus.cc:740] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.235808  6911 consensus_queue.cc:260] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.238314  6911 ts_tablet_manager.cc:1434] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:43.239243  6911 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:43.240757  6973 heartbeater.cc:344] Connected to a master server at 127.26.205.190:33567
I20260709 12:22:43.241212  6973 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:43.242139  6973 heartbeater.cc:507] Master 127.26.205.190:33567 requested a full tablet report, sending...
I20260709 12:22:43.247918  6753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
mode: GRACEFUL
new_leader_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:54348
I20260709 12:22:43.248673  6753 raft_consensus.cc:606] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Received request to transfer leadership to TS 19599a3207e943748b36d4b4505ee334
I20260709 12:22:43.249357  6503 ts_manager.cc:194] Re-registered known tserver with Master: c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893)
W20260709 12:22:43.257944  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:43.264179  6503 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51274
I20260709 12:22:43.268002  6911 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.268226  6973 heartbeater.cc:499] Master 127.26.205.190:33567 was elected leader, sending a full tablet report...
I20260709 12:22:43.269104  6911 tablet_bootstrap.cc:492] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.269788  6911 ts_tablet_manager.cc:1403] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 12:22:43.271819  6680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
mode: GRACEFUL
new_leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:22:43.272473  6680 raft_consensus.cc:606] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Received request to transfer leadership to TS 20f7b7fec95c4907b8fabc47ea547ffe
I20260709 12:22:43.272534  6911 raft_consensus.cc:359] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.273276  6911 raft_consensus.cc:740] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.274336 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:43.274037  6911 consensus_queue.cc:260] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.275000 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:43.275760 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:43.276239  6911 ts_tablet_manager.cc:1434] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:43.277097  6911 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:43.292654  6911 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.293670  6911 tablet_bootstrap.cc:492] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.294245  6911 ts_tablet_manager.cc:1403] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:22:43.296068  6911 raft_consensus.cc:359] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.296608  6911 raft_consensus.cc:740] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.297204  6911 consensus_queue.cc:260] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.298674  6911 ts_tablet_manager.cc:1434] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:43.299366  6911 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:43.314733  6984 raft_consensus.cc:993] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334: : Instructing follower 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:43.316493  6911 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.315970  6882 raft_consensus.cc:1081] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Signalling peer 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:43.317981  6911 tablet_bootstrap.cc:492] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.318976  6911 ts_tablet_manager.cc:1403] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:22:43.320025  6753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:54344
I20260709 12:22:43.320932  6753 raft_consensus.cc:493] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.321408  6753 raft_consensus.cc:3060] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.322332  6911 raft_consensus.cc:359] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.323165  6911 raft_consensus.cc:740] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.324227  6911 consensus_queue.cc:260] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.326784  6911 ts_tablet_manager.cc:1434] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:43.328018  6911 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:43.347388  6753 raft_consensus.cc:515] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.356834  6753 leader_election.cc:290] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 3 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:43.357944  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:43.358619  6680 raft_consensus.cc:3055] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:43.358918  6680 raft_consensus.cc:740] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:43.359676  6680 consensus_queue.cc:260] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.360863  6680 raft_consensus.cc:3060] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.362912  6945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa519025a92435d80dfcae39fd33338" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:43.363634  6945 raft_consensus.cc:3060] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.365116  6911 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.366287  6911 tablet_bootstrap.cc:492] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.367038  6911 ts_tablet_manager.cc:1403] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.012s
I20260709 12:22:43.369141  6944 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.369983  6911 raft_consensus.cc:359] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.370751  6911 raft_consensus.cc:740] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.371714  6911 consensus_queue.cc:260] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
W20260709 12:22:43.372609  6645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:37607, user_credentials={real_user=slave}} blocked reactor thread for 53524.6us
I20260709 12:22:43.374130  6911 ts_tablet_manager.cc:1434] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:43.375100  6911 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Bootstrap starting.
I20260709 12:22:43.379235  6944 pending_rounds.cc:85] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Aborting all ops after (but not including) 0
I20260709 12:22:43.388650  6944 pending_rounds.cc:107] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:22:43.389083  6944 raft_consensus.cc:2889] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:43.380635  6680 raft_consensus.cc:2468] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 3.
I20260709 12:22:43.398571  6945 raft_consensus.cc:2468] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 3.
I20260709 12:22:43.398838  6721 leader_election.cc:304] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, 20f7b7fec95c4907b8fabc47ea547ffe; no voters: 
I20260709 12:22:43.403975  6894 raft_consensus.cc:2804] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:43.405335  6911 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:43.407032  6911 tablet_bootstrap.cc:492] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Bootstrap complete.
I20260709 12:22:43.407761  6911 ts_tablet_manager.cc:1403] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.012s
I20260709 12:22:43.411131  6911 raft_consensus.cc:359] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.412067  6911 raft_consensus.cc:740] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d2ea2a843343a9843407d627de9d91, State: Initialized, Role: FOLLOWER
I20260709 12:22:43.421453  6911 consensus_queue.cc:260] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.424561  6911 ts_tablet_manager.cc:1434] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:22:43.420167  6894 raft_consensus.cc:697] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:43.430409  6894 consensus_queue.cc:237] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.444712  6503 catalog_manager.cc:5697] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 2 to 3, leader changed from 19599a3207e943748b36d4b4505ee334 (127.26.205.130) to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 3 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:43.524390  6946 raft_consensus.cc:3060] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.566732  6946 raft_consensus.cc:3060] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.664819  7000 raft_consensus.cc:993] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe: : Instructing follower 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:43.665328  6894 raft_consensus.cc:1081] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Signalling peer 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:43.666954  6680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:46028
I20260709 12:22:43.667374  6680 raft_consensus.cc:493] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.667598  6680 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.672665  6680 raft_consensus.cc:515] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.674082  6680 leader_election.cc:290] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:43.674921  6946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:43.675534  6946 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.675438  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:43.676177  6753 raft_consensus.cc:3055] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:43.676476  6753 raft_consensus.cc:740] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:43.677292  6753 consensus_queue.cc:260] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.678303  6753 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.680727  6946 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:43.681900  6644 leader_election.cc:304] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:43.682750  6882 raft_consensus.cc:2804] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:43.683136  6882 raft_consensus.cc:697] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:43.684087  6753 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:43.684062  6882 consensus_queue.cc:237] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:43.692143  6502 catalog_manager.cc:5697] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 1 to 2, leader changed from 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131) to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.945075  6946 raft_consensus.cc:1275] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:43.946290  6894 consensus_queue.cc:1048] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.956949  6680 raft_consensus.cc:1275] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:43.958779  6894 consensus_queue.cc:1048] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:44.143272  6753 raft_consensus.cc:1275] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.144450  6882 consensus_queue.cc:1048] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:44.153374  6946 raft_consensus.cc:1275] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:44.155550  6984 consensus_queue.cc:1048] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:44.259037  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:44.283949 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:44.291150  6680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
mode: GRACEFUL
new_leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:22:44.291661  6680 raft_consensus.cc:606] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Received request to transfer leadership to TS 20f7b7fec95c4907b8fabc47ea547ffe
I20260709 12:22:44.294456  6753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c88ea66150894013ba7d60ef9703f72b"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
mode: GRACEFUL
new_leader_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:54348
I20260709 12:22:44.294853  6753 raft_consensus.cc:606] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Received request to transfer leadership to TS 19599a3207e943748b36d4b4505ee334
I20260709 12:22:44.295933 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:44.296353 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:44.296875 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:44.601920  6894 raft_consensus.cc:993] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe: : Instructing follower 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:44.602381  7000 raft_consensus.cc:1081] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Signalling peer 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:44.603929  6680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c88ea66150894013ba7d60ef9703f72b"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:46028
I20260709 12:22:44.604456  6680 raft_consensus.cc:493] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:44.604791  6680 raft_consensus.cc:3060] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.609877  6680 raft_consensus.cc:515] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:44.611629  6680 leader_election.cc:290] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:44.612485  6946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88ea66150894013ba7d60ef9703f72b" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:44.612699  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88ea66150894013ba7d60ef9703f72b" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:44.613209  6946 raft_consensus.cc:3060] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.613276  6753 raft_consensus.cc:3055] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:44.613759  6753 raft_consensus.cc:740] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:44.614656  6753 consensus_queue.cc:260] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:44.615979  6753 raft_consensus.cc:3060] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:44.621197  6946 raft_consensus.cc:2468] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:44.622618  6644 leader_election.cc:304] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:44.623425  6753 raft_consensus.cc:2468] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:44.623517  6984 raft_consensus.cc:2804] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:44.624097  6984 raft_consensus.cc:697] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:44.625058  6984 consensus_queue.cc:237] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:44.632634  6503 catalog_manager.cc:5697] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 1 to 2, leader changed from 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131) to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.709646  7023 raft_consensus.cc:993] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334: : Instructing follower 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:44.710112  6988 raft_consensus.cc:1081] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Signalling peer 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:44.711439  6753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:54344
I20260709 12:22:44.711838  6753 raft_consensus.cc:493] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:44.712061  6753 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:44.716625  6753 raft_consensus.cc:515] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:44.717999  6753 leader_election.cc:290] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 3 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:44.718837  6946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:44.719023  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2bd0763a046f589c55245b0a97278" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:44.719519  6946 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:44.719556  6680 raft_consensus.cc:3055] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:44.719977  6680 raft_consensus.cc:740] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:44.720745  6680 consensus_queue.cc:260] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:44.721930  6680 raft_consensus.cc:3060] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:44.724793  6946 raft_consensus.cc:2468] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 3.
I20260709 12:22:44.725864  6718 leader_election.cc:304] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:44.726547  7000 raft_consensus.cc:2804] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:44.726959  7000 raft_consensus.cc:697] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:44.727306  6680 raft_consensus.cc:2468] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 3.
I20260709 12:22:44.727859  7000 consensus_queue.cc:237] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:44.734818  6503 catalog_manager.cc:5697] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 2 to 3, leader changed from 19599a3207e943748b36d4b4505ee334 (127.26.205.130) to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 3 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.023547  6753 raft_consensus.cc:1275] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:45.024796  6988 consensus_queue.cc:1048] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:45.036831  6946 raft_consensus.cc:1275] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:45.038650  7023 consensus_queue.cc:1048] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:45.186770  6680 raft_consensus.cc:1275] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:45.187979  7000 consensus_queue.cc:1048] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:45.196224  6946 raft_consensus.cc:1275] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:45.198160  7032 consensus_queue.cc:1048] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:22:45.259946  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:45.303131 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.310598  6753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
mode: GRACEFUL
new_leader_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:54348
I20260709 12:22:45.311160  6753 raft_consensus.cc:606] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Received request to transfer leadership to TS 19599a3207e943748b36d4b4505ee334
I20260709 12:22:45.313701  6680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
mode: GRACEFUL
new_leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:22:45.314179  6680 raft_consensus.cc:606] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Received request to transfer leadership to TS 20f7b7fec95c4907b8fabc47ea547ffe
I20260709 12:22:45.315339 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:45.315830 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:45.316409 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.497481  6894 raft_consensus.cc:993] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe: : Instructing follower 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:45.498020  7032 raft_consensus.cc:1081] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Signalling peer 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:45.499570  6680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:46028
I20260709 12:22:45.500028  6680 raft_consensus.cc:493] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.500300  6680 raft_consensus.cc:3060] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:45.504990  6680 raft_consensus.cc:515] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:45.506726  6680 leader_election.cc:290] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:45.507651  6946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:45.508033  6754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c08c3b93c940a0933076cf33c06c1c" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:45.508394  6946 raft_consensus.cc:3060] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:45.508781  6754 raft_consensus.cc:3055] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:45.509136  6754 raft_consensus.cc:740] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:45.510018  6754 consensus_queue.cc:260] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:45.511128  6754 raft_consensus.cc:3060] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:45.513909  6946 raft_consensus.cc:2468] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:45.515036  6644 leader_election.cc:304] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:45.515823  7023 raft_consensus.cc:2804] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:45.516253  7023 raft_consensus.cc:697] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:45.517102  7023 consensus_queue.cc:237] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:45.517771  6754 raft_consensus.cc:2468] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:45.524324  6502 catalog_manager.cc:5697] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 1 to 2, leader changed from 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131) to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.621440  7038 raft_consensus.cc:993] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334: : Instructing follower 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:45.622018  7038 raft_consensus.cc:1081] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Signalling peer 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:45.623620  6754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:54344
I20260709 12:22:45.624168  6754 raft_consensus.cc:493] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.624567  6754 raft_consensus.cc:3060] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:45.630070  6754 raft_consensus.cc:515] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:45.631788  6754 leader_election.cc:290] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:45.632628  6946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:45.632886  6680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc6a902d5cf43ac92f8a59a96687008" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:45.633306  6946 raft_consensus.cc:3060] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:45.633425  6680 raft_consensus.cc:3055] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:45.633822  6680 raft_consensus.cc:740] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:45.634609  6680 consensus_queue.cc:260] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:45.635897  6680 raft_consensus.cc:3060] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:45.640357  6946 raft_consensus.cc:2468] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 2.
I20260709 12:22:45.641510  6718 leader_election.cc:304] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:45.642324  7032 raft_consensus.cc:2804] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:45.642777  7032 raft_consensus.cc:697] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:45.642784  6680 raft_consensus.cc:2468] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 2.
I20260709 12:22:45.643702  7032 consensus_queue.cc:237] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:45.650610  6502 catalog_manager.cc:5697] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 1 to 2, leader changed from 19599a3207e943748b36d4b4505ee334 (127.26.205.130) to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 2 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.897945  6754 raft_consensus.cc:1275] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:45.899217  7038 consensus_queue.cc:1048] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:45.908667  6946 raft_consensus.cc:1275] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:45.913043  7038 consensus_queue.cc:1048] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:46.200623  6946 raft_consensus.cc:1275] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:46.202147  7032 consensus_queue.cc:1048] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:46.213241  6680 raft_consensus.cc:1275] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:46.215950  7048 consensus_queue.cc:1048] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:46.260974  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:46.322536 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.330507  6681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
mode: GRACEFUL
new_leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:22:46.331014  6681 raft_consensus.cc:606] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Received request to transfer leadership to TS 20f7b7fec95c4907b8fabc47ea547ffe
I20260709 12:22:46.333559  6754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd54b38b050946e78b2a467d33f9e262"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
mode: GRACEFUL
new_leader_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:54348
I20260709 12:22:46.334054  6754 raft_consensus.cc:606] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Received request to transfer leadership to TS 19599a3207e943748b36d4b4505ee334
I20260709 12:22:46.335170 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:46.335675 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:46.336248 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.470574  7038 raft_consensus.cc:993] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334: : Instructing follower 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:46.471067  7051 raft_consensus.cc:1081] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Signalling peer 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:46.472525  6754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:54344
I20260709 12:22:46.473011  6754 raft_consensus.cc:493] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.473312  6754 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.478996  6754 raft_consensus.cc:515] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:46.480661  6754 leader_election.cc:290] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 3 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817)
I20260709 12:22:46.481490  6946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:46.481667  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:46.482239  6946 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.482311  6681 raft_consensus.cc:3055] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:46.482746  6681 raft_consensus.cc:740] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:46.483484  6681 consensus_queue.cc:260] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:46.484535  6681 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.487883  6946 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 3.
I20260709 12:22:46.489123  6718 leader_election.cc:304] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:46.489841  7047 raft_consensus.cc:2804] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:46.490351  7047 raft_consensus.cc:697] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:46.491194  7047 consensus_queue.cc:237] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:46.491606  6681 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 3.
I20260709 12:22:46.499128  6503 catalog_manager.cc:5697] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 2 to 3, leader changed from 19599a3207e943748b36d4b4505ee334 (127.26.205.130) to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 3 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.549428  7048 raft_consensus.cc:993] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe: : Instructing follower 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:46.549952  7047 raft_consensus.cc:1081] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Signalling peer 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:46.551525  6681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd54b38b050946e78b2a467d33f9e262"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:46028
I20260709 12:22:46.551981  6681 raft_consensus.cc:493] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.552235  6681 raft_consensus.cc:3060] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:46.557555  6681 raft_consensus.cc:515] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:46.559113  6681 leader_election.cc:290] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:46.560026  6947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd54b38b050946e78b2a467d33f9e262" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:46.560304  6754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd54b38b050946e78b2a467d33f9e262" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:46.560761  6947 raft_consensus.cc:3060] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:46.560921  6754 raft_consensus.cc:3055] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:46.561323  6754 raft_consensus.cc:740] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:46.562203  6754 consensus_queue.cc:260] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:46.563607  6754 raft_consensus.cc:3060] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:46.568667  6947 raft_consensus.cc:2468] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:46.569944  6644 leader_election.cc:304] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:46.570760  7051 raft_consensus.cc:2804] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:46.571169  7051 raft_consensus.cc:697] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:46.571286  6754 raft_consensus.cc:2468] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 2.
I20260709 12:22:46.572098  7051 consensus_queue.cc:237] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:46.579324  6503 catalog_manager.cc:5697] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 1 to 2, leader changed from 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131) to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.899122  6681 raft_consensus.cc:1275] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.900594  7057 consensus_queue.cc:1048] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.910490  6947 raft_consensus.cc:1275] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.913043  7047 consensus_queue.cc:1048] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.120635  6753 raft_consensus.cc:1275] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:47.121891  7051 consensus_queue.cc:1048] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:47.132512  6946 raft_consensus.cc:1275] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:47.133808  7051 consensus_queue.cc:1048] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:47.261888  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:47.343017 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.351389  6753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
mode: GRACEFUL
new_leader_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:54348
I20260709 12:22:47.351903  6753 raft_consensus.cc:606] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Received request to transfer leadership to TS 19599a3207e943748b36d4b4505ee334
I20260709 12:22:47.354422  6681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
mode: GRACEFUL
new_leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:46040
I20260709 12:22:47.354938  6681 raft_consensus.cc:606] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Received request to transfer leadership to TS 20f7b7fec95c4907b8fabc47ea547ffe
I20260709 12:22:47.356035 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:47.356593 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:47.357159 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.842554  7065 raft_consensus.cc:993] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334: : Instructing follower 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:47.843015  7051 raft_consensus.cc:1081] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Signalling peer 20f7b7fec95c4907b8fabc47ea547ffe to start an election
I20260709 12:22:47.844410  6753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d"
dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
 from {username='slave'} at 127.0.0.1:54344
I20260709 12:22:47.844941  6753 raft_consensus.cc:493] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:47.845224  6753 raft_consensus.cc:3060] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:47.850134  6753 raft_consensus.cc:515] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:47.851621  6753 leader_election.cc:290] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 election: Requested vote from peers 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817), c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893)
I20260709 12:22:47.852528  6681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19599a3207e943748b36d4b4505ee334"
I20260709 12:22:47.852645  6946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447f8dfed7745d3888f713d4df03c5d" candidate_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:47.853407  6681 raft_consensus.cc:3055] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:47.853508  6946 raft_consensus.cc:3060] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:47.853844  6681 raft_consensus.cc:740] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:47.855139  6681 consensus_queue.cc:260] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:47.856772  6681 raft_consensus.cc:3060] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:47.861380  6946 raft_consensus.cc:2468] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 2.
I20260709 12:22:47.862679  6718 leader_election.cc:304] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20f7b7fec95c4907b8fabc47ea547ffe, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:47.863487  7069 raft_consensus.cc:2804] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:47.863972  7069 raft_consensus.cc:697] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 LEADER]: Becoming Leader. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:47.864892  6681 raft_consensus.cc:2468] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20f7b7fec95c4907b8fabc47ea547ffe in term 2.
I20260709 12:22:47.864933  7069 consensus_queue.cc:237] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:47.872417  6503 catalog_manager.cc:5697] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe reported cstate change: term changed from 1 to 2, leader changed from 19599a3207e943748b36d4b4505ee334 (127.26.205.130) to 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131). New cstate: current_term: 2 leader_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:47.901625  7068 raft_consensus.cc:993] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe: : Instructing follower 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:47.902063  7069 raft_consensus.cc:1081] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Signalling peer 19599a3207e943748b36d4b4505ee334 to start an election
I20260709 12:22:47.903394  6681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74"
dest_uuid: "19599a3207e943748b36d4b4505ee334"
 from {username='slave'} at 127.0.0.1:46028
I20260709 12:22:47.903820  6681 raft_consensus.cc:493] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:47.904059  6681 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:47.909219  6681 raft_consensus.cc:515] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:47.910907  6681 leader_election.cc:290] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 4 election: Requested vote from peers c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893), 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131:37607)
I20260709 12:22:47.911688  6947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0d2ea2a843343a9843407d627de9d91"
I20260709 12:22:47.912010  6753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6081970742dd4ec389b8df32ff80be74" candidate_uuid: "19599a3207e943748b36d4b4505ee334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20f7b7fec95c4907b8fabc47ea547ffe"
I20260709 12:22:47.912369  6947 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:47.912719  6753 raft_consensus.cc:3055] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:47.913034  6753 raft_consensus.cc:740] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20f7b7fec95c4907b8fabc47ea547ffe, State: Running, Role: LEADER
I20260709 12:22:47.913674  6753 consensus_queue.cc:260] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:47.914548  6753 raft_consensus.cc:3060] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:47.917608  6947 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 4.
I20260709 12:22:47.918617  6644 leader_election.cc:304] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19599a3207e943748b36d4b4505ee334, c0d2ea2a843343a9843407d627de9d91; no voters: 
I20260709 12:22:47.919180  6753 raft_consensus.cc:2468] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19599a3207e943748b36d4b4505ee334 in term 4.
I20260709 12:22:47.919283  7051 raft_consensus.cc:2804] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:47.919843  7051 raft_consensus.cc:697] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 4 LEADER]: Becoming Leader. State: Replica: 19599a3207e943748b36d4b4505ee334, State: Running, Role: LEADER
I20260709 12:22:47.920645  7051 consensus_queue.cc:237] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } }
I20260709 12:22:47.927791  6503 catalog_manager.cc:5697] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 reported cstate change: term changed from 3 to 4, leader changed from 20f7b7fec95c4907b8fabc47ea547ffe (127.26.205.131) to 19599a3207e943748b36d4b4505ee334 (127.26.205.130). New cstate: current_term: 4 leader_uuid: "19599a3207e943748b36d4b4505ee334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:48.262889  6552 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:22:48.363198 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.389400  6947 raft_consensus.cc:1275] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 4 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:48.390931  7051 consensus_queue.cc:1048] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0d2ea2a843343a9843407d627de9d91" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 43893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:48.392553 27446 tablet_server.cc:179] TabletServer@127.26.205.129:43893 shutting down...
W20260709 12:22:48.393798  6644 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 55 similar messages]
W20260709 12:22:48.399151  6644 consensus_peers.cc:597] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:48.408272  6644 consensus_peers.cc:597] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:48.415148  6718 consensus_peers.cc:597] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:48.422387 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:48.423261 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.423972 27446 raft_consensus.cc:2243] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.424532 27446 raft_consensus.cc:2272] T 4b79bcf2dba94a7db0382c9521fd8cdb P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.424772  6681 raft_consensus.cc:1275] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Refusing update from remote peer 20f7b7fec95c4907b8fabc47ea547ffe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:48.426285  7069 consensus_queue.cc:1048] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [LEADER]: Connected to new peer: Peer: permanent_uuid: "19599a3207e943748b36d4b4505ee334" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 44817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:48.426800 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.427479 27446 raft_consensus.cc:2243] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.427914 27446 raft_consensus.cc:2272] T dfc6a902d5cf43ac92f8a59a96687008 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.430295 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.431146 27446 raft_consensus.cc:2243] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:22:48.432817  6718 consensus_peers.cc:597] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:48.433923 27446 raft_consensus.cc:2272] T b8c08c3b93c940a0933076cf33c06c1c P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.436245 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.436869 27446 raft_consensus.cc:2243] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.437306 27446 raft_consensus.cc:2272] T 6fa519025a92435d80dfcae39fd33338 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.439261 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.440047 27446 raft_consensus.cc:2243] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.440680 27446 raft_consensus.cc:2272] T fd54b38b050946e78b2a467d33f9e262 P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.443174 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.443993 27446 raft_consensus.cc:2243] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.444566 27446 raft_consensus.cc:2272] T c88ea66150894013ba7d60ef9703f72b P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.448233 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.449052 27446 raft_consensus.cc:2243] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.449638 27446 raft_consensus.cc:2272] T 79b2bd0763a046f589c55245b0a97278 P c0d2ea2a843343a9843407d627de9d91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.450963  6753 raft_consensus.cc:1275] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 4 FOLLOWER]: Refusing update from remote peer 19599a3207e943748b36d4b4505ee334: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:48.452319 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.453128 27446 raft_consensus.cc:2243] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.453632 27446 raft_consensus.cc:2272] T f447f8dfed7745d3888f713d4df03c5d P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.455039  7051 consensus_queue.cc:1048] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f7b7fec95c4907b8fabc47ea547ffe" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 37607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:48.456132 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.456957 27446 raft_consensus.cc:2243] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.457453 27446 raft_consensus.cc:2272] T 5cd1d0a5dea54a12b2a486f051d53e9b P c0d2ea2a843343a9843407d627de9d91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.459856 27446 tablet_replica.cc:333] stopping tablet replica
I20260709 12:22:48.460392 27446 raft_consensus.cc:2243] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.460877 27446 raft_consensus.cc:2272] T 6081970742dd4ec389b8df32ff80be74 P c0d2ea2a843343a9843407d627de9d91 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:48.478643  6908 connection.cc:466] server connection from 127.0.0.1:42438 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42438 (request call id 62) could send its response
W20260709 12:22:48.482575  6644 consensus_peers.cc:597] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:48.492503 27446 tablet_server.cc:196] TabletServer@127.26.205.129:43893 shutdown complete.
I20260709 12:22:48.512917 27446 tablet_server.cc:179] TabletServer@127.26.205.130:0 shutting down...
I20260709 12:22:48.535969 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:48.536736 27446 tablet_replica.cc:333] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.537499 27446 raft_consensus.cc:2243] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.539000 27446 raft_consensus.cc:2272] T b8c08c3b93c940a0933076cf33c06c1c P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.541442 27446 tablet_replica.cc:333] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.542083 27446 raft_consensus.cc:2243] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.542867 27446 raft_consensus.cc:2272] T fd54b38b050946e78b2a467d33f9e262 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.545256 27446 tablet_replica.cc:333] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.545899 27446 raft_consensus.cc:2243] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.546406 27446 raft_consensus.cc:2272] T 6fa519025a92435d80dfcae39fd33338 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.548585 27446 tablet_replica.cc:333] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.549455 27446 raft_consensus.cc:2243] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.550437 27446 raft_consensus.cc:2272] T 6081970742dd4ec389b8df32ff80be74 P 19599a3207e943748b36d4b4505ee334 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.553151 27446 tablet_replica.cc:333] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.553715 27446 raft_consensus.cc:2243] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.554692 27446 raft_consensus.cc:2272] T 5cd1d0a5dea54a12b2a486f051d53e9b P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.556864 27446 tablet_replica.cc:333] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.557368 27446 raft_consensus.cc:2243] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.557790 27446 raft_consensus.cc:2272] T 4b79bcf2dba94a7db0382c9521fd8cdb P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.559844 27446 tablet_replica.cc:333] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.560396 27446 raft_consensus.cc:2243] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.560889 27446 raft_consensus.cc:2272] T dfc6a902d5cf43ac92f8a59a96687008 P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.563014 27446 tablet_replica.cc:333] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.563688 27446 raft_consensus.cc:2243] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.564100 27446 raft_consensus.cc:2272] T 79b2bd0763a046f589c55245b0a97278 P 19599a3207e943748b36d4b4505ee334 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.566190 27446 tablet_replica.cc:333] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.566705 27446 raft_consensus.cc:2243] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.567483 27446 raft_consensus.cc:2272] T c88ea66150894013ba7d60ef9703f72b P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.569656 27446 tablet_replica.cc:333] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334: stopping tablet replica
I20260709 12:22:48.570209 27446 raft_consensus.cc:2243] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.570617 27446 raft_consensus.cc:2272] T f447f8dfed7745d3888f713d4df03c5d P 19599a3207e943748b36d4b4505ee334 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:48.596726  6721 consensus_peers.cc:597] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817): Couldn't send request to peer 19599a3207e943748b36d4b4505ee334. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:44817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:48.603891  6721 consensus_peers.cc:597] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817): Couldn't send request to peer 19599a3207e943748b36d4b4505ee334. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:44817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:48.604715 27446 tablet_server.cc:196] TabletServer@127.26.205.130:0 shutdown complete.
W20260709 12:22:48.626497  6718 consensus_peers.cc:597] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer c0d2ea2a843343a9843407d627de9d91 (127.26.205.129:43893): Couldn't send request to peer c0d2ea2a843343a9843407d627de9d91. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:43893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:48.630188 27446 tablet_server.cc:179] TabletServer@127.26.205.131:0 shutting down...
I20260709 12:22:48.655089 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:48.655843 27446 tablet_replica.cc:333] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.657006 27446 raft_consensus.cc:2243] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.657619 27446 raft_consensus.cc:2272] T b8c08c3b93c940a0933076cf33c06c1c P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.660220 27446 tablet_replica.cc:333] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.660951 27446 raft_consensus.cc:2243] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.661401 27446 raft_consensus.cc:2272] T fd54b38b050946e78b2a467d33f9e262 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:48.663707  6721 consensus_peers.cc:597] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe -> Peer 19599a3207e943748b36d4b4505ee334 (127.26.205.130:44817): Couldn't send request to peer 19599a3207e943748b36d4b4505ee334. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:44817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:48.663832 27446 tablet_replica.cc:333] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.664732 27446 raft_consensus.cc:2243] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.665514 27446 raft_consensus.cc:2272] T 6fa519025a92435d80dfcae39fd33338 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.667708 27446 tablet_replica.cc:333] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.668246 27446 raft_consensus.cc:2243] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.669054 27446 raft_consensus.cc:2272] T f447f8dfed7745d3888f713d4df03c5d P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.671799 27446 tablet_replica.cc:333] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.672329 27446 raft_consensus.cc:2243] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.673143 27446 raft_consensus.cc:2272] T dfc6a902d5cf43ac92f8a59a96687008 P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.675189 27446 tablet_replica.cc:333] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.675695 27446 raft_consensus.cc:2243] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.676429 27446 raft_consensus.cc:2272] T 4b79bcf2dba94a7db0382c9521fd8cdb P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.678436 27446 tablet_replica.cc:333] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.678951 27446 raft_consensus.cc:2243] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.679724 27446 raft_consensus.cc:2272] T 79b2bd0763a046f589c55245b0a97278 P 20f7b7fec95c4907b8fabc47ea547ffe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.681957 27446 tablet_replica.cc:333] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.682468 27446 raft_consensus.cc:2243] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.682868 27446 raft_consensus.cc:2272] T c88ea66150894013ba7d60ef9703f72b P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.684944 27446 tablet_replica.cc:333] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.685460 27446 raft_consensus.cc:2243] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.685863 27446 raft_consensus.cc:2272] T 6081970742dd4ec389b8df32ff80be74 P 20f7b7fec95c4907b8fabc47ea547ffe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.688215 27446 tablet_replica.cc:333] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe: stopping tablet replica
I20260709 12:22:48.688849 27446 raft_consensus.cc:2243] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:48.689287 27446 raft_consensus.cc:2272] T 5cd1d0a5dea54a12b2a486f051d53e9b P 20f7b7fec95c4907b8fabc47ea547ffe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.721590 27446 tablet_server.cc:196] TabletServer@127.26.205.131:0 shutdown complete.
I20260709 12:22:48.747008 27446 master.cc:562] Master@127.26.205.190:33567 shutting down...
I20260709 12:22:48.776118 27446 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:48.776830 27446 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:48.777233 27446 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3e99dcfaf5e540d9a7c8f8e7f3a8b0ab: stopping tablet replica
I20260709 12:22:48.799310 27446 master.cc:584] Master@127.26.205.190:33567 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12720 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:22:48.842753 27446 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.205.190:36873
I20260709 12:22:48.843897 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:48.849458  7089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:48.849471  7088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:48.850560  7091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:48.853845 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:48.854755 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:48.854964 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:48.855125 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599768855108 us; error 0 us; skew 500 ppm
I20260709 12:22:48.855679 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:48.857893 27446 webserver.cc:533] Webserver started at http://127.26.205.190:45221/ using document root <none> and password file <none>
I20260709 12:22:48.858407 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:48.858610 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:48.858929 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:48.860041 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/master-0-root/instance:
uuid: "6e094e97f5f84aeea88ce2855e067a3d"
format_stamp: "Formatted at 2026-07-09 12:22:48 on dist-test-slave-673s"
I20260709 12:22:48.864590 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 12:22:48.867834  7096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:48.868703 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:48.869014 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/master-0-root
uuid: "6e094e97f5f84aeea88ce2855e067a3d"
format_stamp: "Formatted at 2026-07-09 12:22:48 on dist-test-slave-673s"
I20260709 12:22:48.869311 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:48.881968 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:48.883102 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:48.920389 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.190:36873
I20260709 12:22:48.920506  7147 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.190:36873 every 8 connection(s)
I20260709 12:22:48.924310  7148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:48.935528  7148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d: Bootstrap starting.
I20260709 12:22:48.940423  7148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.944640  7148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d: No bootstrap required, opened a new log
I20260709 12:22:48.946779  7148 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e094e97f5f84aeea88ce2855e067a3d" member_type: VOTER }
I20260709 12:22:48.947171  7148 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.947430  7148 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e094e97f5f84aeea88ce2855e067a3d, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.948093  7148 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e094e97f5f84aeea88ce2855e067a3d" member_type: VOTER }
I20260709 12:22:48.948567  7148 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:48.948787  7148 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:48.949061  7148 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.954002  7148 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e094e97f5f84aeea88ce2855e067a3d" member_type: VOTER }
I20260709 12:22:48.954599  7148 leader_election.cc:304] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e094e97f5f84aeea88ce2855e067a3d; no voters: 
I20260709 12:22:48.955816  7148 leader_election.cc:290] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:48.956193  7151 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.957657  7151 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 1 LEADER]: Becoming Leader. State: Replica: 6e094e97f5f84aeea88ce2855e067a3d, State: Running, Role: LEADER
I20260709 12:22:48.958341  7151 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e094e97f5f84aeea88ce2855e067a3d" member_type: VOTER }
I20260709 12:22:48.958688  7148 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:48.963238  7152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e094e97f5f84aeea88ce2855e067a3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e094e97f5f84aeea88ce2855e067a3d" member_type: VOTER } }
I20260709 12:22:48.963376  7153 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e094e97f5f84aeea88ce2855e067a3d. Latest consensus state: current_term: 1 leader_uuid: "6e094e97f5f84aeea88ce2855e067a3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e094e97f5f84aeea88ce2855e067a3d" member_type: VOTER } }
I20260709 12:22:48.964327  7153 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:48.964310  7152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:48.967790  7159 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:48.972869  7159 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:48.977056 27446 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:48.981593  7159 catalog_manager.cc:1383] Generated new cluster ID: cde149faa2fb4897ba0afe649352c48d
I20260709 12:22:48.981832  7159 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:49.007251  7159 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:49.008628  7159 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:49.026887  7159 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d: Generated new TSK 0
I20260709 12:22:49.027501  7159 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:49.043507 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:49.050170  7169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:49.051468  7170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:49.053005  7172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:49.053817 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:49.054967 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:49.055197 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:49.055380 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599769055359 us; error 0 us; skew 500 ppm
I20260709 12:22:49.055992 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:49.058357 27446 webserver.cc:533] Webserver started at http://127.26.205.129:41541/ using document root <none> and password file <none>
I20260709 12:22:49.058864 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:49.059063 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:49.059333 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:49.060546 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-0-root/instance:
uuid: "bc6fc01b370e41bbb96589b0d0f191da"
format_stamp: "Formatted at 2026-07-09 12:22:49 on dist-test-slave-673s"
I20260709 12:22:49.065157 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:22:49.069036  7177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.069772 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:49.070084 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "bc6fc01b370e41bbb96589b0d0f191da"
format_stamp: "Formatted at 2026-07-09 12:22:49 on dist-test-slave-673s"
I20260709 12:22:49.070372 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:49.099327 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:49.100610 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:49.102149 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:49.104413 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:49.104632 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.104897 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:49.105059 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.145043 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:39783
I20260709 12:22:49.145143  7239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:39783 every 8 connection(s)
I20260709 12:22:49.150095 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:49.157694  7244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:49.159303  7245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:49.161448 27446 server_base.cc:1061] running on GCE node
W20260709 12:22:49.162585  7247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:49.163767 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:49.164091 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:49.164276  7240 heartbeater.cc:344] Connected to a master server at 127.26.205.190:36873
I20260709 12:22:49.164332 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599769164313 us; error 0 us; skew 500 ppm
I20260709 12:22:49.164855  7240 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:49.165282 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:49.165717  7240 heartbeater.cc:507] Master 127.26.205.190:36873 requested a full tablet report, sending...
I20260709 12:22:49.168100 27446 webserver.cc:533] Webserver started at http://127.26.205.130:43955/ using document root <none> and password file <none>
I20260709 12:22:49.168326  7113 ts_manager.cc:194] Registered new tserver with Master: bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783)
I20260709 12:22:49.168854 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:49.169139 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:49.169458 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:49.170849  7113 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40760
I20260709 12:22:49.170982 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-1-root/instance:
uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
format_stamp: "Formatted at 2026-07-09 12:22:49 on dist-test-slave-673s"
I20260709 12:22:49.175721 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:22:49.178996  7252 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.179744 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:49.180037 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-1-root
uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
format_stamp: "Formatted at 2026-07-09 12:22:49 on dist-test-slave-673s"
I20260709 12:22:49.180321 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:49.198033 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:49.199278 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:49.200790 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:49.202963 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:49.203192 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.203436 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:49.203606 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.243314 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.130:34665
I20260709 12:22:49.243440  7314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.130:34665 every 8 connection(s)
I20260709 12:22:49.248286 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:49.285205  7319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:49.286770  7320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:49.292212  7315 heartbeater.cc:344] Connected to a master server at 127.26.205.190:36873
I20260709 12:22:49.292973  7315 heartbeater.cc:461] Registering TS with master...
W20260709 12:22:49.293815  7322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:49.294008 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:49.294266  7315 heartbeater.cc:507] Master 127.26.205.190:36873 requested a full tablet report, sending...
I20260709 12:22:49.295535 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:49.295805 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:49.296036 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599769296014 us; error 0 us; skew 500 ppm
I20260709 12:22:49.296840 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:49.297474  7113 ts_manager.cc:194] Registered new tserver with Master: ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665)
I20260709 12:22:49.299553  7113 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40772
I20260709 12:22:49.300410 27446 webserver.cc:533] Webserver started at http://127.26.205.131:44195/ using document root <none> and password file <none>
I20260709 12:22:49.301190 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:49.301541 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:49.301972 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:49.303849 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-2-root/instance:
uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
format_stamp: "Formatted at 2026-07-09 12:22:49 on dist-test-slave-673s"
I20260709 12:22:49.308878 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:22:49.312570  7327 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.313400 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:22:49.313717 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-2-root
uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
format_stamp: "Formatted at 2026-07-09 12:22:49 on dist-test-slave-673s"
I20260709 12:22:49.314009 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599367894863-27446-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:49.326296 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:49.327623 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:49.329255 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:49.331738 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:49.331928 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.332260 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:49.332423 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:49.379586 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.131:41293
I20260709 12:22:49.379721  7389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.131:41293 every 8 connection(s)
I20260709 12:22:49.397208  7390 heartbeater.cc:344] Connected to a master server at 127.26.205.190:36873
I20260709 12:22:49.397738  7390 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:49.398612  7390 heartbeater.cc:507] Master 127.26.205.190:36873 requested a full tablet report, sending...
I20260709 12:22:49.400780  7113 ts_manager.cc:194] Registered new tserver with Master: d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131:41293)
I20260709 12:22:49.401415 27446 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017273973s
I20260709 12:22:49.402333  7113 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40788
I20260709 12:22:49.429351  7113 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40796:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:49.431773  7113 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:49.492686  7204 tablet_service.cc:1511] Processing CreateTablet for tablet 8b93df4487d548288d9d5a84416ba85d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e8e9b255df8a47b4b87589e1a3963ef4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:49.492690  7205 tablet_service.cc:1511] Processing CreateTablet for tablet 305b02ffd80c42119c5fbf7d5e49a4ae (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e8e9b255df8a47b4b87589e1a3963ef4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:49.494626  7204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b93df4487d548288d9d5a84416ba85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.495311  7205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b02ffd80c42119c5fbf7d5e49a4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.502439  7355 tablet_service.cc:1511] Processing CreateTablet for tablet 305b02ffd80c42119c5fbf7d5e49a4ae (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e8e9b255df8a47b4b87589e1a3963ef4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:49.504053  7355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b02ffd80c42119c5fbf7d5e49a4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.509770  7354 tablet_service.cc:1511] Processing CreateTablet for tablet 8b93df4487d548288d9d5a84416ba85d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e8e9b255df8a47b4b87589e1a3963ef4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:49.511363  7354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b93df4487d548288d9d5a84416ba85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.518144  7279 tablet_service.cc:1511] Processing CreateTablet for tablet 8b93df4487d548288d9d5a84416ba85d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e8e9b255df8a47b4b87589e1a3963ef4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:49.519968  7279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b93df4487d548288d9d5a84416ba85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.515925  7280 tablet_service.cc:1511] Processing CreateTablet for tablet 305b02ffd80c42119c5fbf7d5e49a4ae (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e8e9b255df8a47b4b87589e1a3963ef4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:49.521529  7280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b02ffd80c42119c5fbf7d5e49a4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.541671  7406 tablet_bootstrap.cc:492] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e: Bootstrap starting.
I20260709 12:22:49.550784  7406 tablet_bootstrap.cc:654] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.561921  7405 tablet_bootstrap.cc:492] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da: Bootstrap starting.
I20260709 12:22:49.564600  7408 tablet_bootstrap.cc:492] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e: Bootstrap starting.
I20260709 12:22:49.566527  7406 tablet_bootstrap.cc:492] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e: No bootstrap required, opened a new log
I20260709 12:22:49.567167  7406 ts_tablet_manager.cc:1403] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 12:22:49.569507  7405 tablet_bootstrap.cc:654] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.571336  7406 raft_consensus.cc:359] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.572624  7406 raft_consensus.cc:385] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.573022  7406 raft_consensus.cc:740] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.573523  7408 tablet_bootstrap.cc:654] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.574724  7405 tablet_bootstrap.cc:492] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da: No bootstrap required, opened a new log
I20260709 12:22:49.574088  7406 consensus_queue.cc:260] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.575210  7405 ts_tablet_manager.cc:1403] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 12:22:49.577196  7390 heartbeater.cc:499] Master 127.26.205.190:36873 was elected leader, sending a full tablet report...
I20260709 12:22:49.577867  7406 ts_tablet_manager.cc:1434] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:22:49.578334  7405 raft_consensus.cc:359] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.579108  7405 raft_consensus.cc:385] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.579192  7406 tablet_bootstrap.cc:492] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e: Bootstrap starting.
I20260709 12:22:49.579449  7405 raft_consensus.cc:740] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6fc01b370e41bbb96589b0d0f191da, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.580477  7405 consensus_queue.cc:260] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.583038  7405 ts_tablet_manager.cc:1434] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.007s
I20260709 12:22:49.583086  7240 heartbeater.cc:499] Master 127.26.205.190:36873 was elected leader, sending a full tablet report...
I20260709 12:22:49.583930  7405 tablet_bootstrap.cc:492] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da: Bootstrap starting.
I20260709 12:22:49.588019  7406 tablet_bootstrap.cc:654] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.591003  7405 tablet_bootstrap.cc:654] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.597580  7406 tablet_bootstrap.cc:492] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e: No bootstrap required, opened a new log
I20260709 12:22:49.598156  7406 ts_tablet_manager.cc:1403] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:22:49.601599  7406 raft_consensus.cc:359] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.602414  7406 raft_consensus.cc:385] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.602736  7406 raft_consensus.cc:740] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.604471  7406 consensus_queue.cc:260] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.606673  7408 tablet_bootstrap.cc:492] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e: No bootstrap required, opened a new log
I20260709 12:22:49.607309  7408 ts_tablet_manager.cc:1403] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.009s
I20260709 12:22:49.608088  7406 ts_tablet_manager.cc:1434] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:22:49.611440  7405 tablet_bootstrap.cc:492] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da: No bootstrap required, opened a new log
I20260709 12:22:49.611104  7408 raft_consensus.cc:359] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.611971  7405 ts_tablet_manager.cc:1403] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 12:22:49.612049  7408 raft_consensus.cc:385] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.612540  7408 raft_consensus.cc:740] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2e421b9c984aed970bf86f23ee1e4e, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.613472  7408 consensus_queue.cc:260] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.614749  7405 raft_consensus.cc:359] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.615422  7405 raft_consensus.cc:385] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.615744  7405 raft_consensus.cc:740] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6fc01b370e41bbb96589b0d0f191da, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.616426  7315 heartbeater.cc:499] Master 127.26.205.190:36873 was elected leader, sending a full tablet report...
I20260709 12:22:49.617259  7408 ts_tablet_manager.cc:1434] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 12:22:49.618507  7408 tablet_bootstrap.cc:492] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e: Bootstrap starting.
I20260709 12:22:49.617352  7405 consensus_queue.cc:260] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.621827  7405 ts_tablet_manager.cc:1434] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:22:49.626313  7408 tablet_bootstrap.cc:654] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.632375  7408 tablet_bootstrap.cc:492] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e: No bootstrap required, opened a new log
I20260709 12:22:49.632941  7408 ts_tablet_manager.cc:1403] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 12:22:49.635421  7408 raft_consensus.cc:359] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.636049  7408 raft_consensus.cc:385] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.636317  7408 raft_consensus.cc:740] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2e421b9c984aed970bf86f23ee1e4e, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.637176  7408 consensus_queue.cc:260] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.638876  7408 ts_tablet_manager.cc:1434] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:49.649575  7410 raft_consensus.cc:493] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.650278  7410 raft_consensus.cc:515] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.652740  7410 leader_election.cc:290] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783), ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665)
I20260709 12:22:49.663676  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b93df4487d548288d9d5a84416ba85d" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da" is_pre_election: true
I20260709 12:22:49.664817  7215 raft_consensus.cc:2468] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 0.
I20260709 12:22:49.665373  7290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b93df4487d548288d9d5a84416ba85d" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" is_pre_election: true
I20260709 12:22:49.666018  7290 raft_consensus.cc:2468] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 0.
I20260709 12:22:49.666141  7328 leader_election.cc:304] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc6fc01b370e41bbb96589b0d0f191da, d01edb7b8a8a4ffc944843a20f624e4e; no voters: 
I20260709 12:22:49.667119  7410 raft_consensus.cc:2804] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.667450  7410 raft_consensus.cc:493] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.667716  7410 raft_consensus.cc:3060] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.674463  7410 raft_consensus.cc:515] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.676011  7410 leader_election.cc:290] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 1 election: Requested vote from peers bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783), ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665)
I20260709 12:22:49.676982  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b93df4487d548288d9d5a84416ba85d" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
I20260709 12:22:49.677323  7290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b93df4487d548288d9d5a84416ba85d" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
I20260709 12:22:49.677533  7215 raft_consensus.cc:3060] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.677994  7290 raft_consensus.cc:3060] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.684219  7215 raft_consensus.cc:2468] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 1.
I20260709 12:22:49.685292  7290 raft_consensus.cc:2468] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 1.
I20260709 12:22:49.685355  7328 leader_election.cc:304] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc6fc01b370e41bbb96589b0d0f191da, d01edb7b8a8a4ffc944843a20f624e4e; no voters: 
I20260709 12:22:49.686357  7410 raft_consensus.cc:2804] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.687218  7410 raft_consensus.cc:697] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Becoming Leader. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Running, Role: LEADER
I20260709 12:22:49.688136  7410 consensus_queue.cc:237] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.697268  7111 catalog_manager.cc:5697] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e reported cstate change: term changed from 0 to 1, leader changed from <none> to d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.806150  7415 raft_consensus.cc:493] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.806713  7415 raft_consensus.cc:515] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.808947  7415 leader_election.cc:290] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783), d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131:41293)
I20260709 12:22:49.820719  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b02ffd80c42119c5fbf7d5e49a4ae" candidate_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da" is_pre_election: true
I20260709 12:22:49.821292  7365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b02ffd80c42119c5fbf7d5e49a4ae" candidate_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" is_pre_election: true
I20260709 12:22:49.821420  7215 raft_consensus.cc:2468] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2e421b9c984aed970bf86f23ee1e4e in term 0.
I20260709 12:22:49.821949  7365 raft_consensus.cc:2468] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2e421b9c984aed970bf86f23ee1e4e in term 0.
I20260709 12:22:49.822646  7253 leader_election.cc:304] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2e421b9c984aed970bf86f23ee1e4e, bc6fc01b370e41bbb96589b0d0f191da; no voters: 
I20260709 12:22:49.823551  7415 raft_consensus.cc:2804] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.823901  7415 raft_consensus.cc:493] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.824133  7415 raft_consensus.cc:3060] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.830148  7415 raft_consensus.cc:515] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.832113  7415 leader_election.cc:290] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [CANDIDATE]: Term 1 election: Requested vote from peers bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783), d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131:41293)
I20260709 12:22:49.832660  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b02ffd80c42119c5fbf7d5e49a4ae" candidate_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
I20260709 12:22:49.833215  7365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b02ffd80c42119c5fbf7d5e49a4ae" candidate_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
I20260709 12:22:49.833284  7215 raft_consensus.cc:3060] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.833794  7365 raft_consensus.cc:3060] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.838639  7215 raft_consensus.cc:2468] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2e421b9c984aed970bf86f23ee1e4e in term 1.
I20260709 12:22:49.839789  7253 leader_election.cc:304] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2e421b9c984aed970bf86f23ee1e4e, bc6fc01b370e41bbb96589b0d0f191da; no voters: 
I20260709 12:22:49.840342  7365 raft_consensus.cc:2468] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2e421b9c984aed970bf86f23ee1e4e in term 1.
I20260709 12:22:49.840718  7415 raft_consensus.cc:2804] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.841840  7415 raft_consensus.cc:697] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 1 LEADER]: Becoming Leader. State: Replica: ad2e421b9c984aed970bf86f23ee1e4e, State: Running, Role: LEADER
I20260709 12:22:49.842583  7415 consensus_queue.cc:237] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.849660  7111 catalog_manager.cc:5697] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130). New cstate: current_term: 1 leader_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.900146  7111 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40802:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:49.902508  7111 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:49.925691  7205 tablet_service.cc:1511] Processing CreateTablet for tablet a8ed393dd39d418889948f96b70599c3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=733e59b8d0e64723bf4fcdca00e85244]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:49.926998  7205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ed393dd39d418889948f96b70599c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.927248  7279 tablet_service.cc:1511] Processing CreateTablet for tablet a8ed393dd39d418889948f96b70599c3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=733e59b8d0e64723bf4fcdca00e85244]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:49.928524  7279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ed393dd39d418889948f96b70599c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.928750  7354 tablet_service.cc:1511] Processing CreateTablet for tablet a8ed393dd39d418889948f96b70599c3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=733e59b8d0e64723bf4fcdca00e85244]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:22:49.930095  7354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ed393dd39d418889948f96b70599c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.930617  7204 tablet_service.cc:1511] Processing CreateTablet for tablet 5150c1fc0cc44481b95d96ffd6157cfe (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=733e59b8d0e64723bf4fcdca00e85244]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:49.931869  7204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5150c1fc0cc44481b95d96ffd6157cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.944048  7405 tablet_bootstrap.cc:492] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da: Bootstrap starting.
I20260709 12:22:49.944099  7280 tablet_service.cc:1511] Processing CreateTablet for tablet 5150c1fc0cc44481b95d96ffd6157cfe (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=733e59b8d0e64723bf4fcdca00e85244]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:49.944867  7408 tablet_bootstrap.cc:492] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e: Bootstrap starting.
I20260709 12:22:49.946223  7280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5150c1fc0cc44481b95d96ffd6157cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.950964  7405 tablet_bootstrap.cc:654] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.953125  7408 tablet_bootstrap.cc:654] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.954806  7406 tablet_bootstrap.cc:492] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e: Bootstrap starting.
I20260709 12:22:49.966157  7405 tablet_bootstrap.cc:492] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da: No bootstrap required, opened a new log
I20260709 12:22:49.966785  7405 ts_tablet_manager.cc:1403] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.012s
I20260709 12:22:49.967628  7354 tablet_service.cc:1511] Processing CreateTablet for tablet 5150c1fc0cc44481b95d96ffd6157cfe (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=733e59b8d0e64723bf4fcdca00e85244]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:22:49.968997  7354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5150c1fc0cc44481b95d96ffd6157cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:49.969962  7405 raft_consensus.cc:359] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
W20260709 12:22:49.972604  7161 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:49.972842  7405 raft_consensus.cc:385] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.973232  7405 raft_consensus.cc:740] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6fc01b370e41bbb96589b0d0f191da, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.973450  7406 tablet_bootstrap.cc:654] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.973937  7405 consensus_queue.cc:260] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.981765  7405 ts_tablet_manager.cc:1434] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 12:22:49.982865  7405 tablet_bootstrap.cc:492] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da: Bootstrap starting.
I20260709 12:22:49.989606  7411 raft_consensus.cc:493] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.990167  7408 tablet_bootstrap.cc:492] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e: No bootstrap required, opened a new log
I20260709 12:22:49.990132  7411 raft_consensus.cc:515] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.990772  7408 ts_tablet_manager.cc:1403] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.005s
I20260709 12:22:49.993799  7411 leader_election.cc:290] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665), d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131:41293)
I20260709 12:22:49.994547  7406 tablet_bootstrap.cc:492] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e: No bootstrap required, opened a new log
I20260709 12:22:49.994141  7408 raft_consensus.cc:359] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:49.994983  7408 raft_consensus.cc:385] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.995100  7406 ts_tablet_manager.cc:1403] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.010s
I20260709 12:22:49.995349  7408 raft_consensus.cc:740] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2e421b9c984aed970bf86f23ee1e4e, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.996013  7405 tablet_bootstrap.cc:654] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.996268  7408 consensus_queue.cc:260] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.000037  7406 raft_consensus.cc:359] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.001160  7406 raft_consensus.cc:385] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.001549  7406 raft_consensus.cc:740] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.003034  7408 ts_tablet_manager.cc:1434] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:22:50.002763  7406 consensus_queue.cc:260] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.004204  7408 tablet_bootstrap.cc:492] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e: Bootstrap starting.
I20260709 12:22:50.009002  7406 ts_tablet_manager.cc:1434] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:22:50.010557  7406 tablet_bootstrap.cc:492] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e: Bootstrap starting.
I20260709 12:22:50.019475  7406 tablet_bootstrap.cc:654] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:50.030961  7408 tablet_bootstrap.cc:654] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:50.043282  7365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ed393dd39d418889948f96b70599c3" candidate_uuid: "bc6fc01b370e41bbb96589b0d0f191da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" is_pre_election: true
I20260709 12:22:50.044085  7365 raft_consensus.cc:2468] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc6fc01b370e41bbb96589b0d0f191da in term 0.
I20260709 12:22:50.044299  7290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ed393dd39d418889948f96b70599c3" candidate_uuid: "bc6fc01b370e41bbb96589b0d0f191da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" is_pre_election: true
I20260709 12:22:50.044718  7406 tablet_bootstrap.cc:492] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e: No bootstrap required, opened a new log
I20260709 12:22:50.045039  7290 raft_consensus.cc:2468] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc6fc01b370e41bbb96589b0d0f191da in term 0.
I20260709 12:22:50.045238  7406 ts_tablet_manager.cc:1403] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.011s
I20260709 12:22:50.045699  7181 leader_election.cc:304] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc6fc01b370e41bbb96589b0d0f191da, d01edb7b8a8a4ffc944843a20f624e4e; no voters: 
I20260709 12:22:50.046002  7408 tablet_bootstrap.cc:492] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e: No bootstrap required, opened a new log
I20260709 12:22:50.046657  7408 ts_tablet_manager.cc:1403] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.005s
I20260709 12:22:50.047000  7411 raft_consensus.cc:2804] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:50.047459  7411 raft_consensus.cc:493] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.047818  7411 raft_consensus.cc:3060] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:50.048112  7405 tablet_bootstrap.cc:492] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da: No bootstrap required, opened a new log
I20260709 12:22:50.048689  7405 ts_tablet_manager.cc:1403] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da: Time spent bootstrapping tablet: real 0.066s	user 0.034s	sys 0.021s
I20260709 12:22:50.048607  7406 raft_consensus.cc:359] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.049530  7406 raft_consensus.cc:385] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.049856  7406 raft_consensus.cc:740] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.050534  7408 raft_consensus.cc:359] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.050812  7406 consensus_queue.cc:260] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.051394  7408 raft_consensus.cc:385] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.051854  7408 raft_consensus.cc:740] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2e421b9c984aed970bf86f23ee1e4e, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.051923  7405 raft_consensus.cc:359] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.052724  7405 raft_consensus.cc:385] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.053211  7405 raft_consensus.cc:740] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6fc01b370e41bbb96589b0d0f191da, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.052977  7408 consensus_queue.cc:260] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.054157  7405 consensus_queue.cc:260] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.056635  7406 ts_tablet_manager.cc:1434] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.006s
I20260709 12:22:50.058490  7408 ts_tablet_manager.cc:1434] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:22:50.059469  7405 ts_tablet_manager.cc:1434] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 12:22:50.064738  7411 raft_consensus.cc:515] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.067543  7411 leader_election.cc:290] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [CANDIDATE]: Term 1 election: Requested vote from peers ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665), d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131:41293)
I20260709 12:22:50.068153  7365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ed393dd39d418889948f96b70599c3" candidate_uuid: "bc6fc01b370e41bbb96589b0d0f191da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
I20260709 12:22:50.068409  7290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ed393dd39d418889948f96b70599c3" candidate_uuid: "bc6fc01b370e41bbb96589b0d0f191da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
I20260709 12:22:50.068814  7365 raft_consensus.cc:3060] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:50.069047  7290 raft_consensus.cc:3060] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:50.076094  7290 raft_consensus.cc:2468] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc6fc01b370e41bbb96589b0d0f191da in term 1.
I20260709 12:22:50.076643  7365 raft_consensus.cc:2468] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc6fc01b370e41bbb96589b0d0f191da in term 1.
I20260709 12:22:50.077450  7178 leader_election.cc:304] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2e421b9c984aed970bf86f23ee1e4e, bc6fc01b370e41bbb96589b0d0f191da; no voters: 
I20260709 12:22:50.078358  7411 raft_consensus.cc:2804] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:50.078804  7411 raft_consensus.cc:697] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 1 LEADER]: Becoming Leader. State: Replica: bc6fc01b370e41bbb96589b0d0f191da, State: Running, Role: LEADER
I20260709 12:22:50.079599  7411 consensus_queue.cc:237] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.086494  7110 catalog_manager.cc:5697] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da reported cstate change: term changed from 0 to 1, leader changed from <none> to bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129). New cstate: current_term: 1 leader_uuid: "bc6fc01b370e41bbb96589b0d0f191da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.162214  7410 consensus_queue.cc:1048] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:50.174218  7418 consensus_queue.cc:1048] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:50.174544  7442 raft_consensus.cc:493] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.175150  7442 raft_consensus.cc:515] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.177350  7442 leader_election.cc:290] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783), ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665)
I20260709 12:22:50.178898  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150c1fc0cc44481b95d96ffd6157cfe" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da" is_pre_election: true
I20260709 12:22:50.179116  7289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150c1fc0cc44481b95d96ffd6157cfe" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" is_pre_election: true
I20260709 12:22:50.179798  7215 raft_consensus.cc:2468] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 0.
I20260709 12:22:50.179906  7289 raft_consensus.cc:2468] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 0.
I20260709 12:22:50.181025  7328 leader_election.cc:304] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc6fc01b370e41bbb96589b0d0f191da, d01edb7b8a8a4ffc944843a20f624e4e; no voters: 
I20260709 12:22:50.181891  7418 raft_consensus.cc:2804] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:50.182281  7418 raft_consensus.cc:493] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.182622  7418 raft_consensus.cc:3060] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:50.190909  7418 raft_consensus.cc:515] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.192821  7418 leader_election.cc:290] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 1 election: Requested vote from peers bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783), ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665)
I20260709 12:22:50.193513  7215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150c1fc0cc44481b95d96ffd6157cfe" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
I20260709 12:22:50.193794  7290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150c1fc0cc44481b95d96ffd6157cfe" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
I20260709 12:22:50.194180  7215 raft_consensus.cc:3060] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:50.194448  7290 raft_consensus.cc:3060] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:50.199805  7290 raft_consensus.cc:2468] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 1.
I20260709 12:22:50.200405  7215 raft_consensus.cc:2468] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 1.
I20260709 12:22:50.200729  7328 leader_election.cc:304] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2e421b9c984aed970bf86f23ee1e4e, d01edb7b8a8a4ffc944843a20f624e4e; no voters: 
I20260709 12:22:50.201632  7418 raft_consensus.cc:2804] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:50.202080  7418 raft_consensus.cc:697] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Becoming Leader. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Running, Role: LEADER
I20260709 12:22:50.202805  7418 consensus_queue.cc:237] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.210177  7111 catalog_manager.cc:5697] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e reported cstate change: term changed from 0 to 1, leader changed from <none> to d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:50.237192  7290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "305b02ffd80c42119c5fbf7d5e49a4ae"
dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
mode: GRACEFUL
new_leader_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
 from {username='slave'} at 127.0.0.1:47880
I20260709 12:22:50.237805  7290 raft_consensus.cc:606] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 1 LEADER]: Received request to transfer leadership to TS bc6fc01b370e41bbb96589b0d0f191da
I20260709 12:22:50.249423  7415 consensus_queue.cc:1048] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:50.252298  7364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b93df4487d548288d9d5a84416ba85d"
dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
mode: GRACEFUL
new_leader_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
 from {username='slave'} at 127.0.0.1:33508
I20260709 12:22:50.253096  7364 raft_consensus.cc:606] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Received request to transfer leadership to TS ad2e421b9c984aed970bf86f23ee1e4e
I20260709 12:22:50.263764  7449 consensus_queue.cc:1048] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:50.269053  7365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5150c1fc0cc44481b95d96ffd6157cfe"
dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
mode: GRACEFUL
new_leader_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
 from {username='slave'} at 127.0.0.1:33508
I20260709 12:22:50.269731  7365 raft_consensus.cc:606] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Received request to transfer leadership to TS bc6fc01b370e41bbb96589b0d0f191da
I20260709 12:22:50.273980  7415 raft_consensus.cc:993] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e: : Instructing follower bc6fc01b370e41bbb96589b0d0f191da to start an election
I20260709 12:22:50.274480  7449 raft_consensus.cc:1081] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 1 LEADER]: Signalling peer bc6fc01b370e41bbb96589b0d0f191da to start an election
I20260709 12:22:50.276043  7215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "305b02ffd80c42119c5fbf7d5e49a4ae"
dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
 from {username='slave'} at 127.0.0.1:51270
I20260709 12:22:50.276729  7215 raft_consensus.cc:493] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.277137  7215 raft_consensus.cc:3060] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.283453  7215 raft_consensus.cc:515] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.285490  7215 leader_election.cc:290] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [CANDIDATE]: Term 2 election: Requested vote from peers ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665), d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131:41293)
I20260709 12:22:50.286199  7290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b02ffd80c42119c5fbf7d5e49a4ae" candidate_uuid: "bc6fc01b370e41bbb96589b0d0f191da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
I20260709 12:22:50.286893  7290 raft_consensus.cc:3055] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.287246  7290 raft_consensus.cc:740] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2e421b9c984aed970bf86f23ee1e4e, State: Running, Role: LEADER
I20260709 12:22:50.287936  7290 consensus_queue.cc:260] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.288941  7290 raft_consensus.cc:3060] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.287001  7365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305b02ffd80c42119c5fbf7d5e49a4ae" candidate_uuid: "bc6fc01b370e41bbb96589b0d0f191da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
I20260709 12:22:50.290036  7365 raft_consensus.cc:3060] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.295466  7290 raft_consensus.cc:2468] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc6fc01b370e41bbb96589b0d0f191da in term 2.
I20260709 12:22:50.296634  7365 raft_consensus.cc:2468] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc6fc01b370e41bbb96589b0d0f191da in term 2.
I20260709 12:22:50.296650  7178 leader_election.cc:304] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2e421b9c984aed970bf86f23ee1e4e, bc6fc01b370e41bbb96589b0d0f191da; no voters: 
I20260709 12:22:50.297667  7411 raft_consensus.cc:2804] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.298141  7411 raft_consensus.cc:697] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 2 LEADER]: Becoming Leader. State: Replica: bc6fc01b370e41bbb96589b0d0f191da, State: Running, Role: LEADER
I20260709 12:22:50.299014  7411 consensus_queue.cc:237] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.306519  7111 catalog_manager.cc:5697] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da reported cstate change: term changed from 1 to 2, leader changed from ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130) to bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129). New cstate: current_term: 2 leader_uuid: "bc6fc01b370e41bbb96589b0d0f191da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.482066  7411 consensus_queue.cc:1048] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:50.493631  7438 consensus_queue.cc:1048] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:50.642735  7418 consensus_queue.cc:1048] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:50.655360  7410 consensus_queue.cc:1048] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:50.662879  7455 raft_consensus.cc:993] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e: : Instructing follower bc6fc01b370e41bbb96589b0d0f191da to start an election
I20260709 12:22:50.663400  7410 raft_consensus.cc:1081] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Signalling peer bc6fc01b370e41bbb96589b0d0f191da to start an election
I20260709 12:22:50.664953  7215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5150c1fc0cc44481b95d96ffd6157cfe"
dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
 from {username='slave'} at 127.0.0.1:51262
I20260709 12:22:50.665465  7215 raft_consensus.cc:493] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.665848  7215 raft_consensus.cc:3060] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.671329  7215 raft_consensus.cc:515] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.673290  7215 leader_election.cc:290] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [CANDIDATE]: Term 2 election: Requested vote from peers ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665), d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131:41293)
I20260709 12:22:50.674036  7290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150c1fc0cc44481b95d96ffd6157cfe" candidate_uuid: "bc6fc01b370e41bbb96589b0d0f191da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
I20260709 12:22:50.674479  7365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5150c1fc0cc44481b95d96ffd6157cfe" candidate_uuid: "bc6fc01b370e41bbb96589b0d0f191da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
I20260709 12:22:50.674758  7290 raft_consensus.cc:3060] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.675213  7365 raft_consensus.cc:3055] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.675523  7365 raft_consensus.cc:740] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Running, Role: LEADER
I20260709 12:22:50.676285  7365 consensus_queue.cc:260] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.677433  7365 raft_consensus.cc:3060] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.681152  7290 raft_consensus.cc:2468] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc6fc01b370e41bbb96589b0d0f191da in term 2.
I20260709 12:22:50.682384  7178 leader_election.cc:304] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2e421b9c984aed970bf86f23ee1e4e, bc6fc01b370e41bbb96589b0d0f191da; no voters: 
I20260709 12:22:50.683108  7438 raft_consensus.cc:2804] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.683023  7365 raft_consensus.cc:2468] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc6fc01b370e41bbb96589b0d0f191da in term 2.
I20260709 12:22:50.683760  7438 raft_consensus.cc:697] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 2 LEADER]: Becoming Leader. State: Replica: bc6fc01b370e41bbb96589b0d0f191da, State: Running, Role: LEADER
I20260709 12:22:50.684650  7438 consensus_queue.cc:237] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.690460  7111 catalog_manager.cc:5697] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da reported cstate change: term changed from 1 to 2, leader changed from d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131) to bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129). New cstate: current_term: 2 leader_uuid: "bc6fc01b370e41bbb96589b0d0f191da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.755328  7455 raft_consensus.cc:993] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e: : Instructing follower ad2e421b9c984aed970bf86f23ee1e4e to start an election
I20260709 12:22:50.755821  7410 raft_consensus.cc:1081] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Signalling peer ad2e421b9c984aed970bf86f23ee1e4e to start an election
I20260709 12:22:50.757457  7290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b93df4487d548288d9d5a84416ba85d"
dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
 from {username='slave'} at 127.0.0.1:47872
I20260709 12:22:50.758021  7290 raft_consensus.cc:493] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:50.758397  7290 raft_consensus.cc:3060] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.763587  7290 raft_consensus.cc:515] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.765480  7290 leader_election.cc:290] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [CANDIDATE]: Term 2 election: Requested vote from peers bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783), d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131:41293)
I20260709 12:22:50.766299  7214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b93df4487d548288d9d5a84416ba85d" candidate_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
I20260709 12:22:50.766626  7365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b93df4487d548288d9d5a84416ba85d" candidate_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
I20260709 12:22:50.767040  7214 raft_consensus.cc:3060] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.767558  7365 raft_consensus.cc:3055] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:50.767825  7365 raft_consensus.cc:740] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Running, Role: LEADER
I20260709 12:22:50.768532  7365 consensus_queue.cc:260] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.769467  7365 raft_consensus.cc:3060] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:50.773471  7214 raft_consensus.cc:2468] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2e421b9c984aed970bf86f23ee1e4e in term 2.
I20260709 12:22:50.774657  7253 leader_election.cc:304] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2e421b9c984aed970bf86f23ee1e4e, bc6fc01b370e41bbb96589b0d0f191da; no voters: 
I20260709 12:22:50.774998  7365 raft_consensus.cc:2468] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2e421b9c984aed970bf86f23ee1e4e in term 2.
I20260709 12:22:50.775607  7449 raft_consensus.cc:2804] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:50.776732  7449 raft_consensus.cc:697] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 2 LEADER]: Becoming Leader. State: Replica: ad2e421b9c984aed970bf86f23ee1e4e, State: Running, Role: LEADER
I20260709 12:22:50.777447  7449 consensus_queue.cc:237] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:50.783321  7111 catalog_manager.cc:5697] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e reported cstate change: term changed from 1 to 2, leader changed from d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131) to ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130). New cstate: current_term: 2 leader_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:50.843468  7290 raft_consensus.cc:1275] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Refusing update from remote peer bc6fc01b370e41bbb96589b0d0f191da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.844844  7438 consensus_queue.cc:1048] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.853977  7365 raft_consensus.cc:1275] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Refusing update from remote peer bc6fc01b370e41bbb96589b0d0f191da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:50.855649  7452 consensus_queue.cc:1048] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:50.990485 27446 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:22:50.992094 27446 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:22:50.992519 27446 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:22:51.003819  7214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8ed393dd39d418889948f96b70599c3"
dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
mode: GRACEFUL
new_leader_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
 from {username='slave'} at 127.0.0.1:51272
I20260709 12:22:51.004375  7214 raft_consensus.cc:606] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 1 LEADER]: Received request to transfer leadership to TS d01edb7b8a8a4ffc944843a20f624e4e
I20260709 12:22:51.005594 27446 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:22:51.089953  7290 raft_consensus.cc:1275] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Refusing update from remote peer bc6fc01b370e41bbb96589b0d0f191da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.091427  7452 consensus_queue.cc:1048] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.096520  7452 raft_consensus.cc:993] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da: : Instructing follower d01edb7b8a8a4ffc944843a20f624e4e to start an election
I20260709 12:22:51.097039  7438 raft_consensus.cc:1081] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 1 LEADER]: Signalling peer d01edb7b8a8a4ffc944843a20f624e4e to start an election
I20260709 12:22:51.100951  7365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8ed393dd39d418889948f96b70599c3"
dest_uuid: "d01edb7b8a8a4ffc944843a20f624e4e"
 from {username='slave'} at 127.0.0.1:33506
I20260709 12:22:51.101485  7365 raft_consensus.cc:493] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:51.101848  7365 raft_consensus.cc:3060] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.101962  7364 raft_consensus.cc:1275] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Refusing update from remote peer bc6fc01b370e41bbb96589b0d0f191da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.103886  7438 consensus_queue.cc:1048] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:51.112720  7365 raft_consensus.cc:515] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:51.114980  7365 leader_election.cc:290] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 2 election: Requested vote from peers bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783), ad2e421b9c984aed970bf86f23ee1e4e (127.26.205.130:34665)
I20260709 12:22:51.115549  7214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ed393dd39d418889948f96b70599c3" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc6fc01b370e41bbb96589b0d0f191da"
I20260709 12:22:51.115970  7290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ed393dd39d418889948f96b70599c3" candidate_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2e421b9c984aed970bf86f23ee1e4e"
I20260709 12:22:51.116281  7214 raft_consensus.cc:3055] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:51.116660  7290 raft_consensus.cc:3060] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.116775  7214 raft_consensus.cc:740] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc6fc01b370e41bbb96589b0d0f191da, State: Running, Role: LEADER
I20260709 12:22:51.117750  7214 consensus_queue.cc:260] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:51.119004  7214 raft_consensus.cc:3060] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.122871  7290 raft_consensus.cc:2468] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 2.
I20260709 12:22:51.124037  7328 leader_election.cc:304] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2e421b9c984aed970bf86f23ee1e4e, d01edb7b8a8a4ffc944843a20f624e4e; no voters: 
I20260709 12:22:51.124795  7410 raft_consensus.cc:2804] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:51.125216  7410 raft_consensus.cc:697] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 2 LEADER]: Becoming Leader. State: Replica: d01edb7b8a8a4ffc944843a20f624e4e, State: Running, Role: LEADER
I20260709 12:22:51.125998  7410 consensus_queue.cc:237] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } }
I20260709 12:22:51.125969  7214 raft_consensus.cc:2468] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01edb7b8a8a4ffc944843a20f624e4e in term 2.
I20260709 12:22:51.133319  7111 catalog_manager.cc:5697] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e reported cstate change: term changed from 1 to 2, leader changed from bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129) to d01edb7b8a8a4ffc944843a20f624e4e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6fc01b370e41bbb96589b0d0f191da" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 39783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad2e421b9c984aed970bf86f23ee1e4e" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 34665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:51.211561 27446 tablet_server.cc:179] TabletServer@127.26.205.129:0 shutting down...
I20260709 12:22:51.234539  7365 raft_consensus.cc:1275] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Refusing update from remote peer ad2e421b9c984aed970bf86f23ee1e4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:51.236233  7449 consensus_queue.cc:1048] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01edb7b8a8a4ffc944843a20f624e4e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 41293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:51.237073 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:51.237953 27446 tablet_replica.cc:333] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da: stopping tablet replica
I20260709 12:22:51.238611 27446 raft_consensus.cc:2243] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.239594 27446 raft_consensus.cc:2272] T 5150c1fc0cc44481b95d96ffd6157cfe P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.242321 27446 tablet_replica.cc:333] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da: stopping tablet replica
I20260709 12:22:51.242882 27446 raft_consensus.cc:2243] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.243909 27446 raft_consensus.cc:2272] T 305b02ffd80c42119c5fbf7d5e49a4ae P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.250531 27446 tablet_replica.cc:333] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da: stopping tablet replica
W20260709 12:22:51.250593  7253 consensus_peers.cc:597] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e -> Peer bc6fc01b370e41bbb96589b0d0f191da (127.26.205.129:39783): Couldn't send request to peer bc6fc01b370e41bbb96589b0d0f191da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:51.251148 27446 raft_consensus.cc:2243] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.251622 27446 raft_consensus.cc:2272] T a8ed393dd39d418889948f96b70599c3 P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.254494 27446 tablet_replica.cc:333] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da: stopping tablet replica
I20260709 12:22:51.255173 27446 raft_consensus.cc:2243] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.255693 27446 raft_consensus.cc:2272] T 8b93df4487d548288d9d5a84416ba85d P bc6fc01b370e41bbb96589b0d0f191da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.280221 27446 tablet_server.cc:196] TabletServer@127.26.205.129:0 shutdown complete.
I20260709 12:22:51.301571 27446 tablet_server.cc:179] TabletServer@127.26.205.130:0 shutting down...
I20260709 12:22:51.332679 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:51.333384 27446 tablet_replica.cc:333] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e: stopping tablet replica
I20260709 12:22:51.333982 27446 raft_consensus.cc:2243] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.334474 27446 raft_consensus.cc:2272] T 5150c1fc0cc44481b95d96ffd6157cfe P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.337052 27446 tablet_replica.cc:333] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e: stopping tablet replica
I20260709 12:22:51.337587 27446 raft_consensus.cc:2243] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.338006 27446 raft_consensus.cc:2272] T a8ed393dd39d418889948f96b70599c3 P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.340776 27446 tablet_replica.cc:333] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e: stopping tablet replica
I20260709 12:22:51.341284 27446 raft_consensus.cc:2243] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.342098 27446 raft_consensus.cc:2272] T 8b93df4487d548288d9d5a84416ba85d P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.344318 27446 tablet_replica.cc:333] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e: stopping tablet replica
I20260709 12:22:51.344880 27446 raft_consensus.cc:2243] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.345309 27446 raft_consensus.cc:2272] T 305b02ffd80c42119c5fbf7d5e49a4ae P ad2e421b9c984aed970bf86f23ee1e4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.368427 27446 tablet_server.cc:196] TabletServer@127.26.205.130:0 shutdown complete.
I20260709 12:22:51.382633 27446 tablet_server.cc:179] TabletServer@127.26.205.131:0 shutting down...
I20260709 12:22:51.399705 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:51.400554 27446 tablet_replica.cc:333] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e: stopping tablet replica
I20260709 12:22:51.401391 27446 raft_consensus.cc:2243] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.402125 27446 raft_consensus.cc:2272] T 5150c1fc0cc44481b95d96ffd6157cfe P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.405253 27446 tablet_replica.cc:333] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e: stopping tablet replica
I20260709 12:22:51.406008 27446 raft_consensus.cc:2243] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.406574 27446 raft_consensus.cc:2272] T 305b02ffd80c42119c5fbf7d5e49a4ae P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.408973 27446 tablet_replica.cc:333] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e: stopping tablet replica
I20260709 12:22:51.409475 27446 raft_consensus.cc:2243] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.410084 27446 pending_rounds.cc:70] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e: Trying to abort 1 pending ops.
I20260709 12:22:51.410277 27446 pending_rounds.cc:77] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624662542278656 op_type: NO_OP noop_request { }
I20260709 12:22:51.410573 27446 raft_consensus.cc:2889] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:22:51.410840 27446 raft_consensus.cc:2272] T a8ed393dd39d418889948f96b70599c3 P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.413369 27446 tablet_replica.cc:333] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e: stopping tablet replica
I20260709 12:22:51.413847 27446 raft_consensus.cc:2243] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:51.414263 27446 raft_consensus.cc:2272] T 8b93df4487d548288d9d5a84416ba85d P d01edb7b8a8a4ffc944843a20f624e4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.426859 27446 tablet_server.cc:196] TabletServer@127.26.205.131:0 shutdown complete.
I20260709 12:22:51.438809 27446 master.cc:562] Master@127.26.205.190:36873 shutting down...
I20260709 12:22:51.456367 27446 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:51.456988 27446 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:51.457329 27446 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6e094e97f5f84aeea88ce2855e067a3d: stopping tablet replica
I20260709 12:22:51.476892 27446 master.cc:584] Master@127.26.205.190:36873 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2668 ms)
[----------] 6 tests from LeaderRebalancerTest (403451 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:22:51.511971 27446 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.205.190:44179
I20260709 12:22:51.513245 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:51.518352  7463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.518602  7464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.520022  7466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.521194 27446 server_base.cc:1061] running on GCE node
I20260709 12:22:51.521973 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:51.522174 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:51.522342 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599771522306 us; error 0 us; skew 500 ppm
I20260709 12:22:51.522931 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:51.525348 27446 webserver.cc:533] Webserver started at http://127.26.205.190:40933/ using document root <none> and password file <none>
I20260709 12:22:51.525830 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:51.525987 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:51.526300 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:51.527369 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/master-0-root/instance:
uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-673s"
I20260709 12:22:51.531673 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:22:51.535014  7471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.535706 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:51.536026 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/master-0-root
uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-673s"
I20260709 12:22:51.536309 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:51.544795 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:51.545897 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:51.583725 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.190:44179
I20260709 12:22:51.583837  7522 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.190:44179 every 8 connection(s)
I20260709 12:22:51.587690  7523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:51.598809  7523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e: Bootstrap starting.
I20260709 12:22:51.603767  7523 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.608088  7523 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e: No bootstrap required, opened a new log
I20260709 12:22:51.610348  7523 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e" member_type: VOTER }
I20260709 12:22:51.610723  7523 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.610909  7523 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1144f85f68ec4d09b6cd0fdba7e83f5e, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.611505  7523 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e" member_type: VOTER }
I20260709 12:22:51.611949  7523 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:51.612138  7523 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:51.612353  7523 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.617290  7523 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e" member_type: VOTER }
I20260709 12:22:51.617772  7523 leader_election.cc:304] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1144f85f68ec4d09b6cd0fdba7e83f5e; no voters: 
I20260709 12:22:51.618881  7523 leader_election.cc:290] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:51.619231  7526 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:51.620757  7526 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 1 LEADER]: Becoming Leader. State: Replica: 1144f85f68ec4d09b6cd0fdba7e83f5e, State: Running, Role: LEADER
I20260709 12:22:51.621378  7526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e" member_type: VOTER }
I20260709 12:22:51.621898  7523 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:51.624204  7527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e" member_type: VOTER } }
I20260709 12:22:51.624208  7528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1144f85f68ec4d09b6cd0fdba7e83f5e. Latest consensus state: current_term: 1 leader_uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1144f85f68ec4d09b6cd0fdba7e83f5e" member_type: VOTER } }
I20260709 12:22:51.625015  7527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:51.625115  7528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:51.630421  7531 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:51.638150  7531 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:51.639148 27446 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:51.647461  7531 catalog_manager.cc:1383] Generated new cluster ID: 861901e24473478a9697a26d569beba1
I20260709 12:22:51.647764  7531 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:51.673138  7531 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:51.674429  7531 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:51.687475  7531 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e: Generated new TSK 0
I20260709 12:22:51.688048  7531 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:51.706326 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:51.712425  7544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.713433  7545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.716115 27446 server_base.cc:1061] running on GCE node
W20260709 12:22:51.716614  7547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.717824 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:51.718135 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:51.718359 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599771718342 us; error 0 us; skew 500 ppm
I20260709 12:22:51.718902 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:51.721189 27446 webserver.cc:533] Webserver started at http://127.26.205.129:41815/ using document root <none> and password file <none>
I20260709 12:22:51.721624 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:51.721773 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:51.721980 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:51.722998 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-0-root/instance:
uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-673s"
I20260709 12:22:51.727370 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:51.730648  7552 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.731355 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:51.731665 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-673s"
I20260709 12:22:51.731940 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:51.753302 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:51.754499 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:51.755981 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:51.758242 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:51.758493 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.758729 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:51.758894 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.797060 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:46105
I20260709 12:22:51.797154  7614 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:46105 every 8 connection(s)
I20260709 12:22:51.802052 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:51.809667  7619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.810621  7620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.814749 27446 server_base.cc:1061] running on GCE node
W20260709 12:22:51.814695  7622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.816202  7615 heartbeater.cc:344] Connected to a master server at 127.26.205.190:44179
I20260709 12:22:51.816665 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:22:51.816745  7615 heartbeater.cc:461] Registering TS with master...
W20260709 12:22:51.817032 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:51.817276 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599771817261 us; error 0 us; skew 500 ppm
I20260709 12:22:51.817775  7615 heartbeater.cc:507] Master 127.26.205.190:44179 requested a full tablet report, sending...
I20260709 12:22:51.817893 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:51.820083  7488 ts_manager.cc:194] Registered new tserver with Master: c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105)
I20260709 12:22:51.821168 27446 webserver.cc:533] Webserver started at http://127.26.205.130:40023/ using document root <none> and password file <none>
I20260709 12:22:51.821875 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:51.822111 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:51.822408 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:51.822589  7488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56946
I20260709 12:22:51.823942 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-1-root/instance:
uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-673s"
I20260709 12:22:51.828377 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:22:51.831758  7627 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.832695 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:51.832962 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-1-root
uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-673s"
I20260709 12:22:51.833248 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:51.858757 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:51.860273 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:51.862473 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:51.865181 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:51.865383 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.865572 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:51.865696 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.903546 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.130:46159
I20260709 12:22:51.903668  7689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.130:46159 every 8 connection(s)
I20260709 12:22:51.909164 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:51.915510  7693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:51.916290  7694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.919988 27446 server_base.cc:1061] running on GCE node
W20260709 12:22:51.920017  7696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:51.921474 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:51.921782 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:51.921834  7690 heartbeater.cc:344] Connected to a master server at 127.26.205.190:44179
I20260709 12:22:51.921976 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599771921961 us; error 0 us; skew 500 ppm
I20260709 12:22:51.922442  7690 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:51.922757 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:51.923305  7690 heartbeater.cc:507] Master 127.26.205.190:44179 requested a full tablet report, sending...
I20260709 12:22:51.925514 27446 webserver.cc:533] Webserver started at http://127.26.205.131:35423/ using document root <none> and password file <none>
I20260709 12:22:51.925666  7488 ts_manager.cc:194] Registered new tserver with Master: 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:51.926314 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:51.926591 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:51.926923 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:51.927606  7488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56956
I20260709 12:22:51.928401 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-2-root/instance:
uuid: "0f409b8d7d1144d3b20518efc1164a13"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-673s"
I20260709 12:22:51.933171 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:51.936591  7701 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.937386 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:51.937712 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-2-root
uuid: "0f409b8d7d1144d3b20518efc1164a13"
format_stamp: "Formatted at 2026-07-09 12:22:51 on dist-test-slave-673s"
I20260709 12:22:51.938021 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599367894863-27446-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:51.947626 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:51.948750 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:51.950136 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:51.952425 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:51.952715 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.952968 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:51.953145 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:51.993871 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.131:34893
I20260709 12:22:51.993995  7763 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.131:34893 every 8 connection(s)
I20260709 12:22:52.007431  7764 heartbeater.cc:344] Connected to a master server at 127.26.205.190:44179
I20260709 12:22:52.007843  7764 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:52.008635  7764 heartbeater.cc:507] Master 127.26.205.190:44179 requested a full tablet report, sending...
I20260709 12:22:52.010515  7488 ts_manager.cc:194] Registered new tserver with Master: 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.010842 27446 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01375441s
I20260709 12:22:52.011965  7488 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56960
I20260709 12:22:52.037091  7488 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56970:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:52.040076  7488 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:52.107760  7579 tablet_service.cc:1511] Processing CreateTablet for tablet 8e43cf05c3124a7eae3a2cad23c3433d (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:52.108012  7729 tablet_service.cc:1511] Processing CreateTablet for tablet 842eb71698124890907e22ed545909ad (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:52.108863  7580 tablet_service.cc:1511] Processing CreateTablet for tablet 842eb71698124890907e22ed545909ad (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:52.109392  7579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e43cf05c3124a7eae3a2cad23c3433d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.109519  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842eb71698124890907e22ed545909ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.110234  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842eb71698124890907e22ed545909ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.111240  7728 tablet_service.cc:1511] Processing CreateTablet for tablet 8e43cf05c3124a7eae3a2cad23c3433d (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:52.112112  7578 tablet_service.cc:1511] Processing CreateTablet for tablet b0286c20effd44c6af3e85d855969659 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:52.112602  7728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e43cf05c3124a7eae3a2cad23c3433d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.113541  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0286c20effd44c6af3e85d855969659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.115388  7577 tablet_service.cc:1511] Processing CreateTablet for tablet 88dc8a5919994bbf880599b85766b454 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:52.116809  7577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dc8a5919994bbf880599b85766b454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.121579  7576 tablet_service.cc:1511] Processing CreateTablet for tablet 3ade4b051b9e4d528bb82258ffe38b87 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:52.122215  7727 tablet_service.cc:1511] Processing CreateTablet for tablet b0286c20effd44c6af3e85d855969659 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:52.123020  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ade4b051b9e4d528bb82258ffe38b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.123608  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0286c20effd44c6af3e85d855969659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.135834  7778 tablet_bootstrap.cc:492] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.135550  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 88dc8a5919994bbf880599b85766b454 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:52.137980  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dc8a5919994bbf880599b85766b454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.150365  7778 tablet_bootstrap.cc:654] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.154431  7725 tablet_service.cc:1511] Processing CreateTablet for tablet 3ade4b051b9e4d528bb82258ffe38b87 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:52.161764  7652 tablet_service.cc:1511] Processing CreateTablet for tablet 88dc8a5919994bbf880599b85766b454 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:52.162756  7725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ade4b051b9e4d528bb82258ffe38b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.163370  7652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88dc8a5919994bbf880599b85766b454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.165892  7651 tablet_service.cc:1511] Processing CreateTablet for tablet 3ade4b051b9e4d528bb82258ffe38b87 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:52.167723  7651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ade4b051b9e4d528bb82258ffe38b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.160039  7653 tablet_service.cc:1511] Processing CreateTablet for tablet b0286c20effd44c6af3e85d855969659 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:52.173971  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0286c20effd44c6af3e85d855969659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.155687  7655 tablet_service.cc:1511] Processing CreateTablet for tablet 842eb71698124890907e22ed545909ad (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:52.156906  7580 tablet_service.cc:1511] Processing CreateTablet for tablet ee3cdf50703a469583232b9b0bf232f7 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:52.177472  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3cdf50703a469583232b9b0bf232f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.179030  7724 tablet_service.cc:1511] Processing CreateTablet for tablet ee3cdf50703a469583232b9b0bf232f7 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:52.179030  7650 tablet_service.cc:1511] Processing CreateTablet for tablet ee3cdf50703a469583232b9b0bf232f7 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:52.157852  7654 tablet_service.cc:1511] Processing CreateTablet for tablet 8e43cf05c3124a7eae3a2cad23c3433d (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:52.177490  7655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842eb71698124890907e22ed545909ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.182576  7575 tablet_service.cc:1511] Processing CreateTablet for tablet 5d928b4866504469aec0d2ff3769219c (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:52.183964  7575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d928b4866504469aec0d2ff3769219c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.180493  7724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3cdf50703a469583232b9b0bf232f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.184800  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e43cf05c3124a7eae3a2cad23c3433d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.187016  7650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3cdf50703a469583232b9b0bf232f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.189932  7649 tablet_service.cc:1511] Processing CreateTablet for tablet 5d928b4866504469aec0d2ff3769219c (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:52.191268  7649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d928b4866504469aec0d2ff3769219c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.210397  7723 tablet_service.cc:1511] Processing CreateTablet for tablet eb9a370a18204449b0612439e1381459 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:52.211776  7723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9a370a18204449b0612439e1381459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.204869  7648 tablet_service.cc:1511] Processing CreateTablet for tablet eb9a370a18204449b0612439e1381459 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:52.213718  7648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9a370a18204449b0612439e1381459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.213815  7576 tablet_service.cc:1511] Processing CreateTablet for tablet f79204baa78c48b0acd0c839667e564c (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:52.215095  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79204baa78c48b0acd0c839667e564c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.205382  7578 tablet_service.cc:1511] Processing CreateTablet for tablet eb9a370a18204449b0612439e1381459 (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:52.217474  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9a370a18204449b0612439e1381459. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.219507  7647 tablet_service.cc:1511] Processing CreateTablet for tablet f79204baa78c48b0acd0c839667e564c (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:52.221151  7647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79204baa78c48b0acd0c839667e564c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.233464  7778 tablet_bootstrap.cc:492] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.234143  7778 ts_tablet_manager.cc:1403] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.006s
I20260709 12:22:52.219507  7725 tablet_service.cc:1511] Processing CreateTablet for tablet f79204baa78c48b0acd0c839667e564c (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:52.249698  7725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f79204baa78c48b0acd0c839667e564c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.265583  7778 raft_consensus.cc:359] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.266736  7778 raft_consensus.cc:385] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.267119  7778 raft_consensus.cc:740] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.199487  7726 tablet_service.cc:1511] Processing CreateTablet for tablet 5d928b4866504469aec0d2ff3769219c (DEFAULT_TABLE table=test-workload [id=d8c04c4474b04c1991a63d7d96db5b1d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:52.281739  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d928b4866504469aec0d2ff3769219c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:52.292565  7781 tablet_bootstrap.cc:492] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:52.294116  7779 tablet_bootstrap.cc:492] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.298866  7781 tablet_bootstrap.cc:654] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.268131  7778 consensus_queue.cc:260] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.333463  7778 ts_tablet_manager.cc:1434] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.006s
I20260709 12:22:52.334136  7615 heartbeater.cc:499] Master 127.26.205.190:44179 was elected leader, sending a full tablet report...
I20260709 12:22:52.334461  7778 tablet_bootstrap.cc:492] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.337759  7779 tablet_bootstrap.cc:654] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.338083  7783 raft_consensus.cc:493] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.338613  7783 raft_consensus.cc:515] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.344496  7778 tablet_bootstrap.cc:654] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.348148  7783 leader_election.cc:290] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:52.357940  7781 tablet_bootstrap.cc:492] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.358527  7781 ts_tablet_manager.cc:1403] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.023s
I20260709 12:22:52.361725  7781 raft_consensus.cc:359] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.362532  7781 raft_consensus.cc:385] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.362985  7781 raft_consensus.cc:740] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.364789  7781 consensus_queue.cc:260] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.365262  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842eb71698124890907e22ed545909ad" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
W20260709 12:22:52.366882  7553 leader_election.cc:343] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.369429  7690 heartbeater.cc:499] Master 127.26.205.190:44179 was elected leader, sending a full tablet report...
I20260709 12:22:52.371598  7779 tablet_bootstrap.cc:492] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.372293  7779 ts_tablet_manager.cc:1403] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.004s
I20260709 12:22:52.375325  7781 ts_tablet_manager.cc:1434] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:22:52.376350  7781 tablet_bootstrap.cc:492] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:52.376917  7779 raft_consensus.cc:359] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.378049  7779 raft_consensus.cc:385] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.378484  7779 raft_consensus.cc:740] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.380590  7779 consensus_queue.cc:260] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.381441  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842eb71698124890907e22ed545909ad" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:52.381943  7778 tablet_bootstrap.cc:492] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.382680  7778 ts_tablet_manager.cc:1403] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.022s
W20260709 12:22:52.383054  7553 leader_election.cc:343] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.383674  7781 tablet_bootstrap.cc:654] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.383559  7553 leader_election.cc:304] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:52.384972  7784 raft_consensus.cc:2749] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.386663  7778 raft_consensus.cc:359] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.387694  7778 raft_consensus.cc:385] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.388067  7778 raft_consensus.cc:740] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.388988  7778 consensus_queue.cc:260] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.391122  7778 ts_tablet_manager.cc:1434] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:52.392150  7778 tablet_bootstrap.cc:492] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.394559  7779 ts_tablet_manager.cc:1434] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 12:22:52.395342  7781 tablet_bootstrap.cc:492] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.395407  7764 heartbeater.cc:499] Master 127.26.205.190:44179 was elected leader, sending a full tablet report...
I20260709 12:22:52.395954  7781 ts_tablet_manager.cc:1403] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 12:22:52.397248  7784 raft_consensus.cc:493] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.397719  7784 raft_consensus.cc:515] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.398501  7778 tablet_bootstrap.cc:654] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.398955  7781 raft_consensus.cc:359] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.399669  7781 raft_consensus.cc:385] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.399896  7784 leader_election.cc:290] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.400007  7781 raft_consensus.cc:740] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.401947  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0286c20effd44c6af3e85d855969659" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:52.401675  7781 consensus_queue.cc:260] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.402720  7665 raft_consensus.cc:2468] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 0.
I20260709 12:22:52.403038  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0286c20effd44c6af3e85d855969659" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:52.403901  7781 ts_tablet_manager.cc:1434] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:52.404011  7553 leader_election.cc:304] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.405052  7781 tablet_bootstrap.cc:492] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
W20260709 12:22:52.411648  7553 leader_election.cc:343] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.411897  7781 tablet_bootstrap.cc:654] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.411502  7779 tablet_bootstrap.cc:492] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.404919  7784 raft_consensus.cc:2804] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.421607  7779 tablet_bootstrap.cc:654] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.423400  7781 tablet_bootstrap.cc:492] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.423938  7781 ts_tablet_manager.cc:1403] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:22:52.420742  7784 raft_consensus.cc:493] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.424860  7778 tablet_bootstrap.cc:492] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.425052  7784 raft_consensus.cc:3060] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.425484  7778 ts_tablet_manager.cc:1403] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.013s
I20260709 12:22:52.426985  7781 raft_consensus.cc:359] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.427798  7781 raft_consensus.cc:385] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.428086  7781 raft_consensus.cc:740] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.429078  7781 consensus_queue.cc:260] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.429524  7778 raft_consensus.cc:359] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.430568  7778 raft_consensus.cc:385] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.430943  7778 raft_consensus.cc:740] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.432176  7778 consensus_queue.cc:260] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.438838  7778 ts_tablet_manager.cc:1434] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:22:52.438990  7781 ts_tablet_manager.cc:1434] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 12:22:52.440174  7781 tablet_bootstrap.cc:492] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:52.440213  7778 tablet_bootstrap.cc:492] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.443147  7779 tablet_bootstrap.cc:492] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.443773  7779 ts_tablet_manager.cc:1403] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.011s
I20260709 12:22:52.447160  7781 tablet_bootstrap.cc:654] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.446966  7779 raft_consensus.cc:359] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.447482  7778 tablet_bootstrap.cc:654] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.447916  7779 raft_consensus.cc:385] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.448284  7779 raft_consensus.cc:740] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.449234  7779 consensus_queue.cc:260] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.452204  7779 ts_tablet_manager.cc:1434] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:52.453534  7779 tablet_bootstrap.cc:492] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.458307  7781 tablet_bootstrap.cc:492] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.458896  7781 ts_tablet_manager.cc:1403] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:22:52.459019  7778 tablet_bootstrap.cc:492] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.459609  7778 ts_tablet_manager.cc:1403] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:22:52.460593  7779 tablet_bootstrap.cc:654] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.462353  7781 raft_consensus.cc:359] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.462736  7778 raft_consensus.cc:359] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.463562  7778 raft_consensus.cc:385] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.463949  7778 raft_consensus.cc:740] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.463168  7781 raft_consensus.cc:385] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.464677  7781 raft_consensus.cc:740] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.465730  7781 consensus_queue.cc:260] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.467572  7778 consensus_queue.cc:260] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.469848  7784 raft_consensus.cc:515] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.471148  7778 ts_tablet_manager.cc:1434] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:22:52.471868  7784 leader_election.cc:290] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.472515  7778 tablet_bootstrap.cc:492] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.474040  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0286c20effd44c6af3e85d855969659" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:52.474668  7665 raft_consensus.cc:3060] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.480784  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0286c20effd44c6af3e85d855969659" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
W20260709 12:22:52.486091  7553 leader_election.cc:343] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.481704  7781 ts_tablet_manager.cc:1434] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 12:22:52.482209  7778 tablet_bootstrap.cc:654] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.487497  7665 raft_consensus.cc:2468] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:52.488099  7781 tablet_bootstrap.cc:492] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:52.490178  7553 leader_election.cc:304] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:52.491400  7784 raft_consensus.cc:2804] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.491874  7784 raft_consensus.cc:697] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:52.492821  7778 tablet_bootstrap.cc:492] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.492669  7784 consensus_queue.cc:237] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.493386  7778 ts_tablet_manager.cc:1403] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 12:22:52.494153  7781 tablet_bootstrap.cc:654] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.480952  7779 tablet_bootstrap.cc:492] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.496613  7778 raft_consensus.cc:359] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.497568  7778 raft_consensus.cc:385] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.497375  7779 ts_tablet_manager.cc:1403] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.015s
I20260709 12:22:52.497874  7778 raft_consensus.cc:740] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.499231  7778 consensus_queue.cc:260] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.497399  7795 raft_consensus.cc:493] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.501508  7778 ts_tablet_manager.cc:1434] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:52.501155  7795 raft_consensus.cc:515] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.501760  7779 raft_consensus.cc:359] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.503213  7779 raft_consensus.cc:385] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.502669  7778 tablet_bootstrap.cc:492] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.505697  7781 tablet_bootstrap.cc:492] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.506331  7781 ts_tablet_manager.cc:1403] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:22:52.508901  7795 leader_election.cc:290] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.503742  7779 raft_consensus.cc:740] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.510138  7779 consensus_queue.cc:260] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.511216  7778 tablet_bootstrap.cc:654] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.513016  7779 ts_tablet_manager.cc:1434] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:22:52.513535  7781 raft_consensus.cc:359] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.515254  7781 raft_consensus.cc:385] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.515849  7781 raft_consensus.cc:740] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.517120  7781 consensus_queue.cc:260] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.521164  7781 ts_tablet_manager.cc:1434] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:22:52.522653  7781 tablet_bootstrap.cc:492] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:52.518580  7779 tablet_bootstrap.cc:492] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.531944  7779 tablet_bootstrap.cc:654] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.536794  7783 raft_consensus.cc:493] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.537369  7795 raft_consensus.cc:493] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.536420  7487 catalog_manager.cc:5697] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 0 to 1, leader changed from <none> to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.540208  7783 raft_consensus.cc:515] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.540228  7795 raft_consensus.cc:515] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.543619  7783 leader_election.cc:290] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.544339  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88dc8a5919994bbf880599b85766b454" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:52.544953  7795 leader_election.cc:290] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
W20260709 12:22:52.546128  7553 leader_election.cc:343] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.546566  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88dc8a5919994bbf880599b85766b454" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:52.547222  7739 raft_consensus.cc:2468] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 0.
I20260709 12:22:52.548637  7553 leader_election.cc:304] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:52.549383  7781 tablet_bootstrap.cc:654] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.549892  7783 raft_consensus.cc:2804] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.550315  7783 raft_consensus.cc:493] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.550626  7783 raft_consensus.cc:3060] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.557663  7778 tablet_bootstrap.cc:492] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.558506  7778 ts_tablet_manager.cc:1403] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.056s	user 0.035s	sys 0.018s
I20260709 12:22:52.562359  7783 raft_consensus.cc:515] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.562474  7778 raft_consensus.cc:359] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.565865  7781 tablet_bootstrap.cc:492] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.567032  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9a370a18204449b0612439e1381459" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:52.567889  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3cdf50703a469583232b9b0bf232f7" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:52.569849  7778 raft_consensus.cc:385] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:52.570188  7628 leader_election.cc:343] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.570293  7778 raft_consensus.cc:740] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.570696  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9a370a18204449b0612439e1381459" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
W20260709 12:22:52.571036  7628 leader_election.cc:343] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.571237  7781 ts_tablet_manager.cc:1403] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.000s
I20260709 12:22:52.569721  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3cdf50703a469583232b9b0bf232f7" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:52.571394  7778 consensus_queue.cc:260] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
W20260709 12:22:52.572218  7628 leader_election.cc:343] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.572481  7590 raft_consensus.cc:2468] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:52.574242  7778 ts_tablet_manager.cc:1434] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:22:52.574855  7779 tablet_bootstrap.cc:492] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.574537  7781 raft_consensus.cc:359] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.575344  7781 raft_consensus.cc:385] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.575387  7779 ts_tablet_manager.cc:1403] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.009s
I20260709 12:22:52.575723  7781 raft_consensus.cc:740] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.575389  7778 tablet_bootstrap.cc:492] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.576689  7781 consensus_queue.cc:260] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.577113  7783 leader_election.cc:290] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.579373  7781 ts_tablet_manager.cc:1434] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:22:52.580394  7781 tablet_bootstrap.cc:492] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:52.582717  7779 raft_consensus.cc:359] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.583468  7779 raft_consensus.cc:385] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.583755  7779 raft_consensus.cc:740] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.584515  7779 consensus_queue.cc:260] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.586843  7779 ts_tablet_manager.cc:1434] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:22:52.587930  7779 tablet_bootstrap.cc:492] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.587934  7778 tablet_bootstrap.cc:654] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.589586  7781 tablet_bootstrap.cc:654] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.595678  7779 tablet_bootstrap.cc:654] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.596231  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88dc8a5919994bbf880599b85766b454" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:52.596916  7739 raft_consensus.cc:3060] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.600867  7628 leader_election.cc:304] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:52.602056  7795 raft_consensus.cc:2749] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.603353  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88dc8a5919994bbf880599b85766b454" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:52.604212  7665 raft_consensus.cc:3060] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.607007  7739 raft_consensus.cc:2468] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:52.608098  7553 leader_election.cc:304] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.609369  7783 raft_consensus.cc:2804] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.609958  7783 raft_consensus.cc:697] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:52.610996  7783 consensus_queue.cc:237] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.612984  7628 leader_election.cc:304] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:52.615005  7795 raft_consensus.cc:2804] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.615489  7795 raft_consensus.cc:493] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.615895  7795 raft_consensus.cc:3060] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.620234  7781 tablet_bootstrap.cc:492] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.620901  7781 ts_tablet_manager.cc:1403] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.008s
I20260709 12:22:52.624070  7781 raft_consensus.cc:359] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.624738  7781 raft_consensus.cc:385] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.625063  7778 tablet_bootstrap.cc:492] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.625653  7778 ts_tablet_manager.cc:1403] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.027s
I20260709 12:22:52.626446  7779 tablet_bootstrap.cc:492] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.627046  7779 ts_tablet_manager.cc:1403] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.010s
I20260709 12:22:52.627912  7665 raft_consensus.cc:2468] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:52.628801  7778 raft_consensus.cc:359] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.625100  7781 raft_consensus.cc:740] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.630180  7779 raft_consensus.cc:359] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.630473  7781 consensus_queue.cc:260] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.630970  7779 raft_consensus.cc:385] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.631368  7779 raft_consensus.cc:740] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.630604  7487 catalog_manager.cc:5697] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 0 to 1, leader changed from <none> to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.632241  7779 consensus_queue.cc:260] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.633105  7781 ts_tablet_manager.cc:1434] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:22:52.631363  7536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:52.629581  7778 raft_consensus.cc:385] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.635763  7778 raft_consensus.cc:740] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.636523  7781 tablet_bootstrap.cc:492] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:52.636618  7778 consensus_queue.cc:260] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.638422  7795 raft_consensus.cc:515] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.639058  7778 ts_tablet_manager.cc:1434] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:22:52.640038  7778 tablet_bootstrap.cc:492] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.640686  7789 raft_consensus.cc:493] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.641238  7789 raft_consensus.cc:515] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.642161  7795 leader_election.cc:290] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.634686  7779 ts_tablet_manager.cc:1434] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:52.643275  7789 leader_election.cc:290] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.643676  7779 tablet_bootstrap.cc:492] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.644222  7781 tablet_bootstrap.cc:654] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.644981  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842eb71698124890907e22ed545909ad" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:52.645439  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3cdf50703a469583232b9b0bf232f7" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:52.645637  7589 raft_consensus.cc:2468] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:52.646061  7590 raft_consensus.cc:3060] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.647503  7628 leader_election.cc:304] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.648384  7789 raft_consensus.cc:2804] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.648813  7789 raft_consensus.cc:493] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.649137  7789 raft_consensus.cc:3060] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.654410  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3cdf50703a469583232b9b0bf232f7" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:52.655452  7778 tablet_bootstrap.cc:654] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:52.658249  7628 leader_election.cc:343] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.655661  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842eb71698124890907e22ed545909ad" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:52.659494  7738 raft_consensus.cc:2468] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:52.660696  7779 tablet_bootstrap.cc:654] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.659667  7789 raft_consensus.cc:515] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.667230  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842eb71698124890907e22ed545909ad" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:52.667984  7589 raft_consensus.cc:3060] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.678390  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842eb71698124890907e22ed545909ad" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:52.679220  7738 raft_consensus.cc:3060] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.688571  7789 leader_election.cc:290] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.691279  7783 raft_consensus.cc:493] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.695544  7738 raft_consensus.cc:2468] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:52.695925  7783 raft_consensus.cc:515] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.697283  7781 tablet_bootstrap.cc:492] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.697296  7628 leader_election.cc:304] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:22:52.698192  7783 leader_election.cc:290] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.693440  7589 raft_consensus.cc:2468] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:52.695582  7778 tablet_bootstrap.cc:492] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.698230  7781 ts_tablet_manager.cc:1403] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.062s	user 0.032s	sys 0.021s
I20260709 12:22:52.692157  7590 raft_consensus.cc:2468] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:52.699400  7778 ts_tablet_manager.cc:1403] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.013s
I20260709 12:22:52.700399  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79204baa78c48b0acd0c839667e564c" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:52.699256  7795 raft_consensus.cc:2804] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.702004  7795 raft_consensus.cc:697] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:52.702765  7781 raft_consensus.cc:359] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.702913  7795 consensus_queue.cc:237] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:52.703505  7781 raft_consensus.cc:385] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.703809  7781 raft_consensus.cc:740] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.703848  7778 raft_consensus.cc:359] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.704484  7779 tablet_bootstrap.cc:492] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.704679  7778 raft_consensus.cc:385] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.704726  7781 consensus_queue.cc:260] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.705054  7779 ts_tablet_manager.cc:1403] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.015s
W20260709 12:22:52.705184  7553 leader_election.cc:343] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.706429  7628 leader_election.cc:304] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:52.705094  7778 raft_consensus.cc:740] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.708534  7779 raft_consensus.cc:359] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.709326  7779 raft_consensus.cc:385] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.709439  7778 consensus_queue.cc:260] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.709996  7789 raft_consensus.cc:2804] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.710078  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79204baa78c48b0acd0c839667e564c" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:52.710716  7789 raft_consensus.cc:697] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:52.710891  7665 raft_consensus.cc:2468] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 0.
I20260709 12:22:52.711617  7778 ts_tablet_manager.cc:1434] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:22:52.711578  7789 consensus_queue.cc:237] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.712016  7553 leader_election.cc:304] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:52.712791  7778 tablet_bootstrap.cc:492] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:52.713222  7783 raft_consensus.cc:2804] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.713603  7783 raft_consensus.cc:493] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.707747  7781 ts_tablet_manager.cc:1434] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:52.713927  7783 raft_consensus.cc:3060] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.714916  7781 tablet_bootstrap.cc:492] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:52.719452  7778 tablet_bootstrap.cc:654] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.723027  7783 raft_consensus.cc:515] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.726913  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79204baa78c48b0acd0c839667e564c" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:52.727727  7665 raft_consensus.cc:3060] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.727177  7781 tablet_bootstrap.cc:654] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.709651  7779 raft_consensus.cc:740] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.736016  7779 consensus_queue.cc:260] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.745406  7484 catalog_manager.cc:5697] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.750778  7779 ts_tablet_manager.cc:1434] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:22:52.753892  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79204baa78c48b0acd0c839667e564c" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:52.754714  7738 raft_consensus.cc:3060] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.762697  7784 raft_consensus.cc:493] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.763466  7784 raft_consensus.cc:515] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.766373  7784 leader_election.cc:290] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.766424  7665 raft_consensus.cc:2468] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:52.768529  7553 leader_election.cc:304] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.769135  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ade4b051b9e4d528bb82258ffe38b87" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:52.770166  7664 raft_consensus.cc:2468] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 0.
I20260709 12:22:52.770522  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ade4b051b9e4d528bb82258ffe38b87" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:52.771255  7739 raft_consensus.cc:2468] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 0.
I20260709 12:22:52.772184  7553 leader_election.cc:304] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.772840  7784 raft_consensus.cc:2804] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.773686  7783 leader_election.cc:290] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.774561  7783 raft_consensus.cc:2804] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.775034  7783 raft_consensus.cc:493] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.775457  7783 raft_consensus.cc:3060] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.782191  7779 tablet_bootstrap.cc:492] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.783222  7487 catalog_manager.cc:5697] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.785750  7738 raft_consensus.cc:2468] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:52.800683  7779 tablet_bootstrap.cc:654] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.808475  7783 raft_consensus.cc:515] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.810678  7783 leader_election.cc:290] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.820282  7784 raft_consensus.cc:697] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:52.824172  7784 consensus_queue.cc:237] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
W20260709 12:22:52.822645  7553 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.205.130:46159, user_credentials={real_user=slave}} blocked reactor thread for 50576.9us
I20260709 12:22:52.827354  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ade4b051b9e4d528bb82258ffe38b87" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:52.828219  7665 raft_consensus.cc:3060] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.832372  7778 tablet_bootstrap.cc:492] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:52.832981  7778 ts_tablet_manager.cc:1403] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.120s	user 0.048s	sys 0.067s
I20260709 12:22:52.832839  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ade4b051b9e4d528bb82258ffe38b87" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:52.833555  7738 raft_consensus.cc:3060] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.836644  7781 tablet_bootstrap.cc:492] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:52.837263  7781 ts_tablet_manager.cc:1403] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.123s	user 0.044s	sys 0.060s
I20260709 12:22:52.836694  7778 raft_consensus.cc:359] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.837677  7778 raft_consensus.cc:385] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.837965  7778 raft_consensus.cc:740] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.838672  7778 consensus_queue.cc:260] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.840968  7778 ts_tablet_manager.cc:1434] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:52.840406  7781 raft_consensus.cc:359] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.841462  7781 raft_consensus.cc:385] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.841781  7781 raft_consensus.cc:740] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.842547  7781 consensus_queue.cc:260] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.843951  7665 raft_consensus.cc:2468] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:52.844605  7781 ts_tablet_manager.cc:1434] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:52.845283  7553 leader_election.cc:304] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.846616  7819 raft_consensus.cc:2804] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.846655  7738 raft_consensus.cc:2468] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:52.847265  7819 raft_consensus.cc:697] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:52.848104  7819 consensus_queue.cc:237] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.850878  7487 catalog_manager.cc:5697] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 0 to 1, leader changed from <none> to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.853425  7779 tablet_bootstrap.cc:492] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.853964  7779 ts_tablet_manager.cc:1403] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.017s
I20260709 12:22:52.855355  7795 raft_consensus.cc:493] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.855878  7795 raft_consensus.cc:515] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.857000  7779 raft_consensus.cc:359] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.857707  7779 raft_consensus.cc:385] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.858016  7795 leader_election.cc:290] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.858007  7779 raft_consensus.cc:740] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.859478  7779 consensus_queue.cc:260] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.861054  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:52.861744  7590 raft_consensus.cc:2468] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:52.861896  7779 ts_tablet_manager.cc:1434] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:22:52.863040  7779 tablet_bootstrap.cc:492] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.863332  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:52.864023  7738 raft_consensus.cc:2468] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:52.863391  7628 leader_election.cc:304] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.866379  7795 raft_consensus.cc:2804] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.866745  7795 raft_consensus.cc:493] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.867110  7795 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.870879  7779 tablet_bootstrap.cc:654] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.870451  7484 catalog_manager.cc:5697] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 0 to 1, leader changed from <none> to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.876187  7779 tablet_bootstrap.cc:492] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.876804  7779 ts_tablet_manager.cc:1403] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:22:52.875588  7795 raft_consensus.cc:515] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.879654  7779 raft_consensus.cc:359] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.880038  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:52.880416  7779 raft_consensus.cc:385] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.880785  7738 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.880950  7779 raft_consensus.cc:740] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.881494  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:52.882092  7590 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.881970  7779 consensus_queue.cc:260] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.880330  7790 raft_consensus.cc:493] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.883958  7790 raft_consensus.cc:515] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.884933  7779 ts_tablet_manager.cc:1434] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:52.885975  7779 tablet_bootstrap.cc:492] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:52.886566  7790 leader_election.cc:290] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:52.890625  7738 raft_consensus.cc:2468] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:52.891762  7779 tablet_bootstrap.cc:654] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.891875  7628 leader_election.cc:304] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:22:52.892877  7789 raft_consensus.cc:2804] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.893283  7789 raft_consensus.cc:697] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:52.894102  7789 consensus_queue.cc:237] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.897317  7779 tablet_bootstrap.cc:492] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:52.897857  7779 ts_tablet_manager.cc:1403] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:22:52.898654  7590 raft_consensus.cc:2468] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:52.899484  7795 leader_election.cc:290] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:52.900827  7779 raft_consensus.cc:359] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.901747  7779 raft_consensus.cc:385] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.902101  7779 raft_consensus.cc:740] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.903064  7779 consensus_queue.cc:260] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.905829  7779 ts_tablet_manager.cc:1434] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:52.918695  7484 catalog_manager.cc:5697] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.924976  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9a370a18204449b0612439e1381459" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:52.925669  7590 raft_consensus.cc:2468] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 0.
I20260709 12:22:52.926934  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9a370a18204449b0612439e1381459" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:52.927692  7665 raft_consensus.cc:2468] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 0.
I20260709 12:22:52.927917  7702 leader_election.cc:304] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.929461  7825 raft_consensus.cc:493] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.929915  7825 raft_consensus.cc:515] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.928929  7790 raft_consensus.cc:2804] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.931272  7790 raft_consensus.cc:493] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.931634  7790 raft_consensus.cc:3060] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.931900  7825 leader_election.cc:290] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:52.932684  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0286c20effd44c6af3e85d855969659" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:52.932897  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0286c20effd44c6af3e85d855969659" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:52.933660  7665 raft_consensus.cc:2393] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f409b8d7d1144d3b20518efc1164a13 in current term 1: Already voted for candidate c44ccfd8978b413bbc4eb7111f5d4706 in this term.
I20260709 12:22:52.934566  7702 leader_election.cc:304] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13; no voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:52.935325  7825 raft_consensus.cc:3060] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.938410  7790 raft_consensus.cc:515] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.940104  7790 leader_election.cc:290] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:52.940866  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9a370a18204449b0612439e1381459" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:52.941220  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9a370a18204449b0612439e1381459" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:52.941514  7590 raft_consensus.cc:3060] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.941617  7825 raft_consensus.cc:2749] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.941854  7665 raft_consensus.cc:3060] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.948868  7590 raft_consensus.cc:2468] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 1.
I20260709 12:22:52.948875  7665 raft_consensus.cc:2468] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 1.
I20260709 12:22:52.950273  7702 leader_election.cc:304] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:52.950981  7825 raft_consensus.cc:2804] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.951483  7825 raft_consensus.cc:697] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:52.952284  7825 consensus_queue.cc:237] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:52.959146  7484 catalog_manager.cc:5697] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.969470  7819 consensus_queue.cc:1048] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.980669  7820 consensus_queue.cc:1048] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.027271  7789 raft_consensus.cc:493] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.027765  7789 raft_consensus.cc:515] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.029573  7789 leader_election.cc:290] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:53.030586  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d928b4866504469aec0d2ff3769219c" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:53.030910  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d928b4866504469aec0d2ff3769219c" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:53.031380  7590 raft_consensus.cc:2468] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:53.031545  7738 raft_consensus.cc:2468] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:53.032557  7628 leader_election.cc:304] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:53.033182  7789 raft_consensus.cc:2804] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.033609  7789 raft_consensus.cc:493] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.033885  7789 raft_consensus.cc:3060] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.039294  7789 raft_consensus.cc:515] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.041150  7789 leader_election.cc:290] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:53.041858  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d928b4866504469aec0d2ff3769219c" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:53.042112  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d928b4866504469aec0d2ff3769219c" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:53.042443  7590 raft_consensus.cc:3060] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.042726  7738 raft_consensus.cc:3060] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.047641  7590 raft_consensus.cc:2468] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:53.047670  7738 raft_consensus.cc:2468] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:53.048758  7628 leader_election.cc:304] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:53.049378  7789 raft_consensus.cc:2804] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.049786  7789 raft_consensus.cc:697] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:53.050565  7789 consensus_queue.cc:237] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.057909  7486 catalog_manager.cc:5697] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.081796  7820 consensus_queue.cc:1048] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.092388  7820 consensus_queue.cc:1048] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.126714  7789 consensus_queue.cc:1048] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.138911  7789 consensus_queue.cc:1048] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.141224  7665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "842eb71698124890907e22ed545909ad"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
mode: GRACEFUL
new_leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
 from {username='slave'} at 127.0.0.1:49598
I20260709 12:22:53.144780  7665 raft_consensus.cc:606] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Received request to transfer leadership to TS c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:53.150997  7789 consensus_queue.cc:1048] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.160817  7665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
mode: GRACEFUL
new_leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
 from {username='slave'} at 127.0.0.1:49598
I20260709 12:22:53.161346  7665 raft_consensus.cc:606] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Received request to transfer leadership to TS c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:53.178664  7738 raft_consensus.cc:3060] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.187777  7789 consensus_queue.cc:1048] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.194670  7589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ade4b051b9e4d528bb82258ffe38b87"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
mode: GRACEFUL
new_leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
 from {username='slave'} at 127.0.0.1:40118
I20260709 12:22:53.195372  7589 raft_consensus.cc:606] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Received request to transfer leadership to TS 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:53.214630  7738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb9a370a18204449b0612439e1381459"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
mode: GRACEFUL
new_leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
 from {username='slave'} at 127.0.0.1:55032
I20260709 12:22:53.215209  7738 raft_consensus.cc:606] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Received request to transfer leadership to TS 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:53.220124  7589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f79204baa78c48b0acd0c839667e564c"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
mode: GRACEFUL
new_leader_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:40118
I20260709 12:22:53.220739  7589 raft_consensus.cc:606] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Received request to transfer leadership to TS 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:53.317065  7820 consensus_queue.cc:1048] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.327734  7820 consensus_queue.cc:1048] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.336395  7819 raft_consensus.cc:993] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706: : Instructing follower 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:22:53.336930  7820 raft_consensus.cc:1081] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Signalling peer 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:22:53.338624  7738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f79204baa78c48b0acd0c839667e564c"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:55006
I20260709 12:22:53.339057  7738 raft_consensus.cc:493] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.339408  7738 raft_consensus.cc:3060] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.345432  7738 raft_consensus.cc:515] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.347121  7738 leader_election.cc:290] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:53.348033  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79204baa78c48b0acd0c839667e564c" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:53.348467  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f79204baa78c48b0acd0c839667e564c" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:53.348805  7589 raft_consensus.cc:3055] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.349146  7665 raft_consensus.cc:3060] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.349186  7589 raft_consensus.cc:740] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:53.350171  7589 consensus_queue.cc:260] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.351485  7589 raft_consensus.cc:3060] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.356993  7665 raft_consensus.cc:2468] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:22:53.358280  7702 leader_election.cc:304] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:22:53.358965  7589 raft_consensus.cc:2468] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:22:53.359115  7825 raft_consensus.cc:2804] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.359757  7825 raft_consensus.cc:697] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:53.360550  7825 consensus_queue.cc:237] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.366845  7487 catalog_manager.cc:5697] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 1 to 2, leader changed from c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129) to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 2 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:53.385792  7820 consensus_queue.cc:1048] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.393280  7819 raft_consensus.cc:993] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706: : Instructing follower 4513eec79edf4342ba5c9a5b1528ff1b to start an election
I20260709 12:22:53.393751  7819 raft_consensus.cc:1081] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Signalling peer 4513eec79edf4342ba5c9a5b1528ff1b to start an election
I20260709 12:22:53.395960  7664 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ade4b051b9e4d528bb82258ffe38b87"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
 from {username='slave'} at 127.0.0.1:49578
I20260709 12:22:53.398020  7664 raft_consensus.cc:493] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.398414  7664 raft_consensus.cc:3060] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.399863  7820 consensus_queue.cc:1048] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.406431  7664 raft_consensus.cc:515] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.410116  7825 consensus_queue.cc:1048] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.412969  7664 leader_election.cc:290] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:53.415889  7590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ade4b051b9e4d528bb82258ffe38b87" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:53.416158  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ade4b051b9e4d528bb82258ffe38b87" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:53.416517  7590 raft_consensus.cc:3055] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.416800  7738 raft_consensus.cc:3060] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.416885  7590 raft_consensus.cc:740] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:53.417887  7590 consensus_queue.cc:260] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.419157  7590 raft_consensus.cc:3060] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.424544  7738 raft_consensus.cc:2468] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 2.
I20260709 12:22:53.426244  7628 leader_election.cc:304] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:22:53.427415  7789 raft_consensus.cc:2804] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.428719  7789 raft_consensus.cc:697] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:53.429554  7789 consensus_queue.cc:237] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.431257  7790 consensus_queue.cc:1048] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.434746  7590 raft_consensus.cc:2468] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 2.
I20260709 12:22:53.441619  7789 consensus_queue.cc:1048] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.441205  7484 catalog_manager.cc:5697] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 1 to 2, leader changed from c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129) to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.442540  7842 consensus_queue.cc:1048] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.454708  7790 raft_consensus.cc:993] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13: : Instructing follower 4513eec79edf4342ba5c9a5b1528ff1b to start an election
I20260709 12:22:53.455152  7790 raft_consensus.cc:1081] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Signalling peer 4513eec79edf4342ba5c9a5b1528ff1b to start an election
I20260709 12:22:53.458249  7665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb9a370a18204449b0612439e1381459"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
 from {username='slave'} at 127.0.0.1:49594
I20260709 12:22:53.458890  7665 raft_consensus.cc:493] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.459312  7665 raft_consensus.cc:3060] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.461122  7814 consensus_queue.cc:1048] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.467644  7665 raft_consensus.cc:515] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.471055  7588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9a370a18204449b0612439e1381459" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:53.471750  7665 leader_election.cc:290] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:53.471868  7588 raft_consensus.cc:3060] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.473587  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9a370a18204449b0612439e1381459" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:53.474298  7738 raft_consensus.cc:3055] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.474617  7738 raft_consensus.cc:740] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:53.475457  7738 consensus_queue.cc:260] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.476327  7738 raft_consensus.cc:3060] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.483039  7738 raft_consensus.cc:2468] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 2.
I20260709 12:22:53.484752  7789 consensus_queue.cc:1048] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.485364  7628 leader_election.cc:304] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:22:53.486228  7789 raft_consensus.cc:2804] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.486718  7789 raft_consensus.cc:697] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:53.487603  7789 consensus_queue.cc:237] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.489301  7795 raft_consensus.cc:993] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b: : Instructing follower c44ccfd8978b413bbc4eb7111f5d4706 to start an election
I20260709 12:22:53.490360  7795 raft_consensus.cc:1081] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Signalling peer c44ccfd8978b413bbc4eb7111f5d4706 to start an election
I20260709 12:22:53.498824  7589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
 from {username='slave'} at 127.0.0.1:40108
I20260709 12:22:53.500052  7589 raft_consensus.cc:493] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.500581  7589 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.501729  7588 raft_consensus.cc:2468] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 2.
I20260709 12:22:53.497095  7487 catalog_manager.cc:5697] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 1 to 2, leader changed from 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131) to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.511953  7589 raft_consensus.cc:515] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.518676  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:53.519285  7665 raft_consensus.cc:3055] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.519635  7665 raft_consensus.cc:740] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:53.519909  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:53.520602  7738 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.520515  7665 consensus_queue.cc:260] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.521816  7665 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.522708  7589 leader_election.cc:290] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 2 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:53.527822  7738 raft_consensus.cc:2468] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 2.
I20260709 12:22:53.529117  7553 leader_election.cc:304] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:53.529488  7665 raft_consensus.cc:2468] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 2.
I20260709 12:22:53.530017  7783 raft_consensus.cc:2804] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.530515  7783 raft_consensus.cc:697] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:53.531358  7783 consensus_queue.cc:237] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:53.537701  7484 catalog_manager.cc:5697] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 1 to 2, leader changed from 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130) to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.755690  7795 raft_consensus.cc:993] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b: : Instructing follower c44ccfd8978b413bbc4eb7111f5d4706 to start an election
I20260709 12:22:53.756250  7814 raft_consensus.cc:1081] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Signalling peer c44ccfd8978b413bbc4eb7111f5d4706 to start an election
I20260709 12:22:53.758021  7589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "842eb71698124890907e22ed545909ad"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
 from {username='slave'} at 127.0.0.1:40108
I20260709 12:22:53.758576  7589 raft_consensus.cc:493] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:53.758917  7589 raft_consensus.cc:3060] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.766201  7589 raft_consensus.cc:515] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:53.767985  7589 leader_election.cc:290] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 2 election: Requested vote from peers 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:53.768908  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842eb71698124890907e22ed545909ad" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:53.769233  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842eb71698124890907e22ed545909ad" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:53.769523  7738 raft_consensus.cc:3060] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.769939  7665 raft_consensus.cc:3055] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:53.770248  7665 raft_consensus.cc:740] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:53.770985  7665 consensus_queue.cc:260] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:53.772039  7665 raft_consensus.cc:3060] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.775008  7738 raft_consensus.cc:2468] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 2.
I20260709 12:22:53.776113  7553 leader_election.cc:304] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:53.776835  7783 raft_consensus.cc:2804] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:53.777230  7783 raft_consensus.cc:697] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:53.777797  7665 raft_consensus.cc:2468] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 2.
I20260709 12:22:53.777987  7783 consensus_queue.cc:237] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } }
I20260709 12:22:53.785084  7484 catalog_manager.cc:5697] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 1 to 2, leader changed from 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130) to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.913971  7589 raft_consensus.cc:1275] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.915357  7790 consensus_queue.cc:1048] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.919941  7588 raft_consensus.cc:1275] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 4513eec79edf4342ba5c9a5b1528ff1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.922497  7814 consensus_queue.cc:1048] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:53.926558  7665 raft_consensus.cc:1275] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.928145  7857 consensus_queue.cc:1048] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.933809  7738 raft_consensus.cc:1275] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Refusing update from remote peer 4513eec79edf4342ba5c9a5b1528ff1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.935398  7842 consensus_queue.cc:1048] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.976769  7588 raft_consensus.cc:1275] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 4513eec79edf4342ba5c9a5b1528ff1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.978137  7842 consensus_queue.cc:1048] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:53.986310  7738 raft_consensus.cc:1275] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Refusing update from remote peer 4513eec79edf4342ba5c9a5b1528ff1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:53.988793  7789 consensus_queue.cc:1048] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.013402  7738 raft_consensus.cc:1275] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Refusing update from remote peer c44ccfd8978b413bbc4eb7111f5d4706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.014889  7783 consensus_queue.cc:1048] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.024343  7665 raft_consensus.cc:1275] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer c44ccfd8978b413bbc4eb7111f5d4706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.026613  7783 consensus_queue.cc:1048] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.159391  7665 raft_consensus.cc:1275] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer c44ccfd8978b413bbc4eb7111f5d4706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.160691  7783 consensus_queue.cc:1048] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:54.169413  7738 raft_consensus.cc:1275] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Refusing update from remote peer c44ccfd8978b413bbc4eb7111f5d4706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:54.171042  7859 consensus_queue.cc:1048] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:56.251637  7487 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33332:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:56.253952  7487 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:56.300563  7575 tablet_service.cc:1511] Processing CreateTablet for tablet b76321debadc4ce686de151489cb191b (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:56.301892  7575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76321debadc4ce686de151489cb191b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.301748  7649 tablet_service.cc:1511] Processing CreateTablet for tablet b76321debadc4ce686de151489cb191b (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:56.303210  7649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76321debadc4ce686de151489cb191b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.304966  7726 tablet_service.cc:1511] Processing CreateTablet for tablet b76321debadc4ce686de151489cb191b (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:56.306221  7726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76321debadc4ce686de151489cb191b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.306126  7647 tablet_service.cc:1511] Processing CreateTablet for tablet d2dd7667e72342b096b9abfc7332bee1 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:56.307461  7647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd7667e72342b096b9abfc7332bee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.307808  7724 tablet_service.cc:1511] Processing CreateTablet for tablet d2dd7667e72342b096b9abfc7332bee1 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:56.309082  7724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd7667e72342b096b9abfc7332bee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.309993  7579 tablet_service.cc:1511] Processing CreateTablet for tablet 03f91fb14eab46f0aefe15730d9ca235 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:56.311250  7579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f91fb14eab46f0aefe15730d9ca235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.313441  7728 tablet_service.cc:1511] Processing CreateTablet for tablet 03f91fb14eab46f0aefe15730d9ca235 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:56.314687  7728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f91fb14eab46f0aefe15730d9ca235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.317431  7580 tablet_service.cc:1511] Processing CreateTablet for tablet a0de635746aa42dab69581b12a00668d (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:56.318688  7580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0de635746aa42dab69581b12a00668d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.314368  7655 tablet_service.cc:1511] Processing CreateTablet for tablet 03f91fb14eab46f0aefe15730d9ca235 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:56.320955  7655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f91fb14eab46f0aefe15730d9ca235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.321265  7725 tablet_service.cc:1511] Processing CreateTablet for tablet a0de635746aa42dab69581b12a00668d (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:56.321527  7576 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfb32c2fb3c4a29a918e850bfa2c409 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:56.322571  7725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0de635746aa42dab69581b12a00668d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.322723  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfb32c2fb3c4a29a918e850bfa2c409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.324509  7652 tablet_service.cc:1511] Processing CreateTablet for tablet a0de635746aa42dab69581b12a00668d (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:56.304973  7578 tablet_service.cc:1511] Processing CreateTablet for tablet d2dd7667e72342b096b9abfc7332bee1 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:56.325881  7652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0de635746aa42dab69581b12a00668d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.325990  7578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2dd7667e72342b096b9abfc7332bee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.336293  7648 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfb32c2fb3c4a29a918e850bfa2c409 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:56.337962  7648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfb32c2fb3c4a29a918e850bfa2c409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.343012  7874 tablet_bootstrap.cc:492] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:56.339133  7729 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfb32c2fb3c4a29a918e850bfa2c409 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:56.351495  7729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfb32c2fb3c4a29a918e850bfa2c409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.351662  7651 tablet_service.cc:1511] Processing CreateTablet for tablet 5263c593bd334af4bf46e288d1e342e2 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:56.353013  7651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5263c593bd334af4bf46e288d1e342e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.353380  7874 tablet_bootstrap.cc:654] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.340687  7577 tablet_service.cc:1511] Processing CreateTablet for tablet 5263c593bd334af4bf46e288d1e342e2 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:56.357720  7577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5263c593bd334af4bf46e288d1e342e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.358093  7654 tablet_service.cc:1511] Processing CreateTablet for tablet 79522c34a1964bacbd70d987e7c293a8 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:56.359367  7654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79522c34a1964bacbd70d987e7c293a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.359870  7727 tablet_service.cc:1511] Processing CreateTablet for tablet 79522c34a1964bacbd70d987e7c293a8 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:56.361338  7727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79522c34a1964bacbd70d987e7c293a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.362252  7723 tablet_service.cc:1511] Processing CreateTablet for tablet 5263c593bd334af4bf46e288d1e342e2 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:56.363540  7723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5263c593bd334af4bf46e288d1e342e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.369772  7576 tablet_service.cc:1511] Processing CreateTablet for tablet 79522c34a1964bacbd70d987e7c293a8 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:56.371170  7576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79522c34a1964bacbd70d987e7c293a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.383917  7575 tablet_service.cc:1511] Processing CreateTablet for tablet 01df735d86ea4d5aa2e3aa9f294a69f8 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:56.385398  7653 tablet_service.cc:1511] Processing CreateTablet for tablet 01df735d86ea4d5aa2e3aa9f294a69f8 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:56.386734  7653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df735d86ea4d5aa2e3aa9f294a69f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.386734  7575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df735d86ea4d5aa2e3aa9f294a69f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.395941  7722 tablet_service.cc:1511] Processing CreateTablet for tablet 01df735d86ea4d5aa2e3aa9f294a69f8 (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:56.397436  7722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01df735d86ea4d5aa2e3aa9f294a69f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.403337  7874 tablet_bootstrap.cc:492] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:56.404018  7874 ts_tablet_manager.cc:1403] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.064s	user 0.006s	sys 0.006s
I20260709 12:22:56.408654  7574 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffb56f458d4411dbae636d1325c788b (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:56.411096  7574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffb56f458d4411dbae636d1325c788b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.416297  7650 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffb56f458d4411dbae636d1325c788b (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:56.417673  7650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffb56f458d4411dbae636d1325c788b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.418532  7721 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffb56f458d4411dbae636d1325c788b (DEFAULT_TABLE table=soft_deleted_table [id=413759abea484a4e9fd02cd9396af125]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:56.419870  7721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffb56f458d4411dbae636d1325c788b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:56.432579  7874 raft_consensus.cc:359] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.436934  7874 raft_consensus.cc:385] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.438076  7874 raft_consensus.cc:740] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.440646  7874 consensus_queue.cc:260] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.443668  7874 ts_tablet_manager.cc:1434] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:22:56.444737  7874 tablet_bootstrap.cc:492] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:56.473095  7877 tablet_bootstrap.cc:492] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:56.509119  7874 tablet_bootstrap.cc:654] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.525960  7877 tablet_bootstrap.cc:654] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.540284  7878 tablet_bootstrap.cc:492] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.548544  7878 tablet_bootstrap.cc:654] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:56.555003  7628 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:46105, user_credentials={real_user=slave}} blocked reactor thread for 51762us
I20260709 12:22:56.576191  7877 tablet_bootstrap.cc:492] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:56.576812  7877 ts_tablet_manager.cc:1403] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.015s
I20260709 12:22:56.576943  7874 tablet_bootstrap.cc:492] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:56.577549  7874 ts_tablet_manager.cc:1403] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.133s	user 0.025s	sys 0.007s
I20260709 12:22:56.578118  7878 tablet_bootstrap.cc:492] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:56.578711  7878 ts_tablet_manager.cc:1403] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.016s
I20260709 12:22:56.580235  7877 raft_consensus.cc:359] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.581107  7877 raft_consensus.cc:385] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.580681  7874 raft_consensus.cc:359] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.581473  7877 raft_consensus.cc:740] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.581677  7874 raft_consensus.cc:385] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.582151  7874 raft_consensus.cc:740] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.581776  7878 raft_consensus.cc:359] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.582649  7878 raft_consensus.cc:385] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.582412  7877 consensus_queue.cc:260] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.582965  7878 raft_consensus.cc:740] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.583041  7874 consensus_queue.cc:260] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.583806  7878 consensus_queue.cc:260] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.585192  7877 ts_tablet_manager.cc:1434] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:56.585641  7874 ts_tablet_manager.cc:1434] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:56.586340  7877 tablet_bootstrap.cc:492] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:56.586763  7874 tablet_bootstrap.cc:492] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:56.588882  7878 ts_tablet_manager.cc:1434] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:22:56.592494  7878 tablet_bootstrap.cc:492] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.593483  7874 tablet_bootstrap.cc:654] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.594565  7877 tablet_bootstrap.cc:654] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.599700  7878 tablet_bootstrap.cc:654] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.613296  7878 tablet_bootstrap.cc:492] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:56.614037  7878 ts_tablet_manager.cc:1403] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 12:22:56.618090  7878 raft_consensus.cc:359] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.619025  7878 raft_consensus.cc:385] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.619064  7880 raft_consensus.cc:493] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.619975  7878 raft_consensus.cc:740] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.620198  7880 raft_consensus.cc:515] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.620810  7878 consensus_queue.cc:260] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.623430  7880 leader_election.cc:290] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.623929  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79522c34a1964bacbd70d987e7c293a8" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:56.624692  7878 ts_tablet_manager.cc:1434] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:56.626117  7878 tablet_bootstrap.cc:492] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.626986  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79522c34a1964bacbd70d987e7c293a8" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.627938  7739 raft_consensus.cc:2468] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
W20260709 12:22:56.631330  7628 leader_election.cc:343] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.632825  7859 raft_consensus.cc:493] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.633539  7859 raft_consensus.cc:515] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.636566  7859 leader_election.cc:290] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.637286  7878 tablet_bootstrap.cc:654] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.638079  7880 raft_consensus.cc:493] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.646359  7880 raft_consensus.cc:515] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.648411  7880 leader_election.cc:290] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.638720  7628 leader_election.cc:304] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:56.648766  7874 tablet_bootstrap.cc:492] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:56.649344  7874 ts_tablet_manager.cc:1403] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.038s
I20260709 12:22:56.650012  7881 raft_consensus.cc:2804] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.650458  7881 raft_consensus.cc:493] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.650786  7881 raft_consensus.cc:3060] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.651525  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:56.642408  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.654471  7874 raft_consensus.cc:359] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.655313  7874 raft_consensus.cc:385] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.655656  7874 raft_consensus.cc:740] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.656656  7874 consensus_queue.cc:260] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
W20260709 12:22:56.656911  7553 leader_election.cc:343] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:56.657744  7553 leader_election.cc:343] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.658147  7553 leader_election.cc:304] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:56.658288  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0de635746aa42dab69581b12a00668d" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.658699  7878 tablet_bootstrap.cc:492] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:56.659057  7874 ts_tablet_manager.cc:1434] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:56.659245  7878 ts_tablet_manager.cc:1403] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
W20260709 12:22:56.659641  7628 leader_election.cc:343] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.659871  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0de635746aa42dab69581b12a00668d" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:56.660107  7874 tablet_bootstrap.cc:492] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:56.661100  7869 raft_consensus.cc:2749] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:56.662531  7878 raft_consensus.cc:359] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
W20260709 12:22:56.663288  7628 leader_election.cc:343] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.663323  7878 raft_consensus.cc:385] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.663834  7878 raft_consensus.cc:740] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.663813  7628 leader_election.cc:304] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:56.664963  7879 raft_consensus.cc:2749] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:56.666757  7878 consensus_queue.cc:260] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.669382  7878 ts_tablet_manager.cc:1434] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:22:56.669793  7874 tablet_bootstrap.cc:654] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.670493  7878 tablet_bootstrap.cc:492] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.672482  7881 raft_consensus.cc:515] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
W20260709 12:22:56.676497  7536 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:56.677737  7879 raft_consensus.cc:493] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.678481  7879 raft_consensus.cc:515] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.680903  7879 leader_election.cc:290] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.681003  7877 tablet_bootstrap.cc:492] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:56.681654  7874 tablet_bootstrap.cc:492] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:56.682103  7877 ts_tablet_manager.cc:1403] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.032s
I20260709 12:22:56.682268  7874 ts_tablet_manager.cc:1403] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:22:56.682153  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79522c34a1964bacbd70d987e7c293a8" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
W20260709 12:22:56.683497  7628 leader_election.cc:343] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.684137  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.681675  7881 leader_election.cc:290] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.684196  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79522c34a1964bacbd70d987e7c293a8" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:56.685401  7739 raft_consensus.cc:3060] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:56.686306  7628 leader_election.cc:343] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.686335  7874 raft_consensus.cc:359] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.686950  7877 raft_consensus.cc:359] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.687276  7874 raft_consensus.cc:385] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.687516  7877 raft_consensus.cc:385] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.687631  7874 raft_consensus.cc:740] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.687773  7877 raft_consensus.cc:740] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.688591  7874 consensus_queue.cc:260] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.688798  7877 consensus_queue.cc:260] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.689698  7878 tablet_bootstrap.cc:654] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.691015  7874 ts_tablet_manager.cc:1434] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:56.691452  7877 ts_tablet_manager.cc:1434] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:22:56.692085  7874 tablet_bootstrap.cc:492] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:56.692534  7877 tablet_bootstrap.cc:492] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:56.684547  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
W20260709 12:22:56.697270  7628 leader_election.cc:343] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.697919  7628 leader_election.cc:304] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:56.698757  7881 raft_consensus.cc:2749] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:56.699455  7874 tablet_bootstrap.cc:654] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.701427  7877 tablet_bootstrap.cc:654] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.701503  7878 tablet_bootstrap.cc:492] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:56.702277  7878 ts_tablet_manager.cc:1403] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.007s
I20260709 12:22:56.704910  7739 raft_consensus.cc:2468] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:56.706041  7878 raft_consensus.cc:359] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.706698  7628 leader_election.cc:304] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:56.707186  7878 raft_consensus.cc:385] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.707782  7878 raft_consensus.cc:740] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.707923  7881 raft_consensus.cc:2804] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:56.708667  7881 raft_consensus.cc:697] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:56.709067  7878 consensus_queue.cc:260] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.709617  7881 consensus_queue.cc:237] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.711341  7874 tablet_bootstrap.cc:492] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:56.711983  7874 ts_tablet_manager.cc:1403] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.002s
I20260709 12:22:56.712565  7878 ts_tablet_manager.cc:1434] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:22:56.713721  7878 tablet_bootstrap.cc:492] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.714258  7877 tablet_bootstrap.cc:492] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:56.714846  7877 ts_tablet_manager.cc:1403] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:22:56.715273  7874 raft_consensus.cc:359] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.716454  7874 raft_consensus.cc:385] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.716809  7874 raft_consensus.cc:740] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.717669  7874 consensus_queue.cc:260] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.720074  7874 ts_tablet_manager.cc:1434] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:22:56.721397  7874 tablet_bootstrap.cc:492] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:56.721429  7878 tablet_bootstrap.cc:654] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.721995  7877 raft_consensus.cc:359] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.723143  7877 raft_consensus.cc:385] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.723517  7877 raft_consensus.cc:740] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.724359  7877 consensus_queue.cc:260] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.726598  7877 ts_tablet_manager.cc:1434] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:22:56.727427  7877 tablet_bootstrap.cc:492] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:56.731302  7874 tablet_bootstrap.cc:654] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.733009  7878 tablet_bootstrap.cc:492] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:56.733628  7878 ts_tablet_manager.cc:1403] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.006s
I20260709 12:22:56.737191  7878 raft_consensus.cc:359] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.738088  7878 raft_consensus.cc:385] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.738441  7878 raft_consensus.cc:740] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.739471  7878 consensus_queue.cc:260] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.741333  7877 tablet_bootstrap.cc:654] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.742138  7878 ts_tablet_manager.cc:1434] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:22:56.743347  7878 tablet_bootstrap.cc:492] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.743993  7859 raft_consensus.cc:493] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.745446  7859 raft_consensus.cc:515] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.753419  7874 tablet_bootstrap.cc:492] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:56.754084  7874 ts_tablet_manager.cc:1403] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.010s
I20260709 12:22:56.757464  7874 raft_consensus.cc:359] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.758235  7874 raft_consensus.cc:385] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.758330  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0de635746aa42dab69581b12a00668d" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.758638  7874 raft_consensus.cc:740] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.761330  7485 catalog_manager.cc:5697] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.758921  7859 leader_election.cc:290] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.758394  7878 tablet_bootstrap.cc:654] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.761204  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0de635746aa42dab69581b12a00668d" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:56.762626  7874 consensus_queue.cc:260] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.763123  7664 raft_consensus.cc:2468] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 0.
W20260709 12:22:56.763300  7553 leader_election.cc:343] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.761538  7877 tablet_bootstrap.cc:492] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:56.764477  7877 ts_tablet_manager.cc:1403] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 12:22:56.764501  7553 leader_election.cc:304] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:56.765236  7874 ts_tablet_manager.cc:1434] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:56.765558  7869 raft_consensus.cc:2804] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.765959  7869 raft_consensus.cc:493] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.766287  7869 raft_consensus.cc:3060] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.766407  7874 tablet_bootstrap.cc:492] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:56.767663  7877 raft_consensus.cc:359] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.768421  7877 raft_consensus.cc:385] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.768771  7877 raft_consensus.cc:740] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.769546  7877 consensus_queue.cc:260] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.771917  7877 ts_tablet_manager.cc:1434] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:56.772130  7879 raft_consensus.cc:493] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.772836  7877 tablet_bootstrap.cc:492] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:56.772735  7879 raft_consensus.cc:515] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.774909  7879 leader_election.cc:290] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.775386  7879 raft_consensus.cc:493] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.775776  7879 raft_consensus.cc:515] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.776408  7874 tablet_bootstrap.cc:654] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.778035  7879 leader_election.cc:290] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.780741  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76321debadc4ce686de151489cb191b" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:56.781608  7589 raft_consensus.cc:2468] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:56.784359  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76321debadc4ce686de151489cb191b" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.786950  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.789119  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:56.787057  7877 tablet_bootstrap.cc:654] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.800248  7589 raft_consensus.cc:2468] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:56.805593  7878 tablet_bootstrap.cc:492] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:56.806293  7878 ts_tablet_manager.cc:1403] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.013s
I20260709 12:22:56.806566  7877 tablet_bootstrap.cc:492] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:56.807157  7877 ts_tablet_manager.cc:1403] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.002s
I20260709 12:22:56.809628  7878 raft_consensus.cc:359] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.810452  7878 raft_consensus.cc:385] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.810755  7878 raft_consensus.cc:740] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.811580  7878 consensus_queue.cc:260] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.814043  7878 ts_tablet_manager.cc:1434] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:56.815196  7878 tablet_bootstrap.cc:492] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.814195  7877 raft_consensus.cc:359] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.815845  7877 raft_consensus.cc:385] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.816190  7877 raft_consensus.cc:740] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.818053  7858 raft_consensus.cc:493] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.818584  7858 raft_consensus.cc:515] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.820883  7858 leader_election.cc:290] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:56.817054  7877 consensus_queue.cc:260] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.822077  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:56.823024  7878 tablet_bootstrap.cc:654] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:56.823504  7702 leader_election.cc:343] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.823747  7877 ts_tablet_manager.cc:1434] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:22:56.825145  7858 raft_consensus.cc:493] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.825691  7858 raft_consensus.cc:515] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.828372  7858 leader_election.cc:290] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:56.829396  7877 tablet_bootstrap.cc:492] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:56.829329  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f91fb14eab46f0aefe15730d9ca235" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
W20260709 12:22:56.831040  7702 leader_election.cc:343] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.831310  7858 raft_consensus.cc:493] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.831835  7858 raft_consensus.cc:515] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.834721  7858 leader_election.cc:290] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:56.835542  7878 tablet_bootstrap.cc:492] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
W20260709 12:22:56.815228  7628 leader_election.cc:343] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.835963  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:56.836263  7878 ts_tablet_manager.cc:1403] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.005s
W20260709 12:22:56.836455  7628 leader_election.cc:343] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.836696  7589 raft_consensus.cc:2468] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 0.
I20260709 12:22:56.838178  7877 tablet_bootstrap.cc:654] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.838050  7702 leader_election.cc:304] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:56.839176  7858 raft_consensus.cc:2804] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.839582  7858 raft_consensus.cc:493] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.839962  7858 raft_consensus.cc:3060] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.840027  7878 raft_consensus.cc:359] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.840999  7878 raft_consensus.cc:385] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.841360  7878 raft_consensus.cc:740] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.842413  7878 consensus_queue.cc:260] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.846213  7878 ts_tablet_manager.cc:1434] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:56.850179  7878 tablet_bootstrap.cc:492] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.850369  7877 tablet_bootstrap.cc:492] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:56.851029  7877 ts_tablet_manager.cc:1403] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.000s
I20260709 12:22:56.851032  7869 raft_consensus.cc:515] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.857334  7878 tablet_bootstrap.cc:654] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.858603  7869 leader_election.cc:290] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.854923  7877 raft_consensus.cc:359] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.849085  7858 raft_consensus.cc:515] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.860678  7877 raft_consensus.cc:385] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.861022  7877 raft_consensus.cc:740] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.852595  7628 leader_election.cc:304] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:56.859723  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0de635746aa42dab69581b12a00668d" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:56.861843  7877 consensus_queue.cc:260] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.862219  7881 raft_consensus.cc:2804] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.862703  7881 raft_consensus.cc:493] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.863216  7881 raft_consensus.cc:3060] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.863241  7739 raft_consensus.cc:3060] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.864274  7877 ts_tablet_manager.cc:1434] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:22:56.865849  7877 tablet_bootstrap.cc:492] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:56.867467  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:56.868144  7589 raft_consensus.cc:3060] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.862623  7628 leader_election.cc:304] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:56.870046  7879 raft_consensus.cc:2804] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.870481  7879 raft_consensus.cc:493] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.870873  7879 raft_consensus.cc:3060] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.871573  7881 raft_consensus.cc:515] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.874363  7877 tablet_bootstrap.cc:654] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.874567  7878 tablet_bootstrap.cc:492] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:56.875141  7878 ts_tablet_manager.cc:1403] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.001s
I20260709 12:22:56.875840  7589 raft_consensus.cc:2468] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 1.
I20260709 12:22:56.877220  7702 leader_election.cc:304] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:56.878310  7902 raft_consensus.cc:2804] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:56.878473  7878 raft_consensus.cc:359] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.882121  7878 raft_consensus.cc:385] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.882566  7878 raft_consensus.cc:740] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.883559  7878 consensus_queue.cc:260] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.881500  7881 leader_election.cc:290] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.886184  7877 tablet_bootstrap.cc:492] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:56.886372  7878 ts_tablet_manager.cc:1434] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:56.886804  7877 ts_tablet_manager.cc:1403] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:22:56.886627  7588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76321debadc4ce686de151489cb191b" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:56.887441  7878 tablet_bootstrap.cc:492] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b: Bootstrap starting.
I20260709 12:22:56.887451  7588 raft_consensus.cc:3060] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.889461  7874 tablet_bootstrap.cc:492] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:56.889999  7877 raft_consensus.cc:359] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.890758  7877 raft_consensus.cc:385] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.891062  7877 raft_consensus.cc:740] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.891850  7877 consensus_queue.cc:260] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.892390  7858 leader_election.cc:290] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:56.890010  7874 ts_tablet_manager.cc:1403] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.052s
I20260709 12:22:56.894457  7878 tablet_bootstrap.cc:654] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.903128  7588 raft_consensus.cc:2468] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:56.903894  7902 raft_consensus.cc:697] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:56.908618  7662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:56.909253  7902 consensus_queue.cc:237] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.913894  7879 raft_consensus.cc:515] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.915381  7662 raft_consensus.cc:2393] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f409b8d7d1144d3b20518efc1164a13 in current term 1: Already voted for candidate 4513eec79edf4342ba5c9a5b1528ff1b in this term.
I20260709 12:22:56.887674  7739 raft_consensus.cc:2468] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:56.905593  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0de635746aa42dab69581b12a00668d" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:56.905556  7874 raft_consensus.cc:359] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.906504  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:56.907315  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f91fb14eab46f0aefe15730d9ca235" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:56.916805  7874 raft_consensus.cc:385] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.917160  7665 raft_consensus.cc:2468] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 0.
I20260709 12:22:56.917248  7874 raft_consensus.cc:740] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.918457  7874 consensus_queue.cc:260] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.920960  7660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:56.921875  7660 raft_consensus.cc:2393] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f409b8d7d1144d3b20518efc1164a13 in current term 1: Already voted for candidate 4513eec79edf4342ba5c9a5b1528ff1b in this term.
I20260709 12:22:56.916802  7664 raft_consensus.cc:3060] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.917212  7663 raft_consensus.cc:2468] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 0.
I20260709 12:22:56.924319  7702 leader_election.cc:304] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:56.926820  7905 raft_consensus.cc:2804] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.927361  7905 raft_consensus.cc:493] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.927713  7905 raft_consensus.cc:3060] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.928158  7874 ts_tablet_manager.cc:1434] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 12:22:56.924865  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:56.929373  7874 tablet_bootstrap.cc:492] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:56.924202  7553 leader_election.cc:304] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:56.932119  7859 raft_consensus.cc:2804] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:56.935173  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:56.936046  7589 raft_consensus.cc:2393] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4513eec79edf4342ba5c9a5b1528ff1b in current term 1: Already voted for candidate 0f409b8d7d1144d3b20518efc1164a13 in this term.
I20260709 12:22:56.916239  7879 leader_election.cc:290] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.941246  7488 catalog_manager.cc:5697] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:56.942166  7877 ts_tablet_manager.cc:1434] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.055s	user 0.016s	sys 0.023s
I20260709 12:22:56.952402  7664 raft_consensus.cc:2468] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:56.953183  7877 tablet_bootstrap.cc:492] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:56.954056  7878 tablet_bootstrap.cc:492] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b: No bootstrap required, opened a new log
I20260709 12:22:56.954594  7878 ts_tablet_manager.cc:1403] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.012s
I20260709 12:22:56.954792  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76321debadc4ce686de151489cb191b" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:56.942549  7628 leader_election.cc:304] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:56.944550  7859 raft_consensus.cc:697] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:56.955480  7739 raft_consensus.cc:3060] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.955935  7881 raft_consensus.cc:2804] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:56.956519  7881 raft_consensus.cc:697] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:56.956229  7859 consensus_queue.cc:237] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.957408  7881 consensus_queue.cc:237] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.961309  7628 leader_election.cc:304] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:56.961794  7877 tablet_bootstrap.cc:654] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.962791  7880 raft_consensus.cc:2749] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:56.963356  7739 raft_consensus.cc:2468] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:56.965350  7874 tablet_bootstrap.cc:654] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.965700  7702 leader_election.cc:304] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:56.966821  7906 raft_consensus.cc:2804] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.967353  7906 raft_consensus.cc:493] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.965914  7878 raft_consensus.cc:359] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.967772  7906 raft_consensus.cc:3060] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.968222  7878 raft_consensus.cc:385] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.950554  7905 raft_consensus.cc:515] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.943876  7909 raft_consensus.cc:493] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.968668  7878 raft_consensus.cc:740] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.969079  7909 raft_consensus.cc:515] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.969403  7878 consensus_queue.cc:260] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.971354  7909 leader_election.cc:290] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.971762  7878 ts_tablet_manager.cc:1434] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:22:56.969099  7869 raft_consensus.cc:493] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.972515  7869 raft_consensus.cc:515] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:56.975220  7869 leader_election.cc:290] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:56.977037  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2dd7667e72342b096b9abfc7332bee1" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:56.978209  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2dd7667e72342b096b9abfc7332bee1" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.979766  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79522c34a1964bacbd70d987e7c293a8" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
W20260709 12:22:56.979760  7553 leader_election.cc:343] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.981160  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79522c34a1964bacbd70d987e7c293a8" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:56.982018  7737 raft_consensus.cc:2393] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c44ccfd8978b413bbc4eb7111f5d4706 in current term 1: Already voted for candidate 4513eec79edf4342ba5c9a5b1528ff1b in this term.
I20260709 12:22:56.977733  7664 raft_consensus.cc:2468] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 0.
I20260709 12:22:56.982931  7588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:56.987805  7905 leader_election.cc:290] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
W20260709 12:22:56.989533  7702 leader_election.cc:343] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.982924  7553 leader_election.cc:304] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:56.991536  7859 raft_consensus.cc:2804] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.991961  7553 leader_election.cc:304] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:56.992027  7859 raft_consensus.cc:493] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.992748  7859 raft_consensus.cc:3060] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.996590  7869 raft_consensus.cc:3060] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.999380  7906 raft_consensus.cc:515] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.001075  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:57.002502  7664 raft_consensus.cc:3060] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.007089  7859 raft_consensus.cc:515] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.009764  7880 raft_consensus.cc:493] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.010026  7869 raft_consensus.cc:2749] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:57.010422  7880 raft_consensus.cc:515] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.013386  7906 leader_election.cc:290] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:57.015381  7588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f91fb14eab46f0aefe15730d9ca235" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:57.016028  7588 raft_consensus.cc:3060] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.017521  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f91fb14eab46f0aefe15730d9ca235" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:57.018143  7663 raft_consensus.cc:3060] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.020805  7485 catalog_manager.cc:5697] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 0 to 1, leader changed from <none> to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.027822  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" is_pre_election: true
I20260709 12:22:57.031039  7664 raft_consensus.cc:2468] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 1.
I20260709 12:22:57.026667  7880 leader_election.cc:290] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.033911  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:57.036228  7739 raft_consensus.cc:2468] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 0.
I20260709 12:22:57.037492  7628 leader_election.cc:304] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:22:57.038249  7880 raft_consensus.cc:2804] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:57.038336  7877 tablet_bootstrap.cc:492] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:57.038659  7880 raft_consensus.cc:493] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.038985  7877 ts_tablet_manager.cc:1403] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.034s
I20260709 12:22:57.038791  7702 leader_election.cc:304] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:57.039088  7880 raft_consensus.cc:3060] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.040364  7588 raft_consensus.cc:2468] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 1.
I20260709 12:22:57.041589  7702 leader_election.cc:304] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:57.042462  7905 raft_consensus.cc:2804] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.042255  7877 raft_consensus.cc:359] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.043560  7877 raft_consensus.cc:385] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.043895  7877 raft_consensus.cc:740] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.042994  7905 raft_consensus.cc:697] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:57.043149  7902 raft_consensus.cc:2804] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.045560  7902 raft_consensus.cc:697] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:57.045783  7905 consensus_queue.cc:237] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.046422  7902 consensus_queue.cc:237] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.049055  7880 raft_consensus.cc:515] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.044701  7877 consensus_queue.cc:260] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.057706  7880 leader_election.cc:290] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.058207  7877 ts_tablet_manager.cc:1434] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:22:57.061529  7877 tablet_bootstrap.cc:492] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13: Bootstrap starting.
I20260709 12:22:57.049896  7859 leader_election.cc:290] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
W20260709 12:22:57.051887  7628 leader_election.cc:343] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:57.066226  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2dd7667e72342b096b9abfc7332bee1" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:57.067059  7664 raft_consensus.cc:3060] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.067715  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:57.069006  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:57.069674  7737 raft_consensus.cc:3060] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:57.073559  7628 leader_election.cc:343] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:57.082233  7874 tablet_bootstrap.cc:492] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:57.082804  7874 ts_tablet_manager.cc:1403] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.021s
I20260709 12:22:57.055188  7869 raft_consensus.cc:493] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.083319  7869 raft_consensus.cc:515] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.085529  7869 leader_election.cc:290] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.055541  7663 raft_consensus.cc:2468] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 1.
I20260709 12:22:57.085861  7874 raft_consensus.cc:359] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.086634  7874 raft_consensus.cc:385] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.086946  7874 raft_consensus.cc:740] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.081840  7488 catalog_manager.cc:5697] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.083062  7877 tablet_bootstrap.cc:654] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.088023  7874 consensus_queue.cc:260] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.090531  7874 ts_tablet_manager.cc:1434] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:57.090610  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffb56f458d4411dbae636d1325c788b" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:57.098831  7874 tablet_bootstrap.cc:492] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706: Bootstrap starting.
I20260709 12:22:57.087744  7664 raft_consensus.cc:2468] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:57.092150  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffb56f458d4411dbae636d1325c788b" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:57.054324  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2dd7667e72342b096b9abfc7332bee1" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:57.109362  7739 raft_consensus.cc:3060] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.109918  7486 catalog_manager.cc:5697] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.112298  7486 catalog_manager.cc:5697] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 1 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.115888  7739 raft_consensus.cc:2468] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:57.093920  7737 raft_consensus.cc:2468] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 1.
I20260709 12:22:57.117381  7663 raft_consensus.cc:2468] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 0.
W20260709 12:22:57.118063  7553 leader_election.cc:343] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:57.116278  7874 tablet_bootstrap.cc:654] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.119016  7877 tablet_bootstrap.cc:492] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13: No bootstrap required, opened a new log
I20260709 12:22:57.118848  7553 leader_election.cc:304] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:57.119691  7869 raft_consensus.cc:2804] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.120203  7869 raft_consensus.cc:697] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:57.121049  7869 consensus_queue.cc:237] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.123492  7553 leader_election.cc:304] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:57.124739  7909 raft_consensus.cc:2804] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:57.125136  7909 raft_consensus.cc:493] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.125090  7628 leader_election.cc:304] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:57.125819  7877 ts_tablet_manager.cc:1403] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.004s
I20260709 12:22:57.125846  7909 raft_consensus.cc:3060] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.127043  7881 raft_consensus.cc:2804] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.127727  7881 raft_consensus.cc:697] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:57.129189  7877 raft_consensus.cc:359] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.129927  7877 raft_consensus.cc:385] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.130287  7877 raft_consensus.cc:740] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.128891  7881 consensus_queue.cc:237] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.131093  7877 consensus_queue.cc:260] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.133672  7877 ts_tablet_manager.cc:1434] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:22:57.135927  7909 raft_consensus.cc:515] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.141494  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffb56f458d4411dbae636d1325c788b" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:57.142336  7663 raft_consensus.cc:3060] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.163981  7663 raft_consensus.cc:2468] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:57.164503  7486 catalog_manager.cc:5697] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.166817  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffb56f458d4411dbae636d1325c788b" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:57.167532  7739 raft_consensus.cc:3060] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.167975  7553 leader_election.cc:304] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:57.169086  7859 raft_consensus.cc:2804] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.169206  7874 tablet_bootstrap.cc:492] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706: No bootstrap required, opened a new log
I20260709 12:22:57.169821  7874 ts_tablet_manager.cc:1403] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.030s
I20260709 12:22:57.166584  7909 leader_election.cc:290] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.172782  7874 raft_consensus.cc:359] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.173621  7874 raft_consensus.cc:385] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.173923  7874 raft_consensus.cc:740] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.174650  7874 consensus_queue.cc:260] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.176785  7874 ts_tablet_manager.cc:1434] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:57.177448  7739 raft_consensus.cc:2468] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 1.
I20260709 12:22:57.179016  7859 raft_consensus.cc:697] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:57.179955  7859 consensus_queue.cc:237] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.186375  7486 catalog_manager.cc:5697] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 0 to 1, leader changed from <none> to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.198204  7486 catalog_manager.cc:5697] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 0 to 1, leader changed from <none> to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 1 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.264199  7859 raft_consensus.cc:493] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.264705  7859 raft_consensus.cc:515] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.266403  7859 leader_election.cc:290] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.267143  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:57.267519  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:57.268085  7663 raft_consensus.cc:2393] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c44ccfd8978b413bbc4eb7111f5d4706 in current term 1: Already voted for candidate 0f409b8d7d1144d3b20518efc1164a13 in this term.
I20260709 12:22:57.269124  7553 leader_election.cc:304] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:57.269706  7859 raft_consensus.cc:3060] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.275435  7859 raft_consensus.cc:2749] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:57.277042  7881 consensus_queue.cc:1048] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.290880  7663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b76321debadc4ce686de151489cb191b"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
mode: GRACEFUL
new_leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
 from {username='slave'} at 127.0.0.1:49598
I20260709 12:22:57.290928  7880 consensus_queue.cc:1048] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:57.291561  7663 raft_consensus.cc:606] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Received request to transfer leadership to TS c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:57.292883  7859 raft_consensus.cc:493] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.293399  7859 raft_consensus.cc:515] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.295454  7859 leader_election.cc:290] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.296820  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" is_pre_election: true
I20260709 12:22:57.297427  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f409b8d7d1144d3b20518efc1164a13" is_pre_election: true
I20260709 12:22:57.298218  7739 raft_consensus.cc:2393] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c44ccfd8978b413bbc4eb7111f5d4706 in current term 1: Already voted for candidate 4513eec79edf4342ba5c9a5b1528ff1b in this term.
I20260709 12:22:57.301860  7553 leader_election.cc:304] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c44ccfd8978b413bbc4eb7111f5d4706; no voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:57.302577  7859 raft_consensus.cc:3060] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.307997  7739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f91fb14eab46f0aefe15730d9ca235"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
mode: GRACEFUL
new_leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
 from {username='slave'} at 127.0.0.1:55032
I20260709 12:22:57.309033  7739 raft_consensus.cc:606] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Received request to transfer leadership to TS c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:57.316010  7859 raft_consensus.cc:2749] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:57.317047  7739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
mode: GRACEFUL
new_leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
 from {username='slave'} at 127.0.0.1:55032
I20260709 12:22:57.317727  7739 raft_consensus.cc:606] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Received request to transfer leadership to TS 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:57.323443  7739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
mode: GRACEFUL
new_leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
 from {username='slave'} at 127.0.0.1:55032
I20260709 12:22:57.324055  7739 raft_consensus.cc:606] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Received request to transfer leadership to TS 4513eec79edf4342ba5c9a5b1528ff1b
I20260709 12:22:57.335650  7589 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ffb56f458d4411dbae636d1325c788b"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
mode: GRACEFUL
new_leader_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:40118
I20260709 12:22:57.336225  7589 raft_consensus.cc:606] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Received request to transfer leadership to TS 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:22:57.407051  7902 consensus_queue.cc:1048] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.407557  7859 consensus_queue.cc:1048] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.421963  7858 consensus_queue.cc:1048] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.427629  7869 consensus_queue.cc:1048] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.435369  7858 consensus_queue.cc:1048] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.447363  7902 raft_consensus.cc:993] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: : Instructing follower 4513eec79edf4342ba5c9a5b1528ff1b to start an election
I20260709 12:22:57.448048  7902 raft_consensus.cc:1081] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Signalling peer 4513eec79edf4342ba5c9a5b1528ff1b to start an election
I20260709 12:22:57.451643  7663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
 from {username='slave'} at 127.0.0.1:49594
I20260709 12:22:57.451871  7858 consensus_queue.cc:1048] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:57.452217  7663 raft_consensus.cc:493] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.453087  7663 raft_consensus.cc:3060] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.460898  7902 raft_consensus.cc:993] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13: : Instructing follower c44ccfd8978b413bbc4eb7111f5d4706 to start an election
I20260709 12:22:57.461418  7902 raft_consensus.cc:1081] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Signalling peer c44ccfd8978b413bbc4eb7111f5d4706 to start an election
I20260709 12:22:57.464509  7588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03f91fb14eab46f0aefe15730d9ca235"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
 from {username='slave'} at 127.0.0.1:40110
I20260709 12:22:57.465173  7588 raft_consensus.cc:493] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.465576  7588 raft_consensus.cc:3060] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.466040  7663 raft_consensus.cc:515] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.468243  7663 leader_election.cc:290] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.468770  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:57.469272  7739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfb32c2fb3c4a29a918e850bfa2c409" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:57.469470  7589 raft_consensus.cc:3060] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.469956  7739 raft_consensus.cc:3055] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:57.470324  7739 raft_consensus.cc:740] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:57.471340  7739 consensus_queue.cc:260] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.472782  7739 raft_consensus.cc:3060] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.472972  7588 raft_consensus.cc:515] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.474413  7881 consensus_queue.cc:1048] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.475823  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f91fb14eab46f0aefe15730d9ca235" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:57.476658  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f91fb14eab46f0aefe15730d9ca235" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:57.476543  7663 raft_consensus.cc:3060] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.477258  7737 raft_consensus.cc:3055] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:57.477610  7737 raft_consensus.cc:740] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:57.478374  7737 consensus_queue.cc:260] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.479509  7737 raft_consensus.cc:3060] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.476006  7588 leader_election.cc:290] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 2 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.485910  7739 raft_consensus.cc:2468] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 2.
I20260709 12:22:57.486452  7663 raft_consensus.cc:2468] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 2.
I20260709 12:22:57.487071  7628 leader_election.cc:304] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:22:57.487917  7881 raft_consensus.cc:2804] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:57.488372  7881 raft_consensus.cc:697] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:57.489172  7737 raft_consensus.cc:2468] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 2.
I20260709 12:22:57.489420  7881 consensus_queue.cc:237] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.488376  7553 leader_election.cc:304] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4513eec79edf4342ba5c9a5b1528ff1b, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:57.491988  7869 raft_consensus.cc:2804] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:57.492566  7869 raft_consensus.cc:697] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:57.493420  7589 raft_consensus.cc:2468] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 2.
I20260709 12:22:57.493501  7869 consensus_queue.cc:237] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.502987  7880 consensus_queue.cc:1048] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.502936  7488 catalog_manager.cc:5697] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 1 to 2, leader changed from 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131) to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.510830  7487 catalog_manager.cc:5697] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 1 to 2, leader changed from 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131) to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.514503  7880 raft_consensus.cc:993] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b: : Instructing follower c44ccfd8978b413bbc4eb7111f5d4706 to start an election
I20260709 12:22:57.515075  7880 raft_consensus.cc:1081] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Signalling peer c44ccfd8978b413bbc4eb7111f5d4706 to start an election
I20260709 12:22:57.516796  7589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b76321debadc4ce686de151489cb191b"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
 from {username='slave'} at 127.0.0.1:40108
I20260709 12:22:57.517364  7589 raft_consensus.cc:493] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.518059  7589 raft_consensus.cc:3060] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.525215  7589 raft_consensus.cc:515] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.527093  7589 leader_election.cc:290] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 2 election: Requested vote from peers 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.528077  7738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76321debadc4ce686de151489cb191b" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:57.528759  7738 raft_consensus.cc:3060] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.528995  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76321debadc4ce686de151489cb191b" candidate_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:57.529640  7663 raft_consensus.cc:3055] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:57.529997  7663 raft_consensus.cc:740] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:57.530856  7663 consensus_queue.cc:260] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.532212  7663 raft_consensus.cc:3060] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.534250  7738 raft_consensus.cc:2468] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 2.
I20260709 12:22:57.537011  7553 leader_election.cc:304] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:22:57.537463  7858 consensus_queue.cc:1048] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.537798  7869 raft_consensus.cc:2804] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:57.538343  7869 raft_consensus.cc:697] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Becoming Leader. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:57.539216  7869 consensus_queue.cc:237] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.542685  7663 raft_consensus.cc:2468] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c44ccfd8978b413bbc4eb7111f5d4706 in term 2.
I20260709 12:22:57.546574  7858 raft_consensus.cc:993] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: : Instructing follower 4513eec79edf4342ba5c9a5b1528ff1b to start an election
I20260709 12:22:57.546996  7858 raft_consensus.cc:1081] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Signalling peer 4513eec79edf4342ba5c9a5b1528ff1b to start an election
I20260709 12:22:57.548215  7881 consensus_queue.cc:1048] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.552022  7902 consensus_queue.cc:1048] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.554388  7663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
 from {username='slave'} at 127.0.0.1:49594
I20260709 12:22:57.555135  7663 raft_consensus.cc:493] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.559428  7663 raft_consensus.cc:3060] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.561770  7879 consensus_queue.cc:1048] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:57.562915  7486 catalog_manager.cc:5697] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 reported cstate change: term changed from 1 to 2, leader changed from 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130) to c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129). New cstate: current_term: 2 leader_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.567481  7663 raft_consensus.cc:515] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.569707  7663 leader_election.cc:290] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131:34893)
I20260709 12:22:57.572335  7588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:57.573879  7737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5263c593bd334af4bf46e288d1e342e2" candidate_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
I20260709 12:22:57.577303  7737 raft_consensus.cc:3055] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:57.577663  7737 raft_consensus.cc:740] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:57.578485  7737 consensus_queue.cc:260] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.579401  7737 raft_consensus.cc:3060] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.585703  7737 raft_consensus.cc:2468] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4513eec79edf4342ba5c9a5b1528ff1b in term 2.
I20260709 12:22:57.586834  7628 leader_election.cc:304] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: c44ccfd8978b413bbc4eb7111f5d4706
I20260709 12:22:57.587659  7880 raft_consensus.cc:2804] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:57.588140  7880 raft_consensus.cc:697] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 LEADER]: Becoming Leader. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:22:57.588853  7880 consensus_queue.cc:237] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.598904  7488 catalog_manager.cc:5697] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b reported cstate change: term changed from 1 to 2, leader changed from 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131) to 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:57.633767  7869 consensus_queue.cc:1048] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.644104  7869 consensus_queue.cc:1048] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.729588  7869 consensus_queue.cc:1048] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.736045  7920 raft_consensus.cc:993] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706: : Instructing follower 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:22:57.736795  7859 raft_consensus.cc:1081] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Signalling peer 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:22:57.739194  7738 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ffb56f458d4411dbae636d1325c788b"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:55006
I20260709 12:22:57.739769  7738 raft_consensus.cc:493] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:57.740170  7738 raft_consensus.cc:3060] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.741708  7869 consensus_queue.cc:1048] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.747210  7738 raft_consensus.cc:515] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.748188  7737 raft_consensus.cc:1240] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Rejecting Update request from peer c44ccfd8978b413bbc4eb7111f5d4706 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:57.750073  7589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffb56f458d4411dbae636d1325c788b" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:22:57.750766  7589 raft_consensus.cc:3055] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:57.751101  7589 raft_consensus.cc:740] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:22:57.752137  7589 consensus_queue.cc:260] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.752774  7738 leader_election.cc:290] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:22:57.753333  7589 raft_consensus.cc:3060] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:57.753731  7663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ffb56f458d4411dbae636d1325c788b" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:22:57.754179  7663 raft_consensus.cc:3060] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:57.755750  7869 consensus_queue.cc:1175] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f409b8d7d1144d3b20518efc1164a13" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c44ccfd8978b413bbc4eb7111f5d4706 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:57.760408  7663 raft_consensus.cc:2468] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:22:57.761762  7702 leader_election.cc:304] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:22:57.762501  7589 raft_consensus.cc:2468] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:22:57.762699  7902 raft_consensus.cc:2804] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:57.763244  7902 raft_consensus.cc:697] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:22:57.764097  7902 consensus_queue.cc:237] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:22:57.771183  7486 catalog_manager.cc:5697] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 1 to 2, leader changed from c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129) to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 2 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:57.898191  7663 raft_consensus.cc:1275] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer c44ccfd8978b413bbc4eb7111f5d4706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:57.899307  7909 consensus_queue.cc:1048] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:57.906947  7737 raft_consensus.cc:1275] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Refusing update from remote peer c44ccfd8978b413bbc4eb7111f5d4706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:57.910326  7869 consensus_queue.cc:1048] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:57.970757  7663 raft_consensus.cc:1275] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer c44ccfd8978b413bbc4eb7111f5d4706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:57.971997  7943 consensus_queue.cc:1048] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:57.981988  7737 raft_consensus.cc:1275] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Refusing update from remote peer c44ccfd8978b413bbc4eb7111f5d4706: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:57.984273  7920 consensus_queue.cc:1048] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.049026  7737 raft_consensus.cc:1275] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Refusing update from remote peer 4513eec79edf4342ba5c9a5b1528ff1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:58.050330  7881 consensus_queue.cc:1048] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.059666  7589 raft_consensus.cc:1275] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 4513eec79edf4342ba5c9a5b1528ff1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:58.060935  7944 consensus_queue.cc:1048] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.105738  7737 raft_consensus.cc:1275] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Refusing update from remote peer 4513eec79edf4342ba5c9a5b1528ff1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:58.107005  7879 consensus_queue.cc:1048] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.117313  7589 raft_consensus.cc:3060] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:58.123812  7589 raft_consensus.cc:1275] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 4513eec79edf4342ba5c9a5b1528ff1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:58.125028  7879 consensus_queue.cc:1048] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.152594  7663 raft_consensus.cc:1275] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:58.153785  7902 consensus_queue.cc:1048] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.162786  7589 raft_consensus.cc:1275] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:58.164113  7945 consensus_queue.cc:1048] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.340340  7488 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33332:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:23:00.367641  7488 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33332:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:23:00.401515 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:23:00.630297  7972 log.cc:927] Time spent T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:23:00.686427  7983 log.cc:927] Time spent T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: Append to log took a long time: real 0.117s	user 0.000s	sys 0.012s
I20260709 12:23:00.687762  7992 tablet.cc:1724] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:00.736946  7984 log.cc:927] Time spent T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: Append to log took a long time: real 0.078s	user 0.004s	sys 0.000s
I20260709 12:23:00.791042  7996 tablet.cc:1724] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.811650  8001 tablet.cc:1724] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.786351  8005 tablet.cc:1724] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.829600  8006 tablet.cc:1724] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.831538  8011 tablet.cc:1724] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.829910  8014 tablet.cc:1724] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:00.838490  7691 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:03f91fb14eab46f0aefe15730d9ca235)
I20260709 12:23:00.839298  8009 tablet.cc:1724] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.842947  7660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
mode: GRACEFUL
new_leader_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:37088
W20260709 12:23:00.847401  7691 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:03f91fb14eab46f0aefe15730d9ca235)
I20260709 12:23:00.817879  8010 tablet.cc:1724] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:00.849786  7691 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:03f91fb14eab46f0aefe15730d9ca235)
I20260709 12:23:00.853713  8008 tablet.cc:1724] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.856559  7660 raft_consensus.cc:606] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Received request to transfer leadership to TS 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:23:00.862612  8016 tablet.cc:1724] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.900089  8011 tablet.cc:1724] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.867398  8015 tablet.cc:1724] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.913086  8011 tablet.cc:1724] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.920863  8001 tablet.cc:1724] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.927461  8008 tablet.cc:1724] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.949486  8014 tablet.cc:1724] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.963677  8016 tablet.cc:1724] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.971215  8014 tablet.cc:1724] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.983489  7992 tablet.cc:1724] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.987684  7590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0de635746aa42dab69581b12a00668d"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
mode: GRACEFUL
new_leader_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:55290
I20260709 12:23:00.988464  7590 raft_consensus.cc:606] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Received request to transfer leadership to TS 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:23:00.990543 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:23:00.990291  8014 tablet.cc:1724] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:00.991307 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:01.004177  7948 raft_consensus.cc:993] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b: : Instructing follower 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:23:01.004885  8020 raft_consensus.cc:1081] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Signalling peer 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:23:01.005051  7590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d"
dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
mode: GRACEFUL
new_leader_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:55290
I20260709 12:23:01.005784  7590 raft_consensus.cc:606] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Received request to transfer leadership to TS 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:23:01.009012  7660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee3cdf50703a469583232b9b0bf232f7"
dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
mode: GRACEFUL
new_leader_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:37088
I20260709 12:23:01.009588  7660 raft_consensus.cc:606] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Received request to transfer leadership to TS 0f409b8d7d1144d3b20518efc1164a13
I20260709 12:23:01.011915 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:01.012522 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:01.022169  8008 tablet.cc:1724] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:01.024286  7735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:55018
I20260709 12:23:01.025063  7735 raft_consensus.cc:493] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.025519  7735 raft_consensus.cc:3060] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.028515  8009 tablet.cc:1724] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:01.019791  8001 tablet.cc:1724] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:01.032022  8011 tablet.cc:1724] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:01.034332  7735 raft_consensus.cc:515] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.036791  7735 leader_election.cc:290] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:23:01.038144  7586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:23:01.039011  7586 raft_consensus.cc:3060] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.049038  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01df735d86ea4d5aa2e3aa9f294a69f8" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:23:01.049996  7664 raft_consensus.cc:3055] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.050436  7664 raft_consensus.cc:740] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:23:01.051541  7664 consensus_queue.cc:260] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.053076  7664 raft_consensus.cc:3060] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.055394  8005 tablet.cc:1724] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:01.057814  7586 raft_consensus.cc:2468] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:23:01.059346  7702 leader_election.cc:304] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, c44ccfd8978b413bbc4eb7111f5d4706; no voters: 
I20260709 12:23:01.059106  8011 tablet.cc:1724] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:01.061193  8004 raft_consensus.cc:2804] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.061697  8004 raft_consensus.cc:697] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:23:01.062671  8004 consensus_queue.cc:237] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.072784  7664 raft_consensus.cc:2468] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:23:01.073544  7486 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e: soft_deleted_table [id=413759abea484a4e9fd02cd9396af125] alter complete (version 1)
I20260709 12:23:01.083863  7488 catalog_manager.cc:5697] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 1 to 2, leader changed from 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130) to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 2 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.248685  8002 raft_consensus.cc:993] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706: : Instructing follower 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:23:01.249344  7997 raft_consensus.cc:1081] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Signalling peer 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:23:01.250952  7735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:55006
I20260709 12:23:01.251473  7735 raft_consensus.cc:493] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.251789  7735 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:01.257730  7735 raft_consensus.cc:515] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.259506  7735 leader_election.cc:290] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 3 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:23:01.260401  7586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:23:01.260625  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e43cf05c3124a7eae3a2cad23c3433d" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:23:01.261111  7586 raft_consensus.cc:3055] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:01.261283  7664 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:01.261449  7586 raft_consensus.cc:740] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:23:01.262488  7586 consensus_queue.cc:260] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.263772  7586 raft_consensus.cc:3060] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:01.268885  7664 raft_consensus.cc:2468] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 3.
I20260709 12:23:01.269840  7586 raft_consensus.cc:2468] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 3.
I20260709 12:23:01.270259  7702 leader_election.cc:304] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:23:01.271142  8004 raft_consensus.cc:2804] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:01.271642  8004 raft_consensus.cc:697] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 3 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:23:01.272555  8004 consensus_queue.cc:237] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.282189  7487 catalog_manager.cc:5697] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 2 to 3, leader changed from c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129) to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 3 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.326669  7948 raft_consensus.cc:993] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b: : Instructing follower 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:23:01.327198  8020 raft_consensus.cc:1081] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Signalling peer 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:23:01.329357  7735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee3cdf50703a469583232b9b0bf232f7"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:55018
I20260709 12:23:01.330044  7735 raft_consensus.cc:493] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.330439  7735 raft_consensus.cc:3060] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.341404  7735 raft_consensus.cc:515] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.342998  8002 raft_consensus.cc:993] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706: : Instructing follower 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:23:01.343614  8002 raft_consensus.cc:1081] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Signalling peer 0f409b8d7d1144d3b20518efc1164a13 to start an election
I20260709 12:23:01.344048  7735 leader_election.cc:290] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:23:01.345147  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3cdf50703a469583232b9b0bf232f7" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:23:01.345790  7664 raft_consensus.cc:3055] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.345978  7586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3cdf50703a469583232b9b0bf232f7" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:23:01.346132  7664 raft_consensus.cc:740] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4513eec79edf4342ba5c9a5b1528ff1b, State: Running, Role: LEADER
I20260709 12:23:01.346652  7586 raft_consensus.cc:3060] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.347234  7664 consensus_queue.cc:260] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.349170  7664 raft_consensus.cc:3060] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.351235  7735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0de635746aa42dab69581b12a00668d"
dest_uuid: "0f409b8d7d1144d3b20518efc1164a13"
 from {username='slave'} at 127.0.0.1:55006
I20260709 12:23:01.351861  7735 raft_consensus.cc:493] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.352248  7735 raft_consensus.cc:3060] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.358088  7664 raft_consensus.cc:2468] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:23:01.359650  7702 leader_election.cc:304] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:23:01.360553  8004 raft_consensus.cc:2804] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.361111  8004 raft_consensus.cc:697] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:23:01.362159  8004 consensus_queue.cc:237] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.363833  7586 raft_consensus.cc:2468] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:23:01.359643  7735 raft_consensus.cc:515] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.369481  7735 leader_election.cc:290] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Requested vote from peers c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105), 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159)
I20260709 12:23:01.371436  7664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0de635746aa42dab69581b12a00668d" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4513eec79edf4342ba5c9a5b1528ff1b"
I20260709 12:23:01.372193  7664 raft_consensus.cc:3060] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.371196  7487 catalog_manager.cc:5697] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 1 to 2, leader changed from 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130) to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 2 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.371436  7586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0de635746aa42dab69581b12a00668d" candidate_uuid: "0f409b8d7d1144d3b20518efc1164a13" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c44ccfd8978b413bbc4eb7111f5d4706"
I20260709 12:23:01.373163  7586 raft_consensus.cc:3055] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:01.373522  7586 raft_consensus.cc:740] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c44ccfd8978b413bbc4eb7111f5d4706, State: Running, Role: LEADER
I20260709 12:23:01.375017  7586 consensus_queue.cc:260] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.376487  7586 raft_consensus.cc:3060] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:01.381745  7664 raft_consensus.cc:2468] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:23:01.383180  7702 leader_election.cc:304] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f409b8d7d1144d3b20518efc1164a13, 4513eec79edf4342ba5c9a5b1528ff1b; no voters: 
I20260709 12:23:01.384404  8004 raft_consensus.cc:2804] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:01.384903  8004 raft_consensus.cc:697] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Becoming Leader. State: Replica: 0f409b8d7d1144d3b20518efc1164a13, State: Running, Role: LEADER
I20260709 12:23:01.385653  7586 raft_consensus.cc:2468] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f409b8d7d1144d3b20518efc1164a13 in term 2.
I20260709 12:23:01.385728  8004 consensus_queue.cc:237] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } }
I20260709 12:23:01.395218  7487 catalog_manager.cc:5697] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 reported cstate change: term changed from 1 to 2, leader changed from c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129) to 0f409b8d7d1144d3b20518efc1164a13 (127.26.205.131). New cstate: current_term: 2 leader_uuid: "0f409b8d7d1144d3b20518efc1164a13" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f409b8d7d1144d3b20518efc1164a13" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 34893 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.563143  7664 raft_consensus.cc:1275] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:01.564399  8004 consensus_queue.cc:1048] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:01.573652  7586 raft_consensus.cc:1275] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:01.575887  7945 consensus_queue.cc:1048] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:01.679884  7664 raft_consensus.cc:1275] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 3 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:01.681140  7945 consensus_queue.cc:1048] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:01.690891  7586 raft_consensus.cc:1275] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 3 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:01.695724  8031 consensus_queue.cc:1048] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:01.830519  7664 raft_consensus.cc:1275] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:01.832067  8031 consensus_queue.cc:1048] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:01.840485  7586 raft_consensus.cc:1275] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:01.843478  8031 consensus_queue.cc:1048] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:01.872990  7586 raft_consensus.cc:1275] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.874354  8031 consensus_queue.cc:1048] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c44ccfd8978b413bbc4eb7111f5d4706" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:01.886579  7660 raft_consensus.cc:1275] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Refusing update from remote peer 0f409b8d7d1144d3b20518efc1164a13: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:01.888638  8004 consensus_queue.cc:1048] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4513eec79edf4342ba5c9a5b1528ff1b" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:02.013568 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:02.018718 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:02.019142 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:02.024350 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:02.024823 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:03.025905 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:03.031234 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:03.031639 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.036473 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:03.036806 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:04.037748 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:04.043744 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:04.044149 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:04.048915 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:04.049247 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.050203 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:05.055553 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:05.056123 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.061911 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:05.062319 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.063233 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:06.068508 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:06.068949 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.074499 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:06.074977 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.076078 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:07.081270 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:07.081743 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.088361 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:07.088817 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:08.089752 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:08.095604 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:08.096074 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:08.101159 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:08.101588 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:09.102643 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:09.108194 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:09.108683 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:09.113636 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:09.114023 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:10.115208 27446 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:23:10.120805 27446 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:23:10.121275 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.127132 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:10.127576 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:11.185842 27446 tablet_server.cc:179] TabletServer@127.26.205.129:0 shutting down...
W20260709 12:23:11.201674  7628 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:23:11.208814  7628 consensus_peers.cc:597] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.228663 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:11.229592 27446 tablet_replica.cc:333] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.230549 27446 raft_consensus.cc:2243] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.231459 27446 raft_consensus.cc:2272] T 5263c593bd334af4bf46e288d1e342e2 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.234607 27446 tablet_replica.cc:333] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.235404 27446 raft_consensus.cc:2243] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.235968 27446 raft_consensus.cc:2272] T a0de635746aa42dab69581b12a00668d P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.238992 27446 tablet_replica.cc:333] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.239660 27446 raft_consensus.cc:2243] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.240319 27446 raft_consensus.cc:2272] T 79522c34a1964bacbd70d987e7c293a8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.243043 27446 tablet_replica.cc:333] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.243691 27446 raft_consensus.cc:2243] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.244560 27446 raft_consensus.cc:2272] T 1ffb56f458d4411dbae636d1325c788b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.247117 27446 tablet_replica.cc:333] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.247761 27446 raft_consensus.cc:2243] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.248840 27446 raft_consensus.cc:2272] T d2dd7667e72342b096b9abfc7332bee1 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.251526 27446 tablet_replica.cc:333] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.252246 27446 raft_consensus.cc:2243] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.253086 27446 raft_consensus.cc:2272] T f79204baa78c48b0acd0c839667e564c P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:11.255348  7628 consensus_peers.cc:597] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.256588 27446 tablet_replica.cc:333] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.257365 27446 raft_consensus.cc:2243] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.258054 27446 raft_consensus.cc:2272] T 5d928b4866504469aec0d2ff3769219c P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.261153 27446 tablet_replica.cc:333] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.261750 27446 raft_consensus.cc:2243] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.262647 27446 raft_consensus.cc:2272] T 03f91fb14eab46f0aefe15730d9ca235 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.265110 27446 tablet_replica.cc:333] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.265668 27446 raft_consensus.cc:2243] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.266175 27446 raft_consensus.cc:2272] T eb9a370a18204449b0612439e1381459 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.268467 27446 tablet_replica.cc:333] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.269007 27446 raft_consensus.cc:2243] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.269541 27446 raft_consensus.cc:2272] T 01df735d86ea4d5aa2e3aa9f294a69f8 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.272197 27446 tablet_replica.cc:333] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.272768 27446 raft_consensus.cc:2243] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.273209 27446 raft_consensus.cc:2272] T 8e43cf05c3124a7eae3a2cad23c3433d P c44ccfd8978b413bbc4eb7111f5d4706 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.275802 27446 tablet_replica.cc:333] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.276401 27446 raft_consensus.cc:2243] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.277395 27446 raft_consensus.cc:2272] T 88dc8a5919994bbf880599b85766b454 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.279871 27446 tablet_replica.cc:333] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.280356 27446 raft_consensus.cc:2243] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.281306 27446 raft_consensus.cc:2272] T b76321debadc4ce686de151489cb191b P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.283778 27446 tablet_replica.cc:333] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.284281 27446 raft_consensus.cc:2243] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.284796 27446 raft_consensus.cc:2272] T ee3cdf50703a469583232b9b0bf232f7 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.287000 27446 tablet_replica.cc:333] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.287624 27446 raft_consensus.cc:2243] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.288190 27446 raft_consensus.cc:2272] T 7cfb32c2fb3c4a29a918e850bfa2c409 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.290592 27446 tablet_replica.cc:333] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.291128 27446 raft_consensus.cc:2243] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.292060 27446 raft_consensus.cc:2272] T 842eb71698124890907e22ed545909ad P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.294674 27446 tablet_replica.cc:333] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.295224 27446 raft_consensus.cc:2243] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.296134 27446 raft_consensus.cc:2272] T b0286c20effd44c6af3e85d855969659 P c44ccfd8978b413bbc4eb7111f5d4706 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.298542 27446 tablet_replica.cc:333] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706: stopping tablet replica
I20260709 12:23:11.299036 27446 raft_consensus.cc:2243] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.299612 27446 raft_consensus.cc:2272] T 3ade4b051b9e4d528bb82258ffe38b87 P c44ccfd8978b413bbc4eb7111f5d4706 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:11.303340  7628 consensus_peers.cc:597] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.351049 27446 tablet_server.cc:196] TabletServer@127.26.205.129:0 shutdown complete.
W20260709 12:23:11.380160  7702 consensus_peers.cc:597] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:46105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:11.393708  7702 consensus_peers.cc:597] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:46105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:11.398891  7702 consensus_peers.cc:597] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:46105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.407416 27446 tablet_server.cc:179] TabletServer@127.26.205.130:0 shutting down...
I20260709 12:23:11.446569 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:11.447768 27446 tablet_replica.cc:333] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.449178 27446 raft_consensus.cc:2243] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.450137 27446 raft_consensus.cc:2272] T d2dd7667e72342b096b9abfc7332bee1 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.454298 27446 tablet_replica.cc:333] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
W20260709 12:23:11.454535  7702 consensus_peers.cc:597] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:46105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.455479 27446 raft_consensus.cc:2243] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.456408 27446 raft_consensus.cc:2272] T 1ffb56f458d4411dbae636d1325c788b P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.460569 27446 tablet_replica.cc:333] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.461725 27446 raft_consensus.cc:2243] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.463210 27446 raft_consensus.cc:2272] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.466831 27446 tablet_replica.cc:333] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.467792 27446 raft_consensus.cc:2243] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.469220 27446 raft_consensus.cc:2272] T 5263c593bd334af4bf46e288d1e342e2 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.472855 27446 tablet_replica.cc:333] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.473839 27446 raft_consensus.cc:2243] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.474604 27446 raft_consensus.cc:2272] T a0de635746aa42dab69581b12a00668d P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.477785 27446 tablet_replica.cc:333] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.478561 27446 raft_consensus.cc:2243] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.479777 27446 raft_consensus.cc:2272] T 5d928b4866504469aec0d2ff3769219c P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.482324 27446 tablet_replica.cc:333] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.482939 27446 raft_consensus.cc:2243] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.483433 27446 raft_consensus.cc:2272] T f79204baa78c48b0acd0c839667e564c P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.485693 27446 tablet_replica.cc:333] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.486238 27446 raft_consensus.cc:2243] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.486727 27446 raft_consensus.cc:2272] T 842eb71698124890907e22ed545909ad P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.489283 27446 tablet_replica.cc:333] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.489877 27446 raft_consensus.cc:2243] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.490425 27446 raft_consensus.cc:2272] T 03f91fb14eab46f0aefe15730d9ca235 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.492764 27446 tablet_replica.cc:333] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.493311 27446 raft_consensus.cc:2243] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.494256 27446 raft_consensus.cc:2272] T eb9a370a18204449b0612439e1381459 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.496717 27446 tablet_replica.cc:333] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.497316 27446 raft_consensus.cc:2243] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.498247 27446 raft_consensus.cc:2272] T 3ade4b051b9e4d528bb82258ffe38b87 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.500624 27446 tablet_replica.cc:333] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.501197 27446 raft_consensus.cc:2243] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.502111 27446 raft_consensus.cc:2272] T 79522c34a1964bacbd70d987e7c293a8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.504388 27446 tablet_replica.cc:333] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.505038 27446 raft_consensus.cc:2243] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.505537 27446 raft_consensus.cc:2272] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.507850 27446 tablet_replica.cc:333] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.508385 27446 raft_consensus.cc:2243] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.508917 27446 raft_consensus.cc:2272] T 8e43cf05c3124a7eae3a2cad23c3433d P 4513eec79edf4342ba5c9a5b1528ff1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.511207 27446 tablet_replica.cc:333] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.511744 27446 raft_consensus.cc:2243] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.512339 27446 raft_consensus.cc:2272] T b76321debadc4ce686de151489cb191b P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.514629 27446 tablet_replica.cc:333] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.515154 27446 raft_consensus.cc:2243] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.515689 27446 raft_consensus.cc:2272] T 88dc8a5919994bbf880599b85766b454 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.517951 27446 tablet_replica.cc:333] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.518453 27446 raft_consensus.cc:2243] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.518939 27446 raft_consensus.cc:2272] T b0286c20effd44c6af3e85d855969659 P 4513eec79edf4342ba5c9a5b1528ff1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.521265 27446 tablet_replica.cc:333] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b: stopping tablet replica
I20260709 12:23:11.521768 27446 raft_consensus.cc:2243] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.522262 27446 raft_consensus.cc:2272] T ee3cdf50703a469583232b9b0bf232f7 P 4513eec79edf4342ba5c9a5b1528ff1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:11.558288  7702 consensus_peers.cc:597] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:46105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.568094 27446 tablet_server.cc:196] TabletServer@127.26.205.130:0 shutdown complete.
W20260709 12:23:11.573204  7702 consensus_peers.cc:597] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 -> Peer c44ccfd8978b413bbc4eb7111f5d4706 (127.26.205.129:46105): Couldn't send request to peer c44ccfd8978b413bbc4eb7111f5d4706. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:46105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:11.582015  7702 consensus_peers.cc:597] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 -> Peer 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159): Couldn't send request to peer 4513eec79edf4342ba5c9a5b1528ff1b. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.611922 27446 tablet_server.cc:179] TabletServer@127.26.205.131:0 shutting down...
W20260709 12:23:11.628240  7702 consensus_peers.cc:597] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 -> Peer 4513eec79edf4342ba5c9a5b1528ff1b (127.26.205.130:46159): Couldn't send request to peer 4513eec79edf4342ba5c9a5b1528ff1b. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:11.643364 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:11.644322 27446 tablet_replica.cc:333] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.645358 27446 raft_consensus.cc:2243] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.646294 27446 raft_consensus.cc:2272] T 1ffb56f458d4411dbae636d1325c788b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.648841 27446 tablet_replica.cc:333] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.649467 27446 raft_consensus.cc:2243] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.650008 27446 raft_consensus.cc:2272] T d2dd7667e72342b096b9abfc7332bee1 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.652212 27446 tablet_replica.cc:333] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.652771 27446 raft_consensus.cc:2243] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.653589 27446 raft_consensus.cc:2272] T a0de635746aa42dab69581b12a00668d P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.655709 27446 tablet_replica.cc:333] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.656289 27446 raft_consensus.cc:2243] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.656836 27446 raft_consensus.cc:2272] T 7cfb32c2fb3c4a29a918e850bfa2c409 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.658957 27446 tablet_replica.cc:333] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.659456 27446 raft_consensus.cc:2243] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.660323 27446 raft_consensus.cc:2272] T f79204baa78c48b0acd0c839667e564c P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.662803 27446 tablet_replica.cc:333] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.663363 27446 raft_consensus.cc:2243] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.663785 27446 raft_consensus.cc:2272] T 5d928b4866504469aec0d2ff3769219c P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.665968 27446 tablet_replica.cc:333] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.666508 27446 raft_consensus.cc:2243] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.667306 27446 raft_consensus.cc:2272] T ee3cdf50703a469583232b9b0bf232f7 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.669638 27446 tablet_replica.cc:333] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.670168 27446 raft_consensus.cc:2243] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.670614 27446 raft_consensus.cc:2272] T 79522c34a1964bacbd70d987e7c293a8 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.673085 27446 tablet_replica.cc:333] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.673632 27446 raft_consensus.cc:2243] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.674533 27446 raft_consensus.cc:2272] T 01df735d86ea4d5aa2e3aa9f294a69f8 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.676729 27446 tablet_replica.cc:333] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.677313 27446 raft_consensus.cc:2243] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.678186 27446 raft_consensus.cc:2272] T 8e43cf05c3124a7eae3a2cad23c3433d P 0f409b8d7d1144d3b20518efc1164a13 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.680526 27446 tablet_replica.cc:333] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.681079 27446 raft_consensus.cc:2243] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.681631 27446 raft_consensus.cc:2272] T 03f91fb14eab46f0aefe15730d9ca235 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.683838 27446 tablet_replica.cc:333] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.684404 27446 raft_consensus.cc:2243] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.684954 27446 raft_consensus.cc:2272] T eb9a370a18204449b0612439e1381459 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.687148 27446 tablet_replica.cc:333] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.687729 27446 raft_consensus.cc:2243] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.688210 27446 raft_consensus.cc:2272] T 3ade4b051b9e4d528bb82258ffe38b87 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.690635 27446 tablet_replica.cc:333] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.691188 27446 raft_consensus.cc:2243] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.691692 27446 raft_consensus.cc:2272] T b76321debadc4ce686de151489cb191b P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.693815 27446 tablet_replica.cc:333] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.694768 27446 raft_consensus.cc:2243] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.695230 27446 raft_consensus.cc:2272] T 88dc8a5919994bbf880599b85766b454 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.697467 27446 tablet_replica.cc:333] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.697949 27446 raft_consensus.cc:2243] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.698360 27446 raft_consensus.cc:2272] T b0286c20effd44c6af3e85d855969659 P 0f409b8d7d1144d3b20518efc1164a13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.700539 27446 tablet_replica.cc:333] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.701031 27446 raft_consensus.cc:2243] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.701500 27446 raft_consensus.cc:2272] T 5263c593bd334af4bf46e288d1e342e2 P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.703522 27446 tablet_replica.cc:333] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13: stopping tablet replica
I20260709 12:23:11.703920 27446 raft_consensus.cc:2243] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.704332 27446 raft_consensus.cc:2272] T 842eb71698124890907e22ed545909ad P 0f409b8d7d1144d3b20518efc1164a13 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.750284 27446 tablet_server.cc:196] TabletServer@127.26.205.131:0 shutdown complete.
I20260709 12:23:11.790859 27446 master.cc:562] Master@127.26.205.190:44179 shutting down...
I20260709 12:23:11.815100 27446 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:11.815721 27446 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.816088 27446 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1144f85f68ec4d09b6cd0fdba7e83f5e: stopping tablet replica
I20260709 12:23:11.836925 27446 master.cc:584] Master@127.26.205.190:44179 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20381 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:23:11.894364 27446 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.205.190:34543
I20260709 12:23:11.895548 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:11.901296  8060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:11.901850  8061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:11.902949  8063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:11.903694 27446 server_base.cc:1061] running on GCE node
I20260709 12:23:11.904742 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:11.904932 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:11.905129 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599791905096 us; error 0 us; skew 500 ppm
I20260709 12:23:11.905673 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:11.908154 27446 webserver.cc:533] Webserver started at http://127.26.205.190:33811/ using document root <none> and password file <none>
I20260709 12:23:11.908737 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:11.908946 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:11.909215 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:11.910414 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/master-0-root/instance:
uuid: "2c21d5620ab645bf8aba078e52c9dfca"
format_stamp: "Formatted at 2026-07-09 12:23:11 on dist-test-slave-673s"
I20260709 12:23:11.914839 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:11.918318  8068 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:11.919201 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:11.919451 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/master-0-root
uuid: "2c21d5620ab645bf8aba078e52c9dfca"
format_stamp: "Formatted at 2026-07-09 12:23:11 on dist-test-slave-673s"
I20260709 12:23:11.919687 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:11.948762 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:11.949990 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:11.988955 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.190:34543
I20260709 12:23:11.989059  8119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.190:34543 every 8 connection(s)
I20260709 12:23:11.993103  8120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.005149  8120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca: Bootstrap starting.
I20260709 12:23:12.010365  8120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.014951  8120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca: No bootstrap required, opened a new log
I20260709 12:23:12.017454  8120 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c21d5620ab645bf8aba078e52c9dfca" member_type: VOTER }
I20260709 12:23:12.017939  8120 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.018174  8120 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c21d5620ab645bf8aba078e52c9dfca, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.018841  8120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c21d5620ab645bf8aba078e52c9dfca" member_type: VOTER }
I20260709 12:23:12.019325  8120 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:12.019565  8120 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:12.019888  8120 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.025498  8120 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c21d5620ab645bf8aba078e52c9dfca" member_type: VOTER }
I20260709 12:23:12.026082  8120 leader_election.cc:304] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c21d5620ab645bf8aba078e52c9dfca; no voters: 
I20260709 12:23:12.027297  8120 leader_election.cc:290] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:12.027827  8123 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:12.029374  8123 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 1 LEADER]: Becoming Leader. State: Replica: 2c21d5620ab645bf8aba078e52c9dfca, State: Running, Role: LEADER
I20260709 12:23:12.030157  8123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c21d5620ab645bf8aba078e52c9dfca" member_type: VOTER }
I20260709 12:23:12.030385  8120 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:12.035854  8125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c21d5620ab645bf8aba078e52c9dfca. Latest consensus state: current_term: 1 leader_uuid: "2c21d5620ab645bf8aba078e52c9dfca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c21d5620ab645bf8aba078e52c9dfca" member_type: VOTER } }
I20260709 12:23:12.036649  8125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:12.036772  8124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c21d5620ab645bf8aba078e52c9dfca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c21d5620ab645bf8aba078e52c9dfca" member_type: VOTER } }
I20260709 12:23:12.037313  8124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:12.038599  8131 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:12.043532  8131 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:12.047868 27446 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:12.052802  8131 catalog_manager.cc:1383] Generated new cluster ID: 3f8b393e323b46999e48b9431a51833e
I20260709 12:23:12.053118  8131 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:12.075027  8131 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:12.076516  8131 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:12.093286  8131 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca: Generated new TSK 0
I20260709 12:23:12.094034  8131 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:12.114400 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:12.121223  8141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:12.122104  8142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:12.124169  8144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:12.124799 27446 server_base.cc:1061] running on GCE node
I20260709 12:23:12.125855 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:12.126107 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:12.126307 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599792126280 us; error 0 us; skew 500 ppm
I20260709 12:23:12.126892 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:12.129452 27446 webserver.cc:533] Webserver started at http://127.26.205.129:42255/ using document root <none> and password file <none>
I20260709 12:23:12.129945 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:12.130159 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:12.130445 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:12.131594 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-0-root/instance:
uuid: "7d2700ce1caf4992a01c0d609a488b0f"
format_stamp: "Formatted at 2026-07-09 12:23:12 on dist-test-slave-673s"
I20260709 12:23:12.136499 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:12.139935  8149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:12.140929 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:12.141201 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-0-root
uuid: "7d2700ce1caf4992a01c0d609a488b0f"
format_stamp: "Formatted at 2026-07-09 12:23:12 on dist-test-slave-673s"
I20260709 12:23:12.141436 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:12.152738 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:12.153918 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:12.155324 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:12.157898 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:12.158082 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:12.158375 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:12.158552 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:12.198989 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.129:33599
I20260709 12:23:12.199082  8211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.129:33599 every 8 connection(s)
I20260709 12:23:12.204149 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:12.213024  8216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:12.214457  8217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:12.218442 27446 server_base.cc:1061] running on GCE node
I20260709 12:23:12.218492  8212 heartbeater.cc:344] Connected to a master server at 127.26.205.190:34543
W20260709 12:23:12.218801  8219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:12.219163  8212 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:12.220170 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:12.220187  8212 heartbeater.cc:507] Master 127.26.205.190:34543 requested a full tablet report, sending...
W20260709 12:23:12.220614 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:12.220850 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599792220829 us; error 0 us; skew 500 ppm
I20260709 12:23:12.221716 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:12.222944  8085 ts_manager.cc:194] Registered new tserver with Master: 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599)
I20260709 12:23:12.224370 27446 webserver.cc:533] Webserver started at http://127.26.205.130:46251/ using document root <none> and password file <none>
I20260709 12:23:12.224996 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:12.225184  8085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58908
I20260709 12:23:12.225185 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:12.225827 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:12.227133 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-1-root/instance:
uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
format_stamp: "Formatted at 2026-07-09 12:23:12 on dist-test-slave-673s"
I20260709 12:23:12.231523 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:12.235082  8224 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:12.236011 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:12.236308 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-1-root
uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
format_stamp: "Formatted at 2026-07-09 12:23:12 on dist-test-slave-673s"
I20260709 12:23:12.236644 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:12.261143 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:12.262347 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:12.263805 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:12.266037 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:12.266367 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:12.266649 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:12.266819 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:12.306931 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.130:41637
I20260709 12:23:12.307053  8286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.130:41637 every 8 connection(s)
I20260709 12:23:12.311877 27446 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:12.319581  8290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:12.320569  8291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:12.322252 27446 server_base.cc:1061] running on GCE node
W20260709 12:23:12.323688  8293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:12.324623  8287 heartbeater.cc:344] Connected to a master server at 127.26.205.190:34543
I20260709 12:23:12.325004 27446 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:12.325116  8287 heartbeater.cc:461] Registering TS with master...
W20260709 12:23:12.325397 27446 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:12.325637 27446 hybrid_clock.cc:648] HybridClock initialized: now 1783599792325616 us; error 0 us; skew 500 ppm
I20260709 12:23:12.326184  8287 heartbeater.cc:507] Master 127.26.205.190:34543 requested a full tablet report, sending...
I20260709 12:23:12.326463 27446 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:12.328816  8085 ts_manager.cc:194] Registered new tserver with Master: 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:12.329296 27446 webserver.cc:533] Webserver started at http://127.26.205.131:33483/ using document root <none> and password file <none>
I20260709 12:23:12.329891 27446 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:12.330104 27446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:12.330379 27446 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:12.330435  8085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58910
I20260709 12:23:12.331794 27446 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-2-root/instance:
uuid: "2afd499b9da147d08fd9fd6084e56d7e"
format_stamp: "Formatted at 2026-07-09 12:23:12 on dist-test-slave-673s"
I20260709 12:23:12.336613 27446 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:12.339951  8298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:12.340809 27446 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:12.341117 27446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-2-root
uuid: "2afd499b9da147d08fd9fd6084e56d7e"
format_stamp: "Formatted at 2026-07-09 12:23:12 on dist-test-slave-673s"
I20260709 12:23:12.341421 27446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvpVanx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599367894863-27446-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:12.363154 27446 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:12.364495 27446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:12.366050 27446 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:12.368289 27446 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:12.368549 27446 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:23:12.368790 27446 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:12.368965 27446 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:12.409384 27446 rpc_server.cc:307] RPC server started. Bound to: 127.26.205.131:36081
I20260709 12:23:12.409509  8361 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.205.131:36081 every 8 connection(s)
I20260709 12:23:12.425915  8362 heartbeater.cc:344] Connected to a master server at 127.26.205.190:34543
I20260709 12:23:12.426383  8362 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:12.427114  8362 heartbeater.cc:507] Master 127.26.205.190:34543 requested a full tablet report, sending...
I20260709 12:23:12.429244  8085 ts_manager.cc:194] Registered new tserver with Master: 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:12.429580 27446 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016880276s
I20260709 12:23:12.430785  8085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58912
I20260709 12:23:12.456415  8085 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58924:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:12.459251  8085 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:12.529754  8177 tablet_service.cc:1511] Processing CreateTablet for tablet 721fe09959cd439393d3b3e5f9dd6f30 (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:12.531323  8177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721fe09959cd439393d3b3e5f9dd6f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.541692  8326 tablet_service.cc:1511] Processing CreateTablet for tablet 721fe09959cd439393d3b3e5f9dd6f30 (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:12.543231  8326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721fe09959cd439393d3b3e5f9dd6f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.554935  8173 tablet_service.cc:1511] Processing CreateTablet for tablet 32453e9a3cf647518ca102397137719f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:12.555181  8176 tablet_service.cc:1511] Processing CreateTablet for tablet 1158d1bb8464470187e3ca390ecd248a (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:12.556092  8325 tablet_service.cc:1511] Processing CreateTablet for tablet 1158d1bb8464470187e3ca390ecd248a (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:12.556602  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32453e9a3cf647518ca102397137719f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.557494  8325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1158d1bb8464470187e3ca390ecd248a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.557279  8175 tablet_service.cc:1511] Processing CreateTablet for tablet a6f6b5ef00ce4fdaa5952ab2fdfbd310 (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:12.559312  8174 tablet_service.cc:1511] Processing CreateTablet for tablet 34ea743232cc4e79af77c0be753cddbd (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:12.560894  8175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f6b5ef00ce4fdaa5952ab2fdfbd310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.561691  8172 tablet_service.cc:1511] Processing CreateTablet for tablet 01db1b02be5e4afe8d70f32e9023628f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:12.563061  8172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01db1b02be5e4afe8d70f32e9023628f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.565326  8174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ea743232cc4e79af77c0be753cddbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.565667  8252 tablet_service.cc:1511] Processing CreateTablet for tablet 721fe09959cd439393d3b3e5f9dd6f30 (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:12.566390  8324 tablet_service.cc:1511] Processing CreateTablet for tablet a6f6b5ef00ce4fdaa5952ab2fdfbd310 (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:12.567103  8252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721fe09959cd439393d3b3e5f9dd6f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.567775  8324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f6b5ef00ce4fdaa5952ab2fdfbd310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.569320  8176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1158d1bb8464470187e3ca390ecd248a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.573410  8323 tablet_service.cc:1511] Processing CreateTablet for tablet 34ea743232cc4e79af77c0be753cddbd (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:12.574815  8323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ea743232cc4e79af77c0be753cddbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.590725  8322 tablet_service.cc:1511] Processing CreateTablet for tablet 32453e9a3cf647518ca102397137719f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:12.592234  8322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32453e9a3cf647518ca102397137719f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.606612  8321 tablet_service.cc:1511] Processing CreateTablet for tablet 01db1b02be5e4afe8d70f32e9023628f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:12.608160  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01db1b02be5e4afe8d70f32e9023628f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.608050  8251 tablet_service.cc:1511] Processing CreateTablet for tablet 1158d1bb8464470187e3ca390ecd248a (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:12.609508  8251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1158d1bb8464470187e3ca390ecd248a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.612913  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 9810ce4fab834d939d94f9bbf22e6e0f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:12.614316  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9810ce4fab834d939d94f9bbf22e6e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.618399  8250 tablet_service.cc:1511] Processing CreateTablet for tablet a6f6b5ef00ce4fdaa5952ab2fdfbd310 (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:12.619835  8250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f6b5ef00ce4fdaa5952ab2fdfbd310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.623626  8319 tablet_service.cc:1511] Processing CreateTablet for tablet dbccf357a4064e1282a8bedb8e23972b (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:12.625022  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbccf357a4064e1282a8bedb8e23972b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.630681  8249 tablet_service.cc:1511] Processing CreateTablet for tablet 34ea743232cc4e79af77c0be753cddbd (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:12.632421  8249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ea743232cc4e79af77c0be753cddbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.635072  8248 tablet_service.cc:1511] Processing CreateTablet for tablet 32453e9a3cf647518ca102397137719f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:12.636837  8248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32453e9a3cf647518ca102397137719f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.640125  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 01db1b02be5e4afe8d70f32e9023628f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:12.641757  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01db1b02be5e4afe8d70f32e9023628f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.643465  8171 tablet_service.cc:1511] Processing CreateTablet for tablet 9810ce4fab834d939d94f9bbf22e6e0f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:12.645640  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9810ce4fab834d939d94f9bbf22e6e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.646051  8246 tablet_service.cc:1511] Processing CreateTablet for tablet 9810ce4fab834d939d94f9bbf22e6e0f (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:12.647423  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9810ce4fab834d939d94f9bbf22e6e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.654100  8245 tablet_service.cc:1511] Processing CreateTablet for tablet dbccf357a4064e1282a8bedb8e23972b (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:12.654670  8170 tablet_service.cc:1511] Processing CreateTablet for tablet dbccf357a4064e1282a8bedb8e23972b (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:12.655580  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbccf357a4064e1282a8bedb8e23972b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.656579  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbccf357a4064e1282a8bedb8e23972b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.691454  8379 tablet_bootstrap.cc:492] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:12.697582  8377 tablet_bootstrap.cc:492] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:12.710750  8378 tablet_bootstrap.cc:492] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:12.712992  8251 tablet_service.cc:1511] Processing CreateTablet for tablet 65363c79f2374c70a157a3130e20e73a (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:12.714286  8322 tablet_service.cc:1511] Processing CreateTablet for tablet 65363c79f2374c70a157a3130e20e73a (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:12.729401  8251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65363c79f2374c70a157a3130e20e73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.729498  8322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65363c79f2374c70a157a3130e20e73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.730140  8378 tablet_bootstrap.cc:654] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.733559  8377 tablet_bootstrap.cc:654] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.722471  8176 tablet_service.cc:1511] Processing CreateTablet for tablet 65363c79f2374c70a157a3130e20e73a (DEFAULT_TABLE table=test-workload [id=3675c3e75d194b918173465ed7a3d40a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:12.743803  8176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65363c79f2374c70a157a3130e20e73a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.759891  8377 tablet_bootstrap.cc:492] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:12.760632  8377 ts_tablet_manager.cc:1403] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 12:23:12.761831  8378 tablet_bootstrap.cc:492] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:12.762145  8379 tablet_bootstrap.cc:654] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.762449  8378 ts_tablet_manager.cc:1403] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.015s
I20260709 12:23:12.763756  8377 raft_consensus.cc:359] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:12.764631  8377 raft_consensus.cc:385] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.765086  8377 raft_consensus.cc:740] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.766147  8377 consensus_queue.cc:260] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:12.766462  8378 raft_consensus.cc:359] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:12.767261  8378 raft_consensus.cc:385] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.767644  8378 raft_consensus.cc:740] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.768534  8378 consensus_queue.cc:260] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:12.775431  8377 ts_tablet_manager.cc:1434] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:23:12.776297  8212 heartbeater.cc:499] Master 127.26.205.190:34543 was elected leader, sending a full tablet report...
I20260709 12:23:12.786880  8377 tablet_bootstrap.cc:492] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:12.795830  8377 tablet_bootstrap.cc:654] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.796108  8379 tablet_bootstrap.cc:492] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:12.796765  8379 ts_tablet_manager.cc:1403] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.022s
I20260709 12:23:12.800031  8379 raft_consensus.cc:359] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.800784  8379 raft_consensus.cc:385] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.801132  8379 raft_consensus.cc:740] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.802371  8362 heartbeater.cc:499] Master 127.26.205.190:34543 was elected leader, sending a full tablet report...
I20260709 12:23:12.802103  8379 consensus_queue.cc:260] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.803087  8378 ts_tablet_manager.cc:1434] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.040s	user 0.012s	sys 0.026s
I20260709 12:23:12.804569  8378 tablet_bootstrap.cc:492] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:12.808635  8377 tablet_bootstrap.cc:492] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:12.809336  8377 ts_tablet_manager.cc:1403] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:23:12.811715  8378 tablet_bootstrap.cc:654] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.812413  8377 raft_consensus.cc:359] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.813407  8377 raft_consensus.cc:385] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.813755  8377 raft_consensus.cc:740] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.815220  8287 heartbeater.cc:499] Master 127.26.205.190:34543 was elected leader, sending a full tablet report...
I20260709 12:23:12.815681  8379 ts_tablet_manager.cc:1434] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:23:12.815737  8377 consensus_queue.cc:260] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.816807  8379 tablet_bootstrap.cc:492] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:12.818917  8377 ts_tablet_manager.cc:1434] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:12.820291  8377 tablet_bootstrap.cc:492] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:12.823537  8379 tablet_bootstrap.cc:654] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.830749  8377 tablet_bootstrap.cc:654] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.834179  8378 tablet_bootstrap.cc:492] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:12.834909  8378 ts_tablet_manager.cc:1403] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.013s
I20260709 12:23:12.838984  8378 raft_consensus.cc:359] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.840093  8378 raft_consensus.cc:385] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.840551  8378 raft_consensus.cc:740] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.841876  8378 consensus_queue.cc:260] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.845083  8378 ts_tablet_manager.cc:1434] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:23:12.846488  8378 tablet_bootstrap.cc:492] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:12.855561  8378 tablet_bootstrap.cc:654] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.868377  8379 tablet_bootstrap.cc:492] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:12.868587  8377 tablet_bootstrap.cc:492] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:12.869043  8379 ts_tablet_manager.cc:1403] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.052s	user 0.034s	sys 0.013s
I20260709 12:23:12.869372  8377 ts_tablet_manager.cc:1403] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.023s
I20260709 12:23:12.870117  8378 tablet_bootstrap.cc:492] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:12.870721  8378 ts_tablet_manager.cc:1403] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.005s
I20260709 12:23:12.872781  8379 raft_consensus.cc:359] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.873126  8377 raft_consensus.cc:359] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.873651  8379 raft_consensus.cc:385] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.874145  8379 raft_consensus.cc:740] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.873984  8378 raft_consensus.cc:359] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.874001  8377 raft_consensus.cc:385] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.874929  8378 raft_consensus.cc:385] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.875021  8377 raft_consensus.cc:740] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.875387  8378 raft_consensus.cc:740] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.875221  8379 consensus_queue.cc:260] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.876187  8377 consensus_queue.cc:260] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.876339  8378 consensus_queue.cc:260] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.878109  8379 ts_tablet_manager.cc:1434] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:12.878630  8378 ts_tablet_manager.cc:1434] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:12.879205  8379 tablet_bootstrap.cc:492] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:12.880353  8377 ts_tablet_manager.cc:1434] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:12.881513  8377 tablet_bootstrap.cc:492] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:12.881989  8378 tablet_bootstrap.cc:492] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:12.886428  8379 tablet_bootstrap.cc:654] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.888039  8377 tablet_bootstrap.cc:654] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.889374  8378 tablet_bootstrap.cc:654] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.893231  8384 raft_consensus.cc:493] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.893981  8384 raft_consensus.cc:515] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.898413  8379 tablet_bootstrap.cc:492] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:12.899029  8379 ts_tablet_manager.cc:1403] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 12:23:12.902344  8379 raft_consensus.cc:359] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:12.903244  8379 raft_consensus.cc:385] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.903613  8379 raft_consensus.cc:740] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.905684  8379 consensus_queue.cc:260] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:12.908258  8379 ts_tablet_manager.cc:1434] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:23:12.915604  8379 tablet_bootstrap.cc:492] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
W20260709 12:23:12.913709  8363 tablet.cc:2406] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:12.920701  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:12.911804  8384 leader_election.cc:290] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:12.923486  8384 raft_consensus.cc:493] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.924165  8384 raft_consensus.cc:515] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:12.927006  8379 tablet_bootstrap.cc:654] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:12.929158  8384 leader_election.cc:290] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:12.943010  8386 raft_consensus.cc:493] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.943657  8386 raft_consensus.cc:515] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.945410  8379 tablet_bootstrap.cc:492] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:12.945976  8379 ts_tablet_manager.cc:1403] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.009s
I20260709 12:23:12.952709  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721fe09959cd439393d3b3e5f9dd6f30" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:12.953809  8187 raft_consensus.cc:2468] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
W20260709 12:23:12.958232  8299 leader_election.cc:343] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.959438  8299 leader_election.cc:304] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:12.948764  8386 leader_election.cc:290] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:12.960810  8384 raft_consensus.cc:2804] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:12.961432  8384 raft_consensus.cc:493] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:12.961969  8384 raft_consensus.cc:3060] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.967741  8379 raft_consensus.cc:359] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.972944  8379 raft_consensus.cc:385] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.973500  8379 raft_consensus.cc:740] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.976835  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:12.977383  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721fe09959cd439393d3b3e5f9dd6f30" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:12.978106  8261 raft_consensus.cc:2468] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:12.978492  8377 tablet_bootstrap.cc:492] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:12.979063  8377 ts_tablet_manager.cc:1403] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.007s
I20260709 12:23:12.979564  8378 tablet_bootstrap.cc:492] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
W20260709 12:23:12.979422  8299 leader_election.cc:343] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:12.980095  8378 ts_tablet_manager.cc:1403] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.098s	user 0.027s	sys 0.063s
I20260709 12:23:12.980033  8299 leader_election.cc:304] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e; no voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:12.981009  8394 raft_consensus.cc:2749] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:12.982153  8377 raft_consensus.cc:359] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.982931  8377 raft_consensus.cc:385] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.983242  8377 raft_consensus.cc:740] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.983335  8378 raft_consensus.cc:359] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.984176  8378 raft_consensus.cc:385] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:12.984694  8378 raft_consensus.cc:740] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:12.984818  8379 consensus_queue.cc:260] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.985704  8378 consensus_queue.cc:260] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.986316  8384 raft_consensus.cc:515] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:12.986778  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32453e9a3cf647518ca102397137719f" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:12.988122  8378 ts_tablet_manager.cc:1434] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:12.988519  8384 leader_election.cc:290] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:12.984086  8377 consensus_queue.cc:260] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:12.989274  8378 tablet_bootstrap.cc:492] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:12.991115  8377 ts_tablet_manager.cc:1434] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:23:12.992264  8377 tablet_bootstrap.cc:492] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:12.996786  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721fe09959cd439393d3b3e5f9dd6f30" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:12.997474  8261 raft_consensus.cc:3060] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:12.998044  8378 tablet_bootstrap.cc:654] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.000936  8379 ts_tablet_manager.cc:1434] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 12:23:13.008277  8377 tablet_bootstrap.cc:654] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.009536  8378 tablet_bootstrap.cc:492] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:13.010147  8378 ts_tablet_manager.cc:1403] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 12:23:13.010726  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721fe09959cd439393d3b3e5f9dd6f30" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:13.011407  8187 raft_consensus.cc:3060] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.012885  8379 tablet_bootstrap.cc:492] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:13.013520  8378 raft_consensus.cc:359] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.014339  8378 raft_consensus.cc:385] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.014703  8378 raft_consensus.cc:740] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.015682  8378 consensus_queue.cc:260] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
W20260709 12:23:13.016752  8225 leader_election.cc:343] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.018044  8378 ts_tablet_manager.cc:1434] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:13.019150  8378 tablet_bootstrap.cc:492] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:13.020720  8379 tablet_bootstrap.cc:654] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.025800  8378 tablet_bootstrap.cc:654] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.027017  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32453e9a3cf647518ca102397137719f" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:13.028118  8337 raft_consensus.cc:2468] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 0.
I20260709 12:23:13.032845  8187 raft_consensus.cc:2468] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:13.034451  8227 leader_election.cc:304] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:13.034575  8299 leader_election.cc:304] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.035933  8384 raft_consensus.cc:2804] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.036217  8386 raft_consensus.cc:2804] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.036494  8384 raft_consensus.cc:697] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:13.036856  8386 raft_consensus.cc:493] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.037798  8384 consensus_queue.cc:237] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:13.038425  8386 raft_consensus.cc:3060] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.038882  8378 tablet_bootstrap.cc:492] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:13.039377  8379 tablet_bootstrap.cc:492] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:13.039414  8378 ts_tablet_manager.cc:1403] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 12:23:13.039980  8379 ts_tablet_manager.cc:1403] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.010s
I20260709 12:23:13.040726  8394 raft_consensus.cc:493] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.041216  8394 raft_consensus.cc:515] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
W20260709 12:23:13.042694  8133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:13.043474  8394 leader_election.cc:290] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:13.043247  8379 raft_consensus.cc:359] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.044256  8379 raft_consensus.cc:385] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.044638  8379 raft_consensus.cc:740] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.045218  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1158d1bb8464470187e3ca390ecd248a" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.045904  8262 raft_consensus.cc:2468] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:13.045552  8379 consensus_queue.cc:260] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.046489  8378 raft_consensus.cc:359] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.047273  8378 raft_consensus.cc:385] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.047703  8378 raft_consensus.cc:740] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.047914  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1158d1bb8464470187e3ca390ecd248a" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:13.048661  8186 raft_consensus.cc:2468] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:13.049023  8299 leader_election.cc:304] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:13.049902  8394 raft_consensus.cc:2804] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.050259  8394 raft_consensus.cc:493] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.050496  8377 tablet_bootstrap.cc:492] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:13.050582  8394 raft_consensus.cc:3060] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.021224  8261 raft_consensus.cc:2468] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:13.047977  8386 raft_consensus.cc:515] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.056070  8386 leader_election.cc:290] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.057574  8379 ts_tablet_manager.cc:1434] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.009s
I20260709 12:23:13.058087  8084 catalog_manager.cc:5697] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.058902  8394 raft_consensus.cc:515] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.048643  8378 consensus_queue.cc:260] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.062160  8394 leader_election.cc:290] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:13.058934  8379 tablet_bootstrap.cc:492] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:13.063587  8377 ts_tablet_manager.cc:1403] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.007s
I20260709 12:23:13.063619  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1158d1bb8464470187e3ca390ecd248a" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:13.064642  8186 raft_consensus.cc:3060] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.068120  8377 raft_consensus.cc:359] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.060096  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32453e9a3cf647518ca102397137719f" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.069161  8379 tablet_bootstrap.cc:654] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.069399  8337 raft_consensus.cc:3060] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.070780  8378 ts_tablet_manager.cc:1434] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:23:13.071923  8378 tablet_bootstrap.cc:492] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:13.059748  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32453e9a3cf647518ca102397137719f" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:13.073340  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1158d1bb8464470187e3ca390ecd248a" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:13.074744  8261 raft_consensus.cc:3060] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:13.074837  8225 leader_election.cc:343] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.075863  8186 raft_consensus.cc:2468] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:13.077219  8299 leader_election.cc:304] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.078132  8394 raft_consensus.cc:2804] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.078620  8394 raft_consensus.cc:697] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:13.079838  8378 tablet_bootstrap.cc:654] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.079450  8394 consensus_queue.cc:237] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.069212  8377 raft_consensus.cc:385] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.080606  8377 raft_consensus.cc:740] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.081378  8377 consensus_queue.cc:260] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.084774  8377 ts_tablet_manager.cc:1434] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 12:23:13.085099  8379 tablet_bootstrap.cc:492] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:13.085626  8379 ts_tablet_manager.cc:1403] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.005s
I20260709 12:23:13.085826  8377 tablet_bootstrap.cc:492] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:13.088717  8379 raft_consensus.cc:359] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.091302  8261 raft_consensus.cc:2468] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:13.092514  8382 raft_consensus.cc:493] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.097168  8382 raft_consensus.cc:515] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.099928  8382 leader_election.cc:290] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.089442  8379 raft_consensus.cc:385] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.101784  8337 raft_consensus.cc:2468] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 1.
I20260709 12:23:13.103147  8227 leader_election.cc:304] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:13.103685  8379 raft_consensus.cc:740] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.104935  8403 raft_consensus.cc:2804] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.104991  8379 consensus_queue.cc:260] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.105535  8403 raft_consensus.cc:697] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:13.107515  8403 consensus_queue.cc:237] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.118414  8377 tablet_bootstrap.cc:654] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.132205  8394 raft_consensus.cc:493] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.133127  8394 raft_consensus.cc:515] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.138751  8394 leader_election.cc:290] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:13.139091  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.140893  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
W20260709 12:23:13.143064  8299 leader_election.cc:343] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:13.144327  8299 leader_election.cc:343] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:13.144893  8299 leader_election.cc:304] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e; no voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:13.145972  8394 raft_consensus.cc:2749] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.157562  8378 tablet_bootstrap.cc:492] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:13.158131  8378 ts_tablet_manager.cc:1403] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.027s
I20260709 12:23:13.160627  8377 tablet_bootstrap.cc:492] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:13.160354  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01db1b02be5e4afe8d70f32e9023628f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:13.156327  8379 ts_tablet_manager.cc:1434] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.020s
I20260709 12:23:13.161244  8337 raft_consensus.cc:2468] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.161409  8378 raft_consensus.cc:359] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.162165  8378 raft_consensus.cc:385] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.162367  8379 tablet_bootstrap.cc:492] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:13.162469  8378 raft_consensus.cc:740] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.162736  8152 leader_election.cc:304] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.163717  8382 raft_consensus.cc:2804] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.164227  8382 raft_consensus.cc:493] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.163662  8378 consensus_queue.cc:260] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.164594  8382 raft_consensus.cc:3060] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.166568  8378 ts_tablet_manager.cc:1434] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:13.167665  8378 tablet_bootstrap.cc:492] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:13.171973  8379 tablet_bootstrap.cc:654] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.172778  8382 raft_consensus.cc:515] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.176338  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01db1b02be5e4afe8d70f32e9023628f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.176998  8378 tablet_bootstrap.cc:654] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.176992  8337 raft_consensus.cc:3060] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.177762  8377 ts_tablet_manager.cc:1403] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.001s
I20260709 12:23:13.180928  8377 raft_consensus.cc:359] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.181648  8377 raft_consensus.cc:385] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.181952  8377 raft_consensus.cc:740] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.184831  8337 raft_consensus.cc:2468] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.187484  8152 leader_election.cc:304] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.194077  8417 raft_consensus.cc:493] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.194566  8417 raft_consensus.cc:515] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.196843  8382 leader_election.cc:290] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.197708  8382 raft_consensus.cc:2804] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.197841  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01db1b02be5e4afe8d70f32e9023628f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.198333  8382 raft_consensus.cc:697] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:13.198630  8261 raft_consensus.cc:2468] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.200428  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01db1b02be5e4afe8d70f32e9023628f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:13.201047  8261 raft_consensus.cc:3060] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.203207  8417 leader_election.cc:290] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.205896  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.199505  8382 consensus_queue.cc:237] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.206601  8262 raft_consensus.cc:2468] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.212198  8377 consensus_queue.cc:260] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.214156  8377 ts_tablet_manager.cc:1434] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:23:13.215548  8377 tablet_bootstrap.cc:492] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:13.218150  8084 catalog_manager.cc:5697] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.219810  8261 raft_consensus.cc:2468] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.207096  8082 catalog_manager.cc:5697] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.224680  8379 tablet_bootstrap.cc:492] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:13.225281  8379 ts_tablet_manager.cc:1403] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.003s
I20260709 12:23:13.227011  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:13.227762  8337 raft_consensus.cc:2468] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.228998  8377 tablet_bootstrap.cc:654] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.228579  8379 raft_consensus.cc:359] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.229489  8379 raft_consensus.cc:385] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.229835  8379 raft_consensus.cc:740] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.227762  8150 leader_election.cc:304] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.230800  8379 consensus_queue.cc:260] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.235625  8419 raft_consensus.cc:2804] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.236094  8419 raft_consensus.cc:493] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.236621  8378 tablet_bootstrap.cc:492] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:13.236541  8419 raft_consensus.cc:3060] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.237238  8378 ts_tablet_manager.cc:1403] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.021s
I20260709 12:23:13.241644  8378 raft_consensus.cc:359] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.242338  8378 raft_consensus.cc:385] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.242614  8378 raft_consensus.cc:740] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.243834  8378 consensus_queue.cc:260] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.247377  8419 raft_consensus.cc:515] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.249197  8378 ts_tablet_manager.cc:1434] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:13.257097  8379 ts_tablet_manager.cc:1434] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.002s
I20260709 12:23:13.257010  8082 catalog_manager.cc:5697] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.258549  8378 tablet_bootstrap.cc:492] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:13.265153  8379 tablet_bootstrap.cc:492] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:13.267230  8419 leader_election.cc:290] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.267927  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:13.268646  8261 raft_consensus.cc:3060] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.275074  8378 tablet_bootstrap.cc:654] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.275099  8261 raft_consensus.cc:2468] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.281852  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.282521  8337 raft_consensus.cc:3060] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.283560  8379 tablet_bootstrap.cc:654] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.284132  8378 tablet_bootstrap.cc:492] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:13.284713  8378 ts_tablet_manager.cc:1403] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.000s
I20260709 12:23:13.285132  8377 tablet_bootstrap.cc:492] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:13.285738  8377 ts_tablet_manager.cc:1403] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.022s
I20260709 12:23:13.287487  8378 raft_consensus.cc:359] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.288174  8378 raft_consensus.cc:385] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.288475  8378 raft_consensus.cc:740] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.288918  8377 raft_consensus.cc:359] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.289201  8378 consensus_queue.cc:260] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.289757  8377 raft_consensus.cc:385] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.289942  8150 leader_election.cc:304] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.290256  8377 raft_consensus.cc:740] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.291400  8378 ts_tablet_manager.cc:1434] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:13.291294  8377 consensus_queue.cc:260] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.290097  8419 raft_consensus.cc:493] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.293143  8419 raft_consensus.cc:515] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.294148  8377 ts_tablet_manager.cc:1434] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:23:13.295231  8377 tablet_bootstrap.cc:492] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:13.297564  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f6b5ef00ce4fdaa5952ab2fdfbd310" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:13.298557  8336 raft_consensus.cc:2468] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.291363  8382 raft_consensus.cc:2804] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.300292  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f6b5ef00ce4fdaa5952ab2fdfbd310" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.301218  8261 raft_consensus.cc:2468] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.302356  8382 raft_consensus.cc:697] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:13.304080  8377 tablet_bootstrap.cc:654] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.303522  8382 consensus_queue.cc:237] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.306579  8152 leader_election.cc:304] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.307735  8417 raft_consensus.cc:2804] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.308095  8417 raft_consensus.cc:493] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.308398  8417 raft_consensus.cc:3060] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.310796  8419 leader_election.cc:290] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.318320  8337 raft_consensus.cc:2468] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.318280  8417 raft_consensus.cc:515] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.320693  8417 leader_election.cc:290] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.321178  8379 tablet_bootstrap.cc:492] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:13.321696  8379 ts_tablet_manager.cc:1403] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.016s
I20260709 12:23:13.322891  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f6b5ef00ce4fdaa5952ab2fdfbd310" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:13.323508  8261 raft_consensus.cc:3060] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.324558  8379 raft_consensus.cc:359] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.325253  8379 raft_consensus.cc:385] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.325541  8379 raft_consensus.cc:740] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.324759  8082 catalog_manager.cc:5697] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.326180  8377 tablet_bootstrap.cc:492] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:13.326757  8377 ts_tablet_manager.cc:1403] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 12:23:13.326332  8379 consensus_queue.cc:260] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.331257  8379 ts_tablet_manager.cc:1434] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:13.333034  8379 tablet_bootstrap.cc:492] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:13.333500  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f6b5ef00ce4fdaa5952ab2fdfbd310" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.334105  8337 raft_consensus.cc:3060] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.332511  8417 raft_consensus.cc:493] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.334785  8417 raft_consensus.cc:515] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.336694  8377 raft_consensus.cc:359] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.337476  8377 raft_consensus.cc:385] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.337970  8377 raft_consensus.cc:740] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.339316  8379 tablet_bootstrap.cc:654] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.338965  8377 consensus_queue.cc:260] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.340842  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.343406  8262 raft_consensus.cc:2468] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.343466  8261 raft_consensus.cc:2468] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.341099  8417 leader_election.cc:290] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.344558  8379 tablet_bootstrap.cc:492] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:13.345057  8379 ts_tablet_manager.cc:1403] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 12:23:13.345230  8150 leader_election.cc:304] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.346197  8150 leader_election.cc:304] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.346921  8382 raft_consensus.cc:2804] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.347048  8417 raft_consensus.cc:2804] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.347364  8382 raft_consensus.cc:493] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.342516  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:13.348117  8379 raft_consensus.cc:359] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.347831  8382 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.348865  8379 raft_consensus.cc:385] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.349159  8379 raft_consensus.cc:740] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.349493  8377 ts_tablet_manager.cc:1434] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:23:13.349912  8337 raft_consensus.cc:2468] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.349978  8379 consensus_queue.cc:260] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.347707  8417 raft_consensus.cc:697] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:13.348407  8336 raft_consensus.cc:2468] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.351588  8417 consensus_queue.cc:237] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.352201  8379 ts_tablet_manager.cc:1434] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:13.350543  8377 tablet_bootstrap.cc:492] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:13.357291  8382 raft_consensus.cc:515] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.360033  8382 leader_election.cc:290] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.360246  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:13.360983  8261 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.362089  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.362701  8336 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.367095  8377 tablet_bootstrap.cc:654] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:13.368901  8261 raft_consensus.cc:2468] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.370260  8150 leader_election.cc:304] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.371158  8417 raft_consensus.cc:2804] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.371628  8417 raft_consensus.cc:697] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:13.372179  8336 raft_consensus.cc:2468] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.372582  8377 tablet_bootstrap.cc:492] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:13.373205  8377 ts_tablet_manager.cc:1403] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 12:23:13.372756  8417 consensus_queue.cc:237] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.374634  8082 catalog_manager.cc:5697] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.375579  8377 raft_consensus.cc:359] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.376223  8377 raft_consensus.cc:385] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:13.376521  8377 raft_consensus.cc:740] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:13.377297  8377 consensus_queue.cc:260] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.379068  8377 ts_tablet_manager.cc:1434] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:23:13.379549  8417 raft_consensus.cc:493] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.380028  8417 raft_consensus.cc:515] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.382658  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.382740  8417 leader_election.cc:290] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.383000  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:13.383373  8261 raft_consensus.cc:2468] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.383714  8336 raft_consensus.cc:2468] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:13.384544  8150 leader_election.cc:304] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.385310  8417 raft_consensus.cc:2804] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.385615  8417 raft_consensus.cc:493] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.385885  8417 raft_consensus.cc:3060] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.389819  8082 catalog_manager.cc:5697] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.391168  8417 raft_consensus.cc:515] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.392812  8417 leader_election.cc:290] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.393604  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:13.393849  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.394212  8261 raft_consensus.cc:3060] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.394448  8336 raft_consensus.cc:3060] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.400588  8336 raft_consensus.cc:2468] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.401149  8261 raft_consensus.cc:2468] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:13.401564  8152 leader_election.cc:304] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.402321  8417 raft_consensus.cc:2804] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.402817  8417 raft_consensus.cc:697] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:13.403501  8417 consensus_queue.cc:237] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.410842  8082 catalog_manager.cc:5697] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.432722  8394 consensus_queue.cc:1048] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.445629  8384 consensus_queue.cc:1048] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.469188  8417 raft_consensus.cc:493] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.469660  8417 raft_consensus.cc:515] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.471472  8417 leader_election.cc:290] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.472280  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32453e9a3cf647518ca102397137719f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.472537  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32453e9a3cf647518ca102397137719f" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:13.473361  8336 raft_consensus.cc:2393] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2700ce1caf4992a01c0d609a488b0f in current term 1: Already voted for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in this term.
I20260709 12:23:13.474359  8152 leader_election.cc:304] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2700ce1caf4992a01c0d609a488b0f; no voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:13.475029  8417 raft_consensus.cc:3060] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.480129  8417 raft_consensus.cc:2749] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:13.531394  8433 raft_consensus.cc:493] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.532035  8433 raft_consensus.cc:515] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.533957  8433 leader_election.cc:290] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:13.534718  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65363c79f2374c70a157a3130e20e73a" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:13.534967  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65363c79f2374c70a157a3130e20e73a" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:13.535362  8186 raft_consensus.cc:2468] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:13.535651  8261 raft_consensus.cc:2468] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:13.536473  8299 leader_election.cc:304] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.537106  8433 raft_consensus.cc:2804] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:13.537410  8433 raft_consensus.cc:493] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:13.537693  8433 raft_consensus.cc:3060] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.544231  8433 raft_consensus.cc:515] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.544802  8394 consensus_queue.cc:1048] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.546157  8433 leader_election.cc:290] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:13.546782  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65363c79f2374c70a157a3130e20e73a" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:13.547462  8186 raft_consensus.cc:3060] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.547490  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65363c79f2374c70a157a3130e20e73a" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:13.548513  8261 raft_consensus.cc:3060] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:13.554566  8261 raft_consensus.cc:2468] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:13.555748  8299 leader_election.cc:304] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:13.556573  8433 raft_consensus.cc:2804] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:13.557114  8433 raft_consensus.cc:697] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:13.558111  8433 consensus_queue.cc:237] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.564355  8384 consensus_queue.cc:1048] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.557113  8186 raft_consensus.cc:2468] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:13.567391  8083 catalog_manager.cc:5697] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.712558  8413 consensus_queue.cc:1048] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.728907  8413 consensus_queue.cc:1048] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.741513  8336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "721fe09959cd439393d3b3e5f9dd6f30"
dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
mode: GRACEFUL
new_leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:23:13.742120  8336 raft_consensus.cc:606] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Received request to transfer leadership to TS 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:13.747457  8336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1158d1bb8464470187e3ca390ecd248a"
dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
mode: GRACEFUL
new_leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:23:13.747967  8336 raft_consensus.cc:606] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Received request to transfer leadership to TS 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:13.758286  8417 consensus_queue.cc:1048] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.764323  8417 consensus_queue.cc:1048] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.771991  8382 consensus_queue.cc:1048] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.784802  8186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01db1b02be5e4afe8d70f32e9023628f"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
mode: GRACEFUL
new_leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:50734
I20260709 12:23:13.785503  8186 raft_consensus.cc:606] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Received request to transfer leadership to TS 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:13.791388  8382 consensus_queue.cc:1048] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.794235  8186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
mode: GRACEFUL
new_leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:50734
I20260709 12:23:13.794868  8186 raft_consensus.cc:606] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Received request to transfer leadership to TS 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:13.796530  8419 raft_consensus.cc:993] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f: : Instructing follower 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:13.797082  8419 raft_consensus.cc:1081] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Signalling peer 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:13.800122  8262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01db1b02be5e4afe8d70f32e9023628f"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:35408
I20260709 12:23:13.801017  8262 raft_consensus.cc:493] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.801522  8262 raft_consensus.cc:3060] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.802305  8186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
mode: GRACEFUL
new_leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:50734
I20260709 12:23:13.803005  8186 raft_consensus.cc:606] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Received request to transfer leadership to TS 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:13.811120  8262 raft_consensus.cc:515] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.813475  8262 leader_election.cc:290] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.814237  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01db1b02be5e4afe8d70f32e9023628f" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:13.814575  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01db1b02be5e4afe8d70f32e9023628f" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.814997  8186 raft_consensus.cc:3055] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.815182  8336 raft_consensus.cc:3060] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.815371  8186 raft_consensus.cc:740] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:13.816334  8186 consensus_queue.cc:260] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.817641  8186 raft_consensus.cc:3060] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.822999  8336 raft_consensus.cc:2468] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:13.824265  8227 leader_election.cc:304] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:13.825119  8413 raft_consensus.cc:2804] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.825166  8186 raft_consensus.cc:2468] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:13.825693  8413 raft_consensus.cc:697] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:13.826629  8413 consensus_queue.cc:237] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.833128  8084 catalog_manager.cc:5697] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 1 to 2, leader changed from 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129) to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.842031  8419 consensus_queue.cc:1048] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.845510  8419 consensus_queue.cc:1048] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.856195  8433 raft_consensus.cc:993] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e: : Instructing follower 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:13.856894  8433 raft_consensus.cc:1081] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Signalling peer 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:13.859279  8186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "721fe09959cd439393d3b3e5f9dd6f30"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:23:13.860105  8186 raft_consensus.cc:493] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.860816  8186 raft_consensus.cc:3060] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.864567  8417 raft_consensus.cc:993] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f: : Instructing follower 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:13.865104  8417 raft_consensus.cc:1081] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Signalling peer 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:13.868983  8261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:35408
I20260709 12:23:13.869614  8261 raft_consensus.cc:493] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.869989  8261 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.870056  8186 raft_consensus.cc:515] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:13.873569  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721fe09959cd439393d3b3e5f9dd6f30" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.874204  8336 raft_consensus.cc:3055] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.874532  8336 raft_consensus.cc:740] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:13.875460  8336 consensus_queue.cc:260] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:13.876619  8336 raft_consensus.cc:3060] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.877158  8261 raft_consensus.cc:515] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.878273  8262 raft_consensus.cc:1240] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Rejecting Update request from peer 7d2700ce1caf4992a01c0d609a488b0f for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:13.879369  8261 leader_election.cc:290] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:13.880559  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:13.880863  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:13.881215  8337 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.881219  8455 consensus_queue.cc:1059] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.882268  8187 raft_consensus.cc:3055] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:13.882627  8187 raft_consensus.cc:740] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:13.883319  8336 raft_consensus.cc:2468] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 2.
I20260709 12:23:13.883492  8187 consensus_queue.cc:260] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.884574  8152 leader_election.cc:304] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:13.884758  8187 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.885434  8382 raft_consensus.cc:2804] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.885589  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721fe09959cd439393d3b3e5f9dd6f30" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:13.885959  8382 raft_consensus.cc:697] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:13.886238  8262 raft_consensus.cc:3060] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:13.886855  8382 consensus_queue.cc:237] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } }
I20260709 12:23:13.888734  8337 raft_consensus.cc:2468] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:13.890055  8227 leader_election.cc:304] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:13.890944  8413 raft_consensus.cc:2804] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:13.891396  8413 raft_consensus.cc:697] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:13.892210  8413 consensus_queue.cc:237] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:13.892318  8187 raft_consensus.cc:2468] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
W20260709 12:23:13.893404  8419 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:23:13.893761  8186 leader_election.cc:290] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Requested vote from peers 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:13.893502  8262 raft_consensus.cc:2468] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 2.
I20260709 12:23:13.897390  8084 catalog_manager.cc:5697] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 1 to 2, leader changed from 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131) to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.899808  8082 catalog_manager.cc:5697] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 1 to 2, leader changed from 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129) to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.940876  8419 consensus_queue.cc:1048] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.942268  8433 consensus_queue.cc:1048] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.944972  8419 consensus_queue.cc:1048] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:13.950677  8455 consensus_queue.cc:1048] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.962356  8417 consensus_queue.cc:1048] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.969367  8394 consensus_queue.cc:1048] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:13.992993  8455 raft_consensus.cc:993] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f: : Instructing follower 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:13.993664  8455 raft_consensus.cc:1081] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Signalling peer 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:13.995517  8260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:35408
I20260709 12:23:13.996286  8260 raft_consensus.cc:493] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:13.996749  8260 raft_consensus.cc:3060] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.006583  8260 raft_consensus.cc:515] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:14.010586  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:14.010993  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810ce4fab834d939d94f9bbf22e6e0f" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:14.011309  8187 raft_consensus.cc:3055] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:14.011730  8336 raft_consensus.cc:3060] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.011809  8187 raft_consensus.cc:740] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:14.012938  8187 consensus_queue.cc:260] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:14.014191  8187 raft_consensus.cc:3060] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.020591  8260 leader_election.cc:290] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:14.020917  8336 raft_consensus.cc:2468] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:14.022347  8227 leader_election.cc:304] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:14.022444  8187 raft_consensus.cc:2468] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:14.023089  8443 raft_consensus.cc:2804] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:14.023603  8443 raft_consensus.cc:697] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:14.024504  8443 consensus_queue.cc:237] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:14.030833  8082 catalog_manager.cc:5697] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 1 to 2, leader changed from 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129) to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.059276  8394 raft_consensus.cc:993] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e: : Instructing follower 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:14.059819  8384 raft_consensus.cc:1081] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Signalling peer 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:14.061625  8187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1158d1bb8464470187e3ca390ecd248a"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:23:14.062254  8187 raft_consensus.cc:493] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.062623  8187 raft_consensus.cc:3060] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.068266  8187 raft_consensus.cc:515] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:14.070232  8187 leader_election.cc:290] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:14.071017  8260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1158d1bb8464470187e3ca390ecd248a" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:14.071455  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1158d1bb8464470187e3ca390ecd248a" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:14.071650  8260 raft_consensus.cc:3060] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.072137  8336 raft_consensus.cc:3055] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:14.072485  8336 raft_consensus.cc:740] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:14.073302  8336 consensus_queue.cc:260] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:14.074388  8336 raft_consensus.cc:3060] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:14.077804  8260 raft_consensus.cc:2468] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 2.
I20260709 12:23:14.079265  8150 leader_election.cc:304] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:14.080159  8455 raft_consensus.cc:2804] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:14.080749  8455 raft_consensus.cc:697] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:14.080720  8336 raft_consensus.cc:2468] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 2.
I20260709 12:23:14.082031  8455 consensus_queue.cc:237] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:14.089401  8082 catalog_manager.cc:5697] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 1 to 2, leader changed from 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131) to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.324258  8187 raft_consensus.cc:1275] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.325667  8443 consensus_queue.cc:1048] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.337138  8336 raft_consensus.cc:1275] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.338446  8260 raft_consensus.cc:1275] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.339007  8462 consensus_queue.cc:1048] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.340152  8419 consensus_queue.cc:1048] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.349059  8336 raft_consensus.cc:1275] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.350543  8455 consensus_queue.cc:1048] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.398943  8336 raft_consensus.cc:1275] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.400257  8462 consensus_queue.cc:1048] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.408399  8186 raft_consensus.cc:1275] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.410421  8446 consensus_queue.cc:1048] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.471396  8186 raft_consensus.cc:1275] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.472821  8443 consensus_queue.cc:1048] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.480592  8336 raft_consensus.cc:1275] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.482296  8413 consensus_queue.cc:1048] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.611776  8336 raft_consensus.cc:1275] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.613147  8417 consensus_queue.cc:1048] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:14.616956  8261 raft_consensus.cc:1275] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:14.618427  8417 consensus_queue.cc:1048] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:16.840708  8085 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54668:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:16.842882  8085 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:16.901674  8176 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5619a36c4540488b0e0d868700e821 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:16.902999  8176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5619a36c4540488b0e0d868700e821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.902864  8251 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5619a36c4540488b0e0d868700e821 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:16.904246  8251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5619a36c4540488b0e0d868700e821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.904142  8322 tablet_service.cc:1511] Processing CreateTablet for tablet 2d5619a36c4540488b0e0d868700e821 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:23:16.905443  8322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5619a36c4540488b0e0d868700e821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.908638  8171 tablet_service.cc:1511] Processing CreateTablet for tablet bceff8beaa804f8b900e41b1c3a08ac1 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:16.909911  8171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bceff8beaa804f8b900e41b1c3a08ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.911275  8170 tablet_service.cc:1511] Processing CreateTablet for tablet f248b751a7264a31a200c420b8000c42 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:16.912575  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f248b751a7264a31a200c420b8000c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.914873  8324 tablet_service.cc:1511] Processing CreateTablet for tablet bceff8beaa804f8b900e41b1c3a08ac1 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:16.915506  8320 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9d663201204da6bfef26e24152c889 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:16.916220  8324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bceff8beaa804f8b900e41b1c3a08ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.915997  8245 tablet_service.cc:1511] Processing CreateTablet for tablet bceff8beaa804f8b900e41b1c3a08ac1 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:23:16.916869  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9d663201204da6bfef26e24152c889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.917353  8245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bceff8beaa804f8b900e41b1c3a08ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.918144  8319 tablet_service.cc:1511] Processing CreateTablet for tablet f248b751a7264a31a200c420b8000c42 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:16.919384  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f248b751a7264a31a200c420b8000c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.921492  8246 tablet_service.cc:1511] Processing CreateTablet for tablet f248b751a7264a31a200c420b8000c42 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:23:16.922149  8250 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9d663201204da6bfef26e24152c889 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:16.922763  8246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f248b751a7264a31a200c420b8000c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.923393  8250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9d663201204da6bfef26e24152c889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.926885  8173 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9d663201204da6bfef26e24152c889 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:23:16.927182  8177 tablet_service.cc:1511] Processing CreateTablet for tablet 425d2889118642e08c4ea9f5cbcee9c3 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:16.928201  8173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9d663201204da6bfef26e24152c889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.930362  8326 tablet_service.cc:1511] Processing CreateTablet for tablet 425d2889118642e08c4ea9f5cbcee9c3 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:16.930639  8175 tablet_service.cc:1511] Processing CreateTablet for tablet b2354718b4e04d64ad592bbf5db12de9 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:16.931794  8175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2354718b4e04d64ad592bbf5db12de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.933852  8177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425d2889118642e08c4ea9f5cbcee9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.931794  8326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425d2889118642e08c4ea9f5cbcee9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.941633  8248 tablet_service.cc:1511] Processing CreateTablet for tablet 425d2889118642e08c4ea9f5cbcee9c3 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:23:16.943327  8248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425d2889118642e08c4ea9f5cbcee9c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.945734  8249 tablet_service.cc:1511] Processing CreateTablet for tablet b2354718b4e04d64ad592bbf5db12de9 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:16.949465  8249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2354718b4e04d64ad592bbf5db12de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.959497  8321 tablet_service.cc:1511] Processing CreateTablet for tablet b2354718b4e04d64ad592bbf5db12de9 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:23:16.960956  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2354718b4e04d64ad592bbf5db12de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.974898  8174 tablet_service.cc:1511] Processing CreateTablet for tablet 008637f2b7974c928aab836789dcf344 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:16.976339  8174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008637f2b7974c928aab836789dcf344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.976820  8247 tablet_service.cc:1511] Processing CreateTablet for tablet 008637f2b7974c928aab836789dcf344 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:16.978125  8247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008637f2b7974c928aab836789dcf344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:17.007120  8325 tablet_service.cc:1511] Processing CreateTablet for tablet 008637f2b7974c928aab836789dcf344 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:23:17.009486  8172 tablet_service.cc:1511] Processing CreateTablet for tablet b445fd697ce245acbab3d79d98b4d096 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:17.010867  8172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b445fd697ce245acbab3d79d98b4d096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:17.013626  8252 tablet_service.cc:1511] Processing CreateTablet for tablet b445fd697ce245acbab3d79d98b4d096 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:17.014957  8252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b445fd697ce245acbab3d79d98b4d096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:17.014061  8325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008637f2b7974c928aab836789dcf344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:17.017395  8169 tablet_service.cc:1511] Processing CreateTablet for tablet 9b63035951a645d3b6a00066cb7f680c (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:17.018723  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b63035951a645d3b6a00066cb7f680c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:17.019142  8323 tablet_service.cc:1511] Processing CreateTablet for tablet b445fd697ce245acbab3d79d98b4d096 (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:23:17.020401  8323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b445fd697ce245acbab3d79d98b4d096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:17.040302  8244 tablet_service.cc:1511] Processing CreateTablet for tablet 9b63035951a645d3b6a00066cb7f680c (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:17.041730  8244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b63035951a645d3b6a00066cb7f680c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:17.044767  8480 tablet_bootstrap.cc:492] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.050908  8321 tablet_service.cc:1511] Processing CreateTablet for tablet 9b63035951a645d3b6a00066cb7f680c (DEFAULT_TABLE table=soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:23:17.052282  8321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b63035951a645d3b6a00066cb7f680c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:17.070803  8479 tablet_bootstrap.cc:492] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.076980  8480 tablet_bootstrap.cc:654] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:17.080875  8133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:17.091192  8479 tablet_bootstrap.cc:654] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.158871  8479 tablet_bootstrap.cc:492] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.159400  8479 ts_tablet_manager.cc:1403] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.089s	user 0.026s	sys 0.035s
I20260709 12:23:17.162536  8479 raft_consensus.cc:359] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.163269  8479 raft_consensus.cc:385] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.163580  8479 raft_consensus.cc:740] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.163735  8480 tablet_bootstrap.cc:492] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.164292  8480 ts_tablet_manager.cc:1403] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.030s
I20260709 12:23:17.164361  8479 consensus_queue.cc:260] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.166846  8479 ts_tablet_manager.cc:1434] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:17.167410  8480 raft_consensus.cc:359] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.168089  8479 tablet_bootstrap.cc:492] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.168201  8480 raft_consensus.cc:385] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.168624  8480 raft_consensus.cc:740] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.169355  8480 consensus_queue.cc:260] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.171676  8480 ts_tablet_manager.cc:1434] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:23:17.172722  8480 tablet_bootstrap.cc:492] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.178220  8479 tablet_bootstrap.cc:654] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.178995  8480 tablet_bootstrap.cc:654] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.181749  8478 tablet_bootstrap.cc:492] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.201527  8479 tablet_bootstrap.cc:492] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.202085  8479 ts_tablet_manager.cc:1403] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.012s
I20260709 12:23:17.203876  8478 tablet_bootstrap.cc:654] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.204545  8479 raft_consensus.cc:359] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.205292  8479 raft_consensus.cc:385] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.205554  8479 raft_consensus.cc:740] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.206516  8480 tablet_bootstrap.cc:492] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.206252  8479 consensus_queue.cc:260] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.207234  8480 ts_tablet_manager.cc:1403] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.019s
I20260709 12:23:17.208755  8479 ts_tablet_manager.cc:1434] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:23:17.209756  8479 tablet_bootstrap.cc:492] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.211403  8480 raft_consensus.cc:359] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.212476  8480 raft_consensus.cc:385] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.212848  8480 raft_consensus.cc:740] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.213966  8480 consensus_queue.cc:260] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.217046  8480 ts_tablet_manager.cc:1434] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:23:17.218394  8480 tablet_bootstrap.cc:492] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.223614  8478 tablet_bootstrap.cc:492] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.224167  8478 ts_tablet_manager.cc:1403] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.012s
I20260709 12:23:17.225361  8479 tablet_bootstrap.cc:654] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.227296  8478 raft_consensus.cc:359] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.227298  8467 raft_consensus.cc:493] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.228922  8467 raft_consensus.cc:515] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.228106  8478 raft_consensus.cc:385] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.230950  8478 raft_consensus.cc:740] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.231554  8479 tablet_bootstrap.cc:492] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.231727  8478 consensus_queue.cc:260] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.232328  8479 ts_tablet_manager.cc:1403] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.002s
I20260709 12:23:17.233717  8467 leader_election.cc:290] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.235541  8479 raft_consensus.cc:359] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.235687  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425d2889118642e08c4ea9f5cbcee9c3" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:17.236327  8479 raft_consensus.cc:385] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.236721  8479 raft_consensus.cc:740] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.237496  8479 consensus_queue.cc:260] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.238454  8336 raft_consensus.cc:2468] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:17.239737  8479 ts_tablet_manager.cc:1434] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:23:17.240830  8479 tablet_bootstrap.cc:492] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.243211  8152 leader_election.cc:304] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.244151  8486 raft_consensus.cc:2804] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.244647  8486 raft_consensus.cc:493] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.245050  8486 raft_consensus.cc:3060] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.247296  8479 tablet_bootstrap.cc:654] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.248502  8480 tablet_bootstrap.cc:654] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.249253  8464 raft_consensus.cc:493] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.249895  8464 raft_consensus.cc:515] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.252399  8464 leader_election.cc:290] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.254290  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2354718b4e04d64ad592bbf5db12de9" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:17.255733  8186 raft_consensus.cc:2468] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:17.257457  8299 leader_election.cc:304] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.258562  8464 raft_consensus.cc:2804] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.259035  8464 raft_consensus.cc:493] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.259447  8464 raft_consensus.cc:3060] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.265341  8480 tablet_bootstrap.cc:492] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.265980  8480 ts_tablet_manager.cc:1403] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.002s
I20260709 12:23:17.277407  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2354718b4e04d64ad592bbf5db12de9" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
W20260709 12:23:17.278275  8227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:36081, user_credentials={real_user=slave}} blocked reactor thread for 44323.9us
I20260709 12:23:17.278626  8478 ts_tablet_manager.cc:1434] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.001s
W20260709 12:23:17.279073  8299 leader_election.cc:343] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.281687  8480 raft_consensus.cc:359] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.282454  8480 raft_consensus.cc:385] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.282577  8478 tablet_bootstrap.cc:492] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.282740  8480 raft_consensus.cc:740] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.283766  8480 consensus_queue.cc:260] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
W20260709 12:23:17.284799  8225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:33599, user_credentials={real_user=slave}} blocked reactor thread for 54126.2us
I20260709 12:23:17.288206  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425d2889118642e08c4ea9f5cbcee9c3" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
W20260709 12:23:17.289439  8150 leader_election.cc:343] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.294173  8480 ts_tablet_manager.cc:1434] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:23:17.295259  8480 tablet_bootstrap.cc:492] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.298945  8486 raft_consensus.cc:515] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.301569  8464 raft_consensus.cc:515] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.301931  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425d2889118642e08c4ea9f5cbcee9c3" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
W20260709 12:23:17.303339  8150 leader_election.cc:343] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.304580  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2354718b4e04d64ad592bbf5db12de9" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:17.305263  8186 raft_consensus.cc:3060] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.305357  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2354718b4e04d64ad592bbf5db12de9" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
W20260709 12:23:17.306828  8299 leader_election.cc:343] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.307832  8480 tablet_bootstrap.cc:654] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.313561  8478 tablet_bootstrap.cc:654] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.314294  8186 raft_consensus.cc:2468] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:17.316705  8299 leader_election.cc:304] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:17.318962  8496 raft_consensus.cc:2804] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.304569  8464 leader_election.cc:290] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.324467  8486 leader_election.cc:290] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.326642  8479 tablet_bootstrap.cc:492] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.326512  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425d2889118642e08c4ea9f5cbcee9c3" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:17.327224  8336 raft_consensus.cc:3060] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.328462  8480 tablet_bootstrap.cc:492] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.328763  8479 ts_tablet_manager.cc:1403] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.088s	user 0.031s	sys 0.053s
I20260709 12:23:17.329095  8480 ts_tablet_manager.cc:1403] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.007s
I20260709 12:23:17.332700  8480 raft_consensus.cc:359] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.334138  8480 raft_consensus.cc:385] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.334542  8336 raft_consensus.cc:2468] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:17.334612  8480 raft_consensus.cc:740] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.336359  8152 leader_election.cc:304] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:17.336165  8480 consensus_queue.cc:260] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.337586  8467 raft_consensus.cc:2804] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.338195  8467 raft_consensus.cc:697] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:17.332510  8479 raft_consensus.cc:359] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.339218  8467 consensus_queue.cc:237] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.339967  8479 raft_consensus.cc:385] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.340404  8479 raft_consensus.cc:740] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.341320  8479 consensus_queue.cc:260] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.345829  8479 ts_tablet_manager.cc:1434] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:23:17.346933  8479 tablet_bootstrap.cc:492] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.348974  8496 raft_consensus.cc:697] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:17.350000  8496 consensus_queue.cc:237] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.353966  8479 tablet_bootstrap.cc:654] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.354852  8480 ts_tablet_manager.cc:1434] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:23:17.354916  8478 tablet_bootstrap.cc:492] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.356072  8478 ts_tablet_manager.cc:1403] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.006s
I20260709 12:23:17.358485  8085 catalog_manager.cc:5697] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.359591  8479 tablet_bootstrap.cc:492] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.359201  8478 raft_consensus.cc:359] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.360003  8478 raft_consensus.cc:385] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.360138  8479 ts_tablet_manager.cc:1403] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:23:17.360327  8478 raft_consensus.cc:740] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.360791  8480 tablet_bootstrap.cc:492] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.361167  8478 consensus_queue.cc:260] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.364907  8478 ts_tablet_manager.cc:1434] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:23:17.365833  8478 tablet_bootstrap.cc:492] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.370611  8480 tablet_bootstrap.cc:654] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.371049  8479 raft_consensus.cc:359] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.372098  8479 raft_consensus.cc:385] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.372469  8479 raft_consensus.cc:740] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.373257  8479 consensus_queue.cc:260] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.375842  8479 ts_tablet_manager.cc:1434] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:23:17.376897  8479 tablet_bootstrap.cc:492] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.378512  8084 catalog_manager.cc:5697] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.383203  8479 tablet_bootstrap.cc:654] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.388679  8478 tablet_bootstrap.cc:654] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.389518  8480 tablet_bootstrap.cc:492] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.390112  8480 ts_tablet_manager.cc:1403] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.012s
I20260709 12:23:17.393216  8480 raft_consensus.cc:359] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.393965  8480 raft_consensus.cc:385] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.394299  8480 raft_consensus.cc:740] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.395088  8480 consensus_queue.cc:260] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.397696  8480 ts_tablet_manager.cc:1434] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 12:23:17.398759  8480 tablet_bootstrap.cc:492] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.402366  8478 tablet_bootstrap.cc:492] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.403124  8478 ts_tablet_manager.cc:1403] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.009s
I20260709 12:23:17.405401  8480 tablet_bootstrap.cc:654] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.407272  8478 raft_consensus.cc:359] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.408046  8467 raft_consensus.cc:493] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.408376  8478 raft_consensus.cc:385] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.408866  8478 raft_consensus.cc:740] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.408643  8467 raft_consensus.cc:515] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.409929  8478 consensus_queue.cc:260] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.411048  8467 leader_election.cc:290] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.412145  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008637f2b7974c928aab836789dcf344" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:17.414372  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008637f2b7974c928aab836789dcf344" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:17.415177  8336 raft_consensus.cc:2468] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:17.416363  8152 leader_election.cc:304] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
W20260709 12:23:17.418449  8150 leader_election.cc:343] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.422060  8467 raft_consensus.cc:2804] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.422642  8467 raft_consensus.cc:493] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.423089  8467 raft_consensus.cc:3060] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.429172  8480 tablet_bootstrap.cc:492] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.429798  8480 ts_tablet_manager.cc:1403] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.007s
I20260709 12:23:17.430437  8479 tablet_bootstrap.cc:492] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.430996  8479 ts_tablet_manager.cc:1403] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.054s	user 0.035s	sys 0.013s
I20260709 12:23:17.433120  8480 raft_consensus.cc:359] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.433936  8480 raft_consensus.cc:385] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.434274  8480 raft_consensus.cc:740] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.434266  8479 raft_consensus.cc:359] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.434984  8479 raft_consensus.cc:385] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.434816  8467 raft_consensus.cc:515] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.435345  8479 raft_consensus.cc:740] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.435357  8480 consensus_queue.cc:260] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.436189  8479 consensus_queue.cc:260] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.437110  8467 leader_election.cc:290] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.438644  8479 ts_tablet_manager.cc:1434] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:17.439714  8479 tablet_bootstrap.cc:492] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.441175  8480 ts_tablet_manager.cc:1434] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:17.442248  8480 tablet_bootstrap.cc:492] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.446048  8479 tablet_bootstrap.cc:654] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.448228  8478 ts_tablet_manager.cc:1434] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.045s	user 0.012s	sys 0.000s
I20260709 12:23:17.448956  8498 raft_consensus.cc:493] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.449580  8478 tablet_bootstrap.cc:492] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.449489  8498 raft_consensus.cc:515] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.451766  8498 leader_election.cc:290] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.454219  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:17.455188  8261 raft_consensus.cc:2468] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:17.456827  8478 tablet_bootstrap.cc:654] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.457050  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008637f2b7974c928aab836789dcf344" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:17.457808  8336 raft_consensus.cc:3060] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.461462  8479 tablet_bootstrap.cc:492] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.462143  8479 ts_tablet_manager.cc:1403] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.006s
I20260709 12:23:17.462878  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008637f2b7974c928aab836789dcf344" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:17.464272  8299 leader_election.cc:304] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:17.467370  8498 raft_consensus.cc:2804] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.467788  8498 raft_consensus.cc:493] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.468158  8498 raft_consensus.cc:3060] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.469484  8480 tablet_bootstrap.cc:654] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.465513  8479 raft_consensus.cc:359] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.470194  8479 raft_consensus.cc:385] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.470533  8479 raft_consensus.cc:740] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.471328  8479 consensus_queue.cc:260] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.466420  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
W20260709 12:23:17.465608  8150 leader_election.cc:343] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.473941  8479 ts_tablet_manager.cc:1434] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
W20260709 12:23:17.474287  8299 leader_election.cc:343] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.488538  8336 raft_consensus.cc:2468] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:17.489883  8152 leader_election.cc:304] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:17.490522  8498 raft_consensus.cc:515] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.491211  8467 raft_consensus.cc:2804] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.491792  8467 raft_consensus.cc:697] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:17.469424  8478 tablet_bootstrap.cc:492] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.476248  8479 tablet_bootstrap.cc:492] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.492667  8498 leader_election.cc:290] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.492740  8467 consensus_queue.cc:237] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.496932  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:17.497113  8478 ts_tablet_manager.cc:1403] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.011s
I20260709 12:23:17.497716  8261 raft_consensus.cc:3060] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.500494  8479 tablet_bootstrap.cc:654] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.501293  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:17.501729  8478 raft_consensus.cc:359] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.502882  8478 raft_consensus.cc:385] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.503325  8478 raft_consensus.cc:740] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.504871  8478 consensus_queue.cc:260] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
W20260709 12:23:17.503470  8299 leader_election.cc:343] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.506609  8480 tablet_bootstrap.cc:492] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.507195  8480 ts_tablet_manager.cc:1403] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.025s
I20260709 12:23:17.510378  8480 raft_consensus.cc:359] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.511267  8480 raft_consensus.cc:385] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.511626  8480 raft_consensus.cc:740] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.512476  8480 consensus_queue.cc:260] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.514564  8478 ts_tablet_manager.cc:1434] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:23:17.515242  8261 raft_consensus.cc:2468] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:17.514654  8480 ts_tablet_manager.cc:1434] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:17.518446  8480 tablet_bootstrap.cc:492] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.522902  8478 tablet_bootstrap.cc:492] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.529675  8478 tablet_bootstrap.cc:654] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.532791  8085 catalog_manager.cc:5697] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.534834  8480 tablet_bootstrap.cc:654] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.539927  8498 raft_consensus.cc:493] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.540647  8498 raft_consensus.cc:515] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.543434  8498 leader_election.cc:290] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.548374  8478 tablet_bootstrap.cc:492] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.549142  8478 ts_tablet_manager.cc:1403] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.008s
I20260709 12:23:17.553365  8478 raft_consensus.cc:359] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.554307  8478 raft_consensus.cc:385] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.554692  8478 raft_consensus.cc:740] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.556303  8478 consensus_queue.cc:260] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.558940  8478 ts_tablet_manager.cc:1434] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:17.558866  8260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9d663201204da6bfef26e24152c889" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:17.559829  8260 raft_consensus.cc:2468] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:17.560272  8478 tablet_bootstrap.cc:492] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.561440  8480 tablet_bootstrap.cc:492] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.561993  8480 ts_tablet_manager.cc:1403] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.007s
I20260709 12:23:17.564649  8490 raft_consensus.cc:493] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.565173  8490 raft_consensus.cc:515] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.565732  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9d663201204da6bfef26e24152c889" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:17.566679  8186 raft_consensus.cc:2468] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:17.567566  8490 leader_election.cc:290] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.568069  8299 leader_election.cc:304] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.568888  8478 tablet_bootstrap.cc:654] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.569198  8498 raft_consensus.cc:2804] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.569289  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceff8beaa804f8b900e41b1c3a08ac1" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:17.569928  8498 raft_consensus.cc:493] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.570230  8187 raft_consensus.cc:2468] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 0.
I20260709 12:23:17.570485  8498 raft_consensus.cc:3060] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.571691  8225 leader_election.cc:304] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.572844  8490 raft_consensus.cc:2804] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.573370  8490 raft_consensus.cc:493] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.573827  8490 raft_consensus.cc:3060] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.565173  8480 raft_consensus.cc:359] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.579309  8480 raft_consensus.cc:385] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.579625  8480 raft_consensus.cc:740] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.580343  8480 consensus_queue.cc:260] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.581643  8478 tablet_bootstrap.cc:492] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.582206  8478 ts_tablet_manager.cc:1403] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:23:17.582319  8480 ts_tablet_manager.cc:1434] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:23:17.582840  8490 raft_consensus.cc:515] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.583515  8480 tablet_bootstrap.cc:492] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f: Bootstrap starting.
I20260709 12:23:17.585419  8478 raft_consensus.cc:359] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.585716  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceff8beaa804f8b900e41b1c3a08ac1" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:17.586134  8478 raft_consensus.cc:385] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.586447  8186 raft_consensus.cc:3060] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.586503  8478 raft_consensus.cc:740] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.587695  8478 consensus_queue.cc:260] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.590044  8478 ts_tablet_manager.cc:1434] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:23:17.590509  8480 tablet_bootstrap.cc:654] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.591024  8478 tablet_bootstrap.cc:492] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.594673  8186 raft_consensus.cc:2468] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 1.
I20260709 12:23:17.596592  8225 leader_election.cc:304] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.597752  8446 raft_consensus.cc:2804] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.598102  8478 tablet_bootstrap.cc:654] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.598374  8446 raft_consensus.cc:697] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:17.599561  8446 consensus_queue.cc:237] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.611299  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceff8beaa804f8b900e41b1c3a08ac1" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
W20260709 12:23:17.612782  8227 leader_election.cc:343] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.612906  8498 raft_consensus.cc:515] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.616103  8490 leader_election.cc:290] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.616354  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9d663201204da6bfef26e24152c889" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:17.617089  8187 raft_consensus.cc:3060] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.618044  8498 leader_election.cc:290] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.617873  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9d663201204da6bfef26e24152c889" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:17.618856  8262 raft_consensus.cc:3060] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.622519  8299 leader_election.cc:304] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:17.624264  8498 raft_consensus.cc:2804] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.624774  8498 raft_consensus.cc:697] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:17.625572  8498 consensus_queue.cc:237] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.626294  8187 raft_consensus.cc:2468] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:17.627394  8299 leader_election.cc:304] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.627584  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceff8beaa804f8b900e41b1c3a08ac1" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:17.628249  8496 raft_consensus.cc:2804] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.628772  8496 raft_consensus.cc:697] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
W20260709 12:23:17.629045  8227 leader_election.cc:343] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:17.629609  8496 consensus_queue.cc:237] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.631597  8478 tablet_bootstrap.cc:492] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.632969  8262 raft_consensus.cc:2468] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:17.637008  8478 ts_tablet_manager.cc:1403] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.009s
I20260709 12:23:17.638233  8464 raft_consensus.cc:493] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.638825  8464 raft_consensus.cc:515] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.639585  8480 tablet_bootstrap.cc:492] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f: No bootstrap required, opened a new log
I20260709 12:23:17.640297  8480 ts_tablet_manager.cc:1403] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.024s
I20260709 12:23:17.640949  8464 leader_election.cc:290] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.642567  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b63035951a645d3b6a00066cb7f680c" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:17.643270  8262 raft_consensus.cc:2468] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:17.643390  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b63035951a645d3b6a00066cb7f680c" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:17.644380  8299 leader_election.cc:304] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:17.644790  8480 raft_consensus.cc:359] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.645385  8464 raft_consensus.cc:2804] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.645915  8464 raft_consensus.cc:493] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.645529  8085 catalog_manager.cc:5697] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 1 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.646106  8478 raft_consensus.cc:359] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.646420  8464 raft_consensus.cc:3060] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.646837  8478 raft_consensus.cc:385] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.648460  8187 raft_consensus.cc:2468] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:17.645533  8480 raft_consensus.cc:385] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.651177  8480 raft_consensus.cc:740] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.651889  8480 consensus_queue.cc:260] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.654000  8480 ts_tablet_manager.cc:1434] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:23:17.650303  8478 raft_consensus.cc:740] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.688158  8478 consensus_queue.cc:260] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.688768  8464 raft_consensus.cc:515] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.690635  8479 tablet_bootstrap.cc:492] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.691191  8479 ts_tablet_manager.cc:1403] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.215s	user 0.061s	sys 0.065s
I20260709 12:23:17.691748  8446 raft_consensus.cc:493] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.692170  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b63035951a645d3b6a00066cb7f680c" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:17.692292  8446 raft_consensus.cc:515] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.692886  8187 raft_consensus.cc:3060] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.693931  8479 raft_consensus.cc:359] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.694622  8479 raft_consensus.cc:385] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.694656  8446 leader_election.cc:290] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.694969  8479 raft_consensus.cc:740] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.696452  8186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008637f2b7974c928aab836789dcf344" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:17.697085  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008637f2b7974c928aab836789dcf344" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:17.695766  8479 consensus_queue.cc:260] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.697818  8336 raft_consensus.cc:2393] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d3b4bafabeb4f76a8e71b3f42007616 in current term 1: Already voted for candidate 7d2700ce1caf4992a01c0d609a488b0f in this term.
I20260709 12:23:17.699214  8227 leader_election.cc:304] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:17.699513  8479 ts_tablet_manager.cc:1434] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:23:17.700736  8446 raft_consensus.cc:3060] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.700798  8479 tablet_bootstrap.cc:492] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e: Bootstrap starting.
I20260709 12:23:17.703617  8082 catalog_manager.cc:5697] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.705626  8187 raft_consensus.cc:2468] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:17.706892  8299 leader_election.cc:304] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.708374  8479 tablet_bootstrap.cc:654] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.708994  8478 ts_tablet_manager.cc:1434] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 12:23:17.710145  8478 tablet_bootstrap.cc:492] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.710661  8464 leader_election.cc:290] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.711298  8464 raft_consensus.cc:2804] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.711735  8464 raft_consensus.cc:697] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:17.711947  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b63035951a645d3b6a00066cb7f680c" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:17.714442  8262 raft_consensus.cc:3060] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.712965  8446 raft_consensus.cc:2749] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:17.712606  8464 consensus_queue.cc:237] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.721743  8478 tablet_bootstrap.cc:654] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.728335  8498 raft_consensus.cc:493] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.729116  8498 raft_consensus.cc:515] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.731985  8498 leader_election.cc:290] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.734800  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445fd697ce245acbab3d79d98b4d096" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f" is_pre_election: true
I20260709 12:23:17.735244  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445fd697ce245acbab3d79d98b4d096" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:17.735543  8187 raft_consensus.cc:2468] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:17.735898  8261 raft_consensus.cc:2468] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 0.
I20260709 12:23:17.739529  8479 tablet_bootstrap.cc:492] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e: No bootstrap required, opened a new log
I20260709 12:23:17.740214  8479 ts_tablet_manager.cc:1403] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.020s
I20260709 12:23:17.738113  8299 leader_election.cc:304] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:17.741562  8262 raft_consensus.cc:2468] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:17.739614  8494 consensus_queue.cc:1048] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:23:17.743276  8479 raft_consensus.cc:359] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.744010  8479 raft_consensus.cc:385] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.744284  8479 raft_consensus.cc:740] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.745007  8478 tablet_bootstrap.cc:492] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.744985  8479 consensus_queue.cc:260] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.745663  8478 ts_tablet_manager.cc:1403] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.011s
I20260709 12:23:17.746052  8498 raft_consensus.cc:2804] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.746483  8498 raft_consensus.cc:493] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.746829  8498 raft_consensus.cc:3060] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.746865  8479 ts_tablet_manager.cc:1434] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:17.749112  8478 raft_consensus.cc:359] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.748958  8082 catalog_manager.cc:5697] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.749881  8478 raft_consensus.cc:385] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.750348  8478 raft_consensus.cc:740] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.750662  8082 catalog_manager.cc:5697] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.751122  8478 consensus_queue.cc:260] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.754884  8478 ts_tablet_manager.cc:1434] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:17.755806  8478 tablet_bootstrap.cc:492] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616: Bootstrap starting.
I20260709 12:23:17.761660  8478 tablet_bootstrap.cc:654] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:17.767915  8498 raft_consensus.cc:515] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.770817  8498 leader_election.cc:290] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:17.772830  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445fd697ce245acbab3d79d98b4d096" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:17.773717  8187 raft_consensus.cc:3060] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.776778  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445fd697ce245acbab3d79d98b4d096" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:17.777433  8262 raft_consensus.cc:3060] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.782320  8261 raft_consensus.cc:3060] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.782544  8478 tablet_bootstrap.cc:492] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616: No bootstrap required, opened a new log
I20260709 12:23:17.783094  8478 ts_tablet_manager.cc:1403] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 12:23:17.785894  8478 raft_consensus.cc:359] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.786556  8478 raft_consensus.cc:385] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:17.786829  8478 raft_consensus.cc:740] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Initialized, Role: FOLLOWER
I20260709 12:23:17.787518  8478 consensus_queue.cc:260] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.789599  8478 ts_tablet_manager.cc:1434] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:17.790493  8494 consensus_queue.cc:1048] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.791626  8187 raft_consensus.cc:2468] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:17.791777  8262 raft_consensus.cc:2468] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 1.
I20260709 12:23:17.793058  8299 leader_election.cc:304] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:17.794749  8498 raft_consensus.cc:2804] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.795241  8498 raft_consensus.cc:697] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:17.796113  8498 consensus_queue.cc:237] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.800485  8494 raft_consensus.cc:493] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.801030  8494 raft_consensus.cc:515] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.803227  8494 leader_election.cc:290] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.804509  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:17.806499  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:17.808511  8261 raft_consensus.cc:2393] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d2700ce1caf4992a01c0d609a488b0f in current term 1: Already voted for candidate 2afd499b9da147d08fd9fd6084e56d7e in this term.
I20260709 12:23:17.810177  8150 leader_election.cc:304] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d2700ce1caf4992a01c0d609a488b0f; no voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:17.809790  8085 catalog_manager.cc:5697] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 1 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.811174  8486 raft_consensus.cc:3060] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.814070  8467 raft_consensus.cc:493] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.814607  8467 raft_consensus.cc:515] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.816656  8467 leader_election.cc:290] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.817467  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f248b751a7264a31a200c420b8000c42" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" is_pre_election: true
I20260709 12:23:17.818090  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f248b751a7264a31a200c420b8000c42" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e" is_pre_election: true
I20260709 12:23:17.818207  8262 raft_consensus.cc:2468] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:17.818804  8336 raft_consensus.cc:2468] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 0.
I20260709 12:23:17.819067  8486 raft_consensus.cc:2749] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:17.819669  8150 leader_election.cc:304] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.820588  8486 raft_consensus.cc:2804] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:17.821071  8486 raft_consensus.cc:493] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.821364  8486 raft_consensus.cc:3060] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.826707  8486 raft_consensus.cc:515] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.828425  8486 leader_election.cc:290] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.829092  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f248b751a7264a31a200c420b8000c42" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:17.829470  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f248b751a7264a31a200c420b8000c42" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:17.829790  8262 raft_consensus.cc:3060] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.830044  8336 raft_consensus.cc:3060] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.836699  8262 raft_consensus.cc:2468] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:17.836699  8336 raft_consensus.cc:2468] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 1.
I20260709 12:23:17.837919  8152 leader_election.cc:304] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:17.838604  8486 raft_consensus.cc:2804] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:17.839012  8486 raft_consensus.cc:697] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:17.839648  8486 consensus_queue.cc:237] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.847924  8083 catalog_manager.cc:5697] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 1 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.879601  8336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821"
dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
mode: GRACEFUL
new_leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:23:17.880116  8336 raft_consensus.cc:606] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Received request to transfer leadership to TS 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:17.886416  8498 consensus_queue.cc:1048] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.896397  8262 raft_consensus.cc:3060] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:17.900852  8260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bceff8beaa804f8b900e41b1c3a08ac1"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
mode: GRACEFUL
new_leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:38012
I20260709 12:23:17.901556  8260 raft_consensus.cc:606] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 LEADER]: Received request to transfer leadership to TS 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:17.909596  8498 consensus_queue.cc:1048] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.912240  8336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e9d663201204da6bfef26e24152c889"
dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
mode: GRACEFUL
new_leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:23:17.912900  8336 raft_consensus.cc:606] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Received request to transfer leadership to TS 7d2700ce1caf4992a01c0d609a488b0f
I20260709 12:23:17.922756  8187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "425d2889118642e08c4ea9f5cbcee9c3"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
mode: GRACEFUL
new_leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:50734
I20260709 12:23:17.923276  8187 raft_consensus.cc:606] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Received request to transfer leadership to TS 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:17.928185  8336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2354718b4e04d64ad592bbf5db12de9"
dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
mode: GRACEFUL
new_leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:23:17.928752  8336 raft_consensus.cc:606] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Received request to transfer leadership to TS 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:17.933276  8187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "008637f2b7974c928aab836789dcf344"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
mode: GRACEFUL
new_leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:50734
I20260709 12:23:17.933790  8187 raft_consensus.cc:606] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Received request to transfer leadership to TS 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:17.938509  8336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b445fd697ce245acbab3d79d98b4d096"
dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
mode: GRACEFUL
new_leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:50090
I20260709 12:23:17.938954  8336 raft_consensus.cc:606] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Received request to transfer leadership to TS 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:17.951687  8486 consensus_queue.cc:1048] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.962456  8486 consensus_queue.cc:1048] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:17.970258  8494 raft_consensus.cc:993] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: : Instructing follower 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:17.970659  8486 raft_consensus.cc:1081] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Signalling peer 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:17.972213  8262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "008637f2b7974c928aab836789dcf344"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:35408
I20260709 12:23:17.972755  8262 raft_consensus.cc:493] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.973058  8262 raft_consensus.cc:3060] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:17.978404  8262 raft_consensus.cc:515] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.980130  8262 leader_election.cc:290] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:17.980882  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008637f2b7974c928aab836789dcf344" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:17.981269  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008637f2b7974c928aab836789dcf344" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:17.981582  8187 raft_consensus.cc:3055] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:17.981977  8337 raft_consensus.cc:3060] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:17.982007  8187 raft_consensus.cc:740] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:17.983098  8187 consensus_queue.cc:260] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.984427  8187 raft_consensus.cc:3060] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:17.989037  8337 raft_consensus.cc:2468] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:17.990149  8227 leader_election.cc:304] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:17.990924  8446 raft_consensus.cc:2804] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:17.991122  8187 raft_consensus.cc:2468] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:17.991350  8446 raft_consensus.cc:697] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:17.992344  8446 consensus_queue.cc:237] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:17.999415  8083 catalog_manager.cc:5697] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 1 to 2, leader changed from 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129) to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.001814  8490 consensus_queue.cc:1048] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.009156  8446 raft_consensus.cc:993] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616: : Instructing follower 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:18.009730  8489 raft_consensus.cc:1081] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 LEADER]: Signalling peer 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:18.011360  8186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bceff8beaa804f8b900e41b1c3a08ac1"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:45190
I20260709 12:23:18.011919  8186 raft_consensus.cc:493] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.012295  8186 raft_consensus.cc:3060] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.013466  8337 raft_consensus.cc:3060] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:18.019163  8186 raft_consensus.cc:515] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.021369  8446 consensus_queue.cc:1048] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.021781  8262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceff8beaa804f8b900e41b1c3a08ac1" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:18.022392  8262 raft_consensus.cc:3055] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.022459  8186 leader_election.cc:290] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:18.022699  8262 raft_consensus.cc:740] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:18.023607  8262 consensus_queue.cc:260] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.024484  8262 raft_consensus.cc:3060] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.025990  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bceff8beaa804f8b900e41b1c3a08ac1" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:18.029834  8464 consensus_queue.cc:1048] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.034096  8262 raft_consensus.cc:2468] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 2.
I20260709 12:23:18.035657  8150 leader_election.cc:304] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 2afd499b9da147d08fd9fd6084e56d7e
I20260709 12:23:18.036496  8494 raft_consensus.cc:2804] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.036998  8494 raft_consensus.cc:697] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:18.037827  8494 consensus_queue.cc:237] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.042853  8519 raft_consensus.cc:993] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e: : Instructing follower 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:18.043380  8519 raft_consensus.cc:1081] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Signalling peer 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:18.048099  8185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:23:18.048708  8185 raft_consensus.cc:493] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.049080  8185 raft_consensus.cc:3060] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.050594  8085 catalog_manager.cc:5697] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 1 to 2, leader changed from 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130) to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.055130  8464 consensus_queue.cc:1048] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.056046  8498 consensus_queue.cc:1048] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.063405  8185 raft_consensus.cc:515] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.063894  8519 raft_consensus.cc:993] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e: : Instructing follower 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:18.064987  8519 raft_consensus.cc:1081] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Signalling peer 7d2700ce1caf4992a01c0d609a488b0f to start an election
I20260709 12:23:18.066259  8185 leader_election.cc:290] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:18.067307  8260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:18.071309  8187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e9d663201204da6bfef26e24152c889"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
 from {username='slave'} at 127.0.0.1:45178
I20260709 12:23:18.071974  8187 raft_consensus.cc:493] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.072386  8187 raft_consensus.cc:3060] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.072710  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d5619a36c4540488b0e0d868700e821" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:18.073335  8337 raft_consensus.cc:3055] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.073660  8337 raft_consensus.cc:740] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:18.074533  8337 consensus_queue.cc:260] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.075667  8337 raft_consensus.cc:3060] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.080130  8187 raft_consensus.cc:515] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.083134  8337 raft_consensus.cc:2468] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 2.
I20260709 12:23:18.084395  8152 leader_election.cc:304] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:18.085812  8494 raft_consensus.cc:2804] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.086298  8494 raft_consensus.cc:697] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:18.086891  8464 consensus_queue.cc:1048] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.087114  8494 consensus_queue.cc:237] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.093190  8187 leader_election.cc:290] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Requested vote from peers 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:18.093843  8260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9d663201204da6bfef26e24152c889" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:18.095420  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9d663201204da6bfef26e24152c889" candidate_uuid: "7d2700ce1caf4992a01c0d609a488b0f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:18.096235  8336 raft_consensus.cc:3055] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.096621  8336 raft_consensus.cc:740] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:18.097447  8336 consensus_queue.cc:260] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.098508  8336 raft_consensus.cc:3060] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.100414  8084 catalog_manager.cc:5697] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 1 to 2, leader changed from 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131) to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.111507  8336 raft_consensus.cc:2468] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2700ce1caf4992a01c0d609a488b0f in term 2.
I20260709 12:23:18.112738  8152 leader_election.cc:304] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 4d3b4bafabeb4f76a8e71b3f42007616
I20260709 12:23:18.113513  8494 raft_consensus.cc:2804] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.114014  8494 raft_consensus.cc:697] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Becoming Leader. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:18.114763  8494 consensus_queue.cc:237] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.121145  8464 consensus_queue.cc:1048] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:18.126538  8084 catalog_manager.cc:5697] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f reported cstate change: term changed from 1 to 2, leader changed from 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131) to 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129). New cstate: current_term: 2 leader_uuid: "7d2700ce1caf4992a01c0d609a488b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.138196  8498 consensus_queue.cc:1048] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.219864  8498 consensus_queue.cc:1048] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.230850  8519 consensus_queue.cc:1048] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.238467  8464 raft_consensus.cc:993] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e: : Instructing follower 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:18.238955  8519 raft_consensus.cc:1081] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Signalling peer 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:18.240567  8262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b445fd697ce245acbab3d79d98b4d096"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:35404
I20260709 12:23:18.241052  8262 raft_consensus.cc:493] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.241360  8262 raft_consensus.cc:3060] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.247483  8262 raft_consensus.cc:515] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.249621  8262 leader_election.cc:290] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:18.250455  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445fd697ce245acbab3d79d98b4d096" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:18.250767  8336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b445fd697ce245acbab3d79d98b4d096" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:18.251173  8187 raft_consensus.cc:3060] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.251358  8336 raft_consensus.cc:3055] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.251761  8336 raft_consensus.cc:740] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:18.252569  8336 consensus_queue.cc:260] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.253468  8336 raft_consensus.cc:3060] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.258399  8187 raft_consensus.cc:2468] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:18.259265  8336 raft_consensus.cc:2468] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:18.259094  8486 consensus_queue.cc:1048] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:18.259828  8225 leader_election.cc:304] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:18.260702  8446 raft_consensus.cc:2804] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.261143  8446 raft_consensus.cc:697] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:18.261940  8446 consensus_queue.cc:237] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.271262  8467 consensus_queue.cc:1048] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:18.271795  8085 catalog_manager.cc:5697] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 1 to 2, leader changed from 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131) to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.355669  8494 raft_consensus.cc:993] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f: : Instructing follower 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:18.356201  8467 raft_consensus.cc:1081] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Signalling peer 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:18.357921  8262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "425d2889118642e08c4ea9f5cbcee9c3"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:35408
I20260709 12:23:18.358485  8262 raft_consensus.cc:493] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.358870  8262 raft_consensus.cc:3060] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.363763  8262 raft_consensus.cc:515] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.365073  8262 leader_election.cc:290] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:18.365875  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425d2889118642e08c4ea9f5cbcee9c3" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:18.366189  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425d2889118642e08c4ea9f5cbcee9c3" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:18.366576  8187 raft_consensus.cc:3055] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.366837  8337 raft_consensus.cc:3060] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.366953  8187 raft_consensus.cc:740] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:18.367903  8187 consensus_queue.cc:260] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.368919  8187 raft_consensus.cc:3060] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.371949  8337 raft_consensus.cc:2468] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:18.373086  8227 leader_election.cc:304] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:18.373787  8446 raft_consensus.cc:2804] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.374097  8187 raft_consensus.cc:2468] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:18.374255  8446 raft_consensus.cc:697] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:18.375273  8446 consensus_queue.cc:237] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.383039  8085 catalog_manager.cc:5697] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 1 to 2, leader changed from 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129) to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.445727  8187 raft_consensus.cc:1275] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.446992  8446 consensus_queue.cc:1048] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.456856  8337 raft_consensus.cc:1275] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.458303  8446 consensus_queue.cc:1048] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.472630  8262 raft_consensus.cc:1275] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.474018  8467 consensus_queue.cc:1048] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.481122  8337 raft_consensus.cc:3060] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.489053  8337 raft_consensus.cc:1275] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.490252  8494 consensus_queue.cc:1048] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.524678  8496 raft_consensus.cc:993] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e: : Instructing follower 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:18.525168  8519 raft_consensus.cc:1081] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Signalling peer 4d3b4bafabeb4f76a8e71b3f42007616 to start an election
I20260709 12:23:18.526736  8262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2354718b4e04d64ad592bbf5db12de9"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
 from {username='slave'} at 127.0.0.1:35404
I20260709 12:23:18.527314  8262 raft_consensus.cc:493] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.527671  8262 raft_consensus.cc:3060] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.533674  8262 raft_consensus.cc:515] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.535243  8262 leader_election.cc:290] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131:36081)
I20260709 12:23:18.536002  8187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2354718b4e04d64ad592bbf5db12de9" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:18.536500  8337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2354718b4e04d64ad592bbf5db12de9" candidate_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
I20260709 12:23:18.536717  8187 raft_consensus.cc:3060] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.537132  8337 raft_consensus.cc:3055] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.537432  8337 raft_consensus.cc:740] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:18.538098  8337 consensus_queue.cc:260] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.539209  8337 raft_consensus.cc:3060] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.542999  8187 raft_consensus.cc:2468] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:18.544162  8225 leader_election.cc:304] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3b4bafabeb4f76a8e71b3f42007616, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:18.544953  8446 raft_consensus.cc:2804] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.545360  8337 raft_consensus.cc:2468] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3b4bafabeb4f76a8e71b3f42007616 in term 2.
I20260709 12:23:18.545498  8446 raft_consensus.cc:697] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Becoming Leader. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:18.546368  8446 consensus_queue.cc:237] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:18.553085  8084 catalog_manager.cc:5697] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 reported cstate change: term changed from 1 to 2, leader changed from 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131) to 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130). New cstate: current_term: 2 leader_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.583164  8262 raft_consensus.cc:3060] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.588402  8262 raft_consensus.cc:1275] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.589646  8494 consensus_queue.cc:1048] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.597220  8337 raft_consensus.cc:1275] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.598780  8486 consensus_queue.cc:1048] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.647140  8187 raft_consensus.cc:1275] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.648519  8446 consensus_queue.cc:1048] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.656028  8337 raft_consensus.cc:1275] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.660887  8446 consensus_queue.cc:1048] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:18.675437  8262 raft_consensus.cc:3060] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.681151  8262 raft_consensus.cc:1275] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.682359  8486 consensus_queue.cc:1048] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.689687  8337 raft_consensus.cc:1275] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 7d2700ce1caf4992a01c0d609a488b0f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.691952  8486 consensus_queue.cc:1048] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.775314  8337 raft_consensus.cc:1275] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.776788  8446 consensus_queue.cc:1048] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.787034  8187 raft_consensus.cc:1275] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.789016  8489 consensus_queue.cc:1048] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.926213  8185 raft_consensus.cc:1275] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.927428  8549 consensus_queue.cc:1048] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.936637  8337 raft_consensus.cc:1275] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Refusing update from remote peer 4d3b4bafabeb4f76a8e71b3f42007616: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.938683  8490 consensus_queue.cc:1048] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:20.945080  8085 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54668:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:23:20.969748  8085 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54668:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:23:20.999563 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.120323  8186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd"
dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
mode: GRACEFUL
new_leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
 from {username='slave'} at 127.0.0.1:50742
I20260709 12:23:21.121356  8186 raft_consensus.cc:606] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Received request to transfer leadership to TS 2afd499b9da147d08fd9fd6084e56d7e
W20260709 12:23:21.270031  8225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.129:33599, user_credentials={real_user=slave}} blocked reactor thread for 106713us
W20260709 12:23:21.270131  8227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:36081, user_credentials={real_user=slave}} blocked reactor thread for 83985.1us
I20260709 12:23:21.313755  8607 tablet.cc:1724] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.325378  8603 tablet.cc:1724] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.339372  8604 tablet.cc:1724] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:21.407168  8152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:36081, user_credentials={real_user=slave}} blocked reactor thread for 62351.9us
I20260709 12:23:21.407969  8611 tablet.cc:1724] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.444396  8615 tablet.cc:1724] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.457537  8619 tablet.cc:1724] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.457756  8621 tablet.cc:1724] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:21.491552  8612 log.cc:927] Time spent T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 12:23:21.492762  8486 raft_consensus.cc:993] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f: : Instructing follower 2afd499b9da147d08fd9fd6084e56d7e to start an election
I20260709 12:23:21.493498  8486 raft_consensus.cc:1081] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Signalling peer 2afd499b9da147d08fd9fd6084e56d7e to start an election
I20260709 12:23:21.401894  8609 tablet.cc:1724] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:21.509063  8152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.205.131:36081, user_credentials={real_user=slave}} blocked reactor thread for 71540.9us
I20260709 12:23:21.526212  8335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd"
dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
 from {username='slave'} at 127.0.0.1:58788
I20260709 12:23:21.526988  8335 raft_consensus.cc:493] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.527426  8335 raft_consensus.cc:3060] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.527966  8620 tablet.cc:1724] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.524269  8257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b"
dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
mode: GRACEFUL
new_leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
 from {username='slave'} at 127.0.0.1:38026
I20260709 12:23:21.530432  8257 raft_consensus.cc:606] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Received request to transfer leadership to TS 2afd499b9da147d08fd9fd6084e56d7e
I20260709 12:23:21.532779 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:21.533452 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:21.533987  8614 log.cc:927] Time spent T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:23:21.539412  8615 tablet.cc:1724] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.552722  8619 tablet.cc:1724] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.558775  8335 raft_consensus.cc:515] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:21.467023  8623 tablet.cc:1724] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.564213  8615 tablet.cc:1724] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.572329  8621 tablet.cc:1724] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.577919  8184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:21.578656  8335 leader_election.cc:290] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 2 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:21.578826  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ea743232cc4e79af77c0be753cddbd" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:21.579553  8261 raft_consensus.cc:3060] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.579089  8626 tablet.cc:1724] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:23:21.578238  8608 log.cc:927] Time spent T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:23:21.578827  8184 raft_consensus.cc:3055] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:21.575789  8616 tablet.cc:1724] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.585573  8184 raft_consensus.cc:740] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d2700ce1caf4992a01c0d609a488b0f, State: Running, Role: LEADER
I20260709 12:23:21.586781  8184 consensus_queue.cc:260] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
W20260709 12:23:21.587725  8618 log.cc:927] Time spent T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:21.588397  8184 raft_consensus.cc:3060] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.607453  8619 tablet.cc:1724] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.613452  8611 tablet.cc:1724] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.596781  8620 tablet.cc:1724] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.596494  8607 tablet.cc:1724] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.623678  8609 tablet.cc:1724] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.595969  8261 raft_consensus.cc:2468] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 2.
I20260709 12:23:21.626655  8299 leader_election.cc:304] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 4d3b4bafabeb4f76a8e71b3f42007616; no voters: 
I20260709 12:23:21.627701  8602 raft_consensus.cc:2804] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:21.628211  8602 raft_consensus.cc:697] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 2 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:21.629463  8602 consensus_queue.cc:237] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:21.636674  8609 tablet.cc:1724] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.604624  8623 tablet.cc:1724] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.648033  8184 raft_consensus.cc:2468] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 2.
I20260709 12:23:21.604065  8615 tablet.cc:1724] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.641850  8626 tablet.cc:1724] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.662441  8619 tablet.cc:1724] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.678735  8626 tablet.cc:1724] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:23:21.698580  8082 catalog_manager.cc:5697] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 1 to 2, leader changed from 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129) to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 2 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.703245  8084 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca: soft_deleted_table [id=5c40f026c8294145895b022d1aee90ed] alter complete (version 1)
I20260709 12:23:21.791917  8490 raft_consensus.cc:993] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616: : Instructing follower 2afd499b9da147d08fd9fd6084e56d7e to start an election
I20260709 12:23:21.792510  8582 raft_consensus.cc:1081] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Signalling peer 2afd499b9da147d08fd9fd6084e56d7e to start an election
I20260709 12:23:21.793902  8335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b"
dest_uuid: "2afd499b9da147d08fd9fd6084e56d7e"
 from {username='slave'} at 127.0.0.1:58772
I20260709 12:23:21.794343  8335 raft_consensus.cc:493] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.794601  8335 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:21.799868  8335 raft_consensus.cc:515] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:21.801847  8335 leader_election.cc:290] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 3 election: Requested vote from peers 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599), 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637)
I20260709 12:23:21.802503  8184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d2700ce1caf4992a01c0d609a488b0f"
I20260709 12:23:21.802901  8261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbccf357a4064e1282a8bedb8e23972b" candidate_uuid: "2afd499b9da147d08fd9fd6084e56d7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d3b4bafabeb4f76a8e71b3f42007616"
I20260709 12:23:21.803222  8184 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:21.803547  8261 raft_consensus.cc:3055] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:21.803886  8261 raft_consensus.cc:740] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d3b4bafabeb4f76a8e71b3f42007616, State: Running, Role: LEADER
I20260709 12:23:21.804721  8261 consensus_queue.cc:260] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:21.806070  8261 raft_consensus.cc:3060] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:21.809226  8184 raft_consensus.cc:2468] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 3.
I20260709 12:23:21.810467  8299 leader_election.cc:304] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2afd499b9da147d08fd9fd6084e56d7e, 7d2700ce1caf4992a01c0d609a488b0f; no voters: 
I20260709 12:23:21.811213  8261 raft_consensus.cc:2468] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2afd499b9da147d08fd9fd6084e56d7e in term 3.
I20260709 12:23:21.811241  8602 raft_consensus.cc:2804] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:21.811957  8602 raft_consensus.cc:697] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 3 LEADER]: Becoming Leader. State: Replica: 2afd499b9da147d08fd9fd6084e56d7e, State: Running, Role: LEADER
I20260709 12:23:21.812824  8602 consensus_queue.cc:237] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } }
I20260709 12:23:21.819689  8082 catalog_manager.cc:5697] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e reported cstate change: term changed from 2 to 3, leader changed from 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130) to 2afd499b9da147d08fd9fd6084e56d7e (127.26.205.131). New cstate: current_term: 3 leader_uuid: "2afd499b9da147d08fd9fd6084e56d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2afd499b9da147d08fd9fd6084e56d7e" member_type: VOTER last_known_addr { host: "127.26.205.131" port: 36081 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:22.118048  8184 raft_consensus.cc:1275] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Refusing update from remote peer 2afd499b9da147d08fd9fd6084e56d7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.119446  8602 consensus_queue.cc:1048] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.119881  8261 raft_consensus.cc:1275] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Refusing update from remote peer 2afd499b9da147d08fd9fd6084e56d7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.121578  8602 consensus_queue.cc:1048] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.280187  8261 raft_consensus.cc:1275] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 3 FOLLOWER]: Refusing update from remote peer 2afd499b9da147d08fd9fd6084e56d7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:22.281477  8602 consensus_queue.cc:1048] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3b4bafabeb4f76a8e71b3f42007616" member_type: VOTER last_known_addr { host: "127.26.205.130" port: 41637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.290776  8184 raft_consensus.cc:1275] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 3 FOLLOWER]: Refusing update from remote peer 2afd499b9da147d08fd9fd6084e56d7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:22.292611  8610 consensus_queue.cc:1048] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2700ce1caf4992a01c0d609a488b0f" member_type: VOTER last_known_addr { host: "127.26.205.129" port: 33599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.534585 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.541275 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:22.541805 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.676653 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.681934 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:23.682402 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:24.029246  8358 debug-util.cc:398] Leaking SignalData structure 0x7b08001519c0 after lost signal to thread 27449
W20260709 12:23:24.030396  8358 debug-util.cc:398] Leaking SignalData structure 0x7b08001da9e0 after lost signal to thread 8119
W20260709 12:23:24.031839  8358 debug-util.cc:398] Leaking SignalData structure 0x7b080017d6e0 after lost signal to thread 8211
W20260709 12:23:24.033038  8358 debug-util.cc:398] Leaking SignalData structure 0x7b080009f3e0 after lost signal to thread 8286
W20260709 12:23:24.034130  8358 debug-util.cc:398] Leaking SignalData structure 0x7b08001085e0 after lost signal to thread 8361
I20260709 12:23:24.683665 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:24.692149 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:24.692806 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.693966 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.700666 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:25.701131 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:26.702114 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.707463 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:26.707926 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:27.708999 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:27.714859 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:27.715238 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:28.716176 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.721462 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:28.721845 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:29.723228 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.733793 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:29.734463 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:30.735998 27446 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:30.742646 27446 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:30.743227 27446 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:31.799875 27446 tablet_server.cc:179] TabletServer@127.26.205.129:0 shutting down...
I20260709 12:23:31.842772 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:31.843624 27446 tablet_replica.cc:333] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.844776 27446 raft_consensus.cc:2243] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:31.845935 27446 raft_consensus.cc:2272] T f248b751a7264a31a200c420b8000c42 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.848868 27446 tablet_replica.cc:333] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.849650 27446 raft_consensus.cc:2243] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:31.850644 27446 raft_consensus.cc:2272] T bceff8beaa804f8b900e41b1c3a08ac1 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.853360 27446 tablet_replica.cc:333] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.854465 27446 raft_consensus.cc:2243] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:31.855863 27446 raft_consensus.cc:2272] T 6e9d663201204da6bfef26e24152c889 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.859694 27446 tablet_replica.cc:333] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.860651 27446 raft_consensus.cc:2243] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.861444 27446 raft_consensus.cc:2272] T 008637f2b7974c928aab836789dcf344 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.864620 27446 tablet_replica.cc:333] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.865373 27446 raft_consensus.cc:2243] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:31.866657 27446 raft_consensus.cc:2272] T 2d5619a36c4540488b0e0d868700e821 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.870002 27446 tablet_replica.cc:333] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.870713 27446 raft_consensus.cc:2243] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.871299 27446 raft_consensus.cc:2272] T 9b63035951a645d3b6a00066cb7f680c P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.873986 27446 tablet_replica.cc:333] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.874858 27446 raft_consensus.cc:2243] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.875640 27446 raft_consensus.cc:2272] T b2354718b4e04d64ad592bbf5db12de9 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.879323 27446 tablet_replica.cc:333] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.880216 27446 raft_consensus.cc:2243] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.881068 27446 raft_consensus.cc:2272] T 425d2889118642e08c4ea9f5cbcee9c3 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.883513 27446 tablet_replica.cc:333] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.884061 27446 raft_consensus.cc:2243] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.884665 27446 raft_consensus.cc:2272] T b445fd697ce245acbab3d79d98b4d096 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.887212 27446 tablet_replica.cc:333] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.887741 27446 raft_consensus.cc:2243] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.888203 27446 raft_consensus.cc:2272] T 65363c79f2374c70a157a3130e20e73a P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.890667 27446 tablet_replica.cc:333] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.891381 27446 raft_consensus.cc:2243] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:31.892633 27446 raft_consensus.cc:2272] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:31.893445  8225 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 12:23:31.896086 27446 tablet_replica.cc:333] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.896929 27446 raft_consensus.cc:2243] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:31.897022  8225 consensus_peers.cc:597] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 -> Peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Couldn't send request to peer 7d2700ce1caf4992a01c0d609a488b0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.897593 27446 raft_consensus.cc:2272] T 9810ce4fab834d939d94f9bbf22e6e0f P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.900152 27446 tablet_replica.cc:333] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.900810 27446 raft_consensus.cc:2243] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.901414 27446 raft_consensus.cc:2272] T 34ea743232cc4e79af77c0be753cddbd P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:31.903936  8225 consensus_peers.cc:597] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 -> Peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Couldn't send request to peer 7d2700ce1caf4992a01c0d609a488b0f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.904601 27446 tablet_replica.cc:333] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.905342 27446 raft_consensus.cc:2243] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:31.906280 27446 raft_consensus.cc:2272] T 1158d1bb8464470187e3ca390ecd248a P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.909214 27446 tablet_replica.cc:333] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.909811 27446 raft_consensus.cc:2243] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.910454 27446 raft_consensus.cc:2272] T dbccf357a4064e1282a8bedb8e23972b P 7d2700ce1caf4992a01c0d609a488b0f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.912937 27446 tablet_replica.cc:333] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.913481 27446 raft_consensus.cc:2243] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.913985 27446 raft_consensus.cc:2272] T 32453e9a3cf647518ca102397137719f P 7d2700ce1caf4992a01c0d609a488b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.916356 27446 tablet_replica.cc:333] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.916911 27446 raft_consensus.cc:2243] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.917474 27446 raft_consensus.cc:2272] T 01db1b02be5e4afe8d70f32e9023628f P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.919878 27446 tablet_replica.cc:333] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f: stopping tablet replica
I20260709 12:23:31.920357 27446 raft_consensus.cc:2243] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:31.921312 27446 raft_consensus.cc:2272] T 721fe09959cd439393d3b3e5f9dd6f30 P 7d2700ce1caf4992a01c0d609a488b0f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.970606 27446 tablet_server.cc:196] TabletServer@127.26.205.129:0 shutdown complete.
W20260709 12:23:32.015345  8225 consensus_peers.cc:597] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 -> Peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Couldn't send request to peer 7d2700ce1caf4992a01c0d609a488b0f. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:33599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.022912 27446 tablet_server.cc:179] TabletServer@127.26.205.130:0 shutting down...
I20260709 12:23:32.056809 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:32.057699 27446 tablet_replica.cc:333] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.058699 27446 raft_consensus.cc:2243] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.059652 27446 raft_consensus.cc:2272] T b2354718b4e04d64ad592bbf5db12de9 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.062837 27446 tablet_replica.cc:333] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.063747 27446 raft_consensus.cc:2243] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.065161 27446 raft_consensus.cc:2272] T 425d2889118642e08c4ea9f5cbcee9c3 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.068812 27446 tablet_replica.cc:333] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
W20260709 12:23:32.069597  8299 consensus_peers.cc:597] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e -> Peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Couldn't send request to peer 7d2700ce1caf4992a01c0d609a488b0f. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:33599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.069913 27446 raft_consensus.cc:2243] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:23:32.070209  8299 consensus_peers.cc:597] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e -> Peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Couldn't send request to peer 7d2700ce1caf4992a01c0d609a488b0f. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:33599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.071026 27446 raft_consensus.cc:2272] T 008637f2b7974c928aab836789dcf344 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.074172 27446 tablet_replica.cc:333] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.074935 27446 raft_consensus.cc:2243] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.075750 27446 raft_consensus.cc:2272] T f248b751a7264a31a200c420b8000c42 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:32.076398  8299 consensus_peers.cc:597] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e -> Peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Couldn't send request to peer 7d2700ce1caf4992a01c0d609a488b0f. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:33599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.078941 27446 tablet_replica.cc:333] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.079978 27446 raft_consensus.cc:2243] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.080825 27446 raft_consensus.cc:2272] T bceff8beaa804f8b900e41b1c3a08ac1 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.084304 27446 tablet_replica.cc:333] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.085157 27446 raft_consensus.cc:2243] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:32.085598  8299 consensus_peers.cc:597] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e -> Peer 7d2700ce1caf4992a01c0d609a488b0f (127.26.205.129:33599): Couldn't send request to peer 7d2700ce1caf4992a01c0d609a488b0f. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.129:33599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.085740 27446 raft_consensus.cc:2272] T 6e9d663201204da6bfef26e24152c889 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.088526 27446 tablet_replica.cc:333] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.089103 27446 raft_consensus.cc:2243] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.089597 27446 raft_consensus.cc:2272] T 9b63035951a645d3b6a00066cb7f680c P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.091952 27446 tablet_replica.cc:333] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.092563 27446 raft_consensus.cc:2243] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.093055 27446 raft_consensus.cc:2272] T 2d5619a36c4540488b0e0d868700e821 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.095258 27446 tablet_replica.cc:333] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.095839 27446 raft_consensus.cc:2243] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.096818 27446 raft_consensus.cc:2272] T b445fd697ce245acbab3d79d98b4d096 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.099133 27446 tablet_replica.cc:333] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.099650 27446 raft_consensus.cc:2243] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.100157 27446 raft_consensus.cc:2272] T 65363c79f2374c70a157a3130e20e73a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.102666 27446 tablet_replica.cc:333] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.103224 27446 raft_consensus.cc:2243] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.104137 27446 raft_consensus.cc:2272] T 9810ce4fab834d939d94f9bbf22e6e0f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.106379 27446 tablet_replica.cc:333] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.106921 27446 raft_consensus.cc:2243] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.107431 27446 raft_consensus.cc:2272] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.109683 27446 tablet_replica.cc:333] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.110220 27446 raft_consensus.cc:2243] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.110809 27446 raft_consensus.cc:2272] T 34ea743232cc4e79af77c0be753cddbd P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.113065 27446 tablet_replica.cc:333] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.113583 27446 raft_consensus.cc:2243] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.114058 27446 raft_consensus.cc:2272] T dbccf357a4064e1282a8bedb8e23972b P 4d3b4bafabeb4f76a8e71b3f42007616 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.116255 27446 tablet_replica.cc:333] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.116784 27446 raft_consensus.cc:2243] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.117695 27446 raft_consensus.cc:2272] T 32453e9a3cf647518ca102397137719f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.119971 27446 tablet_replica.cc:333] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.120540 27446 raft_consensus.cc:2243] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.121471 27446 raft_consensus.cc:2272] T 01db1b02be5e4afe8d70f32e9023628f P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.123855 27446 tablet_replica.cc:333] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.124401 27446 raft_consensus.cc:2243] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.124945 27446 raft_consensus.cc:2272] T 721fe09959cd439393d3b3e5f9dd6f30 P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.127139 27446 tablet_replica.cc:333] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616: stopping tablet replica
I20260709 12:23:32.127677 27446 raft_consensus.cc:2243] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.128177 27446 raft_consensus.cc:2272] T 1158d1bb8464470187e3ca390ecd248a P 4d3b4bafabeb4f76a8e71b3f42007616 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:32.133742  8299 consensus_peers.cc:597] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e -> Peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Couldn't send request to peer 4d3b4bafabeb4f76a8e71b3f42007616. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.176767 27446 tablet_server.cc:196] TabletServer@127.26.205.130:0 shutdown complete.
I20260709 12:23:32.219908 27446 tablet_server.cc:179] TabletServer@127.26.205.131:0 shutting down...
W20260709 12:23:32.242751  8299 consensus_peers.cc:597] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e -> Peer 4d3b4bafabeb4f76a8e71b3f42007616 (127.26.205.130:41637): Couldn't send request to peer 4d3b4bafabeb4f76a8e71b3f42007616. Status: Network error: Client connection negotiation failed: client connection to 127.26.205.130:41637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.252552 27446 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:32.253319 27446 tablet_replica.cc:333] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.254141 27446 raft_consensus.cc:2243] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.254786 27446 raft_consensus.cc:2272] T f248b751a7264a31a200c420b8000c42 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.257305 27446 tablet_replica.cc:333] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.257949 27446 raft_consensus.cc:2243] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.258455 27446 raft_consensus.cc:2272] T bceff8beaa804f8b900e41b1c3a08ac1 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.260758 27446 tablet_replica.cc:333] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.261298 27446 raft_consensus.cc:2243] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.261833 27446 raft_consensus.cc:2272] T 008637f2b7974c928aab836789dcf344 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.264081 27446 tablet_replica.cc:333] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.264720 27446 raft_consensus.cc:2243] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.265638 27446 raft_consensus.cc:2272] T 9b63035951a645d3b6a00066cb7f680c P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.267773 27446 tablet_replica.cc:333] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.268533 27446 raft_consensus.cc:2243] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.269078 27446 raft_consensus.cc:2272] T 2d5619a36c4540488b0e0d868700e821 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.271206 27446 tablet_replica.cc:333] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.271843 27446 raft_consensus.cc:2243] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.272354 27446 raft_consensus.cc:2272] T 425d2889118642e08c4ea9f5cbcee9c3 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.274626 27446 tablet_replica.cc:333] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.275208 27446 raft_consensus.cc:2243] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.275718 27446 raft_consensus.cc:2272] T b2354718b4e04d64ad592bbf5db12de9 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.277894 27446 tablet_replica.cc:333] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.278494 27446 raft_consensus.cc:2243] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.279016 27446 raft_consensus.cc:2272] T 6e9d663201204da6bfef26e24152c889 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.281378 27446 tablet_replica.cc:333] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.281900 27446 raft_consensus.cc:2243] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.282359 27446 raft_consensus.cc:2272] T 9810ce4fab834d939d94f9bbf22e6e0f P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.284585 27446 tablet_replica.cc:333] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.285159 27446 raft_consensus.cc:2243] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.285612 27446 raft_consensus.cc:2272] T a6f6b5ef00ce4fdaa5952ab2fdfbd310 P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.287748 27446 tablet_replica.cc:333] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.288285 27446 raft_consensus.cc:2243] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.288832 27446 raft_consensus.cc:2272] T b445fd697ce245acbab3d79d98b4d096 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.291050 27446 tablet_replica.cc:333] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.291606 27446 raft_consensus.cc:2243] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.292563 27446 raft_consensus.cc:2272] T 65363c79f2374c70a157a3130e20e73a P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.294714 27446 tablet_replica.cc:333] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.295230 27446 raft_consensus.cc:2243] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.296101 27446 raft_consensus.cc:2272] T dbccf357a4064e1282a8bedb8e23972b P 2afd499b9da147d08fd9fd6084e56d7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.298195 27446 tablet_replica.cc:333] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.298689 27446 raft_consensus.cc:2243] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.299157 27446 raft_consensus.cc:2272] T 01db1b02be5e4afe8d70f32e9023628f P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.301281 27446 tablet_replica.cc:333] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.301798 27446 raft_consensus.cc:2243] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.302279 27446 raft_consensus.cc:2272] T 32453e9a3cf647518ca102397137719f P 2afd499b9da147d08fd9fd6084e56d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.304379 27446 tablet_replica.cc:333] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.304903 27446 raft_consensus.cc:2243] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.305382 27446 raft_consensus.cc:2272] T 1158d1bb8464470187e3ca390ecd248a P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.307529 27446 tablet_replica.cc:333] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.308015 27446 raft_consensus.cc:2243] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.308897 27446 raft_consensus.cc:2272] T 34ea743232cc4e79af77c0be753cddbd P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.311231 27446 tablet_replica.cc:333] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e: stopping tablet replica
I20260709 12:23:32.311726 27446 raft_consensus.cc:2243] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.312227 27446 raft_consensus.cc:2272] T 721fe09959cd439393d3b3e5f9dd6f30 P 2afd499b9da147d08fd9fd6084e56d7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.375182 27446 tablet_server.cc:196] TabletServer@127.26.205.131:0 shutdown complete.
I20260709 12:23:32.415601 27446 master.cc:562] Master@127.26.205.190:34543 shutting down...
I20260709 12:23:32.445588 27446 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:32.446244 27446 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.446599 27446 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2c21d5620ab645bf8aba078e52c9dfca: stopping tablet replica
I20260709 12:23:32.468067 27446 master.cc:584] Master@127.26.205.190:34543 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20627 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41009 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (444461 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:23:32.525156 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2222 messages since previous log ~31 seconds ago
I20260709 12:23:32.525413 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2220 messages since previous log ~31 seconds ago
I20260709 12:23:32.525605 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2219 messages since previous log ~31 seconds ago
I20260709 12:23:32.525833 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:23:32.526011 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:23:32.526280 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 2 messages since previous log ~288 seconds ago
I20260709 12:23:32.526469 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 7 messages since previous log ~168 seconds ago
I20260709 12:23:32.526784 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 12:23:32.527096 27446 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 51 messages since previous log ~19 seconds ago
